Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka avro schema data not reflecting from topic #293

Closed
promothkumarprabakaran opened this issue Sep 13, 2017 · 3 comments
Closed

Kafka avro schema data not reflecting from topic #293

promothkumarprabakaran opened this issue Sep 13, 2017 · 3 comments
Assignees

Comments

@promothkumarprabakaran
Copy link

When creating a stream from kafka topic having records using avro schema values are not getting mapped to column names properly. Some field does not read values and others have first character truncated.

@hjafarpour
Copy link
Contributor

@promothkumarprabakaran how do you write avro values? Are you using schema registry?
Also can you give a bit more details on the avro schema and column names?

@promothkumarprabakaran
Copy link
Author

@hjafarpour Yes we use scheme registry for pushing values into kafka topic. For now i am copying the scheme file to local folder and refer the path in ksqlServerproperties. We have almost 30+ columns and i am creating stream from the kafka topic with only two of those columns. Values are some timing missing and it get truncated some times.

@hjafarpour
Copy link
Contributor

@promothkumarprabakaran When you use Schema Registry the avro values will have extra magic bytes that need to be dealt with. We do not have support for schema registry yet but it is one of high priority items for us. Please stay tune for this.

@hjafarpour hjafarpour self-assigned this Sep 26, 2017
@miguno miguno closed this as completed Oct 30, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants