Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kafka 0.11.0 is not supported #6

Open
er999mi opened this issue Aug 6, 2017 · 3 comments
Open

kafka 0.11.0 is not supported #6

er999mi opened this issue Aug 6, 2017 · 3 comments

Comments

@er999mi
Copy link

er999mi commented Aug 6, 2017

No description provided.

@pchlupacek
Copy link
Member

pchlupacek commented Aug 7, 2017

We will look into that. However releases of kafka are backward compatible, so you may use the driver and talk to 0.11 ensemble like it would by 0.10.x ensemble.

@cleverdeveloper
Copy link

One really cool feature of the newest Kafka versions is ability to have the record headers (https://cwiki.apache.org/confluence/display/KAFKA/KIP-82+-+Add+Record+Headers).

This, for example, allows one to filter the messages quickly without the need to parse the body of the message.

@pchlupacek
Copy link
Member

This is quite interesting feature. We are doing similar thing with lazy evaluation and memoization of that evaluation. In fact if you think about it, this is available if you use cats.Eval, and define own structure of messages.

From the document I assume, that you have to always read full message bytes, so adding headers will slightly hurt performance /though likely non-measurable way).

As for the implementation, I believe only scodec kafka protocols have to be changed to support this feature.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants