Consume only a few of kafka topic partitions

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Consume only a few of kafka topic partitions

Marke Builder
Hi,

it is possible that my flume-kafka consumer read only from part of all Kafka patitions? What I mean is that I can use kafka to route certain messages into specific partitions. And with my flink job I would only consume this partitions (not all topic partitions).

Thanks!

Marke
Reply | Threaded
Open this post in threaded view
|

Re:Consume only a few of kafka topic partitions

shengjk1
Hi, Marke

I understand that you want to consume only the specified partition of a topic of kafka. if so, current  flink (1.7.x/1.8.x) is not support, you can  see



Best,
Shengjk1


On 03/8/2019 01:03[hidden email] wrote:
Hi,

it is possible that my flume-kafka consumer read only from part of all Kafka patitions? What I mean is that I can use kafka to route certain messages into specific partitions. And with my flink job I would only consume this partitions (not all topic partitions).

Thanks!

Marke