Kafka producer connector

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Kafka producer connector

Janardhan Reddy

Hi,
The Flink kafka producer uses fixed partitioner by default and all our events are ending up in 1-2 partitions. Is there any inbuilt partitioner which distributes keys such that same key maps to same partition.

Thanks

Reply | Threaded
Open this post in threaded view
|

Re: Kafka producer connector

rmetzger0
Hi Janardhan,

the fixed partitioner is the only one shipped with Flink.
However, it should be fairly simple to implement one that uses the key to determine the partition.

On Mon, Aug 8, 2016 at 7:16 PM, Janardhan Reddy <[hidden email]> wrote:

Hi,
The Flink kafka producer uses fixed partitioner by default and all our events are ending up in 1-2 partitions. Is there any inbuilt partitioner which distributes keys such that same key maps to same partition.

Thanks