Running 2 instances of LocalExecutionEnvironments with same consumer group.id

[Suraj Puvvada]

Hello,

I have two JVMs that run LocalExecutionEnvorinments each using the same consumer group.id. 

i noticed that the consumers in each instance has all partitions assigned. I was expecting that the partitions will be split across consumers across the two JVMs

Any help on what might be happening ?

Thanks

Suraj 

[Gary Yao-5]

Hi Suraj,

This question has been asked before:

    http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-kafka-consumers-don-t-honor-group-id-td21054.html

Best,
Gary

On Wed, Apr 22, 2020 at 6:08 PM Suraj Puvvada <[hidden email]> wrote:

>
> Hello,
>
> I have two JVMs that run LocalExecutionEnvorinments each using the same consumer group.id.
>
> i noticed that the consumers in each instance has all partitions assigned. I was expecting that the partitions will be split across consumers across the two JVMs
>
> Any help on what might be happening ?
>
> Thanks
> Suraj

[Som Lima]

I followed the link , may be same Suraj  is advertising DataBricks webinar going on live right now.

On Wed, 22 Apr 2020, 18:38 Gary Yao, <[hidden email]> wrote:

Hi Suraj,

This question has been asked before:

    http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-kafka-consumers-don-t-honor-group-id-td21054.html

Best,
Gary

On Wed, Apr 22, 2020 at 6:08 PM Suraj Puvvada <[hidden email]> wrote:
>
> Hello,
>
> I have two JVMs that run LocalExecutionEnvorinments each using the same consumer group.id.
>
> i noticed that the consumers in each instance has all partitions assigned. I was expecting that the partitions will be split across consumers across the two JVMs
>
> Any help on what might be happening ?
>
> Thanks
> Suraj