Modify field topics (KafkaConsumer) during runtime

[Jose Miguel Tejedor Fernandez]

Hi,

I am using Flink version 1.3.1.

I am wondering if it is possible to add/delete new topics to FlinkKafkaConsumer during execution of a job? Otherwise, I guess I need to cancel the job and redeploy the new job.

Cheers

BR

[Piotr Nowojski]

Hi,

As far as I know it is not possible to do it on the fly. There is planned feature for discovering topics using some regex:

https://github.com/apache/flink/pull/3746

https://issues.apache.org/jira/browse/FLINK-5704

But it is not completed yet.

Thanks, Piotrek

On Aug 30, 2017, at 3:31 PM, Jose Miguel Tejedor Fernandez <[hidden email]> wrote:

Hi,

I am using Flink version 1.3.1.

I am wondering if it is possible to add/delete new topics to FlinkKafkaConsumer during execution of a job? Otherwise, I guess I need to cancel the job and redeploy the new job.

Cheers

BR