kinesis table connector support

[Fanbin Bu]

Hi,

Looks like Flink table connectors do not include `kinesis`. (only FileSystem, Kafka, ES) see https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/connect.html#table-connectors.

I also found some examples for Kafka: https://eventador.io/blog/flink_table_and_sql_api_with_apache_flink_16/. I'm wondering is there such a thing for kinesis also.

Is there any plan to support this in the future? Otherwise, what needs to be done if we want to implement it on my own.

Basically, I have a kinesis stream that emits json string data and I would like to use Flink Table/SQL api to to the streaming/batch processing. Currently, I'm using DataStream API which is not as flexible.

Any help would be appreciated.

Thanks,

Fanbin

[Biao Liu]

Hi Fanbin,

I'm not familiar with table module. Maybe someone else could help.

[hidden email] 

Do you know there is any plan for kinesis table connector?

On Sat, 24 Aug 2019 at 02:26, Fanbin Bu <[hidden email]> wrote:

Hi,

Looks like Flink table connectors do not include `kinesis`. (only FileSystem, Kafka, ES) see https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/connect.html#table-connectors.

I also found some examples for Kafka: https://eventador.io/blog/flink_table_and_sql_api_with_apache_flink_16/. I'm wondering is there such a thing for kinesis also.

Is there any plan to support this in the future? Otherwise, what needs to be done if we want to implement it on my own.

Basically, I have a kinesis stream that emits json string data and I would like to use Flink Table/SQL api to to the streaming/batch processing. Currently, I'm using DataStream API which is not as flexible.

Any help would be appreciated.

Thanks,

Fanbin

[phoenixjiangnan]

@Fanbin, I don't think there's one yet. Feel free to create a ticket and submit a PR for it

On Mon, Sep 2, 2019 at 8:13 AM Biao Liu <[hidden email]> wrote:

Hi Fanbin,

I'm not familiar with table module. Maybe someone else could help.

[hidden email] 

Do you know there is any plan for kinesis table connector?

On Sat, 24 Aug 2019 at 02:26, Fanbin Bu <[hidden email]> wrote:

Hi,

Looks like Flink table connectors do not include `kinesis`. (only FileSystem, Kafka, ES) see https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/connect.html#table-connectors.

I also found some examples for Kafka: https://eventador.io/blog/flink_table_and_sql_api_with_apache_flink_16/. I'm wondering is there such a thing for kinesis also.

Is there any plan to support this in the future? Otherwise, what needs to be done if we want to implement it on my own.

Basically, I have a kinesis stream that emits json string data and I would like to use Flink Table/SQL api to to the streaming/batch processing. Currently, I'm using DataStream API which is not as flexible.

Any help would be appreciated.

Thanks,

Fanbin