(no subject)

[Henry Dai]

Hi,

Is there a way to get table's metadata in flink?

if I emit a table to kafka, then how can I know the table columns when I subscribe the kafka topic and restore the table using tableEnv.registerDataStream("t1", source, "field1, field2 ...")  in another flink program?

Flink should provide something like Hive's metastore to keep metadata of tables.

--

[Timo Walther]

Hi Hengyu,

currently, metadata between Flink programs can only be shared via code. For this, we recently introduced a programmatic descriptor-based way of specifying sources and sinks [1].

However, a catalog such as Hive metastore would be much easier and the community is currently working on making this possible [2].

Regards,

Timo

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/table/connect.html

[2] https://docs.google.com/document/d/1SkppRD_rE3uOKSN-LuZCqn4f7dz0zW5aa6T_hBZq5_o/edit?usp=sharing

Am 27.11.18 um 09:44 schrieb Henry Dai:

Hi,

Is there a way to get table's metadata in flink?

if I emit a table to kafka, then how can I know the table columns when I subscribe the kafka topic and restore the table using tableEnv.registerDataStream("t1", source, "field1, field2 ...")  in another flink program?

Flink should provide something like Hive's metastore to keep metadata of tables.

--