static table in flink

[Jaqie Chan]

Hello,

I have questions about static table in flink.

Join the stream table with static table. I'm looking at temporal table, while the time based table would grow exponentially over period. Any suggestions?

Stream tables checks the contains in static table(updates once everyday with new set of data). Trying to approach this with views.

Thanks for any suggestions.

Regards

嘉琪

[vino yang]

Hi Jaqie,

If I understand your question correctly, it seems you are finding a solution about the Stream table and Dim table(you called static table) join.

There were many users who asked this question. Linked some reply here[1][2] to let you consider.

Best,

Vino

[1]: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/How-to-Join-a-dimension-table-in-flink-sql-td20729.html

[2]: http://www.codeha.us/apache-flink-users/msg12421.html

Jaqie Chan <[hidden email]> 于2019年11月9日周六 下午3:04写道：

Hello,

I have questions about static table in flink.

Join the stream table with static table. I'm looking at temporal table, while the time based table would grow exponentially over period. Any suggestions?

Stream tables checks the contains in static table(updates once everyday with new set of data). Trying to approach this with views.

Thanks for any suggestions.

Regards

嘉琪

[Jingsong Li]

Hi Jaqie:

I think you can take a look to temporal table in blink planner. (Using LookupableTableSource). [1]

Use processing time: Its processing is to query from external table(storage like HBase, JDBC) by per record in real time.

[1] https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/joins.html#join-with-a-temporal-table

Best,

Jingsong Lee

On Sun, Nov 10, 2019 at 11:00 AM vino yang <[hidden email]> wrote:

Hi Jaqie,

If I understand your question correctly, it seems you are finding a solution about the Stream table and Dim table(you called static table) join.

There were many users who asked this question. Linked some reply here[1][2] to let you consider.

Best,

Vino

[1]: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/How-to-Join-a-dimension-table-in-flink-sql-td20729.html

[2]: http://www.codeha.us/apache-flink-users/msg12421.html

Jaqie Chan <[hidden email]> 于2019年11月9日周六 下午3:04写道：

Hello,

I have questions about static table in flink.

Join the stream table with static table. I'm looking at temporal table, while the time based table would grow exponentially over period. Any suggestions?

Stream tables checks the contains in static table(updates once everyday with new set of data). Trying to approach this with views.

Thanks for any suggestions.

Regards

嘉琪

--