Flink SQL Gateway
Locked
 
|
Hi Jeff,
FLIP-24 [1] proposed to develop a SQL gateway to query Flink via SQL but since then no progress has been made on that point. Do you think that Zeppelin could be used somehow as a SQL Gateway towards Flink for the moment? Any chance that a Flink SQL Gateway could ever be developed? Is there anybody interested in this? Best, Flavio |
|
|
Hi Flavio, We prose FLIP-91[1] to support SQL Gateway at the beginning of this year. After a long discussion, we reached an agreement that SQL Gateway is an eco-system under ververia as first step.[2] Which could help SQL Gateway move forward faster. Now we almost finish first version development, some users are trying it out. Any suggestions are welcome! Best, Godfrey Flavio Pompermaier <[hidden email]> 于2020年4月16日周四 下午4:42写道：
|
|
|
Great, I'm very interested in trying it out! Maybe we can also help with the development because we need something like that. Thanks a lot for the pointers On Thu, Apr 16, 2020 at 10:55 AM godfrey he <[hidden email]> wrote:
|
|
|
Hi Flavio, that's great~ Best, Godfrey Flavio Pompermaier <[hidden email]> 于2020年4月16日周四 下午5:01写道：
|
|
|
In reply to this post by godfrey he
Hi Flavio, Since 1.11(master), Flink supports "CREATE CATALOG ..." [1], we can use this statement create catalog dynamically. Currently, Catalog[2] dose not supports any operations on TRIGGER. Flink can't also use such info now. What's your user scenario? Best, Godfrey Flavio Pompermaier <[hidden email]> 于2020年4月16日周四 下午6:16写道：
|
|
|
Basically we want to give a UI to the user to register its data sources (i.e. catalogs in the Flink world), preview them (SELECT * LIMIT 100 for example) but, in the case of JDBC catalogs, also to see relationships and triggers. We don't want to reimplement the wheel so we would like to reuse and contribute to Flink as much as possible (since then in the batch jobs we use Flink and we don't like to do the same work twice..). In this way we can contribute to Flink if something is missing in the SQL Gateway. However I don't know how to extend the existing stuff (for example if I want table relationships and triggers).. Best, Flavio On Thu, Apr 16, 2020 at 1:38 PM godfrey he <[hidden email]> wrote:
|
|
|
Hi Flavio， If you would like to use have a UI to register data sources, run flink sql and preview the sql result, then you can use zeppelin directly. You can check the tutorial here, 1) Get started https://link.medium.com/oppqD6dIg5
2) Batch https://link.medium.com/3qumbwRIg5
3) Streaming https://link.medium.com/RBHa2lTIg5
4) Advanced usage https://link.medium.com/CAekyoXIg5 And here's one article shared by someone else about how to use flink on zeppelin. Besides that, Zeppelin provides rest api which you can use to integarte with other system, but it is not standard jdbc protocol. And I am doing more improvement recently, I will reveal more details in next week's flink forward. Flavio Pompermaier <[hidden email]> 于2020年4月16日周四 下午8:24写道：
Best Regards
Jeff Zhang |
|
|
Hi Flavio， Thanks for the detailed explanation. I think we should let Catalog know this concept first, then TableEnvironment or SQL Gateway can do more stuff based on that. But "trigger" is Database domain concept, I think it need more discuss whether Flink should support this. also cc @[hidden email] Best, Godfrey Jeff Zhang <[hidden email]> 于2020年4月16日周四 下午10:54写道：
|
«
Return to (DEPRECATED) Apache Flink User Mailing List archive.
|
1 view|%1 views
| Free forum by Nabble | Edit this page |