Assigning UID to Flink SQL queries

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Assigning UID to Flink SQL queries

Yuval Itzchakov
Hi,

We a have a bunch of Flink SQL queries running in our Flink environment. For
regular Table API interactions, we can override `uid` which also gives us an
indicative name for the thread/UI to look at. For Flink SQL queries, this
doesn't seem the the case which results in very verbose names (essentially
the entire query plan) shown in the UI / thread names while debugging.

Is there any convenient way to set / override the UID for SQL defined
queries?

--
Best Regards,
Yuval Itzchakov.
Reply | Threaded
Open this post in threaded view
|

Re: Assigning UID to Flink SQL queries

Yuval Itzchakov
Anyone?

On Tue, 27 Aug 2019, 17:23 Yuval Itzchakov, <[hidden email]> wrote:
Hi,

We a have a bunch of Flink SQL queries running in our Flink environment. For
regular Table API interactions, we can override `uid` which also gives us an
indicative name for the thread/UI to look at. For Flink SQL queries, this
doesn't seem the the case which results in very verbose names (essentially
the entire query plan) shown in the UI / thread names while debugging.

Is there any convenient way to set / override the UID for SQL defined
queries?

--
Best Regards,
Yuval Itzchakov.
Reply | Threaded
Open this post in threaded view
|

Re: Assigning UID to Flink SQL queries

Dawid Wysakowicz-2

Hi Yuval,

Unfortunately currently you cannot assign UIDs in table programs. The reason is that uid is used for reassigning state upon restart. Table programs are automatically compiled to executable program. This program might change depending on many factors: table statistics, applied rules etc. As of know it can also change between Flink version if we implement new optimizations, operators etc. Right now user also does not have access to the execution graph.

This is though something that we definitely want to address at some point.

Best,

Dawid

On 30/08/2019 12:51, Yuval Itzchakov wrote:
Anyone?

On Tue, 27 Aug 2019, 17:23 Yuval Itzchakov, <[hidden email]> wrote:
Hi,

We a have a bunch of Flink SQL queries running in our Flink environment. For
regular Table API interactions, we can override `uid` which also gives us an
indicative name for the thread/UI to look at. For Flink SQL queries, this
doesn't seem the the case which results in very verbose names (essentially
the entire query plan) shown in the UI / thread names while debugging.

Is there any convenient way to set / override the UID for SQL defined
queries?

--
Best Regards,
Yuval Itzchakov.

signature.asc (849 bytes) Download Attachment