Consumed input splits

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Consumed input splits

Flavio Pompermaier
Hi to all,
is there a way to see from the Flink UI the number of procesed splits o a source?
For example, I'm reading data from a (batch) JDBC input and Flink creates 50 splits.
However I don't know how many of them have been consumed and which one is waiting to be processed.

Best,
Flavio
Reply | Threaded
Open this post in threaded view
|

Re: Consumed input splits

Flavio Pompermaier
Anyone on this? Am I the only one that find this UI feature useful? :(

On Thu, Apr 26, 2018 at 2:54 PM, Flavio Pompermaier <[hidden email]> wrote:
Hi to all,
is there a way to see from the Flink UI the number of procesed splits o a source?
For example, I'm reading data from a (batch) JDBC input and Flink creates 50 splits.
However I don't know how many of them have been consumed and which one is waiting to be processed.

Best,
Flavio

Reply | Threaded
Open this post in threaded view
|

Re: Consumed input splits

Fabian Hueske-2
I think this would be a very good feature.

There's a pretty old JIRA for it [1].
It's even from pre-Apache times because it was imported from the original Github repository.

Cheers, Fabian

2018-05-14 16:46 GMT+02:00 Flavio Pompermaier <[hidden email]>:
Anyone on this? Am I the only one that find this UI feature useful? :(

On Thu, Apr 26, 2018 at 2:54 PM, Flavio Pompermaier <[hidden email]> wrote:
Hi to all,
is there a way to see from the Flink UI the number of procesed splits o a source?
For example, I'm reading data from a (batch) JDBC input and Flink creates 50 splits.
However I don't know how many of them have been consumed and which one is waiting to be processed.

Best,
Flavio