Missing metrics on Flink UI

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Missing metrics on Flink UI

neo21 zerro
Hello everybody,

I have deployed the latest Flink Version 1.0.1 on Yarn 2.5.0-cdh5.3.0.
When I push the WordCount example shipped with the Flink distribution, I can see metrics (bytes received) in the Flink Ui on the corresponding operator.
However, I used the flink kafka connector and when I run my topology I cannot see any metrics reported on the operators. Has anybody experienced something like this?

Thanks!
Reply | Threaded
Open this post in threaded view
|

Re: Missing metrics on Flink UI

neo21 zerro
Nevermind, I've figured it out.
I was skipping the tuples that were coming from kafka based on some custom login.
That custom logic made sure that the kafka operator did not emit any tuples.
Hence, the missing metrics in the flink ui.



On Thursday, April 14, 2016 1:12 AM, neo21 zerro <[hidden email]> wrote:
Hello everybody,

I have deployed the latest Flink Version 1.0.1 on Yarn 2.5.0-cdh5.3.0.
When I push the WordCount example shipped with the Flink distribution, I can see metrics (bytes received) in the Flink Ui on the corresponding operator.
However, I used the flink kafka connector and when I run my topology I cannot see any metrics reported on the operators. Has anybody experienced something like this?

Thanks!
Reply | Threaded
Open this post in threaded view
|

Re: Missing metrics on Flink UI

Aljoscha Krettek

Thanks for the heads up! I'm glad you figured it out.


On Sun, Apr 17, 2016, 13:35 neo21 zerro <[hidden email]> wrote:
Nevermind, I've figured it out.
I was skipping the tuples that were coming from kafka based on some custom login.
That custom logic made sure that the kafka operator did not emit any tuples.
Hence, the missing metrics in the flink ui.



On Thursday, April 14, 2016 1:12 AM, neo21 zerro <[hidden email]> wrote:
Hello everybody,

I have deployed the latest Flink Version 1.0.1 on Yarn 2.5.0-cdh5.3.0.
When I push the WordCount example shipped with the Flink distribution, I can see metrics (bytes received) in the Flink Ui on the corresponding operator.
However, I used the flink kafka connector and when I run my topology I cannot see any metrics reported on the operators. Has anybody experienced something like this?

Thanks!