Job Records In/Out metrics clarification

[Rafi Aroch]

Hi,

Below is the In/Out metrics as they appear in the Flink UI.

I was wondering what are the possible reasons that the "Records sent" of one operator is different than the "Records received"  of the next one. I would expect to see the same number... 

[Chesnay Schepler]

There is a known issue in 1.5.0 with the numRecordsIn/Out metrics for chained tasks: https://issues.apache.org/jira/browse/FLINK-9530

This has been fixed in 1.5.1.

On 15.10.2018 14:37, Rafi Aroch wrote:

Hi,

Below is the In/Out metrics as they appear in the Flink UI.

I was wondering what are the possible reasons that the "Records sent" of one operator is different than the "Records received"  of the next one. I would expect to see the same number... 

[Rafi Aroch]

Awesome, thanks! 

On Mon, Oct 15, 2018, 17:36 Chesnay Schepler <[hidden email]> wrote:

There is a known issue in 1.5.0 with the numRecordsIn/Out metrics for chained tasks: https://issues.apache.org/jira/browse/FLINK-9530

This has been fixed in 1.5.1.

On 15.10.2018 14:37, Rafi Aroch wrote:

Hi,

Below is the In/Out metrics as they appear in the Flink UI.

I was wondering what are the possible reasons that the "Records sent" of one operator is different than the "Records received"  of the next one. I would expect to see the same number...