Improving Flink performance

[Jonas Gröger]

See http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-Performance-td11248.html

[Greg Hogan]

Hi Jonas,

It looks like the mailing list has removed your formatting and/or attachments.

Greg

On Mon, Jan 23, 2017 at 6:08 AM, Jonas <[hidden email]> wrote:

Hello!

I'm having performance problems with a Flink job. If there is anything
valuable missing, please ask and I will try to answer ASAP. My job looks
like this:



First, I read data from Kafka. This is very fast at 100k msgs/s. The data is
decoded, a type is added (we have multiple message types per Kafka topic).
Then we select the TYPE_A messages, create a Scala entity out of if (a case
class). Afterwards in the MapEntityToMultipleEntities the Scala entities are
split into multiple. Finally a watermark is added.

As you can see the data is not keyed in any way yet. *Is there a way to make
this faster?*


/Measurements were taken with

and /



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-performance-tp11211.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[Jonas Gröger]

I received it well-formatted. May it be that the issue is your Mail reader?

[Ted Yu]

After "My job looks like this:", it was empty.

Please consider using third party site for images.

Cheers

On Mon, Jan 23, 2017 at 10:03 AM, Jonas <[hidden email]> wrote:

I received it well-formatted. May it be that the issue is your Mail reader?



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Improving-Flink-performance-tp11211p11225.html

Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

[Jonas Gröger]

I don't even have images in there :O Will delete this thread and create a new one.