Flink stress testing and metrics

Posted by Ladhari Sadok on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-stress-testing-and-metrics-tp16851.html

Hi All,

I want to do a stress testing of my Flink app implementation: event generation with ParallelSourceFunction then measuring the latency ,throughput, CPU & memry leak ...

But when testing, I noticed that :
  • the maximum of CPU usage is 30-33%
  • latency is always NaNd NaNh in the dashboard ( even I have set this configuration executionConfig.setLatencyTrackingInterval(1); )


Can some one help me find the best solution to smoke testing Flink ?

Note: I'm using Flink 1.3 and the Flink Web UI to visualize the metrics.
Also my PC have a 12Go RAM and 8 Core CPU.

Regards,
Sadok