How can I prove ....

Posted by amir bahmanyari on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/How-can-I-prove-tp9113.html

That all nodes in a Flink Cluster are involved simultaneously in processing the data?
Programmatically, graphically...
I need to stress CPU , MEM and all resources to their max.
How can I guarantee this is happening in Flink Cluster?
Out of 4 nodes, this is the highest resource usage I see from "top"...
Everything else is not even close...
t
op - 22:22:45 up 41 days,  2:39,  1 user,  load average: 1.76, 1.55, 1.28
Tasks: 344 total,   1 running, 343 sleeping,   0 stopped,   0 zombie
%Cpu(s):  5.4 us,  1.0 sy,  0.0 ni, 93.5 id,  0.1 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem:  11551564+total, 65702020 used, 49813632 free,   115072 buffers
KiB Swap:        0 total,        0 used,        0 free.  3148420 cached Mem


I am pretty sure I can push FlinkRunner to way more extent than this....
And thats where true realistic perf numbers start showing up.
Thanks+regards,
Amir-