Set heap size

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Set heap size

AndreaKinn
About task manager heap size Flink doc says:

... If the cluster is exclusively running Flink, the total amount of
available memory per machine minus some memory for the operating system
(maybe 1-2 GB) is a good value....

But my nodes have 2GB of ram each. There isn't an empirical count to set ram
memory or a way to estimate the ram used by the OS?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Set heap size

Piotr Nowojski
Hi,

Just log into the machine and check it’s memory consumption using htop or a similar tool under the load. Remember about subtracting Flink’s memory usage and and file system cache.

Piotrek

> On 19 Oct 2017, at 10:15, AndreaKinn <[hidden email]> wrote:
>
> About task manager heap size Flink doc says:
>
> ... If the cluster is exclusively running Flink, the total amount of
> available memory per machine minus some memory for the operating system
> (maybe 1-2 GB) is a good value....
>
> But my nodes have 2GB of ram each. There isn't an empirical count to set ram
> memory or a way to estimate the ram used by the OS?
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/