Accumulators storage path

[Hanan Yehudai]

I am having all the Accumulators store their data on /tmp  - as this is the default.
when running on docker -  this is mapped on my  VM’s   “/”  partition.
a lot of accumulatos – cause low disk util   => pods are evicted.

 

Is there a way to set the Accumulators persistence to a different path then /tmp ?
– one that I can mount o ta different partition on my VM ?

Flink 1.9 Is  used

 

[Matthias]

Hi Hanan,

thanks for reaching out to the Flink community. Have you considered changing io.tmp.dirs [1][2]?

Best,
Matthias

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/config.html#io-tmp-dirs

[2] https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/deployment/cluster_setup.html#configuring-flink

On Thu, Dec 10, 2020 at 10:24 AM Hanan Yehudai <[hidden email]> wrote:

I am having all the Accumulators store their data on /tmp  - as this is the default.
when running on docker -  this is mapped on my  VM’s   “/”  partition.
a lot of accumulatos – cause low disk util   => pods are evicted.

 

Is there a way to set the Accumulators persistence to a different path then /tmp ?
– one that I can mount o ta different partition on my VM ?

Flink 1.9 Is  used