IOException: Size of the state is larger than the maximum permitted memory-backed state

[syed]

Hi;
I am facing the following IO exception while running a simple wordcount
application.

*IOException: Size of the state is larger than the maximum permitted
memory-backed state. Size=34521369 , maxSize=5242880 . Consider using a
different state backend, like the File System State backend.*

I have already using filesystem state backend and configured the checkpoint
and state backend directories.

How can I fix this issue?
 



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Gary Yao-2]

Hi,

It looks like you are still using the MemoryStateBackend. Are you overriding the
state backend settings from within your job? To debug this, it would be helpful
to see the JobManager logs and the contents of your flink-conf.yaml

Best,
Gary

On Wed, May 2, 2018 at 3:25 AM, syed <[hidden email]> wrote:

Hi;
I am facing the following IO exception while running a simple wordcount
application.

*IOException: Size of the state is larger than the maximum permitted
memory-backed state. Size=34521369 , maxSize=5242880 . Consider using a
different state backend, like the File System State backend.*

I have already using filesystem state backend and configured the checkpoint
and state backend directories.




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/