Re: The rpc invocation size 13478509 exceeds the maximum akka framesize
Posted by
Jake on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/The-rpc-invocation-size-13478509-exceeds-the-maximum-akka-framesize-tp38075p38127.html
Hi zheng,
It seem’s data is large. Resizing the framesize of akka will not working.
You can increase the parallelism.
Jake.
Hi Zhu,
It's just a mistake in mail. It seems increase akka.framesize not works in this scenario.
From: Zhu Zhu <[hidden email]>
Sent: Tuesday, September 15, 2020 11:04:06 AM
To: zheng faaron <[hidden email]>
Cc: user <[hidden email]>
Subject: Re: The rpc invocation size 13478509 exceeds the maximum akka framesize
Hi Zheng,
Would you check whether the option "akka.framesize" is properly set?
In your mail I saw a whitespace between "akka." and "framesize". Not sure if it is a mistake in the mail or in the config?
You can also check the printed config options in jobmaster log to see whether your configuration takes effect.
Thanks,
Zhu
Hi all,
I find this exception when I run q71.sql in 10 T tpcds data with 400 parallelism. The flink version is 1.10, I try to increase the value of akka. framesize to 20485760b and it not works. flink will set sink parallelism
with 1 when handle select query. I'm not sure if that's the cause of the problem, but it works fine when I increase the sink parallelism to 400.
<20200914-111346.png><20200914-111353.png>