When using udaf, the startup job has a “Cannot determine simple type name 'com' ” exception（Flink version 1.7.2）

[mailtolrl]

My flink streaming job use a udaf, set 60 parallelisms，submit job in yarn cluster mode，and then happens every time I start.

 

[vino yang]

Hi mailtolrl,

Can you share more context about your program and UDAF.

Best,

Vino

mailtolrl <[hidden email]> 于2019年11月7日周四 下午3:05写道：

My flink streaming job use a udaf, set 60 parallelisms，submit job in yarn cluster mode，and then happens every time I start.

 

[mailtolrl]

Hi, vino:

    Thanks for your answer. When I set 20 parallelism, I can run job succeed every time. When setting 40 parallelism, sometimes I can submit it successfully, sometimes throw the exception. When setting 60 parallelism at the time, it has not been submitted successfully, always this exception.So I don't think it has anything to do with my program.

在 2019-11-07 15:20:13，"vino yang" <[hidden email]> 写道：

Hi mailtolrl,

Can you share more context about your program and UDAF.

Best,

Vino

mailtolrl <[hidden email]> 于2019年11月7日周四 下午3:05写道：

My flink streaming job use a udaf, set 60 parallelisms，submit job in yarn cluster mode，and then happens every time I start.

 

 

[rmetzger0]

Thanks for your message.

It would be great if you could provide code to reproduce the issue (it does not have to be your exact code, a simplified example is also fine). 

Maybe your program is not directly causing the issue, but it seems that the code generator is producing something we can not compile.

On Thu, Nov 7, 2019 at 8:49 AM mailtolrl <[hidden email]> wrote:

Hi, vino:

    Thanks for your answer. When I set 20 parallelism, I can run job succeed every time. When setting 40 parallelism, sometimes I can submit it successfully, sometimes throw the exception. When setting 60 parallelism at the time, it has not been submitted successfully, always this exception.So I don't think it has anything to do with my program.

在 2019-11-07 15:20:13，"vino yang" <[hidden email]> 写道：

Hi mailtolrl,

Can you share more context about your program and UDAF.

Best,

Vino

mailtolrl <[hidden email]> 于2019年11月7日周四 下午3:05写道：

My flink streaming job use a udaf, set 60 parallelisms，submit job in yarn cluster mode，and then happens every time I start.