problem with build from source flink 1.11

[Felipe Lolas]

Hi,

Im Felipe, just started learning flink a few weeks ago(moving spark streaming workloads). 

Now, I currently testing some changes into flink-yarn, but when using my builded flink-dist.jar, the Job in TaskManager fails because of: java.lang.NoSuchMethodError: java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;

env(build)

flink-1.11.0

maven 3.2.5

jdk 1.8

macox

command(into flink-parent)

mvn clean install -DskipTests -Dfast

env

yarn application mode

cdh 6.2.1

can anyone help me?

Thank you!

Cheers,

Felipe L

[Timo Walther]

Hi Felipe,

are you sure that Maven and the TaskManagers are using the JDK version
that you mentioned?

Usually, a `mvn clean install` in the `.../flink/` directory should
succeed without any problems. Also your Maven version seems pretty old.
I'm using Apache Maven 3.6.3 for example.

The NoSuchMethodError indicates that there is some version mismatch. It
seems that this version mismatch is related to your JDK version. Maybe
your task managers run a different version?

Let me know if this helped.

Regards,
Timo


On 27.07.20 12:09, Felipe Lolas wrote:

> Hi,
>
> Im Felipe, just started learning flink a few weeks ago(moving spark
> streaming workloads).
>
> Now, I currently testing some changes into flink-yarn, but when using my
> builded flink-dist.jar, the Job in TaskManager fails because of:
> java.lang.NoSuchMethodError:
> java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
>
> *env(build)*
> flink-1.11.0
> maven 3.2.5
> jdk 1.8
> macox
>
> *command(into flink-parent)*
>
> mvn clean install -DskipTests -Dfast
>
> *env*
> yarn application mode
> cdh 6.2.1
> *
> *
> can anyone help me?
>
> Thank you!
> Cheers,
> Felipe L

[Chesnay Schepler]

@Timo maven 3.2.5 is the recommended Maven version for building Flink.

@Felipe Can you provide us the full stacktrace? This could be a library
issue in regards to JDK compatibility.

On 27/07/2020 15:23, Timo Walther wrote:

> Hi Felipe,
>
> are you sure that Maven and the TaskManagers are using the JDK version
> that you mentioned?
>
> Usually, a `mvn clean install` in the `.../flink/` directory should
> succeed without any problems. Also your Maven version seems pretty
> old. I'm using Apache Maven 3.6.3 for example.
>
> The NoSuchMethodError indicates that there is some version mismatch.
> It seems that this version mismatch is related to your JDK version.
> Maybe your task managers run a different version?
>
> Let me know if this helped.
>
> Regards,
> Timo
>
>
> On 27.07.20 12:09, Felipe Lolas wrote:
>> Hi,
>>
>> Im Felipe, just started learning flink a few weeks ago(moving spark
>> streaming workloads).
>>
>> Now, I currently testing some changes into flink-yarn, but when using
>> my builded flink-dist.jar, the Job in TaskManager fails because of:
>> java.lang.NoSuchMethodError:
>> java.nio.ByteBuffer.position(I)Ljava/nio/ByteBuffer;
>>
>> *env(build)*
>> flink-1.11.0
>> maven 3.2.5
>> jdk 1.8
>> macox
>>
>> *command(into flink-parent)*
>>
>> mvn clean install -DskipTests -Dfast
>>
>> *env*
>> yarn application mode
>> cdh 6.2.1
>> *
>> *
>> can anyone help me?
>>
>> Thank you!
>> Cheers,
>> Felipe L
>
>