NoSuchMethorError when using chill-protobuf

[Prashant Deva]

I am trying to use chill-protobuf to serialize protobuf messages.

However, I am getting this exception:

Caused by: java.lang.NoSuchMethodError: 'boolean com.twitter.chill.java.Java8ClosureRegistrar.areOnJava8()'

at com.twitter.chill.KryoBase.isJavaLambda(KryoBase.scala:47)

at com.twitter.chill.KryoBase.getRegistration(KryoBase.scala:50)

at com.esotericsoftware.kryo.Kryo.getSerializer(Kryo.java:476)

at com.esotericsoftware.kryo.Kryo.copy(Kryo.java:862)

at org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:260)

at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:69)

at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:46)

at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:26)

at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:50)

at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:28)

at org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollectWithTimestamp(StreamSourceContexts.java:322)

at org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collectWithTimestamp(StreamSourceContexts.java:426)

at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.emitRecordsWithTimestamps(AbstractFetcher.java:365)

at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.partitionConsumerRecordsHandler(KafkaFetcher.java:183)

at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.runFetchLoop(KafkaFetcher.java:142)

at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:826)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)

at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263)

Here is my dependencies. It seems fine according to the docs.

Am i doing something wrong? How do I fix this?

       <dependency>

            <groupId>org.apache.flink</groupId>

            <artifactId>flink-clients_2.12</artifactId>

            <version>${flink.version}</version>

        </dependency>

        <dependency>

            <groupId>org.apache.flink</groupId>

            <artifactId>flink-streaming-java_2.12</artifactId>

            <version>${flink.version}</version>

        </dependency>

        <dependency>

            <groupId>org.apache.flink</groupId>

            <artifactId>flink-connector-kafka_2.12</artifactId>

            <version>${flink.version}</version>

        </dependency>

        <dependency>

            <groupId>com.google.protobuf</groupId>

            <artifactId>protobuf-java</artifactId>

            <version>3.15.8</version>

        </dependency>

        <dependency>

            <groupId>com.twitter</groupId>

            <artifactId>chill-protobuf</artifactId>

            <version>0.9.5</version>

            <!-- exclusions for dependency conversion -->

            <exclusions>

                <exclusion>

                    <groupId>com.esotericsoftware.kryo</groupId>

                    <artifactId>kryo</artifactId>

                </exclusion>

            </exclusions>

        </dependency>

[Prashant Deva]

ah it seems that one needs to use chill 0.7.6 in order to get it to work with flink.

On Sat, Apr 24, 2021 at 1:18 PM Prashant Deva <[hidden email]> wrote:

I am trying to use chill-protobuf to serialize protobuf messages.

However, I am getting this exception:

Caused by: java.lang.NoSuchMethodError: 'boolean com.twitter.chill.java.Java8ClosureRegistrar.areOnJava8()'

at com.twitter.chill.KryoBase.isJavaLambda(KryoBase.scala:47)

at com.twitter.chill.KryoBase.getRegistration(KryoBase.scala:50)

at com.esotericsoftware.kryo.Kryo.getSerializer(Kryo.java:476)

at com.esotericsoftware.kryo.Kryo.copy(Kryo.java:862)

at org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:260)

at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:69)

at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:46)

at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:26)

at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:50)

at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:28)

at org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollectWithTimestamp(StreamSourceContexts.java:322)

at org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collectWithTimestamp(StreamSourceContexts.java:426)

at org.apache.flink.streaming.connectors.kafka.internals.AbstractFetcher.emitRecordsWithTimestamps(AbstractFetcher.java:365)

at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.partitionConsumerRecordsHandler(KafkaFetcher.java:183)

at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.runFetchLoop(KafkaFetcher.java:142)

at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:826)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)

at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263)

Here is my dependencies. It seems fine according to the docs.

Am i doing something wrong? How do I fix this?

       <dependency>

            <groupId>org.apache.flink</groupId>

            <artifactId>flink-clients_2.12</artifactId>

            <version>${flink.version}</version>

        </dependency>

        <dependency>

            <groupId>org.apache.flink</groupId>

            <artifactId>flink-streaming-java_2.12</artifactId>

            <version>${flink.version}</version>

        </dependency>

        <dependency>

            <groupId>org.apache.flink</groupId>

            <artifactId>flink-connector-kafka_2.12</artifactId>

            <version>${flink.version}</version>

        </dependency>

        <dependency>

            <groupId>com.google.protobuf</groupId>

            <artifactId>protobuf-java</artifactId>

            <version>3.15.8</version>

        </dependency>

        <dependency>

            <groupId>com.twitter</groupId>

            <artifactId>chill-protobuf</artifactId>

            <version>0.9.5</version>

            <!-- exclusions for dependency conversion -->

            <exclusions>

                <exclusion>

                    <groupId>com.esotericsoftware.kryo</groupId>

                    <artifactId>kryo</artifactId>

                </exclusion>

            </exclusions>

        </dependency>

Sent via Superhuman