[Table API example] Table program cannot be compiled. This is a bug. Please file an issue

[Marvin777]

Hi all,

I have a simple test for looking at Flink Table API and hit an exception reported as a bug.  I wonder though if it is a missing something. 

BTW, the example is flink-examples-table-with-dependencies.jar, and the version is 1.4.2 .

Thanks Mavin.    

 

[Fabian Hueske-2]

Hi Marvin,

Can you post the query (+ schema of tables) that lead to this exception?

Thank you,

Fabian

Am Fr., 30. Nov. 2018 um 10:55 Uhr schrieb Marvin777 <[hidden email]>:

Hi all,

I have a simple test for looking at Flink Table API and hit an exception reported as a bug.  I wonder though if it is a missing something. 

BTW, the example is flink-examples-table-with-dependencies.jar, and the version is 1.4.2 .

Thanks Mavin.    

 

[Marvin777]

Hi Fabian,

I'm the official example of running directly,  and  run the command as follows:

Fabian Hueske <[hidden email]> 于2018年11月30日周五 下午6:35写道：

Hi Marvin,

Can you post the query (+ schema of tables) that lead to this exception?

Thank you,

Fabian

Am Fr., 30. Nov. 2018 um 10:55 Uhr schrieb Marvin777 <[hidden email]>:

Hi all,

I have a simple test for looking at Flink Table API and hit an exception reported as a bug.  I wonder though if it is a missing something. 

BTW, the example is flink-examples-table-with-dependencies.jar, and the version is 1.4.2 .

Thanks Mavin.    

 

[Hequn Cheng]

Hi Marvin,

Thanks for reporting the problem. I think this is a bug. 

The reason is that a system classloader has been set to compile the code while class WC is in the user code classloader. I think we should use a user classloader instead. I created a jira[1] to track the problem. 

As a workaround, you can put the jar into the flink lib folder. Btw, you may also have to put the flink-table.jar into lib folder, since classes in it have also been used.

Best, 

Hequn

[1] https://issues.apache.org/jira/browse/FLINK-11045

On Fri, Nov 30, 2018 at 7:38 PM Marvin777 <[hidden email]> wrote:

Hi Fabian,

I'm the official example of running directly,  and  run the command as follows:

Fabian Hueske <[hidden email]> 于2018年11月30日周五 下午6:35写道：

Hi Marvin,

Can you post the query (+ schema of tables) that lead to this exception?

Thank you,

Fabian

Am Fr., 30. Nov. 2018 um 10:55 Uhr schrieb Marvin777 <[hidden email]>:

Hi all,

I have a simple test for looking at Flink Table API and hit an exception reported as a bug.  I wonder though if it is a missing something. 

BTW, the example is flink-examples-table-with-dependencies.jar, and the version is 1.4.2 .

Thanks Mavin.    

 

[孙森]

HI,all:

        I specify the exact offsets the consumer should start from for each partition.But the Kafka consumer connot periodically commit the offsets to Zookeeper.

I have disabled the checkpoint only if the job is stopped.This is my code:

val properties = new Properties()
properties.setProperty("bootstrap.servers", config.kafka_input.kafka_base_config.brokers)
properties.setProperty("zookeeper.connect", config.zookeeper_address)
properties.setProperty("group.id", config.kafka_input.groupId)
properties.setProperty("session.timeout.ms", config.kafka_input.sessionTimeout)
properties.setProperty("enable.auto.commit", config.kafka_input.autoCommit.toString)
val flinkxConfigUtils = new WormholeFlinkxConfigUtils(config)
val topics = flinkxConfigUtils.getKafkaTopicList
val myConsumer = new FlinkKafkaConsumer010[(String, String, String, Int, Long)](topics, new WormholeDeserializationStringSchema, properties)

val specificStartOffsets = flinkxConfigUtils.getTopicPartitionOffsetMap
myConsumer.setStartFromSpecificOffsets(specificStartOffsets)

 
Can anyone explain the problem?

Thanks very much!

[Marvin777]

Thanks, it works. 

Hequn Cheng <[hidden email]> 于2018年12月2日周日 下午2:36写道：

Hi Marvin,

Thanks for reporting the problem. I think this is a bug. 

The reason is that a system classloader has been set to compile the code while class WC is in the user code classloader. I think we should use a user classloader instead. I created a jira[1] to track the problem. 

As a workaround, you can put the jar into the flink lib folder. Btw, you may also have to put the flink-table.jar into lib folder, since classes in it have also been used.

Best, 

Hequn

[1] https://issues.apache.org/jira/browse/FLINK-11045

On Fri, Nov 30, 2018 at 7:38 PM Marvin777 <[hidden email]> wrote:

Hi Fabian,

I'm the official example of running directly,  and  run the command as follows:

Fabian Hueske <[hidden email]> 于2018年11月30日周五 下午6:35写道：

Hi Marvin,

Can you post the query (+ schema of tables) that lead to this exception?

Thank you,

Fabian

Am Fr., 30. Nov. 2018 um 10:55 Uhr schrieb Marvin777 <[hidden email]>:

Hi all,

I have a simple test for looking at Flink Table API and hit an exception reported as a bug.  I wonder though if it is a missing something. 

BTW, the example is flink-examples-table-with-dependencies.jar, and the version is 1.4.2 .

Thanks Mavin.