Issues with Flink1.5 SQL-Client

[Ashwin Sinha]

Hi folks,

We are trying to setup flink sql client. It is still in development phase, but flink-1.5 contains beta version of this feature.

Our environment:

Kafka-
Topic: test_flink_state_check

Kafka Key: null
Kafka Value example: {"state": 299, "number": 299} 

Flink-
Jobmanager: http://localhost:8080/
conf/sql-client-defaults.yaml: https://pastebin.com/zGb3qs7E

Then we start sql-client shell by 

./bin/sql-client.sh embedded

When we run

select * from [tablename]

the result shell hangs and after sometime it exits without printing any data and give following error on screen: https://pastebin.com/wuitQx1a

Complete stacktrace in flink logs: https://pastebin.com/mgk06xeG

Please assist us in resolving this!

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

[Timo Walther]

Hi Ashwin,

which Flink version is your (local cluster)? Are you executing Flink in the default (new deployment) or legacy mode? The SQL client supports only the new "FLIP-6" deployment model. I'm not sure about your error message but it might be related to that.

Regards,
Timo


Am 03.07.18 um 14:42 schrieb Ashwin Sinha:

Hi folks,

We are trying to setup flink sql client. It is still in development phase, but flink-1.5 contains beta version of this feature.

Our environment:

Kafka-
Topic: test_flink_state_check

Kafka Key: null
Kafka Value example: {"state": 299, "number": 299} 

Flink-
Jobmanager: http://localhost:8080/
conf/sql-client-defaults.yaml: https://pastebin.com/zGb3qs7E

Then we start sql-client shell by 

./bin/sql-client.sh embedded

When we run

select * from [tablename]

the result shell hangs and after sometime it exits without printing any data and give following error on screen: https://pastebin.com/wuitQx1a

Complete stacktrace in flink logs: https://pastebin.com/mgk06xeG

Please assist us in resolving this!

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

[Ashwin Sinha]

Hi Timo, 

Our flink version is 1.5.0

We followed this documentation and started flink cluster same way. Also we are getting more logs https://pastebin.com/fGTW9s2b

On Tue, Jul 3, 2018 at 7:01 PM Timo Walther <[hidden email]> wrote:

Hi Ashwin,

which Flink version is your (local cluster)? Are you executing Flink in the default (new deployment) or legacy mode? The SQL client supports only the new "FLIP-6" deployment model. I'm not sure about your error message but it might be related to that.

Regards,
Timo


Am 03.07.18 um 14:42 schrieb Ashwin Sinha:

Hi folks,

We are trying to setup flink sql client. It is still in development phase, but flink-1.5 contains beta version of this feature.

Our environment:

Kafka-
Topic: test_flink_state_check

Kafka Key: null
Kafka Value example: {"state": 299, "number": 299} 

Flink-
Jobmanager: http://localhost:8080/
conf/sql-client-defaults.yaml: https://pastebin.com/zGb3qs7E

Then we start sql-client shell by 

./bin/sql-client.sh embedded

When we run

select * from [tablename]

the result shell hangs and after sometime it exits without printing any data and give following error on screen: https://pastebin.com/wuitQx1a

Complete stacktrace in flink logs: https://pastebin.com/mgk06xeG

Please assist us in resolving this!

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

[Chesnay Schepler]

Can you provide us with the JobManager logs?

Based on the exception i concur with Timo, it looks like the server is either running 1.4 or below, or was started in the legacy mode.

On 03.07.2018 15:42, Ashwin Sinha wrote:

Hi Timo, 

Our flink version is 1.5.0

We followed this documentation and started flink cluster same way. Also we are getting more logs https://pastebin.com/fGTW9s2b

On Tue, Jul 3, 2018 at 7:01 PM Timo Walther <[hidden email]> wrote:

Hi Ashwin,

which Flink version is your (local cluster)? Are you executing Flink in the default (new deployment) or legacy mode? The SQL client supports only the new "FLIP-6" deployment model. I'm not sure about your error message but it might be related to that.

Regards,
Timo


Am 03.07.18 um 14:42 schrieb Ashwin Sinha:

Hi folks,

We are trying to setup flink sql client. It is still in development phase, but flink-1.5 contains beta version of this feature.

Our environment:

Kafka-
Topic: test_flink_state_check

Kafka Key: null
Kafka Value example: {"state": 299, "number": 299} 

Flink-
Jobmanager: http://localhost:8080/
conf/sql-client-defaults.yaml: https://pastebin.com/zGb3qs7E

Then we start sql-client shell by 

./bin/sql-client.sh embedded

When we run

select * from [tablename]

the result shell hangs and after sometime it exits without printing any data and give following error on screen: https://pastebin.com/wuitQx1a

Complete stacktrace in flink logs: https://pastebin.com/mgk06xeG

Please assist us in resolving this!

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

[Xingcan Cui]

Hi Ashwin,

I encountered this problem before. You should make sure that the version for your Flink cluster and the version you run the SQL-Client are exactly the same.

Best,

Xingcan

On Jul 3, 2018, at 10:00 PM, Chesnay Schepler <[hidden email]> wrote:

Can you provide us with the JobManager logs?

Based on the exception i concur with Timo, it looks like the server is either running 1.4 or below, or was started in the legacy mode.

On 03.07.2018 15:42, Ashwin Sinha wrote:

Hi Timo, 

Our flink version is 1.5.0

We followed this documentation and started flink cluster same way. Also we are getting more logs https://pastebin.com/fGTW9s2b

On Tue, Jul 3, 2018 at 7:01 PM Timo Walther <[hidden email]> wrote:

Hi Ashwin,

which Flink version is your (local cluster)? Are you executing Flink in the default (new deployment) or legacy mode? The SQL client supports only the new "FLIP-6" deployment model. I'm not sure about your error message but it might be related to that.

Regards,
Timo


Am 03.07.18 um 14:42 schrieb Ashwin Sinha:

Hi folks,

We are trying to setup flink sql client. It is still in development phase, but flink-1.5 contains beta version of this feature.

Our environment:

Kafka-
Topic: test_flink_state_check

Kafka Key: null
Kafka Value example: {"state": 299, "number": 299} 

Flink-
Jobmanager: http://localhost:8080/
conf/sql-client-defaults.yaml: https://pastebin.com/zGb3qs7E

Then we start sql-client shell by 

./bin/sql-client.sh embedded

When we run

select * from [tablename]

the result shell hangs and after sometime it exits without printing any data and give following error on screen: https://pastebin.com/wuitQx1a

Complete stacktrace in flink logs: https://pastebin.com/mgk06xeG

Please assist us in resolving this!

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

[Timo Walther]

Great to hear!

Timo

Am 03.07.18 um 16:16 schrieb Ashwin Sinha:

Hi Chesnay, 

We got the issue. Thanks for pointing out the issue. By mistake it was running the 1.3.2 jobmanager version, and now moved to 1.5.0 and working smooth. Will be careful from next time.

Thanks for all the support and help!

On Tue, Jul 3, 2018 at 7:30 PM Chesnay Schepler <[hidden email]> wrote:

Can you provide us with the JobManager logs?

Based on the exception i concur with Timo, it looks like the server is either running 1.4 or below, or was started in the legacy mode.

On 03.07.2018 15:42, Ashwin Sinha wrote:

Hi Timo, 

Our flink version is 1.5.0

We followed this documentation and started flink cluster same way. Also we are getting more logs https://pastebin.com/fGTW9s2b

On Tue, Jul 3, 2018 at 7:01 PM Timo Walther <[hidden email]> wrote:

Hi Ashwin,

which Flink version is your (local cluster)? Are you executing Flink in the default (new deployment) or legacy mode? The SQL client supports only the new "FLIP-6" deployment model. I'm not sure about your error message but it might be related to that.

Regards,
Timo


Am 03.07.18 um 14:42 schrieb Ashwin Sinha:

Hi folks,

We are trying to setup flink sql client. It is still in development phase, but flink-1.5 contains beta version of this feature.

Our environment:

Kafka-
Topic: test_flink_state_check

Kafka Key: null
Kafka Value example: {"state": 299, "number": 299} 

Flink-
Jobmanager: http://localhost:8080/
conf/sql-client-defaults.yaml: https://pastebin.com/zGb3qs7E

Then we start sql-client shell by 

./bin/sql-client.sh embedded

When we run

select * from [tablename]

the result shell hangs and after sometime it exits without printing any data and give following error on screen: https://pastebin.com/wuitQx1a

Complete stacktrace in flink logs: https://pastebin.com/mgk06xeG

Please assist us in resolving this!

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.

--

::DISCLAIMER::

----------------------------------------------------------------------------------------------------------------------------------------------------

This message is intended only for the use of the addressee and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify us immediately by return e-mail and delete this e-mail and all attachments from your system.