(DEPRECATED) Apache Flink User Mailing List archive.

Zeppelin

classic Classic list List threaded Threaded
♦
♦
 4 messages Options
Smirnov Sergey Vladimirovich (39833)
Reply | Threaded
Open this post in threaded view
♦
♦
|

Zeppelin

Smirnov Sergey Vladimirovich (39833)

Hello,

 

Trying to link Zeppelin 0.9 with Flink 1.8. It`s a small dev cluster deployed in standalone manner.

Got the same error as described here https://stackoverflow.com/questions/54257671/runnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to

Would appreciate for any support for helping to resolve that problem.

 

Regards,

Sergey

 
Dawid Wysakowicz-2
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Zeppelin

Dawid Wysakowicz-2

Hi Sergey,

I am not very familiar with Zepellin. But I know Jeff (cc'ed) is working on integrating Flink with some notebooks. He might be able to help you.

Best,

Dawid

On 25/04/2019 08:42, Smirnov Sergey Vladimirovich (39833) wrote:

Hello,

 

Trying to link Zeppelin 0.9 with Flink 1.8. It`s a small dev cluster deployed in standalone manner.

Got the same error as described here https://stackoverflow.com/questions/54257671/runnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to

Would appreciate for any support for helping to resolve that problem.

 

Regards,

Sergey

 


signature.asc (849 bytes) Download Attachment
Jeff Zhang
Reply | Threaded
Open this post in threaded view
♦
♦
|

Re: Zeppelin

Jeff Zhang
Thanks Dawid,

Hi Sergey,

I am working on update the flink interpreter of zeppelin to support flink 1.9 (supposed to be released this summer). 
For the current flink interpreter of zeppelin 0.9, I haven't verified it against flink 1.8. could you show the full interpreter log ? And what is the size your input file ?



Dawid Wysakowicz <[hidden email]> 于2019年4月25日周四 下午6:31写道：

Hi Sergey,

I am not very familiar with Zepellin. But I know Jeff (cc'ed) is working on integrating Flink with some notebooks. He might be able to help you.

Best,

Dawid

On 25/04/2019 08:42, Smirnov Sergey Vladimirovich (39833) wrote:

Hello,

 

Trying to link Zeppelin 0.9 with Flink 1.8. It`s a small dev cluster deployed in standalone manner.

Got the same error as described here https://stackoverflow.com/questions/54257671/runnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to

Would appreciate for any support for helping to resolve that problem.

 

Regards,

Sergey

 



--
Best Regards

Jeff Zhang
Smirnov Sergey Vladimirovich (39833)
Reply | Threaded
Open this post in threaded view
♦
♦
|

RE: Zeppelin

Smirnov Sergey Vladimirovich (39833)

Hi,

 

Dawid, great, thanks for answering.

 

Jeff,

flink 1.8 with default settings, standalone cluster, one job node and three task managers nodes.

zeppelin 0.9 config

checked "Connect to existing cluster"

host: 10.219.179.16

port: 6123

create simple notebook:

%flink

ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment();

 

zeppelin logs:

2019-04-23 10:09:17,241 WARN  akka.remote.transport.netty.NettyTransport                    - Remote connection to [/10.216.26.26:45588] failed with org.apache.flink.shaded.akka.org.jboss.netty.handler.codec.frame.TooLongFrameException: Adjusted frame length exceeds 10485760: 2147549189 - discarded

2019-04-23 10:09:29,475 WARN  akka.remote.transport.netty.NettyTransport                    - Remote connection to [/10.216.26.26:45624] failed with org.apache.flink.shaded.akka.org.jboss.netty.handler.codec.frame.TooLongFrameException: Adjusted frame length exceeds 10485760: 2147549189 - discarded

flink:

org.apache.thrift.transport.TTransportException

                at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)

                at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)

                at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:380)

                at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:230)

                at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)

                at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:189)

                at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:172)

                at org.apache.zeppelin.interpreter.remote.RemoteInterpreter$2.call(RemoteInterpreter.java:169)

                at org.apache.zeppelin.interpreter.remote.RemoteInterpreter$2.call(RemoteInterpreter.java:165)

                at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:118)

                at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:165)

                at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:132)

                at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:290)

                at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:443)

                at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:75)

                at org.apache.zeppelin.scheduler.Job.run(Job.java:181)

                at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:123)

                at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:187)

                at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

                at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)

                at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)

                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

                at java.lang.Thread.run(Thread.java:748)

...

 

Regards,

Sergey

 

From: Jeff Zhang [mailto:[hidden email]]
Sent: Thursday, April 25, 2019 4:24 PM
To: Dawid Wysakowicz <[hidden email]>
Cc: Smirnov Sergey Vladimirovich (39833) <[hidden email]>; [hidden email]
Subject: Re: Zeppelin

 

Thanks Dawid,

 

Hi Sergey,

 

I am working on update the flink interpreter of zeppelin to support flink 1.9 (supposed to be released this summer). 

For the current flink interpreter of zeppelin 0.9, I haven't verified it against flink 1.8. could you show the full interpreter log ? And what is the size your input file ?

 

 

 

Dawid Wysakowicz <[hidden email]> 于2019年4月25日周四 下午6:31写道：

Hi Sergey,

I am not very familiar with Zepellin. But I know Jeff (cc'ed) is working on integrating Flink with some notebooks. He might be able to help you.

Best,

Dawid

On 25/04/2019 08:42, Smirnov Sergey Vladimirovich (39833) wrote:

Hello,

 

Trying to link Zeppelin 0.9 with Flink 1.8. It`s a small dev cluster deployed in standalone manner.

Got the same error as described here https://stackoverflow.com/questions/54257671/runnning-a-job-in-apache-flink-standalone-mode-on-zeppelin-i-have-this-error-to

Would appreciate for any support for helping to resolve that problem.

 

Regards,

Sergey

 


 

--

Best Regards

Jeff Zhang
Free forum by Nabble Edit this page