Connection time out - DataStream API Tutorial

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Connection time out - DataStream API Tutorial

Brett Marcott
Hi Flink users,

I am attempting to follow the tutorial here:

However I am hitting the below error:

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.

at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)

at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:647)

at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)

at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1510)

at wikiedits.WikipediaAnalysis.main(WikipediaAnalysis.java:42)

at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.base/java.lang.reflect.Method.invoke(Method.java:564)

at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282)

at java.base/java.lang.Thread.run(Thread.java:844)

Caused by: java.net.ConnectException: Operation timed out (Connection timed out)

at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)

at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)

at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)

at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)

at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)

at java.base/java.net.Socket.connect(Socket.java:591)

at java.base/java.net.Socket.connect(Socket.java:540)

at java.base/java.net.Socket.<init>(Socket.java:436)

at java.base/java.net.Socket.<init>(Socket.java:213)

at org.schwering.irc.lib.IRCConnection.connect(IRCConnection.java:295)

at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditEventIrcStream.connect(WikipediaEditEventIrcStream.java:62)

at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditsSource.run(WikipediaEditsSource.java:80)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:94)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)

at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)

... 1 more



Below connection works fine on command line:

$ nc -z irc.wikimedia.org 6667

Connection to irc.wikimedia.org port 6667 [tcp/*] succeeded!


Any tips?


Thanks,


Brett

Reply | Threaded
Open this post in threaded view
|

Re: Connection time out - DataStream API Tutorial

vino yang
Hi Brett,

Is your exception generated on your local machine or generated on a remote node?

Best,
Vino

Brett Marcott <[hidden email]> 于2018年12月15日周六 下午5:38写道:
Hi Flink users,

I am attempting to follow the tutorial here:

However I am hitting the below error:

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.

at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)

at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:647)

at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)

at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1510)

at wikiedits.WikipediaAnalysis.main(WikipediaAnalysis.java:42)

at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.base/java.lang.reflect.Method.invoke(Method.java:564)

at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282)

at java.base/java.lang.Thread.run(Thread.java:844)

Caused by: java.net.ConnectException: Operation timed out (Connection timed out)

at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)

at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)

at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)

at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)

at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)

at java.base/java.net.Socket.connect(Socket.java:591)

at java.base/java.net.Socket.connect(Socket.java:540)

at java.base/java.net.Socket.<init>(Socket.java:436)

at java.base/java.net.Socket.<init>(Socket.java:213)

at org.schwering.irc.lib.IRCConnection.connect(IRCConnection.java:295)

at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditEventIrcStream.connect(WikipediaEditEventIrcStream.java:62)

at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditsSource.run(WikipediaEditsSource.java:80)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:94)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)

at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)

... 1 more



Below connection works fine on command line:

$ nc -z irc.wikimedia.org 6667

Connection to irc.wikimedia.org port 6667 [tcp/*] succeeded!


Any tips?


Thanks,


Brett

Reply | Threaded
Open this post in threaded view
|

Re: Connection time out - DataStream API Tutorial

Brett Marcott
Hi Vino,

I am running everything (and generating the exception) locally I believe, as the tutorial instructs.

Thanks,
Brett

On Mon, Dec 17, 2018 at 6:12 PM vino yang <[hidden email]> wrote:
Hi Brett,

Is your exception generated on your local machine or generated on a remote node?

Best,
Vino

Brett Marcott <[hidden email]> 于2018年12月15日周六 下午5:38写道:
Hi Flink users,

I am attempting to follow the tutorial here:

However I am hitting the below error:

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.

at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)

at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:647)

at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)

at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1510)

at wikiedits.WikipediaAnalysis.main(WikipediaAnalysis.java:42)

at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.base/java.lang.reflect.Method.invoke(Method.java:564)

at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282)

at java.base/java.lang.Thread.run(Thread.java:844)

Caused by: java.net.ConnectException: Operation timed out (Connection timed out)

at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)

at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)

at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)

at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)

at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)

at java.base/java.net.Socket.connect(Socket.java:591)

at java.base/java.net.Socket.connect(Socket.java:540)

at java.base/java.net.Socket.<init>(Socket.java:436)

at java.base/java.net.Socket.<init>(Socket.java:213)

at org.schwering.irc.lib.IRCConnection.connect(IRCConnection.java:295)

at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditEventIrcStream.connect(WikipediaEditEventIrcStream.java:62)

at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditsSource.run(WikipediaEditsSource.java:80)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:94)

at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)

at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)

at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)

at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)

... 1 more



Below connection works fine on command line:

$ nc -z irc.wikimedia.org 6667

Connection to irc.wikimedia.org port 6667 [tcp/*] succeeded!


Any tips?


Thanks,


Brett

Reply | Threaded
Open this post in threaded view
|

Re: Connection time out - DataStream API Tutorial

Andrey Zagrebin
Hi Brett,

I have just tried it locally and it works for me.
It looks like some networking issue with the JVM or environment setup where Flink is started.

Best,
Andrey

On 18 Dec 2018, at 05:28, Brett Marcott <[hidden email]> wrote:

Hi Vino,

I am running everything (and generating the exception) locally I believe, as the tutorial instructs.

Thanks,
Brett

On Mon, Dec 17, 2018 at 6:12 PM vino yang <[hidden email]> wrote:
Hi Brett,

Is your exception generated on your local machine or generated on a remote node?

Best,
Vino

Brett Marcott <[hidden email]> 于2018年12月15日周六 下午5:38写道:
Hi Flink users,

I am attempting to follow the tutorial here:

However I am hitting the below error:
org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)
at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:647)
at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1510)
at wikiedits.WikipediaAnalysis.main(WikipediaAnalysis.java:42)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:282)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.net.ConnectException: Operation timed out (Connection timed out)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
at java.base/java.net.Socket.connect(Socket.java:591)
at java.base/java.net.Socket.connect(Socket.java:540)
at java.base/java.net.Socket.<init>(Socket.java:436)
at java.base/java.net.Socket.<init>(Socket.java:213)
at org.schwering.irc.lib.IRCConnection.connect(IRCConnection.java:295)
at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditEventIrcStream.connect(WikipediaEditEventIrcStream.java:62)
at org.apache.flink.streaming.connectors.wikiedits.WikipediaEditsSource.run(WikipediaEditsSource.java:80)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:94)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:58)
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:99)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)
... 1 more


Below connection works fine on command line:
$ nc -z irc.wikimedia.org 6667

Connection to irc.wikimedia.org port 6667 [tcp/*] succeeded!

Any tips?

Thanks,

Brett