Exception when trying to run flink twitter example
Locked
Exception when trying to run flink twitter example
 
|
Hi, I have created a fat jar with my twitterexample classes and am running it like this, ~/flink-1.3.2/build-target/bin/flink run -c TwitterExample ./flinktwitter.jar --twitter-source.consumerKey <key> --twitter-source.consumerSecret <secret> --twitter-source.token <token> --twitter-source.tokenSecret <tokensecret> I am providing all the right twitter credentials. I am however seeing the following exception. Has anyone else seen this before. 08/22/2017 08:52:40 Job execution switched to status RUNNING. 08/22/2017 08:52:40 Source: Custom Source -> Flat Map(1/1) switched to SCHEDULED 08/22/2017 08:52:40 Keyed Aggregation -> Sink: Unnamed(1/1) switched to SCHEDULED 08/22/2017 08:52:40 Source: Custom Source -> Flat Map(1/1) switched to DEPLOYING 08/22/2017 08:52:40 Keyed Aggregation -> Sink: Unnamed(1/1) switched to DEPLOYING 08/22/2017 08:52:40 Keyed Aggregation -> Sink: Unnamed(1/1) switched to RUNNING 08/22/2017 08:52:40 Source: Custom Source -> Flat Map(1/1) switched to RUNNING 08/22/2017 08:52:41 Source: Custom Source -> Flat Map(1/1) switched to FAILED java.lang.ExceptionInInitializerError at org.apache.flink.streaming.connectors.twitter.TwitterSource.run(TwitterSource.java:134) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:55) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:95) at org.apache.flink.streaming.runtime.tasks.StoppableSourceStreamTask.run(StoppableSourceStreamTask.java:39) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:263) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException at com.twitter.hbc.ClientBuilder.loadVersion(ClientBuilder.java:71) at com.twitter.hbc.ClientBuilder.<clinit>(ClientBuilder.java:79) ... 8 more 08/22/2017 08:52:41 Job execution switched to status FAILING. java.lang.ExceptionInInitializerError at org.apache.flink.streaming.connectors.twitter.TwitterSource.run(TwitterSource.java:134) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:55) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:95) at org.apache.flink.streaming.runtime.tasks.StoppableSourceStreamTask.run(StoppableSourceStreamTask.java:39) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:263) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException at com.twitter.hbc.ClientBuilder.loadVersion(ClientBuilder.java:71) at com.twitter.hbc.ClientBuilder.<clinit>(ClientBuilder.java:79) ... 8 more 08/22/2017 08:52:41 Keyed Aggregation -> Sink: Unnamed(1/1) switched to CANCELING 08/22/2017 08:52:41 Keyed Aggregation -> Sink: Unnamed(1/1) switched to CANCELED 08/22/2017 08:52:41 Job execution switched to status FAILED. ------------------------------------------------------------ The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Job execution failed. at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478) at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442) at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73) at TwitterExample.main(TwitterExample.java:68) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528) at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419) at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381) at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838) at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259) at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086) at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133) at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130) at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40) at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130) Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:933) at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:876) at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:876) at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.ExceptionInInitializerError at org.apache.flink.streaming.connectors.twitter.TwitterSource.run(TwitterSource.java:134) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:87) at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:55) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:95) at org.apache.flink.streaming.runtime.tasks.StoppableSourceStreamTask.run(StoppableSourceStreamTask.java:39) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:263) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException at com.twitter.hbc.ClientBuilder.loadVersion(ClientBuilder.java:71) at com.twitter.hbc.ClientBuilder.<clinit>(ClientBuilder.java:79) ... 8 more |
Re: Exception when trying to run flink twitter example
|
|
Hi Krishnanand, could you check that you have the build.properties file in you fat jar containing the field version=<HBC-VERSION>? Cheers, Till On Tue, Aug 22, 2017 at 6:19 PM, Krishnanand Khambadkone <[hidden email]> wrote:
|
Re: Exception when trying to run flink twitter example
|
|
Till, Thank you for the prompt response. Yes, including the build.properties (version = 2.2.0) made the exception go away. Now no exception but no tweets output either. The program just sits there doing nothing. I have not specified an output directory so the tweets are sent to stdout. On Tuesday, August 22, 2017, 9:27:07 AM PDT, Till Rohrmann <[hidden email]> wrote: Hi Krishnanand, could you check that you have the build.properties file in you fat jar containing the field version=<HBC-VERSION>? Cheers, Till On Tue, Aug 22, 2017 at 6:19 PM, Krishnanand Khambadkone <[hidden email]> wrote:
|
| Free forum by Nabble | Edit this page |