How to run flip-6 on mesos

[miki haiat]

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[Gary Yao-2]

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[miki haiat]

NO  :) ...
I usually using the web UI .
Can you refer me to some example how to submit  a job ?
Using REST ? to which port ?

thanks,

miki

On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[Gary Yao-2]

Hi Miki,

IIRC the port on which the Web UI is listening is not allocated dynamically when
deploying on Mesos, and should be 8081 by default (you can override the default
by setting rest.port in flink-conf.yaml). If you can find out the hostname/IP of
the JobManager, you can submit as usual via the Web UI. Alternatively you can
use the CLI, e.g.,

  bin/flink run -m hostname:6123 examples/streaming/WordCount.jar

where 6123 is the jobmanager.rpc.port.

Let me know if any of these work for you

Best,
Gary

On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <[hidden email]> wrote:

NO  :) ...
I usually using the web UI .
Can you refer me to some example how to submit  a job ?
Using REST ? to which port ?

thanks,

miki

On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[miki haiat]

The problem is that the Web UI hasn't started at all 

 Im using the sane config file that i used for none flip-6 is that ok ?

Also i got this error in the logs .

 

2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9c6.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5ac3.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

IIRC the port on which the Web UI is listening is not allocated dynamically when
deploying on Mesos, and should be 8081 by default (you can override the default
by setting rest.port in flink-conf.yaml). If you can find out the hostname/IP of
the JobManager, you can submit as usual via the Web UI. Alternatively you can
use the CLI, e.g.,

  bin/flink run -m hostname:6123 examples/streaming/WordCount.jar

where 6123 is the jobmanager.rpc.port.

Let me know if any of these work for you

Best,
Gary

On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <[hidden email]> wrote:

NO  :) ...
I usually using the web UI .
Can you refer me to some example how to submit  a job ?
Using REST ? to which port ?

thanks,

miki

On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[Gary Yao-2]

Hi Miki,

The stacktrace you posted looks familiar [1]. We have fixed the issue in Flink
1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is very
experimental, and I doubt that it is in a usable state. Since 1.5 is not out
yet, you can either compile the release branch yourself, or use the RC1
binaries [2]. If you are already on 1.5, please open a ticket.

Best,
Gary

[1] https://issues.apache.org/jira/browse/FLINK-8176
[2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/

On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <[hidden email]> wrote:

The problem is that the Web UI hasn't started at all 

 Im using the sane config file that i used for none flip-6 is that ok ?

Also i got this error in the logs .

 

2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9c6.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5ac3.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

IIRC the port on which the Web UI is listening is not allocated dynamically when
deploying on Mesos, and should be 8081 by default (you can override the default
by setting rest.port in flink-conf.yaml). If you can find out the hostname/IP of
the JobManager, you can submit as usual via the Web UI. Alternatively you can
use the CLI, e.g.,

  bin/flink run -m hostname:6123 examples/streaming/WordCount.jar

where 6123 is the jobmanager.rpc.port.

Let me know if any of these work for you

Best,
Gary

On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <[hidden email]> wrote:

NO  :) ...
I usually using the web UI .
Can you refer me to some example how to submit  a job ?
Using REST ? to which port ?

thanks,

miki

On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[miki haiat]

Its 1.4.2 ...

Any approximate date for 1.5 release ?

Thanks allot for your help .

On Tue, Apr 24, 2018 at 10:39 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

The stacktrace you posted looks familiar [1]. We have fixed the issue in Flink
1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is very
experimental, and I doubt that it is in a usable state. Since 1.5 is not out
yet, you can either compile the release branch yourself, or use the RC1
binaries [2]. If you are already on 1.5, please open a ticket.

Best,
Gary

[1] https://issues.apache.org/jira/browse/FLINK-8176
[2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/

On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <[hidden email]> wrote:

The problem is that the Web UI hasn't started at all 

 Im using the sane config file that i used for none flip-6 is that ok ?

Also i got this error in the logs .

 

2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9c6.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5ac3.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

IIRC the port on which the Web UI is listening is not allocated dynamically when
deploying on Mesos, and should be 8081 by default (you can override the default
by setting rest.port in flink-conf.yaml). If you can find out the hostname/IP of
the JobManager, you can submit as usual via the Web UI. Alternatively you can
use the CLI, e.g.,

  bin/flink run -m hostname:6123 examples/streaming/WordCount.jar

where 6123 is the jobmanager.rpc.port.

Let me know if any of these work for you

Best,
Gary

On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <[hidden email]> wrote:

NO  :) ...
I usually using the web UI .
Can you refer me to some example how to submit  a job ?
Using REST ? to which port ?

thanks,

miki

On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki

[Gary Yao-2]

Hi Miki,

We are currently working on resolving the last blocking issues for a second
Release Candidate. Afterwards it depends on how many new blocking issues will be
found during the testing.

Best,
Gary

On Tue, Apr 24, 2018 at 9:42 AM, miki haiat <[hidden email]> wrote:

Its 1.4.2 ...

Any approximate date for 1.5 release ?

Thanks allot for your help .

On Tue, Apr 24, 2018 at 10:39 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

The stacktrace you posted looks familiar [1]. We have fixed the issue in Flink
1.5. What is the Flink version you are using? FLIP-6 before Flink 1.5 is very
experimental, and I doubt that it is in a usable state. Since 1.5 is not out
yet, you can either compile the release branch yourself, or use the RC1
binaries [2]. If you are already on 1.5, please open a ticket.

Best,
Gary

[1] https://issues.apache.org/jira/browse/FLINK-8176
[2] http://people.apache.org/~trohrmann/flink-1.5.0-rc1/

On Tue, Apr 24, 2018 at 9:27 AM, miki haiat <[hidden email]> wrote:

The problem is that the Web UI hasn't started at all 

 Im using the sane config file that i used for none flip-6 is that ok ?

Also i got this error in the logs .

 

2018-04-24 10:16:05,466 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 4ac6ed0270bf6836941285ffcb9eb9c6.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
2018-04-24 10:16:05,469 ERROR org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Could not recover the job graph for 700f37540fe95787510dfa2bc0cc5ac3.
java.lang.IllegalStateException: Not running. Forgot to call start()?
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:195)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.verifyIsRunning(ZooKeeperSubmittedJobGraphStore.java:411)
        at org.apache.flink.runtime.jobmanager.ZooKeeperSubmittedJobGraphStore.recoverJobGraph(ZooKeeperSubmittedJobGraphStore.java:167)
        at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$recoverJobs$3(Dispatcher.java:445)
        at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

On Tue, Apr 24, 2018 at 10:06 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

IIRC the port on which the Web UI is listening is not allocated dynamically when
deploying on Mesos, and should be 8081 by default (you can override the default
by setting rest.port in flink-conf.yaml). If you can find out the hostname/IP of
the JobManager, you can submit as usual via the Web UI. Alternatively you can
use the CLI, e.g.,

  bin/flink run -m hostname:6123 examples/streaming/WordCount.jar

where 6123 is the jobmanager.rpc.port.

Let me know if any of these work for you

Best,
Gary

On Tue, Apr 24, 2018 at 8:55 AM, miki haiat <[hidden email]> wrote:

NO  :) ...
I usually using the web UI .
Can you refer me to some example how to submit  a job ?
Using REST ? to which port ?

thanks,

miki

On Tue, Apr 24, 2018 at 9:42 AM, Gary Yao <[hidden email]> wrote:

Hi Miki,

Did you try to submit a job? With the introduction of FLIP-6, resources are
allocated dynamically.

Best,
Gary

On Tue, Apr 24, 2018 at 8:31 AM, miki haiat <[hidden email]> wrote:

HI, 

Im trying to tun flip-6 on mesos but its not clear to me what is the correct way to do it .

I run  the session script and i can see that new framework has been created in mesos  but the task manager  hasn't been created  

running  taskmanager-flip6.sh throw null pointer ...

what is the correct way to run flip-6 .

thanks,

miki