Administration of running jobs

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Administration of running jobs

Marek Svitok
Hi all.

I'm pretty new to Apache Flink. I'd like to ask you how we can manage
running jobs. I've noticed one possibility
using UI running on 8081 by default, but I'm aiming to some java API. My
problem is that I should be able
to dynamically add and remove jobs which are CEP rules because this
rules could be changed at runtime.

Thank you,
Marek Svitok
Reply | Threaded
Open this post in threaded view
|

Re: Administration of running jobs

rmetzger0
Hi Marek,

You can use the RemoteExecutionEnvironment to submit a job programatically to a Flink cluster.

there is also some ongoing work to programatically control submitted jobs: https://issues.apache.org/jira/browse/FLINK-4272. But for now you would probably need to hack something using the JobManager's REST APIs.

Regards,
Robert


On Thu, Sep 8, 2016 at 5:25 PM, Marek Svitok <[hidden email]> wrote:
Hi all.

I'm pretty new to Apache Flink. I'd like to ask you how we can manage running jobs. I've noticed one possibility
using UI running on 8081 by default, but I'm aiming to some java API. My problem is that I should be able
to dynamically add and remove jobs which are CEP rules because this rules could be changed at runtime.

Thank you,
Marek Svitok

Reply | Threaded
Open this post in threaded view
|

Re: Administration of running jobs

Marek Svitok

Hi Robert.

Thank you very much for your reply. I'll take a look at it.

Marek.

On 9.9.2016 12:09, Robert Metzger wrote:
Hi Marek,

You can use the RemoteExecutionEnvironment to submit a job programatically to a Flink cluster.

there is also some ongoing work to programatically control submitted jobs: https://issues.apache.org/jira/browse/FLINK-4272. But for now you would probably need to hack something using the JobManager's REST APIs.

Regards,
Robert


On Thu, Sep 8, 2016 at 5:25 PM, Marek Svitok <[hidden email]> wrote:
Hi all.

I'm pretty new to Apache Flink. I'd like to ask you how we can manage running jobs. I've noticed one possibility
using UI running on 8081 by default, but I'm aiming to some java API. My problem is that I should be able
to dynamically add and remove jobs which are CEP rules because this rules could be changed at runtime.

Thank you,
Marek Svitok