Re: Gracefully stop long running streaming job

Posted by Robert Schmidtke on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Gracefully-stop-long-running-streaming-job-tp6186p6188.html

I'm on 0.10.2 which seems to be still lacking this feature. Anyway I'm happy to see it'll be in future releases, so I'll get to enjoy it once I upgrade :) I'm using a FlinkKafkaConsumer081 for the record.

Anyway, thanks a bunch

Robert

On Tue, Apr 19, 2016 at 12:14 AM, Matthias J. Sax <[hidden email]> wrote:

If all your sources implements Stoppable interface, you can STOP a job.

./bin/flink stop JobID

STOP is however quite new and it is ongoing work to make available
sources stoppable (some are already). Not sure what kind of sources you
are using right now.

-Matthias

On 04/18/2016 10:50 PM, Robert Schmidtke wrote:
> Hi everyone,
>
> I am running a streaming benchmark which involves a potentially
> infinitely running Flink Streaming Job. I run it blocking on YARN using
> ./bin/flink run ... and then send the command into background,
> remembering its PID to kill it later on. While this gets the work done,
> the job always ends up in the FAILED state. I imagine it would be the
> same if I used ./bin/flink cancel ... to cancel the job? It's not that
> pressing but it would be nice to shut down a streaming job properly.
>
> Thanks
>
> Robert
>
> --
> My GPG Key ID: 336E2680

--