LocalEnvironment and Python streaming

[Joe Malt]

Hi,

Is there any way to execute a job using the LocalEnvironment when using the Python streaming API? This would make it much easier to debug jobs.

At the moment I'm not aware of any way of running them except firing up a local cluster and submitting the job with pyflink-stream.sh.

Thanks,

Joe Malt

Engineering Intern, Stream Processing

Yelp

[vino yang]

Hi Joe,

Maybe Chesnay is better suited to answer this question, Ping him for you.

Thanks, vino.

Joe Malt <[hidden email]> 于2018年9月15日周六 上午1:51写道：

Hi,

Is there any way to execute a job using the LocalEnvironment when using the Python streaming API? This would make it much easier to debug jobs.

At the moment I'm not aware of any way of running them except firing up a local cluster and submitting the job with pyflink-stream.sh.

Thanks,

Joe Malt

Engineering Intern, Stream Processing

Yelp

[Chesnay Schepler]

No, this isn't really possible. You need a java process to kick off the processing.

The only thing i can come up with is to open the flink-streaming-python module in the IDE and manually call the PythonStreamBinder class with the same arguments that you pass in the CLI as a test.

On 17.09.2018 04:35, vino yang wrote:

Hi Joe,

Maybe Chesnay is better suited to answer this question, Ping him for you.

Thanks, vino.

Joe Malt <[hidden email]> 于2018年9月15日周六 上午1:51写道：

Hi,

Is there any way to execute a job using the LocalEnvironment when using the Python streaming API? This would make it much easier to debug jobs.

At the moment I'm not aware of any way of running them except firing up a local cluster and submitting the job with pyflink-stream.sh.

Thanks,

Joe Malt

Engineering Intern, Stream Processing

Yelp