Flink mini IDEA runtime

[Pavel Ciorba]

Hi all!

From what I know, Flink jobs can be run straight from the IDE because IDEA will create a mini Flink runtime.

What is the underlying CLI command that Jetbarins IDEA issues to run a Flink job in a mini-runtime?

My use case is that I want to see if the job written using the SQL API is valid. So the plan is to run the job on a VM in a mini Flink runtime to see whether it will throw an exception or not. If it is healthy, deploy it in the main cluster.

Maybe you have some advice about this, or just an answer to the first question :)

Thanks!

[Jörn Franke]

You can run them in a localenvironment. I do it for my integration tests everytime:

flinkEnvironment = ExecutionEnvironment.createLocalEnvironment(1)

Eg (even together with a local HDFS cluster) https://github.com/ZuInnoTe/hadoopcryptoledger/blob/master/examples/scala-flink-ethereumblock/src/it/scala/org/zuinnote/flink/ethereum/example/FlinkEthereumBlockCounterFlinkMasterIntegrationSpec.scala

On 22. Jul 2018, at 12:42, Pavel Ciorba <[hidden email]> wrote:

Hi all!

From what I know, Flink jobs can be run straight from the IDE because IDEA will create a mini Flink runtime.

What is the underlying CLI command that Jetbarins IDEA issues to run a Flink job in a mini-runtime?

My use case is that I want to see if the job written using the SQL API is valid. So the plan is to run the job on a VM in a mini Flink runtime to see whether it will throw an exception or not. If it is healthy, deploy it in the main cluster.

Maybe you have some advice about this, or just an answer to the first question :)

Thanks!

[Pavel Ciorba]

Thanks Jorn!

2018-07-22 13:53 GMT+03:00 Jörn Franke <[hidden email]>:

You can run them in a localenvironment. I do it for my integration tests everytime:

flinkEnvironment = ExecutionEnvironment.createLocalEnvironment(1)

Eg (even together with a local HDFS cluster) https://github.com/ZuInnoTe/hadoopcryptoledger/blob/master/examples/scala-flink-ethereumblock/src/it/scala/org/zuinnote/flink/ethereum/example/FlinkEthereumBlockCounterFlinkMasterIntegrationSpec.scala

On 22. Jul 2018, at 12:42, Pavel Ciorba <[hidden email]> wrote:

Hi all!

From what I know, Flink jobs can be run straight from the IDE because IDEA will create a mini Flink runtime.

What is the underlying CLI command that Jetbarins IDEA issues to run a Flink job in a mini-runtime?

My use case is that I want to see if the job written using the SQL API is valid. So the plan is to run the job on a VM in a mini Flink runtime to see whether it will throw an exception or not. If it is healthy, deploy it in the main cluster.

Maybe you have some advice about this, or just an answer to the first question :)

Thanks!