Flink and Docker ?

[Esa Heikkinen]

Hi

 

I have noticed that Flink can be pretty tedious to install and build first applications from scratch. Especially if the application is little bit complex. There are also little bit different development and run time environments, which require different software components with correct versions.

 

I found Docker could help with this problem:

https://flink.apache.org/news/2017/05/16/official-docker-image.html

 

Has anyone used Flink with Docker and what are the experiences about using it ?

 

Do you recommend to use Flink with Docker ?

 

Can there be a problem with different versions, if some software component is not correct or latest in the Docker image ?

 

Best, Esa

 

[Christophe Salperwyck]

Hi,

I didn't try docker with Flink but I know that those guys did:

https://github.com/big-data-europe/docker-flink

Perhaps it is worth having a look there.

BR,

Christophe

2018-04-03 9:29 GMT+02:00 Esa Heikkinen <[hidden email]>:

Hi

 

I have noticed that Flink can be pretty tedious to install and build first applications from scratch. Especially if the application is little bit complex. There are also little bit different development and run time environments, which require different software components with correct versions.

 

I found Docker could help with this problem:

https://flink.apache.org/news/2017/05/16/official-docker-image.html

 

Has anyone used Flink with Docker and what are the experiences about using it ?

 

Do you recommend to use Flink with Docker ?

 

Can there be a problem with different versions, if some software component is not correct or latest in the Docker image ?

 

Best, Esa

 

[Hao Sun]

Hi, we are using this docker on K8S + S3.
https://github.com/docker-flink/docker-flink

It works fine for us.

On Tue, Apr 3, 2018 at 1:00 AM Christophe Salperwyck <[hidden email]> wrote:

Hi,

I didn't try docker with Flink but I know that those guys did:

https://github.com/big-data-europe/docker-flink

Perhaps it is worth having a look there.

BR,

Christophe

2018-04-03 9:29 GMT+02:00 Esa Heikkinen <[hidden email]>:

Hi

 

I have noticed that Flink can be pretty tedious to install and build first applications from scratch. Especially if the application is little bit complex. There are also little bit different development and run time environments, which require different software components with correct versions.

 

I found Docker could help with this problem:

https://flink.apache.org/news/2017/05/16/official-docker-image.html

 

Has anyone used Flink with Docker and what are the experiences about using it ?

 

Do you recommend to use Flink with Docker ?

 

Can there be a problem with different versions, if some software component is not correct or latest in the Docker image ?

 

Best, Esa