Python and Scala

[Esa Heikkinen]

 

What the difference is to use Python and Scala in Flink ?

Can I do all the same things with Python and Scala ? For examples CEP with files.

 

 

[Piotr Nowojski]

Hi,

1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.

2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886

3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream

Piotrek

On 13 Feb 2018, at 13:21, Esa Heikkinen <[hidden email]> wrote:

 

What the difference is to use Python and Scala in Flink ?

Can I do all the same things with Python and Scala ? For examples CEP with files.

[Esa Heikkinen-2]

Hi

And what about the differences between Scala REPL and Scala (compiled) ?

Esa

Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:

Hi,

1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.

2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886

3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream

Piotrek

On 13 Feb 2018, at 13:21, Esa Heikkinen <[hidden email]> wrote:

 

What the difference is to use Python and Scala in Flink ?

Can I do all the same things with Python and Scala ? For examples CEP with files.

[Piotr Nowojski]

Hi

Scala REPL uses the same code as compiled library so they should work the same.

Piotrek

On 13 Feb 2018, at 18:32, Esa Heikkinen <[hidden email]> wrote:

Hi

And what about the differences between Scala REPL and Scala (compiled) ?

Esa

Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:

Hi,

1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.

2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886

3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream

Piotrek

On 13 Feb 2018, at 13:21, Esa Heikkinen <[hidden email]> wrote:

 

What the difference is to use Python and Scala in Flink ?

Can I do all the same things with Python and Scala ? For examples CEP with files.

[Esa Heikkinen]

Hi

 

Good news. Is it way to supply Scala-code from file to REPL ?

 

It seems the compiling is too complicated operation.. Actually I don’t get it to work yet.

 

Esa

 

From: Piotr Nowojski [mailto:[hidden email]]
Sent: Wednesday, February 14, 2018 10:55 AM
To: Esa Heikkinen <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; [hidden email]
Subject: Re: Python and Scala

 

Hi

 

Scala REPL uses the same code as compiled library so they should work the same.

 

Piotrek

On 13 Feb 2018, at 18:32, Esa Heikkinen <[hidden email]> wrote:

 

Hi

And what about the differences between Scala REPL and Scala (compiled) ?

Esa

Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:

Hi,

 

1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.

2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886

3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream

 

Piotrek

On 13 Feb 2018, at 13:21, Esa Heikkinen <[hidden email]> wrote:

 

 

What the difference is to use Python and Scala in Flink ?

Can I do all the same things with Python and Scala ? For examples CEP with files.

 

 

 

[Piotr Nowojski]

Hi,

I have never used it before, but it’s described in the documentation:

https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/scala_shell.html

the "Adding external dependencies” part. It should answer to this question.

Piotrek

On 14 Feb 2018, at 10:15, Esa Heikkinen <[hidden email]> wrote:

Hi

 

Good news. Is it way to supply Scala-code from file to REPL ?

 

It seems the compiling is too complicated operation.. Actually I don’t get it to work yet.

 

Esa

 

From: Piotr Nowojski [[hidden email]] 
Sent: Wednesday, February 14, 2018 10:55 AM
To: Esa Heikkinen <[hidden email]>
Cc: Esa Heikkinen <[hidden email]>; [hidden email]
Subject: Re: Python and Scala

 

Hi

 

Scala REPL uses the same code as compiled library so they should work the same.

 

Piotrek

On 13 Feb 2018, at 18:32, Esa Heikkinen <[hidden email]> wrote:

 

Hi

And what about the differences between Scala REPL and Scala (compiled) ?

Esa

Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:

Hi, 

 

1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.

2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886

3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream

 

Piotrek

On 13 Feb 2018, at 13:21, Esa Heikkinen <[hidden email]> wrote:

 

 

What the difference is to use Python and Scala in Flink ?

Can I do all the same things with Python and Scala ? For examples CEP with files.