python vs java api

[Nicos Maris]

Which java features of flink are not supported by the python API when writing a pipeline?

[vino yang]

Hi Nicos,

You can read the official documentation of latest Python API about DataStream transformation[1] and latest Java API transformation[2].

However, the latest documentation may not react the new feature especially for Python API, so you can also compare the implementation of DataStream(java)[3] and PythonDataStream [4]. Note, for [3], it's not completed because some API exists in other stream objects such keyed data stream.

[1]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/python.html#transformations

[2]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/operators/index.html#datastream-transformations

[3]: https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStream.java

[4]: https://github.com/apache/flink/blob/master/flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/datastream/PythonDataStream.java

Thanks, vino.

2018-07-31 22:59 GMT+08:00 Nicos Maris <[hidden email]>:

Which java features of flink are not supported by the python API when writing a pipeline?

[Nicos Maris]

Thanks Vino,

Comparing functionalities in terms of the transformations is clear but what about timestamps and state?

On Tue, Jul 31, 2018 at 6:47 PM vino yang <[hidden email]> wrote:

Hi Nicos,

You can read the official documentation of latest Python API about DataStream transformation[1] and latest Java API transformation[2].

However, the latest documentation may not react the new feature especially for Python API, so you can also compare the implementation of DataStream(java)[3] and PythonDataStream [4]. Note, for [3], it's not completed because some API exists in other stream objects such keyed data stream.

[1]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/python.html#transformations

[2]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/operators/index.html#datastream-transformations

[3]: https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStream.java

[4]: https://github.com/apache/flink/blob/master/flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/datastream/PythonDataStream.java

Thanks, vino.

2018-07-31 22:59 GMT+08:00 Nicos Maris <[hidden email]>:

Which java features of flink are not supported by the python API when writing a pipeline?

[vino yang]

Hi Nicos,

For Checkpoint you can see the API in PythonStreamExecutionEnvironment.

But it can not set TimeCharacteristic now. I will create a JIRA issue for this. 

Thanks, vino.

2018-08-01 0:15 GMT+08:00 Nicos Maris <[hidden email]>:

Thanks Vino,

Comparing functionalities in terms of the transformations is clear but what about timestamps and state?

On Tue, Jul 31, 2018 at 6:47 PM vino yang <[hidden email]> wrote:

Hi Nicos,

You can read the official documentation of latest Python API about DataStream transformation[1] and latest Java API transformation[2].

However, the latest documentation may not react the new feature especially for Python API, so you can also compare the implementation of DataStream(java)[3] and PythonDataStream [4]. Note, for [3], it's not completed because some API exists in other stream objects such keyed data stream.

[1]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/python.html#transformations

[2]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/stream/operators/index.html#datastream-transformations

[3]: https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/datastream/DataStream.java

[4]: https://github.com/apache/flink/blob/master/flink-libraries/flink-streaming-python/src/main/java/org/apache/flink/streaming/python/api/datastream/PythonDataStream.java

Thanks, vino.

2018-07-31 22:59 GMT+08:00 Nicos Maris <[hidden email]>:

Which java features of flink are not supported by the python API when writing a pipeline?