Flink Cluster and Pipeline Version Compatibility?

[jlist9]

I was trying to find some comparability tables between various versions of Flink clusters and pipeline jars but haven't run into any so far. Is it so that the pipeline jars must be build with the same version of the cluster they'll be running on? Or there are some backward comparability? If it's already documented/discussed somewhere a link would be appreciated.

Jack

[Hequn Cheng]

Hi, jlist9

>  Is it so that the pipeline jars must be build with the same version of the cluster they'll be running on?

Most interfaces are supported for backward comparability. And the closer the flink version is, the smaller the differences between interfaces. However, it is not for sure. Hence, it is recommended to build your jars with the version of the cluster.

Best, Hequn

On Fri, Jul 27, 2018 at 1:59 AM, jlist9 <[hidden email]> wrote:

I was trying to find some comparability tables between various versions of Flink clusters and pipeline jars but haven't run into any so far. Is it so that the pipeline jars must be build with the same version of the cluster they'll be running on? Or there are some backward comparability? If it's already documented/discussed somewhere a link would be appreciated.

Jack

[vino yang]

Hi Jlist9:

Most of Flink's APIs try to ensure backward compatibility. But no documentation gives all APIs to do this. With the development of Flink, some features have changed dramatically, such as State, so Flink's official website gives the migration guidance document[1]. So, my personal suggestion is that the best choice is that the cluster is consistent with the version of the Flink API that the Job depends on, especially the Major version of Flink.

[1]: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/migration.html

Thanks, vino.

2018-07-27 19:57 GMT+08:00 Hequn Cheng <[hidden email]>:

Hi, jlist9

>  Is it so that the pipeline jars must be build with the same version of the cluster they'll be running on?

Most interfaces are supported for backward comparability. And the closer the flink version is, the smaller the differences between interfaces. However, it is not for sure. Hence, it is recommended to build your jars with the version of the cluster.

Best, Hequn

On Fri, Jul 27, 2018 at 1:59 AM, jlist9 <[hidden email]> wrote:

I was trying to find some comparability tables between various versions of Flink clusters and pipeline jars but haven't run into any so far. Is it so that the pipeline jars must be build with the same version of the cluster they'll be running on? Or there are some backward comparability? If it's already documented/discussed somewhere a link would be appreciated.

Jack