[NOTICE] Flink Kinesis Producer for versions 1.4.2 and below needs to be built with higher AWS KPL version

[Tzu-Li (Gordon) Tai]

Hi,

This is a notice for users who use the Flink Kinesis connector to produce data to AWS Kinesis Streams, with Flink versions 1.4.2 or below.

For Flink versions 1.4.2 and below, the KPL client version used by default in the Kinesis connectors, KPL 0.12.5, is no longer supported by AWS Kinesis Streams (see [1]).

This means that when building the Kinesis connector, you will need to specify a higher version KPL client (above 0.12.6) in order for the Flink Kinesis Producer to work (please see [2] for instructions).

All Flink release versions above 1.4.2 have also upgraded the KPL version used by default, so it is also possible to fix this by upgrade the Flink version used.

Cheers,

Gordon

[1] https://docs.aws.amazon.com/streams/latest/dev/kinesis-kpl-upgrades.html

[2] https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/kinesis.html