[ANNOUNCE] Weekly Community Update 2019/42

[Konstantin Knauf-2]

Dear community,

happy to share this week's community update with the release of Flink 1.9.1, a couple of threads about our development process, the sql ecosystem and more.

Flink Development

==============

* [releases] Apache Flink 1.9.1 was released. [1,2]

* [statefun] Stephan has started a separate discussion on whether to maintain Stateful Functions in a separate repository or the Flink main repository after its contribution to Apache Flink. The majority seems to prefer a separate repository e.g. to enable quicker iterations on the new code base and not to overwhelm new contributors to Stateful Functions. [3]

* [development process] The NOTICE file and the directory for licenses of bundled dependencies for binary releases is now auto-generated during the release process. [4]

* [development process] According to our FLIP process the introduction of a new config option requires a FLIP (and vote). Aljoscha has started a discussion to clarify this point, as this is currently not always the case. Looks like the majority leans towards a vote for every configuration change, but possibly making it more lightweight than a proper FLIP. [5]

* [development process] Xiyuan gave an update on Flink's ARM support. Travis ARM Support is in alpha now (alternative to previously proposed OpenLab), and regardless of the CI system

Xiyuan points the community to a list of PRs/Jiras, which need to be solved/reviewed. [6]

* [configuration] The discussion on FLIP-59 to make the execution configuration (ExecutionConfig et al.) configurable via the Flink Configuration has been revived a bit and focuses on alignment with FLIP-73 and naming of the different configurations now. [7]

* [sql] Based on feedback from the user community, Timo proposes to rename the "ANY" datatype "OPAQUE" highlighting that a field of type "ANY" does not hold any type, but a data type that is unknown to Flink. [8]

* [sql] Jark has started a discussion on FLIP-80 [9] about how to de/serialize expressions in catalogs. [10]

[1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-9-1-released-tp34170.html

[2] https://flink.apache.org/news/2019/10/18/release-1.9.1.html

[3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Stateful-Functions-in-which-form-to-contribute-same-or-different-repository-tp34034.html

[4] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/NOTICE-Binary-licensing-is-now-auto-generated-tp34121.html

[5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-policy-for-introducing-config-option-keys-tp34011p34045.html

[6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ARM-support-Travis-ARM-CI-is-now-in-Alpha-Release-tp34039.html

[7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-59-Enable-execution-configuration-from-Configuration-object-tp32359.html

[8] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Rename-the-SQL-ANY-type-to-OPAQUE-type-tp34162.html

[9] https://docs.google.com/document/d/1LxPEzbPuEVWNixb1L_USv0gFgjRMgoZuMsAecS_XvdE/edit?usp=sharing

[10] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISUCSS-FLIP-80-Expression-String-Serializable-and-Deserializable-tp34146.html

Notable Bugs

==========

* [FLINK-14429] [1.9.1] [1.8.2] When you run a batch job on YARN in non-detached mode, it will be reported as SUCCEEDED if when it actually FAILED. [11]

[11] https://issues.apache.org/jira/browse/FLINK-14429

Events, Blog Posts, Misc

===================

* This discussion on the dev@ mailing list might be interesting to follow for people using the StreamingFileSink or BucketingSink with S3.  [12]

* There will be full-day meetup with six talks in the Bangalore Kafka Group on the 2nd of November including at least three Flink talks by Timo Walter (Ververica), Shashank Agarwal (Razorpay) and Rasyid Hakim (GoJek).  [13]

[12] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/performances-of-S3-writing-with-many-buckets-in-parallel-tp34021p34050.html

[13] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/

Cheers,

Konstantin (@snntrable)

--