[ANNOUNCE] Weekly Community Update 2019/50

[Konstantin Knauf-2]

Dear community,

happy to share this week's brief community digest with updates on Flink 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive setups, a couple of blog posts and a bit more.

Personal Note: Thank you for reading these updates since I started them early this year. I will take a three week Christmas break and will be back with a Holiday season community update on the 12th of January.

Flink Development

==============

* [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]

* [releases] The feature freeze for Apache Flink took place on Monday. The community is now working on testing, bug fixes and improving the documentation in order to create a first release candidate soon. [3]

* [development process] Seth has revived the discussion on a past PR by Marta, which added a documentation style guide to the contributor guide. Please check it [4] out, if you are contributing documentation to Apache Flink. [5]

* [security] Following a recent report to the Flink PMC of "exploiting" the Flink Web UI for remote code execution, Robert has started a discussion on how to improve the tooling/documentation to make users aware of this possibility and recommend securing this interface in production setups. [6]

* [sql] Bowen has started a discussion on how to simplify the Flink-Hive setup for new users as currently users need to add some additional dependencies to the classpath manually. The discussion seems to conclude towards providing a single additional hive-uber jar, which contains all the required dependencies. [7]

[1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html

[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html

[3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html

[4] https://github.com/apache/flink-web/pull/240

[5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html

[6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html

[7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html

Notable Bugs

==========

[FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not all tasks are in "RUNNING" state the job is not checkpointing afterwards. [8]

[8] https://issues.apache.org/jira/browse/FLINK-15152

Events, Blog Posts, Misc

===================

* Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]

* Gerred Dillon has published a blog post on the Apache Flink blog on how to run Flink on Kubernetes with a KUDO Flink operator. [10]

* In this blog post Apache Flink PMC Sun Jincheng outlines the reasons and motivation for his and his colleague's work to provide a world-class Python support for Apache Flink's Table API. [11]

* Upcoming Meetups

    * On December 17th there will be the second Apache Flink meetup in Seoul. [12] Dongwon has shared a detailed agenda in last weeks community update. [13]

    * On December 18th Alexander Fedulov will talk about Stateful Stream Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]

[9] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html

[10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html

[11] https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/

[12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/

[13] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html

[14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/

Cheers,

Konstantin (@snntrable)

--

[Hequn Cheng]

Hi Konstantin,

Happy holidays and thanks a lot for your great job on the updates continuously.
With the updates, it is easier for us to catch up with what's going on in the community, which I think is quite helpful.

I'm wondering if I can do some help and cover this during your vocation. :)

Best,
Hequn 

On Sun, Dec 15, 2019 at 11:36 PM Konstantin Knauf <[hidden email]> wrote:

Dear community,

happy to share this week's brief community digest with updates on Flink 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive setups, a couple of blog posts and a bit more.

Personal Note: Thank you for reading these updates since I started them early this year. I will take a three week Christmas break and will be back with a Holiday season community update on the 12th of January.

Flink Development

==============

* [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]

* [releases] The feature freeze for Apache Flink took place on Monday. The community is now working on testing, bug fixes and improving the documentation in order to create a first release candidate soon. [3]

* [development process] Seth has revived the discussion on a past PR by Marta, which added a documentation style guide to the contributor guide. Please check it [4] out, if you are contributing documentation to Apache Flink. [5]

* [security] Following a recent report to the Flink PMC of "exploiting" the Flink Web UI for remote code execution, Robert has started a discussion on how to improve the tooling/documentation to make users aware of this possibility and recommend securing this interface in production setups. [6]

* [sql] Bowen has started a discussion on how to simplify the Flink-Hive setup for new users as currently users need to add some additional dependencies to the classpath manually. The discussion seems to conclude towards providing a single additional hive-uber jar, which contains all the required dependencies. [7]

[1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html

[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html

[3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html

[4] https://github.com/apache/flink-web/pull/240

[5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html

[6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html

[7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html

Notable Bugs

==========

[FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not all tasks are in "RUNNING" state the job is not checkpointing afterwards. [8]

[8] https://issues.apache.org/jira/browse/FLINK-15152

Events, Blog Posts, Misc

===================

* Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]

* Gerred Dillon has published a blog post on the Apache Flink blog on how to run Flink on Kubernetes with a KUDO Flink operator. [10]

* In this blog post Apache Flink PMC Sun Jincheng outlines the reasons and motivation for his and his colleague's work to provide a world-class Python support for Apache Flink's Table API. [11]

* Upcoming Meetups

    * On December 17th there will be the second Apache Flink meetup in Seoul. [12] Dongwon has shared a detailed agenda in last weeks community update. [13]

    * On December 18th Alexander Fedulov will talk about Stateful Stream Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]

[9] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html

[10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html

[11] https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/

[12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/

[13] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html

[14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/

Cheers,

Konstantin (@snntrable)

--

Konstantin Knauf | Solutions Architect

[phone]

Follow us @VervericaData Ververica

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng

[Konstantin Knauf-2]

Hi Hequn,

thanks, and thanks for the offer. Of course, you can cover the holiday break, i.e. the next three weeks. Looking forward to your updates!

Cheers,

Konstantin

On Mon, Dec 16, 2019 at 5:53 AM Hequn Cheng <[hidden email]> wrote:

Hi Konstantin,

Happy holidays and thanks a lot for your great job on the updates continuously.
With the updates, it is easier for us to catch up with what's going on in the community, which I think is quite helpful.

I'm wondering if I can do some help and cover this during your vocation. :)

Best,
Hequn 

On Sun, Dec 15, 2019 at 11:36 PM Konstantin Knauf <[hidden email]> wrote:

Dear community,

happy to share this week's brief community digest with updates on Flink 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive setups, a couple of blog posts and a bit more.

Personal Note: Thank you for reading these updates since I started them early this year. I will take a three week Christmas break and will be back with a Holiday season community update on the 12th of January.

Flink Development

==============

* [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]

* [releases] The feature freeze for Apache Flink took place on Monday. The community is now working on testing, bug fixes and improving the documentation in order to create a first release candidate soon. [3]

* [development process] Seth has revived the discussion on a past PR by Marta, which added a documentation style guide to the contributor guide. Please check it [4] out, if you are contributing documentation to Apache Flink. [5]

* [security] Following a recent report to the Flink PMC of "exploiting" the Flink Web UI for remote code execution, Robert has started a discussion on how to improve the tooling/documentation to make users aware of this possibility and recommend securing this interface in production setups. [6]

* [sql] Bowen has started a discussion on how to simplify the Flink-Hive setup for new users as currently users need to add some additional dependencies to the classpath manually. The discussion seems to conclude towards providing a single additional hive-uber jar, which contains all the required dependencies. [7]

[1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html

[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html

[3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html

[4] https://github.com/apache/flink-web/pull/240

[5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html

[6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html

[7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html

Notable Bugs

==========

[FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not all tasks are in "RUNNING" state the job is not checkpointing afterwards. [8]

[8] https://issues.apache.org/jira/browse/FLINK-15152

Events, Blog Posts, Misc

===================

* Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]

* Gerred Dillon has published a blog post on the Apache Flink blog on how to run Flink on Kubernetes with a KUDO Flink operator. [10]

* In this blog post Apache Flink PMC Sun Jincheng outlines the reasons and motivation for his and his colleague's work to provide a world-class Python support for Apache Flink's Table API. [11]

* Upcoming Meetups

    * On December 17th there will be the second Apache Flink meetup in Seoul. [12] Dongwon has shared a detailed agenda in last weeks community update. [13]

    * On December 18th Alexander Fedulov will talk about Stateful Stream Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]

[9] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html

[10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html

[11] https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/

[12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/

[13] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html

[14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/

Cheers,

Konstantin (@snntrable)

--

Konstantin Knauf | Solutions Architect

[phone]

Follow us @VervericaData Ververica

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng

--

[Hequn Cheng]

Cool. I will do it in the next three weeks.

Thanks a lot for your continued great work!

Best, Hequn 

On Tue, Dec 17, 2019 at 6:16 PM Konstantin Knauf <[hidden email]> wrote:

Hi Hequn,

thanks, and thanks for the offer. Of course, you can cover the holiday break, i.e. the next three weeks. Looking forward to your updates!

Cheers,

Konstantin

On Mon, Dec 16, 2019 at 5:53 AM Hequn Cheng <[hidden email]> wrote:

Hi Konstantin,

Happy holidays and thanks a lot for your great job on the updates continuously.
With the updates, it is easier for us to catch up with what's going on in the community, which I think is quite helpful.

I'm wondering if I can do some help and cover this during your vocation. :)

Best,
Hequn 

On Sun, Dec 15, 2019 at 11:36 PM Konstantin Knauf <[hidden email]> wrote:

Dear community,

happy to share this week's brief community digest with updates on Flink 1.8.3 and Flink 1.10, a discussion on how to facilitate easier Flink/Hive setups, a couple of blog posts and a bit more.

Personal Note: Thank you for reading these updates since I started them early this year. I will take a three week Christmas break and will be back with a Holiday season community update on the 12th of January.

Flink Development

==============

* [releases] Apache Flink 1.8.3 was released on Wednesday. [1,2]

* [releases] The feature freeze for Apache Flink took place on Monday. The community is now working on testing, bug fixes and improving the documentation in order to create a first release candidate soon. [3]

* [development process] Seth has revived the discussion on a past PR by Marta, which added a documentation style guide to the contributor guide. Please check it [4] out, if you are contributing documentation to Apache Flink. [5]

* [security] Following a recent report to the Flink PMC of "exploiting" the Flink Web UI for remote code execution, Robert has started a discussion on how to improve the tooling/documentation to make users aware of this possibility and recommend securing this interface in production setups. [6]

* [sql] Bowen has started a discussion on how to simplify the Flink-Hive setup for new users as currently users need to add some additional dependencies to the classpath manually. The discussion seems to conclude towards providing a single additional hive-uber jar, which contains all the required dependencies. [7]

[1] https://flink.apache.org/news/2019/12/11/release-1.8.3.html

[2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-8-3-released-tp35868.html

[3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Feature-freeze-for-Apache-Flink-1-10-0-release-tp35139.html

[4] https://github.com/apache/flink-web/pull/240

[5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Docs-Style-Guide-Review-tp35758.html

[6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Improve-documentation-tooling-around-security-of-Flink-tp35898.html

[7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-have-separate-Flink-distributions-with-built-in-Hive-dependencies-tp35918.html

Notable Bugs

==========

[FLINK-15152] [1.9.1] When a "stop" action on a job fails, because not all tasks are in "RUNNING" state the job is not checkpointing afterwards. [8]

[8] https://issues.apache.org/jira/browse/FLINK-15152

Events, Blog Posts, Misc

===================

* Zhu Zhu is now an Apache Flink Comitter. Congratulations! [9]

* Gerred Dillon has published a blog post on the Apache Flink blog on how to run Flink on Kubernetes with a KUDO Flink operator. [10]

* In this blog post Apache Flink PMC Sun Jincheng outlines the reasons and motivation for his and his colleague's work to provide a world-class Python support for Apache Flink's Table API. [11]

* Upcoming Meetups

    * On December 17th there will be the second Apache Flink meetup in Seoul. [12] Dongwon has shared a detailed agenda in last weeks community update. [13]

    * On December 18th Alexander Fedulov will talk about Stateful Stream Processing with Apache Flink at the Java Professionals Meetup in Minsk. [14]

[9] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Zhu-Zhu-becomes-a-Flink-committer-tp35944.html

[10] https://flink.apache.org/news/2019/12/09/flink-kubernetes-kudo.html

[11] https://developpaper.com/why-will-apache-flink-1-9-0-support-the-python-api/

[12] https://www.meetup.com/Seoul-Apache-Flink-Meetup/events/266824815/

[13] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Weekly-Community-Update-2019-48-td35423.html

[14] https://www.meetup.com/Apache-Flink-Meetup-Minsk/events/267134296/

Cheers,

Konstantin (@snntrable)

--

Konstantin Knauf | Solutions Architect

[phone]

Follow us @VervericaData Ververica

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng

--

Konstantin Knauf | Solutions Architect

[phone]

Follow us @VervericaData Ververica

--

Join Flink Forward - The Apache Flink Conference

Stream Processing | Event Driven | Real Time

--

Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany

--

Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng