Java implementations of Streaming applications for Flink

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Java implementations of Streaming applications for Flink

Piper Piper

Hi all,

The examples in the Flink github repo do not seem to include many standard streaming applications compared to the batch examples.

Where can I get standard (recommended) Java implementations of “Streaming” applications for Flink, that are clearly: (1) CPU-intensive, like streaming PageRank, streaming K-Means, etc., and (2) I/O-intensive, and if possible also,  (3) Network intensive?

By "standard", I mean Java implementations that are accepted by the community in terms of efficiency.

Thank you,

Piper

Reply | Threaded
Open this post in threaded view
|

Re: Java implementations of Streaming applications for Flink

rmetzger0
Hey Piper,

Here's an example for a more advanced Flink application: https://flink.apache.org/news/2020/01/15/demo-fraud-detection.html
The Flink developers internally maintain a number of testing jobs. They are rather artificial, but you still might find some useful things here and there: https://github.com/apache/flink/tree/master/flink-end-to-end-tests

Best,
Robert


On Mon, Feb 24, 2020 at 9:38 AM Piper Piper <[hidden email]> wrote:

Hi all,

The examples in the Flink github repo do not seem to include many standard streaming applications compared to the batch examples.

Where can I get standard (recommended) Java implementations of “Streaming” applications for Flink, that are clearly: (1) CPU-intensive, like streaming PageRank, streaming K-Means, etc., and (2) I/O-intensive, and if possible also,  (3) Network intensive?

By "standard", I mean Java implementations that are accepted by the community in terms of efficiency.

Thank you,

Piper

Reply | Threaded
Open this post in threaded view
|

Re: Java implementations of Streaming applications for Flink

Piper Piper
Very informative. Thank you, Robert!

On Tue, Feb 25, 2020 at 5:02 AM Robert Metzger <[hidden email]> wrote:
Hey Piper,

Here's an example for a more advanced Flink application: https://flink.apache.org/news/2020/01/15/demo-fraud-detection.html
The Flink developers internally maintain a number of testing jobs. They are rather artificial, but you still might find some useful things here and there: https://github.com/apache/flink/tree/master/flink-end-to-end-tests

Best,
Robert


On Mon, Feb 24, 2020 at 9:38 AM Piper Piper <[hidden email]> wrote:

Hi all,

The examples in the Flink github repo do not seem to include many standard streaming applications compared to the batch examples.

Where can I get standard (recommended) Java implementations of “Streaming” applications for Flink, that are clearly: (1) CPU-intensive, like streaming PageRank, streaming K-Means, etc., and (2) I/O-intensive, and if possible also,  (3) Network intensive?

By "standard", I mean Java implementations that are accepted by the community in terms of efficiency.

Thank you,

Piper