Hello World Flink 0.10

[Kamil Gorlo]

Hi guys,

I was trying to implement Hello World from slide 36 from http://www.slideshare.net/FlinkForward/k-tzoumas-s-ewen-flink-forward-keynote

but I have problem with EOFTrigger - is it something I should implement by myself? I cannot find it in Flink libraries.

Cheers,

Kamil

[rmetzger0]

Hi Kamil,

The EOFTrigger is not part of Flink.

However, I've also tried implementing the Hello World from the presentation here: https://github.com/rmetzger/scratch/blob/flink0.10-scala2.11/src/main/scala/com/dataartisans/Job.scala

Stephan Ewen told me that there is a more elegant way of implementing this: The trigger is actually not needed because windows trigger when they are closed (and they are closed when the file has been read). So you can also remove my hack of emitting a fake record at the end of the read process in the close() method.

On Fri, Nov 13, 2015 at 10:52 AM, Kamil Gorlo <[hidden email]> wrote:

Hi guys,

I was trying to implement Hello World from slide 36 from http://www.slideshare.net/FlinkForward/k-tzoumas-s-ewen-flink-forward-keynote

but I have problem with EOFTrigger - is it something I should implement by myself? I cannot find it in Flink libraries.

Cheers,

Kamil

[Kamil Gorlo]

OK, so as far as I understand the line ".trigger(new EOFTrigger)" is simply not needed in this case (it looks that it works as expected when I remove it).

Thanks for your help.

pt., 13.11.2015 o 11:01 użytkownik Robert Metzger <[hidden email]> napisał:

Hi Kamil,

The EOFTrigger is not part of Flink.

However, I've also tried implementing the Hello World from the presentation here: https://github.com/rmetzger/scratch/blob/flink0.10-scala2.11/src/main/scala/com/dataartisans/Job.scala

Stephan Ewen told me that there is a more elegant way of implementing this: The trigger is actually not needed because windows trigger when they are closed (and they are closed when the file has been read). So you can also remove my hack of emitting a fake record at the end of the read process in the close() method.

On Fri, Nov 13, 2015 at 10:52 AM, Kamil Gorlo <[hidden email]> wrote:

Hi guys,

I was trying to implement Hello World from slide 36 from http://www.slideshare.net/FlinkForward/k-tzoumas-s-ewen-flink-forward-keynote

but I have problem with EOFTrigger - is it something I should implement by myself? I cannot find it in Flink libraries.

Cheers,

Kamil

[rmetzger0]

Hi,

yes, you can remove the line with the trigger.

Here is a version of the code without the trigger: https://github.com/rmetzger/scratch/blob/flink0.10-scala2.11/src/main/scala/com/dataartisans/JobWithoutTrigger.scala

On Fri, Nov 13, 2015 at 11:29 AM, Kamil Gorlo <[hidden email]> wrote:

OK, so as far as I understand the line ".trigger(new EOFTrigger)" is simply not needed in this case (it looks that it works as expected when I remove it).

Thanks for your help.

pt., 13.11.2015 o 11:01 użytkownik Robert Metzger <[hidden email]> napisał:

Hi Kamil,

The EOFTrigger is not part of Flink.

However, I've also tried implementing the Hello World from the presentation here: https://github.com/rmetzger/scratch/blob/flink0.10-scala2.11/src/main/scala/com/dataartisans/Job.scala

Stephan Ewen told me that there is a more elegant way of implementing this: The trigger is actually not needed because windows trigger when they are closed (and they are closed when the file has been read). So you can also remove my hack of emitting a fake record at the end of the read process in the close() method.

On Fri, Nov 13, 2015 at 10:52 AM, Kamil Gorlo <[hidden email]> wrote:

Hi guys,

I was trying to implement Hello World from slide 36 from http://www.slideshare.net/FlinkForward/k-tzoumas-s-ewen-flink-forward-keynote

but I have problem with EOFTrigger - is it something I should implement by myself? I cannot find it in Flink libraries.

Cheers,

Kamil