Flink Streaming - WriteAsText

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Flink Streaming - WriteAsText

Ankur Sharma
Hey,

I am trying to use ContinuousProcessingTimeTrigger which fires TimeWindow every 5 seconds. But even though I explicitly state that the output of apply() method should be dumped to file every 10 seconds, I don’t see the file getting appended. When I cancel the job, I see all the dumps which are not visible earlier.

I also tried writing the result to socket but it also has same effect.

Please help.

Best,
Ankur Sharma
Information Systems Group
3.15 E1.1 Universität des Saarlandes
66123, Saarbrücken Germany
Email: [hidden email] 
            [hidden email]

smime.p7s (6K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Flink Streaming - WriteAsText

Maximilian Michels
Hey Ankur,

If the output after cancelling the job is correct, I assume the
changes haven't been flushed to disk before. For further
investigation, could you share some code with us?

Cheers,
Max

On Wed, Feb 24, 2016 at 8:54 PM, Ankur Sharma
<[hidden email]> wrote:

> Hey,
>
> I am trying to use ContinuousProcessingTimeTrigger which fires TimeWindow
> every 5 seconds. But even though I explicitly state that the output of
> apply() method should be dumped to file every 10 seconds, I don’t see the
> file getting appended. When I cancel the job, I see all the dumps which are
> not visible earlier.
>
> I also tried writing the result to socket but it also has same effect.
>
> Please help.
>
> Best,
> Ankur Sharma
> Information Systems Group
> 3.15 E1.1 Universität des Saarlandes
> 66123, Saarbrücken Germany
> Email: [hidden email]
>             [hidden email]