Flink issue in emitting data to same sideoutput from onTimer and processElement

Hi,

I have a coProcessFunction which emits data to same side output from processElement1 method and on timer method.But, data is not getting emitted to sideoutput from onTimer. Is it like to the same sideoutput, we can not emit data from onTimer and processElement methods?

Get Outlook for Android

I am using KeyedCoProcessFunction

Get Outlook for Android

---

From: Jaswin Shah
Sent: Friday, August 14, 2020 3:09:21 PM
To: [hidden email] <[hidden email]>; Dawid Wysakowicz <[hidden email]>; Yun Tang <[hidden email]>
Subject: Flink issue in emitting data to same sideoutput from onTimer and processElement

 

Hi,

I have a coProcessFunction which emits data to same side output from processElement1 method and on timer method.But, data is not getting emitted to sideoutput from onTimer. Is it like to the same sideoutput, we can not emit data from onTimer and processElement methods?

Get Outlook for Android

[Dawid Wysakowicz-2]

It should work just fine. Can you share a minimal reproducible example we can debug if the problem still remains?

Best,

Dawid

On 14/08/2020 11:39, Jaswin Shah wrote:

I am using KeyedCoProcessFunction

Get Outlook for Android

---

From: Jaswin Shah
Sent: Friday, August 14, 2020 3:09:21 PM
To: [hidden email] [hidden email]; Dawid Wysakowicz [hidden email]; Yun Tang [hidden email]
Subject: Flink issue in emitting data to same sideoutput from onTimer and processElement

 

Hi,

I have a coProcessFunction which emits data to same side output from processElement1 method and on timer method.But, data is not getting emitted to sideoutput from onTimer. Is it like to the same sideoutput, we can not emit data from onTimer and processElement methods?

Get Outlook for Android

Please find snippets of code for which I am getting this issue.From onTimer, even event is coming(debuged with log) its not getting emitted to sideoutput but same is being emitted from processElement1. I am executing this on standalone local machine cluster.

---

From: Dawid Wysakowicz
Sent: Friday, August 14, 2020 15:17
To: Jaswin Shah; [hidden email]
Subject: Re: Flink issue in emitting data to same sideoutput from onTimer and processElement

It should work just fine. Can you share a minimal reproducible example we can debug if the problem still remains?

Best,

Dawid

On 14/08/2020 11:39, Jaswin Shah wrote:

I am using KeyedCoProcessFunction

Get Outlook for Android

---

From: Jaswin Shah
Sent: Friday, August 14, 2020 3:09:21 PM
To: [hidden email] [hidden email]; Dawid Wysakowicz [hidden email]; Yun Tang [hidden email]
Subject: Flink issue in emitting data to same sideoutput from onTimer and processElement

 

Hi,

I have a coProcessFunction which emits data to same side output from processElement1 method and on timer method.But, data is not getting emitted to sideoutput from onTimer. Is it like to the same sideoutput, we can not emit data from onTimer and processElement methods?

Get Outlook for Android

[Fabian Hueske-2]

Hi Jaswin,

Which version are you using?

I couldn't reproduce the problem.

Here's a Gist with my code [1].

I'd recommend to simplify your setup (similar to mine) and then start to add more complexity (like state).

Best, Fabian

[1] https://gist.github.com/fhueske/e7820b47c2f8739931e9fc1a66d2268e

Am Fr., 14. Aug. 2020 um 13:51 Uhr schrieb Jaswin Shah <[hidden email]>:

Please find snippets of code for which I am getting this issue.From onTimer, even event is coming(debuged with log) its not getting emitted to sideoutput but same is being emitted from processElement1. I am executing this on standalone local machine cluster.

---

From: Dawid Wysakowicz
Sent: Friday, August 14, 2020 15:17
To: Jaswin Shah; [hidden email]
Subject: Re: Flink issue in emitting data to same sideoutput from onTimer and processElement

It should work just fine. Can you share a minimal reproducible example we can debug if the problem still remains?

Best,

Dawid

On 14/08/2020 11:39, Jaswin Shah wrote:

I am using KeyedCoProcessFunction

Get Outlook for Android

---

From: Jaswin Shah
Sent: Friday, August 14, 2020 3:09:21 PM
To: [hidden email] [hidden email]; Dawid Wysakowicz [hidden email]; Yun Tang [hidden email]
Subject: Flink issue in emitting data to same sideoutput from onTimer and processElement

 

Hi,

I have a coProcessFunction which emits data to same side output from processElement1 method and on timer method.But, data is not getting emitted to sideoutput from onTimer. Is it like to the same sideoutput, we can not emit data from onTimer and processElement methods?

Get Outlook for Android