tumbling time window, date boundary and timezone

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

tumbling time window, date boundary and timezone

Hironori Ogibayashi
Hello,

I want to calculate daily access count using Flink streaming.
Flink's TumblingProcessingTimeWindow assigns events to windows of
00:00 GMT to 23:59 GMT each day, but I live in Japan (GMT+09:00) and
want date boundaries to be 09:00 GMT (00:00 JST).
Do I have to implement my own WindowAssigner for this use case?

Thanks,
Hironori Ogibayashi
Reply | Threaded
Open this post in threaded view
|

Re: tumbling time window, date boundary and timezone

Aljoscha Krettek
Hi,
yes, I'm afraid you would have to use a custom version of the TumblingProcessingTimeWindows right now.

I've opened a Jira issue for adding an offset setting to the built-in window assigners: https://issues.apache.org/jira/browse/FLINK-4282

Cheers,
Aljoscha

On Tue, 26 Jul 2016 at 12:51 Hironori Ogibayashi <[hidden email]> wrote:
Hello,

I want to calculate daily access count using Flink streaming.
Flink's TumblingProcessingTimeWindow assigns events to windows of
00:00 GMT to 23:59 GMT each day, but I live in Japan (GMT+09:00) and
want date boundaries to be 09:00 GMT (00:00 JST).
Do I have to implement my own WindowAssigner for this use case?

Thanks,
Hironori Ogibayashi
Reply | Threaded
Open this post in threaded view
|

Re: tumbling time window, date boundary and timezone

Hironori Ogibayashi
Aljoscha,

Thank you for your response.
It would be great if offset setting is available out-of-the box.
In the meantime, I will use my custom version.

Regards,
Hironori

2016-07-29 19:29 GMT+09:00 Aljoscha Krettek <[hidden email]>:

> Hi,
> yes, I'm afraid you would have to use a custom version of the
> TumblingProcessingTimeWindows right now.
>
> I've opened a Jira issue for adding an offset setting to the built-in window
> assigners: https://issues.apache.org/jira/browse/FLINK-4282
>
> Cheers,
> Aljoscha
>
> On Tue, 26 Jul 2016 at 12:51 Hironori Ogibayashi <[hidden email]>
> wrote:
>>
>> Hello,
>>
>> I want to calculate daily access count using Flink streaming.
>> Flink's TumblingProcessingTimeWindow assigns events to windows of
>> 00:00 GMT to 23:59 GMT each day, but I live in Japan (GMT+09:00) and
>> want date boundaries to be 09:00 GMT (00:00 JST).
>> Do I have to implement my own WindowAssigner for this use case?
>>
>> Thanks,
>> Hironori Ogibayashi