How do I initialize the window state on first run?

[bupt_ljy]

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

[vino yang]

Hi Jiayi,

If you don't mind, I would like to ask you what kind of situation do you have in this situation?

Thanks, vino.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午1:59写道：

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

[bupt_ljy]

Hi, vivo,

    My Flink program is to aggregate the data of a whole day, assume we start this program on 6:00 am, the default state in the window should be the aggregated result of 0:00 am to 6:00 am.

 Original Message 

Sender: vino yang<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: user<[hidden email]>

Date: Friday, Oct 12, 2018 15:13

Subject: Re: How do I initialize the window state on first run?

Hi Jiayi,

If you don't mind, I would like to ask you what kind of situation do you have in this situation?

Thanks, vino.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午1:59写道：

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

[Congxian Qiu]

IIUC, we can't  initialize state at first run,  maybe you could store the aggregated data in another place other than use flink's state, then use flink to aggregate the data realtime.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午3:33写道：

Hi, vivo,

    My Flink program is to aggregate the data of a whole day, assume we start this program on 6:00 am, the default state in the window should be the aggregated result of 0:00 am to 6:00 am.

 Original Message 

Sender: vino yang<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: user<[hidden email]>

Date: Friday, Oct 12, 2018 15:13

Subject: Re: How do I initialize the window state on first run?

Hi Jiayi,

If you don't mind, I would like to ask you what kind of situation do you have in this situation?

Thanks, vino.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午1:59写道：

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

--

[bupt_ljy]

Yes…that’s an option, but it’ll be very complicated because of our storage and business. 

Now I’m trying to write an handler like the “KvStateHandler” so that I can access(read/write) the state from my client.

 Original Message 

Sender: Congxian Qiu<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: yanghua1127<[hidden email]>; user<[hidden email]>

Date: Friday, Oct 12, 2018 20:14

Subject: Re: How do I initialize the window state on first run?

IIUC, we can't  initialize state at first run,  maybe you could store the aggregated data in another place other than use flink's state, then use flink to aggregate the data realtime.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午3:33写道：

Hi, vivo,

    My Flink program is to aggregate the data of a whole day, assume we start this program on 6:00 am, the default state in the window should be the aggregated result of 0:00 am to 6:00 am.

 Original Message 

Sender: vino yang<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: user<[hidden email]>

Date: Friday, Oct 12, 2018 15:13

Subject: Re: How do I initialize the window state on first run?

Hi Jiayi,

If you don't mind, I would like to ask you what kind of situation do you have in this situation?

Thanks, vino.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午1:59写道：

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

--

[Rafi Aroch]

Hi Jiayi, 

This topic has been discussed by others, take a look here for some options by Lyft: https://youtu.be/WdMcyN5QZZQ

Rafi

On Fri, Oct 12, 2018, 16:51 bupt_ljy <[hidden email]> wrote:

Yes…that’s an option, but it’ll be very complicated because of our storage and business. 

Now I’m trying to write an handler like the “KvStateHandler” so that I can access(read/write) the state from my client.

 Original Message 

Sender: Congxian Qiu<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: yanghua1127<[hidden email]>; user<[hidden email]>

Date: Friday, Oct 12, 2018 20:14

Subject: Re: How do I initialize the window state on first run?

IIUC, we can't  initialize state at first run,  maybe you could store the aggregated data in another place other than use flink's state, then use flink to aggregate the data realtime.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午3:33写道：

Hi, vivo,

    My Flink program is to aggregate the data of a whole day, assume we start this program on 6:00 am, the default state in the window should be the aggregated result of 0:00 am to 6:00 am.

 Original Message 

Sender: vino yang<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: user<[hidden email]>

Date: Friday, Oct 12, 2018 15:13

Subject: Re: How do I initialize the window state on first run?

Hi Jiayi,

If you don't mind, I would like to ask you what kind of situation do you have in this situation?

Thanks, vino.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午1:59写道：

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

--

[bupt_ljy]

Thanks!

 Original Message 

Sender: Rafi Aroch<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: Congxian Qiu<[hidden email]>; yanghua1127<[hidden email]>; user<[hidden email]>

Date: Thursday, Oct 18, 2018 05:17

Subject: Re: How do I initialize the window state on first run?

Hi Jiayi, 

This topic has been discussed by others, take a look here for some options by Lyft: https://youtu.be/WdMcyN5QZZQ

Rafi

On Fri, Oct 12, 2018, 16:51 bupt_ljy <[hidden email]> wrote:

Yes…that’s an option, but it’ll be very complicated because of our storage and business. 

Now I’m trying to write an handler like the “KvStateHandler” so that I can access(read/write) the state from my client.

 Original Message 

Sender: Congxian Qiu<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: yanghua1127<[hidden email]>; user<[hidden email]>

Date: Friday, Oct 12, 2018 20:14

Subject: Re: How do I initialize the window state on first run?

IIUC, we can't  initialize state at first run,  maybe you could store the aggregated data in another place other than use flink's state, then use flink to aggregate the data realtime.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午3:33写道：

Hi, vivo,

    My Flink program is to aggregate the data of a whole day, assume we start this program on 6:00 am, the default state in the window should be the aggregated result of 0:00 am to 6:00 am.

 Original Message 

Sender: vino yang<[hidden email]>

Recipient: bupt_ljy<[hidden email]>

Cc: user<[hidden email]>

Date: Friday, Oct 12, 2018 15:13

Subject: Re: How do I initialize the window state on first run?

Hi Jiayi,

If you don't mind, I would like to ask you what kind of situation do you have in this situation?

Thanks, vino.

bupt_ljy <[hidden email]> 于2018年10月12日周五 下午1:59写道：

Hi, 

   I’m going to run a new Flink program with some initialized window states. 

   I can’t see there is an official way to do this, right? I’ve tried the bravo project, but it doesn’t support FsStateBackend and it costs too much work if we add a new StateBackend in it. 

   Any good ideas about this?

Jiayi Liao,Best

   

--