Som question about Flink stream sql

[Hongyuhong]

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong

 

 

 

[Fabian Hueske-2]

Hi Yuhong,

as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.

The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.

You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.

Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.

Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.

Best, Fabian

2017-01-05 4:40 GMT+01:00 Hongyuhong <[hidden email]>:

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong

 

 

 

[Hongyuhong]

Hi Fabian,

 

Thanks for the reply.

As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,

Can you tell something about the progress of the row windows in Table API?

 

Regards.

Yuhong

 

 

 

 

发件人: Fabian Hueske [mailto:[hidden email]]
发送时间: 2017年1月5日 17:43
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong,

as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.

The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.

You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.

Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.

Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.

Best, Fabian

 

 

2017-01-05 4:40 GMT+01:00 Hongyuhong <[hidden email]>:

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong

 

 

 

 

[Fabian Hueske-2]

There are several JIRA issues for row windows, some of them might be assigned.

I haven't seen pull requests and nothing to merged yet.

I would ask on the JIRA issue of the current status.

Best, Fabian

2017-01-05 12:00 GMT+01:00 Hongyuhong <[hidden email]>:

Hi Fabian,

 

Thanks for the reply.

As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,

Can you tell something about the progress of the row windows in Table API?

 

Regards.

Yuhong

 

 

 

 

发件人: Fabian Hueske [mailto:[hidden email]]
发送时间: 2017年1月5日 17:43
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong,

as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.

The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.

You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.

Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.

Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.

Best, Fabian

 

 

2017-01-05 4:40 GMT+01:00 Hongyuhong <[hidden email]>:

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong

 

 

 

 

[Jark Wu]

Hi Yuhong, 

I have assigned an issue for tumble row-window, but the progress is still under design and discuss. The implementation of row window is more complex than group window.

I will push forward this issue in the next days.

- Jark Wu 

在 2017年1月5日，下午7:00，Hongyuhong <[hidden email]> 写道：

Hi Fabian,

 

Thanks for the reply.

As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,

Can you tell something about the progress of the row windows in Table API?

 

Regards.

Yuhong

 

 

 

 

发件人: Fabian Hueske [[hidden email]] 
发送时间: 2017年1月5日 17:43
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong,

as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.

The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.

You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.

Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.

Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.

Best, Fabian

 

 

2017-01-05 4:40 GMT+01:00 Hongyuhong <[hidden email]>:

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong

[Hongyuhong]

Thanks Jark

 

Do you have any design documents or instructions about row window? We are interested in adding supports of window in streamsql side and it’s greate if can have some reference.

Thanks very much.

 

Best

Yuhong

 

 

发件人: Jark Wu [mailto:[hidden email]]
发送时间: 2017年1月6日 11:01
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong, 

 

I have assigned an issue for tumble row-window, but the progress is still under design and discuss. The implementation of row window is more complex than group window.

I will push forward this issue in the next days.

 

- Jark Wu 

 

在 2017年1月5日，下午7:00，Hongyuhong <[hidden email]> 写道：

 

Hi Fabian,

 

Thanks for the reply.

As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,

Can you tell something about the progress of the row windows in Table API?

 

Regards.

Yuhong

 

 

 

 

发件人: Fabian Hueske [[hidden email]] 
发送时间: 2017年1月5日 17:43
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong,

as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.

The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.

You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.

Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.

Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.

Best, Fabian

 

 

2017-01-05 4:40 GMT+01:00 Hongyuhong <[hidden email]>:

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong

 

[Jark Wu]

Hi Yuhong, 

The design doc is not ready. You can refer FLINK-4679. There are some discussions under the issue.

- Jark Wu 

在 2017年1月6日，下午3:08，Hongyuhong <[hidden email]> 写道：

Thanks Jark

 

Do you have any design documents or instructions about row window? We are interested in adding supports of window in streamsql side and it’s greate if can have some reference.

Thanks very much.

 

Best

Yuhong

 

 

发件人: Jark Wu [[hidden email]] 
发送时间: 2017年1月6日 11:01
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong, 

 

I have assigned an issue for tumble row-window, but the progress is still under design and discuss. The implementation of row window is more complex than group window.

I will push forward this issue in the next days.

 

- Jark Wu 

 

在 2017年1月5日，下午7:00，Hongyuhong <[hidden email]> 写道：

 

Hi Fabian,

 

Thanks for the reply.

As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,

Can you tell something about the progress of the row windows in Table API?

 

Regards.

Yuhong

 

 

 

 

发件人: Fabian Hueske [[hidden email]] 
发送时间: 2017年1月5日 17:43
收件人: [hidden email]
主题: Re: Som question about Flink stream sql

 

Hi Yuhong,

as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.

The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.

You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.

Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.

Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.

Best, Fabian

 

 

2017-01-05 4:40 GMT+01:00 Hongyuhong <[hidden email]>:

Hi,

We are currently exploring on Flink streamsql ,

And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.

I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.

And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?

The issue on calcite jira was raised in August, what’s the status right now?

Thanks in advance!

 

Regards

Yuhong