Questions regarding DDL and savepoints

[Kevin Kwon]

I have a question regarding DDLs if they are considered operators and can be savepointed

For example 

CREATE TABLE mytable (
  id BIGINT,
  data STRING

  WATERMARK(...)
) with (
  connector = 'kafka'
)

If I create the table like above, save&exit and resume application, will the application start from the save point (including Kafka offset)?

There's also an ongoing issue that was created by me if the operator names can be specified when creating tables with DDLs

https://issues.apache.org/jira/browse/FLINK-20368

[Yun Tang]

Hi Kevin,

If you pass the savepoint path to resume application [1], the application would resume from last savepoint.

If you change the logic of your DDL and since no uid can be set from users, I am afraid not all state could be restored as you expected.

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.11/ops/cli.html#restore-a-savepoint

Best

Yun Tang

---

From: Kevin Kwon <[hidden email]>
Sent: Thursday, December 3, 2020 8:31
To: [hidden email] <[hidden email]>
Subject: Questions regarding DDL and savepoints

 

I have a question regarding DDLs if they are considered operators and can be savepointed

For example 

CREATE TABLE mytable (
  id BIGINT,
  data STRING

  WATERMARK(...)
) with (
  connector = 'kafka'
)

If I create the table like above, save&exit and resume application, will the application start from the save point (including Kafka offset)?

There's also an ongoing issue that was created by me if the operator names can be specified when creating tables with DDLs

https://issues.apache.org/jira/browse/FLINK-20368