run job with checkpoint in flink1.5.3 got error

[spoon_lz]

     I used flink1.3.2 before, and recently upgraded to flink1.5.3. I found
that the new version has adjusted checkpoint, and there was a problem after
modifying the code
    My code like :

   * RocksDBStateBackend rocksDBStateBackend = new
RocksDBStateBackend("hdfs://hdfs_1/demo/demo-fs-checkpoints/cpk/1_3",
true);*

    My jar is normal when it is submitted to the cluster run, then stops,
and then resumes like :

*/home/flink-1.5.3/bin/flink run -d -m yarn-cluster --yarnname test01 -ytm
4096 -yjm 1024 -s
hdfs://hdfs_1/demo/demo-fs-checkpoints/cpk/1_3/ff31023d23e568290d5596a34aa3cad6/chk-3
/home/flink/jar/test01.jar*

    this job can be submit ,but runs for error:

java.lang.Exception: Exception while creating StreamOperatorStateContext.
        at
org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:197)
        at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:231)
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:730)
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:295)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:715)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
        at
org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.internalTimeServiceManager(StreamTaskStateInitializerImpl.java:230)
        at
org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:160)
        ... 5 more
2018-09-19 19:44:26,518 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph        - Job test01
(f1960bf42cdb35b7f3ee958e06d9e3cf) switched from state RUNNING to FAILING.
java.lang.Exception: Exception while creating StreamOperatorStateContext.
        at
org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:197)
        at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:231)
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:730)
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:295)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:715)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
        at
org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.internalTimeServiceManager(StreamTaskStateInitializerImpl.java:230)
        at
org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:160)

      The source code has not found the cause of the error, and the official
document does not have too many instructions for the use of checkpoint.
      Can anyone help me






--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[spoon_lz]

The stop order is：

/home/flink-1.5.3/bin/flink cancel ff31023d23e568290d5596a34aa3cad6 -yid
application_1526888270443_0336



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Stefan Richter]

Hi,

did you introduce some custom modifications to the code? Your stack trace does not match the lines in the code of release-1.5.3, e.g. line 230 is not in method internalTimeServiceManager(…) which makes it hard to draw any conclusions.

Best,
Stefan

> Am 19.09.2018 um 14:03 schrieb spoon_lz <[hidden email]>:
>
>     I used flink1.3.2 before, and recently upgraded to flink1.5.3. I found
> that the new version has adjusted checkpoint, and there was a problem after
> modifying the code
>    My code like :
>
>   * RocksDBStateBackend rocksDBStateBackend = new
> RocksDBStateBackend("hdfs://hdfs_1/demo/demo-fs-checkpoints/cpk/1_3",
> true);*
>
>    My jar is normal when it is submitted to the cluster run, then stops,
> and then resumes like :
>
> */home/flink-1.5.3/bin/flink run -d -m yarn-cluster --yarnname test01 -ytm
> 4096 -yjm 1024 -s
> hdfs://hdfs_1/demo/demo-fs-checkpoints/cpk/1_3/ff31023d23e568290d5596a34aa3cad6/chk-3
> /home/flink/jar/test01.jar*
>
>    this job can be submit ,but runs for error:
>
> java.lang.Exception: Exception while creating StreamOperatorStateContext.
> at
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:197)
> at
> org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:231)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:730)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:295)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:715)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.internalTimeServiceManager(StreamTaskStateInitializerImpl.java:230)
> at
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:160)
> ... 5 more
> 2018-09-19 19:44:26,518 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph        - Job test01
> (f1960bf42cdb35b7f3ee958e06d9e3cf) switched from state RUNNING to FAILING.
> java.lang.Exception: Exception while creating StreamOperatorStateContext.
> at
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:197)
> at
> org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:231)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:730)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:295)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:715)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.internalTimeServiceManager(StreamTaskStateInitializerImpl.java:230)
> at
> org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.streamOperatorStateContext(StreamTaskStateInitializerImpl.java:160)
>
>      The source code has not found the cause of the error, and the official
> document does not have too many instructions for the use of checkpoint.
>      Can anyone help me
>
>
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[spoon_lz]

I'm sorry that I added some of my own code into the source code, and found
some mistakes. Now the problem has been solved, which is caused by my own
code



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/