Getting warning messages (...hdfs.DataStreamer - caught exception) while running Flink with Hadoop as the state backend

[PedroMrChaves]

While my flink job is running I keep getting the following warning message in
the log:

/2018-02-23 09:08:11,681 WARN  org.apache.hadoop.hdfs.DataStreamer                          
- Caught exception
java.lang.InterruptedException
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at
org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:927)
        at
org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:578)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:755)
But the job keeps running, apparently without issues./

Flink Version: 1.4.0 bundled with Hadoop 2.8

Hadoop version: 2.8.3

Any ideas on what might be the problem?



-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[Stephan Ewen]

Is this happening around a failure / recovery?

Flink interrupts threads when canceling user code in order to reset an operator to a checkpoint.

On Thu, Mar 1, 2018 at 11:27 AM, PedroMrChaves <[hidden email]> wrote:

While my flink job is running I keep getting the following warning message in
the log:

/2018-02-23 09:08:11,681 WARN  org.apache.hadoop.hdfs.DataStreamer
- Caught exception
java.lang.InterruptedException
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at
org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:927)
        at
org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:578)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:755)
But the job keeps running, apparently without issues./

Flink Version: 1.4.0 bundled with Hadoop 2.8

Hadoop version: 2.8.3

Any ideas on what might be the problem?



-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

[PedroMrChaves]

No. It is just a log message with no apparent side effects.



-----
Best Regards,
Pedro Chaves
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/