(DEPRECATED) Apache Flink User Mailing List archive.

UnsupportedOperatorException with TensorFlow on checkpointing

Classic

List

Threaded

2 messages Options

Sung Gon Yi

UnsupportedOperatorException with TensorFlow on checkpointing

Hi,

Following codes have a UnsupportedOperatorException on checkpointing (every time).

Could you suggest any solution?

Example code:

A.java

----------------------------------------------------------

public class A extends RichWindowFunction<Double, Double, String, GlobalWindow> {
  private transient MapState<String, B> state;

@Override
  public void apply(String key, GlobalWindow window, Iterable<Double> elements, Collector<Double> out) {
  String k;
...
  B b = state.get(k); // error reported point (eg. 58th line)
...
}

  …

}

B.java
-----------------
...
import org.tensorflow.SavedModelBundle;
import org.tensorflow.framework.*;

public class B {
...
  private SavedModelBundle savedModel;
  private MetaGraph metaGraph;

  public void initialize(String path, ConfigProto config, String... tags) throws Exception {
...
  this.savedModel = SavedModelBundle.loader(path).withTags(tags).withConfigProto(config.toByteArray()).load();
  this.metaGraph = MetaGraph.parseFrom(this.saveModel.metaGraphDef());
...
}
}

Error logs:

----------------------------------------------------------

2020-07-07 15:55:30,144 INFO org.apache.flink.runtime.taskmanager.Task - Window(GlobalWindows(), CountTrigger, TimeCountEvictor, SequentialOperator) -> asset_score-evaluate -> Sink: Unnamed (1/1) (96fcb5ceb56bc95177b27697cc264edf) switched from RUNNING to FAILED.

om.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException

Serialization trace:

field_ (com.google.protobuf.DescriptorProtos$DescriptorProto)

proto (com.google.protobuf.Descriptors$Descriptor)

messageType (com.google.protobuf.Descriptors$FieldDescriptor)

fields (com.google.protobuf.Descriptors$Descriptor)

messageTypes (com.google.protobuf.Descriptors$FileDescriptor)

dependencies (com.google.protobuf.Descriptors$FileDescriptor)

file (com.google.protobuf.Descriptors$FieldDescriptor)

fields (com.google.protobuf.Descriptors$Descriptor)

containingType (com.google.protobuf.Descriptors$Descriptor)

descriptor (com.google.protobuf.MapEntry$Metadata)

metadata (com.google.protobuf.MapEntry)

defaultEntry (com.google.protobuf.MapField$ImmutableMessageConverter)

converter (com.google.protobuf.MapField)

deviceCount_ (org.tensorflow.framework.ConfigProto)

…

metaGraph_(org.tensorflow.framework.MetaGraphDef)

at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)

at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)

at com.esotericsoftware.kryo.Kryo.readObjectOrNull(Kryo.java:730)

at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:113)

at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)

at com.esotericsoftware.kryo.Kryo.readObjectOrNull(Kryo.java:730)

at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:113)

at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:528)

at com.esotericsoftware.kryo.Kryo.readObjectOrNull(Kryo.java:730)

at com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.read(DefaultArraySerializers.java:368)

at com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.read(DefaultArraySerializers.java:289)