Use ResourceSpec in Flink 1.5

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Use ResourceSpec in Flink 1.5

stevemit

I want to add an extended resource via a ResourceSpec to a DataSet operation.  There is an envisioned usage example in issue FLINK-7878 using the setResource method of SingleOutputStreamOperator (flatMap output).  However, in Flink 1.5 the setResources method appears instead on the StreamTransformation class.

https://issues.apache.org/jira/browse/FLINK-7878

 

How can I require extended resources on a DataSet operation in Flink 1.5?  How do I configure my TaskManager to offer extended resources?

 

I’m new to Flink.  For my application extended resources seem like a big advantage over Spark.

 

Thanks,

  --Steve