using a Yarn cluster for both Spark and Flink

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

using a Yarn cluster for both Spark and Flink

Soheil Pourbafrani
Is it standard approach to set up a Yarn cluster for running both Spark and Flink applications?
Reply | Threaded
Open this post in threaded view
|

Re: using a Yarn cluster for both Spark and Flink

Georg Heiler
Why not? Isn't a resource manager meant for this?
You should however clearly define service level agreements as a flink streaming job might require certain maximum latency opposed to a spark batch job.
Soheil Pourbafrani <[hidden email]> schrieb am Do. 18. Jan. 2018 um 08:30:
Is it standard approach to set up a Yarn cluster for running both Spark and Flink applications?