Login  Register

using a Yarn cluster for both Spark and Flink

classic Classic list List threaded Threaded
2 messages Options Options
Embed post
Permalink
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

using a Yarn cluster for both Spark and Flink

Soheil Pourbafrani
Is it standard approach to set up a Yarn cluster for running both Spark and Flink applications?
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

Re: using a Yarn cluster for both Spark and Flink

Georg Heiler
Why not? Isn't a resource manager meant for this?
You should however clearly define service level agreements as a flink streaming job might require certain maximum latency opposed to a spark batch job.
Soheil Pourbafrani <[hidden email]> schrieb am Do. 18. Jan. 2018 um 08:30:
Is it standard approach to set up a Yarn cluster for running both Spark and Flink applications?