Custom Partition/Task Placement Algorithm

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Custom Partition/Task Placement Algorithm

mbilalce.dev@gmail.com
Hi,

I am experimenting with Gelly and Graph partitioning.
I wanted to perform some experiments where I can control the placement of partitions of the graph. As far as I know there is no out of the box way of implementing such a capability in Flink.

So I am looking for guidance regarding the classes that I need to look into and potentially modify in order to implement custom data partition placement across the available cluster.

Thanks.

Regards,
Bilal