Gelly - which partitioning

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Gelly - which partitioning

Kaepke, Marc
Hi guys,

I can’t found on web which graph partitioning are supported by Gelly.

During my search I found this link. But the ticket is still open.


Thanks for help!

Best
Marc
Reply | Threaded
Open this post in threaded view
|

Re: Gelly - which partitioning

Timo Walther
Hi Marc,

maybe Greg (in CC) can help answering your question?

Regards,
Timo


Am 29/03/17 um 11:50 schrieb Kaepke, Marc:

> Hi guys,
>
> I can’t found on web which graph partitioning are supported by Gelly.
>
> During my search I found this link. But the ticket is still open.
> https://cwiki.apache.org/confluence/display/FLINK/Flink+Gelly
>
>
> Thanks for help!
>
> Best
> Marc


Reply | Threaded
Open this post in threaded view
|

Re: Gelly - which partitioning

Greg Hogan
In reply to this post by Kaepke, Marc
Hi Marc,

I’ll defer to Vasia’s comment below from FLINK-1536 as she has much more knowledge and experience with graph partitioning. This is certainly an area of interest so please let us know if you would like to contribute!


"In a distributed graph processing system, you first have to partition the graph before you perform any computation. The performance of graph algorithms greatly depends on the resulting partitioning. A bad partitioning might assign disproportionally more vertices to one partition thus hurting load balancing or it might partition the graph so that the communication required is too high (or both). Currently, we only support hash partitioning; that is, vertices are randomly assigned to workers using the hash of their id. This strategy has very low overhead and results in good load balancing unless the graphs are skewed.”


Greg


On Mar 29, 2017, at 5:50 AM, Kaepke, Marc <[hidden email]> wrote:

Hi guys,

I can’t found on web which graph partitioning are supported by Gelly.

During my search I found this link. But the ticket is still open.


Thanks for help!

Best
Marc