An interesting apache project: Reef

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

An interesting apache project: Reef

kovas boguta
Some people here (especially Flink contributors) might be interested to know about this project: https://reef.apache.org/index.html

It is lower-level than Flink (and less mature), but with similar architectural sensibilities and emphasis on interfaces. It would be pretty interesting to compare the designs in areas of overlap, and maybe some cross-pollination of ideas (if not outright reuse/compatibility) is possible. 

Also check out the related subprojects:



Reply | Threaded
Open this post in threaded view
|

Re: An interesting apache project: Reef

Stephan Ewen
Thanks for the pointers.

I actually know some of the Reef people (like Markus Weimer) and we talked about ideas a few times. Especially around batch and iterations. There were many common thoughts and good discussions.

In the streaming space, I think Flink and Reef diverged quite a bit (checkpointing, latency, state).

On Wed, Jan 20, 2016 at 5:21 PM, kovas boguta <[hidden email]> wrote:
Some people here (especially Flink contributors) might be interested to know about this project: https://reef.apache.org/index.html

It is lower-level than Flink (and less mature), but with similar architectural sensibilities and emphasis on interfaces. It would be pretty interesting to compare the designs in areas of overlap, and maybe some cross-pollination of ideas (if not outright reuse/compatibility) is possible. 

Also check out the related subprojects: