Multilang Support on Flink

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Multilang Support on Flink

tambunanw
Hi All, 

I want to ask if there's multilang support ( like in Storm and pipeTo in Spark ) in flink ?

I try to find it in the docs but can't find it. 

Any link or direction would be really appreciated. 


Cheers

--
Reply | Threaded
Open this post in threaded view
|

Re: Multilang Support on Flink

Maximilian Michels
Hi Welly,

There is a protocol for communicating with other processes. This is
reflected in flink-language-binding-generic module. I'm not aware how
Spark or Storm communication protocols work but this protocol is
rather low level.

Cheers,
Max

On Fri, Nov 13, 2015 at 9:49 AM, Welly Tambunan <[hidden email]> wrote:

> Hi All,
>
> I want to ask if there's multilang support ( like in Storm and pipeTo in
> Spark ) in flink ?
>
> I try to find it in the docs but can't find it.
>
> Any link or direction would be really appreciated.
>
>
> Cheers
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com
Reply | Threaded
Open this post in threaded view
|

Re: Multilang Support on Flink

tambunanw
Hi Max, 

Do you know where the repo is ? 

I try to search on the flink staging but seems it's not there anymore ( via google)

Cheers

On Fri, Nov 13, 2015 at 5:07 PM, Maximilian Michels <[hidden email]> wrote:
Hi Welly,

There is a protocol for communicating with other processes. This is
reflected in flink-language-binding-generic module. I'm not aware how
Spark or Storm communication protocols work but this protocol is
rather low level.

Cheers,
Max

On Fri, Nov 13, 2015 at 9:49 AM, Welly Tambunan <[hidden email]> wrote:
> Hi All,
>
> I want to ask if there's multilang support ( like in Storm and pipeTo in
> Spark ) in flink ?
>
> I try to find it in the docs but can't find it.
>
> Any link or direction would be really appreciated.
>
>
> Cheers
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com



--
Reply | Threaded
Open this post in threaded view
|

Re: Multilang Support on Flink

Maximilian Michels
Hi Welly,

It's in the main Flink repository. Actually, this has just been
integrated with the Python API, see
https://github.com/apache/flink/blob/master/flink-libraries/flink-python/src/main/java/org/apache/flink/python/api/PythonPlanBinder.java

Before it was independent
https://github.com/apache/flink/blob/release-0.10/flink-staging/flink-language-binding/flink-language-binding-generic/src/main/java/org/apache/flink/languagebinding/api/java/common/PlanBinder.java

I think the creators decided it was too specific to the Python API to
actually serve as a generic interface. You might want to ask Chesnay
(in CC) for the details.

Cheers,
Max

On Sat, Nov 14, 2015 at 12:52 AM, Welly Tambunan <[hidden email]> wrote:

> Hi Max,
>
> Do you know where the repo is ?
>
> I try to search on the flink staging but seems it's not there anymore ( via
> google)
>
> Cheers
>
> On Fri, Nov 13, 2015 at 5:07 PM, Maximilian Michels <[hidden email]> wrote:
>>
>> Hi Welly,
>>
>> There is a protocol for communicating with other processes. This is
>> reflected in flink-language-binding-generic module. I'm not aware how
>> Spark or Storm communication protocols work but this protocol is
>> rather low level.
>>
>> Cheers,
>> Max
>>
>> On Fri, Nov 13, 2015 at 9:49 AM, Welly Tambunan <[hidden email]> wrote:
>> > Hi All,
>> >
>> > I want to ask if there's multilang support ( like in Storm and pipeTo in
>> > Spark ) in flink ?
>> >
>> > I try to find it in the docs but can't find it.
>> >
>> > Any link or direction would be really appreciated.
>> >
>> >
>> > Cheers
>> >
>> > --
>> > Welly Tambunan
>> > Triplelands
>> >
>> > http://weltam.wordpress.com
>> > http://www.triplelands.com
>
>
>
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com