Storm topology running in flink.

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Storm topology running in flink.

yunfan123
I find it never call the spout fail or ack method from the code.
Reply | Threaded
Open this post in threaded view
|

Re: Storm topology running in flink.

Aljoscha Krettek
Hi,

I’m afraid the Storm compatibility layer has not been touched in a while and was never more than a pet project. Do you have an actual use case for running Storm topologies on top of Flink? Do be honest, I think it might be easier to simply port spouts to Flink SourceFunctions and bolts to a FlatMapFunction or a ProcessFunction.

Best,
Aljoscha

> On 6. Jun 2017, at 05:19, yunfan123 <[hidden email]> wrote:
>
> I find it never call the spout fail or ack method from the code.
>
>
>
>
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Storm-topology-running-in-flink-tp13495.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Reply | Threaded
Open this post in threaded view
|

Re: Storm topology running in flink.

yunfan123
It seems ok, but flink-storm not support storm codeDir.
I'm working on to make the flink-storm support the codeDir.
To support the code dir, I have to add a new funtion such as getUserResourceDir(may be return null) in flink RuntimeContext.
I know this may be a big change. What do you think of this?

 
Reply | Threaded
Open this post in threaded view
|

Re: Storm topology running in flink.

Aljoscha Krettek
What would getUserResourceDir() return? In general, Flink devs are very reluctant when adding new methods to such central interfaces because it’s not easy to fix them if they’re broken, unneeded.

Best,
Aljoscha

> On 15. Jun 2017, at 12:40, yunfan123 <[hidden email]> wrote:
>
> It seems ok, but flink-storm not support storm codeDir.
> I'm working on to make the flink-storm support the codeDir.
> To support the code dir, I have to add a new funtion such as
> getUserResourceDir(may be return null) in flink RuntimeContext.
> I know this may be a big change. What do you think of this?
>
>
>
>
>
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Storm-topology-running-in-flink-tp13495p13756.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Reply | Threaded
Open this post in threaded view
|

Re: Storm topology running in flink.

yunfan123
That returns a String specific the resource path.
Any suggestion about this?
What I want is copy the resource to specific path in task manger, and pass the specific path to my operator.
Reply | Threaded
Open this post in threaded view
|

Re: Storm topology running in flink.

m@xi
Hello there,

I have storm code and I need to run it.

If possible I would like to run it with Flink. Is this possible and this
feature stable now?

Best,
Max



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Storm topology running in flink.

Fabian Hueske-2
Hi,

From the dev perspective there hasn't been done much on that component since a long time [1].
Are there any users of this feature on the user list and can comment on how it works for them?

Best, Fabian

2018-05-11 9:46 GMT+02:00 m@xi <[hidden email]>:
Hello there,

I have storm code and I need to run it.

If possible I would like to run it with Flink. Is this possible and this
feature stable now?

Best,
Max



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/