Flume source support

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Flume source support

Alexandr Dzhagriev
Hello,

At the moment master branch contains the commented class FlumeSource. Unfortunately, I can't find any information regarding the future support of it. Can anyone, please, shed the light on it?

Thanks, Alex.
Reply | Threaded
Open this post in threaded view
|

Re: Flume source support

rmetzger0
Hi Alex,

I'm sorry that you found that class commented. I think so far nobody was interested in using the Flume source.It was commented out during a refactoring of the stream sources: https://github.com/apache/flink/pull/659#discussion-diff-29854032.
I just looked a bit through the (commented) code, and it seems that the FlumeSource is at most an example for building a custom source.

Implementing a custom source is quite simple in Flink. Maybe you can get the job done easily by implementing a Flume source yourself. I also volunteer to review your code and help you if you need assistance.

Regards,
Robert





On Wed, Jan 27, 2016 at 9:18 PM, Alexandr Dzhagriev <[hidden email]> wrote:
Hello,

At the moment master branch contains the commented class FlumeSource. Unfortunately, I can't find any information regarding the future support of it. Can anyone, please, shed the light on it?

Thanks, Alex.

Reply | Threaded
Open this post in threaded view
|

Re: Flume source support

Alexandr Dzhagriev
Hi Robert,

Thanks for the quick reply. I'll try.

Best regards, Alex. 

On Thu, Jan 28, 2016 at 11:09 AM, Robert Metzger <[hidden email]> wrote:
Hi Alex,

I'm sorry that you found that class commented. I think so far nobody was interested in using the Flume source.It was commented out during a refactoring of the stream sources: https://github.com/apache/flink/pull/659#discussion-diff-29854032.
I just looked a bit through the (commented) code, and it seems that the FlumeSource is at most an example for building a custom source.

Implementing a custom source is quite simple in Flink. Maybe you can get the job done easily by implementing a Flume source yourself. I also volunteer to review your code and help you if you need assistance.

Regards,
Robert





On Wed, Jan 27, 2016 at 9:18 PM, Alexandr Dzhagriev <[hidden email]> wrote:
Hello,

At the moment master branch contains the commented class FlumeSource. Unfortunately, I can't find any information regarding the future support of it. Can anyone, please, shed the light on it?

Thanks, Alex.