Convert Datastream to Collector or List

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Convert Datastream to Collector or List

Ahmed Nader
Hi,
I want to pass an object of type DataStream ,after applying map function on it, as a parameter to be used somewhere else. But when i do so, i get an error message of trying to access a null context object.
Is there a way that i can convert this DataStream object to a list or a collector so as to be used somewhere else afterwards.
Thanks,
Ahmed
Reply | Threaded
Open this post in threaded view
|

Re: Convert Datastream to Collector or List

Suneel Marthi
DataStream<String> ds = .......

Iterator<String> iter = DataStreamUtils.collect(ds);

List<String> list = Lists.newArrayList(iterator);

Hope that helps.


On Wed, Mar 16, 2016 at 7:37 AM, Ahmed Nader <[hidden email]> wrote:
Hi,
I want to pass an object of type DataStream ,after applying map function on it, as a parameter to be used somewhere else. But when i do so, i get an error message of trying to access a null context object.
Is there a way that i can convert this DataStream object to a list or a collector so as to be used somewhere else afterwards.
Thanks,
Ahmed

Reply | Threaded
Open this post in threaded view
|

Re: Convert Datastream to Collector or List

Ahmed Nader
Hello Suneel,
Yeah that worked, thanks so much.

On 16 March 2016 at 12:50, Suneel Marthi <[hidden email]> wrote:
DataStream<String> ds = .......

Iterator<String> iter = DataStreamUtils.collect(ds);

List<String> list = Lists.newArrayList(iterator);

Hope that helps.


On Wed, Mar 16, 2016 at 7:37 AM, Ahmed Nader <[hidden email]> wrote:
Hi,
I want to pass an object of type DataStream ,after applying map function on it, as a parameter to be used somewhere else. But when i do so, i get an error message of trying to access a null context object.
Is there a way that i can convert this DataStream object to a list or a collector so as to be used somewhere else afterwards.
Thanks,
Ahmed