Re: Flink Data Stream Union

Posted by Aljoscha Krettek on
URL: http://deprecated-apache-flink-user-mailing-list-archive.369.s1.nabble.com/Flink-Data-Stream-Union-tp3169p3207.html

Hmm, that is strange.

Could you maybe send the complete program so that I could have a look?

> On 21 Oct 2015, at 16:43, Gayu <[hidden email]> wrote:
>
> No, it doesn't i even tried removing the filter and return all the values as is received from the port.
>
> My doubt is, is there anything system or CPU specific that fails to attach the data to the datastream created.
>
> On Wed, Oct 21, 2015 at 10:39 AM, Aljoscha Krettek <[hidden email]> wrote:
> So does the filter maybe filter out everything?
> > On 21 Oct 2015, at 16:18, Gayu <[hidden email]> wrote:
> >
> > Yes, exactly.
> >
> > On Wed, Oct 21, 2015 at 10:17 AM, Aljoscha Krettek <[hidden email]> wrote:
> > So it is received in the filter but the print afterwards does not print?
> > > On 21 Oct 2015, at 15:49, Gayu <[hidden email]> wrote:
> > >
> > > The data does arrive in the second port and i am able to see that in the filter class received.
> > > It happens only on specific machine on which i run the code.
> > >
> > >
> > > Yes, i did forget to post here, but my program calls the unionMessageStreams()
> > >
> > > On Wed, Oct 21, 2015 at 9:39 AM, Aljoscha Krettek <[hidden email]> wrote:
> > > Hi Gayu,
> > > could it be that no data ever arrives on the second input stream? Or that the filter filters out all messages?
> > >
> > > Also, in the example you posted you forgot to call unionMessageStreams().
> > >
> > > Cheers,
> > > Aljoscha
> > >
> > > > On 21 Oct 2015, at 15:29, Till Rohrmann <[hidden email]> wrote:
> > > >
> > > > Can it be that you forgot to call unionMessageStreams in your main method?
> > > >
> > > > Cheers,
> > > > Till
> > > >
> > > >
> > > > On Wed, Oct 21, 2015 at 3:02 PM, flinkuser <[hidden email]> wrote:
> > > > Here is the strange behavior.
> > > >
> > > > Below code works in one box but not in the other. I had it working in my
> > > > laptop the whole of yesterday, but strangely today it doesnt work in my
> > > > desktop.
> > > >
> > > > Can anyone please let me know what the issue is.
> > > >
> > > >
> > > > public static void main(String[] args) throws Exception {
> > > >                 try {
> > > >                         final StreamExecutionEnvironment env =
> > > > StreamExecutionEnvironment.getExecutionEnvironment();
> > > >                         DataStream<String> msgDataStream1 = env.addSource((new
> > > > SocketSource(hostName1, port, '\n', -1))).filter(new
> > > > MessageFilter()).setParallelism(1);
> > > >                         DataStream<String> msgDataStream2 = env.addSource((new
> > > > SocketSource(hostName2, port, '\n', -1))).filter(new
> > > > MessageFilter()).setParallelism(1);
> > > >
> > > >                         env.execute("Stock stream");
> > > >
> > > >                 } catch (Exception e) {
> > > >                         System.err.println("Exception  = > " + e.getMessage());
> > > >                         e.printStackTrace();
> > > >                 }
> > > >         }
> > > >
> > > >         private static void unionMessageStreams(DataStream<String> msgDataStream1,
> > > > DataStream<String> msgDataStream2) {
> > > >                 try {
> > > >
> > > >                         DataStream<String> ds = msgDataStream1.union(msgDataStream2);
> > > >                         ds.print();
> > > >                 } catch (Exception e) {
> > > >                         System.err.println("Exception in union Message Streams () = > " +
> > > > e.getMessage());
> > > >                 }
> > > >         }
> > > >
> > > > Thanks
> > > >
> > > >
> > > >
> > > > --
> > > > View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Data-Stream-Union-tp3169p3196.html
> > > > Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
> > > >
> > >
> > >
> > >
> > >
> > > --
> > > Gayu
> >
> >
> >
> >
> > --
> > Gayu
>
>
>
>
> --
> Gayu