You can still connect the streams but it will be more complex than the
reference solution.
You will have to store the events from B in a ListState instead.
If an A arrives, store it in the value state, emit a tuple (A, B_x) for
every stored B, and clear B.
From that point on, emit a new tuple (A, B) for every B that arrives
and ignore the B state.
On 26.03.2018 17:18, Dulce Morim wrote:
> Hello,
>
> Following this exercise:
>
http://training.data-artisans.com/exercises/rideEnrichment-processfunction.html>
> I need to do something similar, but my data structure is something like:
>
> A
> Primary_key
> other fields
>
> B
> Primary_key
> Relation_Key
> other fields
>
> Where A and B relationship is one to more, on B.Relation_key = A.Primary_key
>
> When using the keyby function on both streams, with the key "A.Primary_key" on the A stream and the "B.Relation_key" on the B stream, the data that comes from B, only shows the last occurrence of the records that had the same "B.Relation_key".
>
> Is it possible to connect these two streams? In this solution there seems to be a 1 to 1 relationship, but we want a one to many relationship. Should this be solved via another process?
>
> Thanks,
> Dulce Morim
Locked
