Hi, What is the behaviour of
fromCollection() when restarting from a savepoint? Will the elements of the collection get fed into the resulting stream again or not? What if the contents of the underlying collection change? Thanks, Tomasz Tomasz Dudziak
| Marshall Wace LLP, George House, 131 Sloane Street, London, SW1X 9AT |
E-mail: [hidden email]
| Tel: +44 207 024 7061
This e-mail and any attachments are confidential to the addressee(s) and may contain information that is legally privileged and/or confidential. If you are not the intended recipient of this e-mail you are hereby notified that any dissemination, distribution, or copying of its content is strictly prohibited. If you have received this message in error, please notify the sender by return e-mail and destroy the message and all copies in your possession.
|
Hi Tomasz
The API fromCollection() would record the number of elements emitted [1] in snapshot state, and restore them to remember as elements to skip [2], that is to say not all elements would be read again.
But frankly speaking, once fromCollection is completed, the source task would finish and no more savepoint could be triggered.
Best
Yun Tang
From: Tomasz Dudziak <[hidden email]>
Sent: Wednesday, November 25, 2020 18:22 To: [hidden email] <[hidden email]> Subject: fromCollection() and savepoints Hi,
What is the behaviour of fromCollection() when restarting from a savepoint? Will the elements of the collection get fed into the resulting stream again or not? What if the contents of the underlying collection change?
Thanks, Tomasz
Tomasz Dudziak | Marshall Wace LLP, George House, 131 Sloane Street, London, SW1X 9AT | E-mail: [hidden email] | Tel: +44 207 024 7061
This e-mail and any attachments are confidential to the addressee(s) and may contain information that is legally privileged and/or confidential. If you are not the intended recipient of this e-mail you are hereby notified that any dissemination, distribution, or copying of its content is strictly prohibited. If you have received this message in error, please notify the sender by return e-mail and destroy the message and all copies in your possession.
|
Free forum by Nabble | Edit this page |