When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

Ben Yan
Hi,

I am using BucketingSink to write partitioned files to s3 in DataStream API. But now, a problem is found: every now and then, there will be a file that is always in a state of in-progree.When the checkpoint is over, the file is still in that state.As shown below:
Do you have any solutions?

Best,
Ben