kl0u commented on issue #6466: [FLINK-10005][DataStream API] StreamingFileSink: sets initialPartCounter=maxUsed in new Buckets URL: https://github.com/apache/flink/pull/6466#issuecomment-409468865 Because this will close the previous AND open a new part file, meaning all buckets, active and inactive, will always be in state. Which we do not want. Also, it means that a bucket that has specified a `rollingInterval` will have a lot of empty part files, as they will open, receive no elements, close due to timeout, and open the next one.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
