Hi Xinyu,
would it help to have a small tool which can truncate the finished files
which have a valid-length file associated? That way, one could use this
tool before others are using the data farther down stream.
Cheers,
Till
On Tue, May 15, 2018 at 3:05 PM, Xinyu Zhang <342689...@qq.com>
As far as I know, the bucketing sink is currenlty also limited by
relying on Hadoops file system abstraction. It is planned to switch to
Flink's file system abstraction which might also improve this situation.
Kostas (in CC) might know more about it.
But I think we can discuss if an other
