Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Roman Khachatryan
I said, I > > would introduce the multi-delete API to the original FileSystem class > > instead of introducing another BulkDeletingFileSystem, which makes the > file > > system abstraction closer to the modern cloud-based environment. > > > > Best > > Yun Tang &g

Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Piotr Nowojski
roducing another BulkDeletingFileSystem, which makes the file > system abstraction closer to the modern cloud-based environment. > > Best > Yun Tang > ________ > From: Piotr Nowojski > Sent: Thursday, June 30, 2022 18:25 > To: dev ; Dawid Wysakowicz &

Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Yun Tang
t: Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class Hi, I presume this would mostly supersede the recursive deletes [1]? I remember an argument that the recursive deletes were not obviously better, even if the underlying FS was supporting it. I'm not saying that this would hav

Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Piotr Nowojski
Hi, I presume this would mostly supersede the recursive deletes [1]? I remember an argument that the recursive deletes were not obviously better, even if the underlying FS was supporting it. I'm not saying that this would have been a counter argument against this effort, since every FileSystem cou

Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Zakelly Lan
Hi Yun, Thanks for bringing this into discussion. I'm +1 to this idea. And IIUC, Flink implements the OSS and S3 filesystem based on the hadoop filesystem interface, which does not provide the multi-delete API, it may take some effort to implement this. Best, Zakelly On Thu, Jun 30, 2022 at 5:36

Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Martijn Visser
Hi Yun Tang, +1 for addressing this problem and your approach. Best regards, Martijn Op do 30 jun. 2022 om 11:12 schreef Feifan Wang : > Thanks a lot for the proposal @Yun Tang ! It sounds great and I can't > find any reason not to make this improvement. > > > —— > Name: Feifan Wa

Re:[DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Feifan Wang
Thanks a lot for the proposal @Yun Tang ! It sounds great and I can't find any reason not to make this improvement. —— Name: Feifan Wang Email: zoltar9...@163.com Replied Message | From | Yun Tang | | Date | 06/30/2022 16:56 | | To | dev@flink.apache.org | | Subject | [D