+1 on this. On Fri, Nov 5, 2021 at 9:17 AM Sivabalan <n.siv...@gmail.com> wrote:
> RFC-15 > < > https://cwiki.apache.org/confluence/display/HUDI/RFC+-+15%3A+HUDI+File+Listing+Improvements > > > made an attempt to boost performance of file listing by storing all file > information in metadata table. As we are looking to build more infra around > metadata table (RFC-27 for data skipping, etc), we felt having a > synchronous design will make it more tighter and will avoid some of the > corner cases with async approach. > > So, we will write up a new RFC for file listing based on metadata table > with synchronous updates. > > -- > Regards, > -Sivabalan >