Re: Parquet Metadata table on Rolling window

No, it does not. We rebuild metadata for all directories under mydata when you query /mydata. If new files get added anywhere in the whole hierarchy, metadata gets regenerated for all of them. However, if you query only /mydata/3 and nothing is changed under 3, no metadata is generated.

Re: Parquet Metadata table on Rolling window

Thanks Padma, Would we benefits at all from running metadata on directories that we know we will never modify? We would end up with: /mydata/3/(Metadata generated...) /mydata/4/(Metadata generated...) /mydata/.../(Metadata generated...) /mydata/109/(Metadata generated...) /mydata/110/(Current

Re: Parquet Metadata table on Rolling window

Unfortunately, we do not do incremental metadata updates. If new files are getting added constantly, refresh table metadata will not help. Thanks Padma > On Oct 5, 2017, at 5:36 PM, François Méthot wrote: > > Hi, > > I have been using drill for more than year now, we