Hi! Thanks to everyone who joined today’s meeting. For those who couldn’t attend but would still like to follow the progress, here are some brief notes from today’s discussion. (The detailed notes can be found here <https://docs.google.com/document/d/1eiygLyg_jcEiPnF_F6XI01dmX2DDa6UjDJH9ZAJCKe8/edit?tab=t.f261uoo0bhy3> ).
We had a quick overview of the working doc <https://docs.google.com/document/d/1eiygLyg_jcEiPnF_F6XI01dmX2DDa6UjDJH9ZAJCKe8/edit?usp=sharing> and discussed the current pathology of Parquet files. People were generally leaning toward the idea that if we are going to make a breaking change, we should make it significantly better, which corresponds to option 3, the modular footer. The struct of array encoding also showed great improvements in encoding size and parsing speed. To move things forward and build a more solid proposal, we will propose several typical Parquet footers for benchmarking and evaluate the performance on those examples. There will also be a separate mailing list topic calling for real-world use cases from the community. Overall, the feedback was very positive, and we’re looking forward to continuing the discussion next time. Best, Jiayi Jiayi Wang <[email protected]> 于2026年5月26日周二 19:03写道： > Hi everyone, > > Kindly remind we have started our first parquet footer discussion now. > https://calendar.app.google/rMWe2uomTec2Q2mc8 > > Best, > Jiayi > > Jiayi Wang <[email protected]> 于2026年5月20日周三 19:57写道： > >> Hi everyone, >> >> The very first Parquet footer working session is scheduled for May 26th >> (Tuesday) at 10am PT / 1pm ET / 7pm CET. >> To join the invite, please subscribe to the Parquet calendar: >> https://calendar >> .google.com/calendar/u/0?cid=OTU2YjU0NGRlMGM5MjEwYTZlYzg1OWNhMGNjYTViMTZjNjhlYmRkNmJjYmY0ZmRlNGIzZjFjZTE5MzUwZGU2NkBncm91cC5jYWxlbmRhci5nb29nbGUuY29t >> >> I have listed a few questions we would like to discuss in the meeting in >> this document: Parquet footer working doc >> <https://docs.google.com/document/d/1eiygLyg_jcEiPnF_F6XI01dmX2DDa6UjDJH9ZAJCKe8/edit?usp=sharing>. >> Please review it and add any comments you may have. >> >> Please note that all decisions will be communicated publicly via the >> mailing list, and I will also keep the mailing list updated on progress. >> >> Best, >> Jiayi >> >> Jiayi Wang <[email protected]> 于2026年5月19日周二 12:59写道： >> >>> Hi Raúl, >>> >>> Thanks for taking a look at the doc. I’ve fixed the permission issue, >>> let me know if you still have any problems accessing it. >>> >>> Best, >>> Jiayi >>> >>> Raúl Cumplido <[email protected]> 于2026年5月19日周二 09:25写道： >>> >>>> Hi Jiayi, >>>> >>>> Thanks for doing this. The document has restricted access, could you >>>> open commentator access? >>>> >>>> Regards, >>>> Raúl >>>> >>>> El lun, 18 may 2026 a las 14:48, Jiayi Wang (<[email protected]>) >>>> escribió: >>>> > >>>> > Hi everyone, >>>> > >>>> > As discussed in the Parquet sync meeting, we will set up a dedicated >>>> > working group to help move the Parquet footer work forward more >>>> efficiently. >>>> > >>>> > I’ve listed the options, discussions, and current progress in the >>>> document >>>> > below. Please take a look and share any comments you may have. >>>> > >>>> > Regarding the meeting schedule, we can align on a suitable time >>>> during this >>>> > week’s Parquet sync. >>>> > >>>> > Best, >>>> > Jiayi >>>> > >>>> > Parquet footer working doc: >>>> > >>>> https://docs.google.com/document/d/1eiygLyg_jcEiPnF_F6XI01dmX2DDa6UjDJH9ZAJCKe8/edit?usp=sharing >>>> >>>
