Hi Parquet team, any feedbacks/suggestions on this?

Thanks
Cheng Xu

From: Peng Yu <[email protected]>
Sent: Tuesday, January 4, 2022 5:58 PM
To: [email protected]
Cc: Yu, Peng <[email protected]>; Xu, Cheng A <[email protected]>
Subject: A proposal about adding cache in ParquetFileReader

Hi everyone,

We are making a proposal for apache/parquet-mr.

3 new features are introduced:

  *   Add interface for cache backends which manage cache objects
  *   Make cache backends pluggable by a parquet option
  *   Cache metadata and column chunks in ParquetFileReader if users enable it

You can get more details here:
https://docs.google.com/document/d/1tLA-e_y_rax6DA8JEyaYYPBqMFUcNl28sKC0vAeo4BQ/edit?usp=sharing

Looking forward to your comments at your convenience.


Best regards,
Peng Yu

Reply via email to