Hi Li, We do have support for Parquet <-> Arrow reader/writer in Dremio OSS. Please take a look here:
https://github.com/dremio/dremio-oss/tree/master/sabot/kernel/src/main/java/com/dremio/exec/store/parquet https://github.com/dremio/dremio-oss/blob/master/sabot/kernel/src/main/java/com/dremio/exec/store/parquet/columnreaders/DeprecatedParquetVectorizedReader.java We are yet to discuss how to factor out some/all of such implementation from Dremio and contribute back to Parquet and/or Arrow. Thanks, Sidd On Wed, Jan 17, 2018 at 10:14 AM, Li Jin <ice.xell...@gmail.com> wrote: > Hey folks, > > I know this is supported in C++, but is there a library to convert between > Arrow and Parquet? (i.e., read Parquet files in Arrow format, write Arrow > format to Parquet files). > > Jacques and Sidd, does Dremio has some library to do this? > > Thanks, > Li >
