Hi Sidd, Thanks for the information. This could be a very useful tool.
Li On Wed, Jan 17, 2018 at 3:05 PM, Siddharth Teotia <siddha...@dremio.com> wrote: > Hi Li, > > We do have support for Parquet <-> Arrow reader/writer in Dremio OSS. > Please take a look here: > > https://github.com/dremio/dremio-oss/tree/master/sabot/ > kernel/src/main/java/com/dremio/exec/store/parquet > https://github.com/dremio/dremio-oss/blob/master/sabot/ > kernel/src/main/java/com/dremio/exec/store/parquet/columnreaders/ > DeprecatedParquetVectorizedReader.java > > We are yet to discuss how to factor out some/all of such implementation > from Dremio and contribute back to Parquet and/or Arrow. > > Thanks, > Sidd > > > On Wed, Jan 17, 2018 at 10:14 AM, Li Jin <ice.xell...@gmail.com> wrote: > > > Hey folks, > > > > I know this is supported in C++, but is there a library to convert > between > > Arrow and Parquet? (i.e., read Parquet files in Arrow format, write Arrow > > format to Parquet files). > > > > Jacques and Sidd, does Dremio has some library to do this? > > > > Thanks, > > Li > > >
