Re: Arrow-Parquet converters in Java

[Li Jin]

Hi Sidd,

Thanks for the information. This could be a very useful tool.

Li

On Wed, Jan 17, 2018 at 3:05 PM, Siddharth Teotia 
wrote:

> Hi Li,
>
> We do have support for Parquet <-> Arrow reader/writer in Dremio OSS.
> Please take a look here:
>
> https://github.com/dremio/dremio-oss/tree/master/sabot/
> kernel/src/main/java/com/dremio/exec/store/parquet
> https://github.com/dremio/dremio-oss/blob/master/sabot/
> kernel/src/main/java/com/dremio/exec/store/parquet/columnreaders/
> DeprecatedParquetVectorizedReader.java
>
> We are yet to discuss how to factor out some/all of such implementation
> from Dremio and contribute back to Parquet and/or Arrow.
>
> Thanks,
> Sidd
>
>
> On Wed, Jan 17, 2018 at 10:14 AM, Li Jin  wrote:
>
> > Hey folks,
> >
> > I know this is supported in C++, but is there a library to convert
> between
> > Arrow and Parquet? (i.e., read Parquet files in Arrow format, write Arrow
> > format to Parquet files).
> >
> > Jacques and Sidd, does Dremio has some library to do this?
> >
> > Thanks,
> > Li
> >
>

Arrow-Parquet converters in Java

[Li Jin]

Hey folks,

I know this is supported in C++, but is there a library to convert between
Arrow and Parquet? (i.e., read Parquet files in Arrow format, write Arrow
format to Parquet files).

Jacques and Sidd, does Dremio has some library to do this?

Thanks,
Li