RE: Arrow to/from Parquet in Java

2017-02-13 Thread Nikola Zezelj
I would be happy to contribute. I will email you off the thread and we can figure out the next steps. Nikola -Original Message- From: Julien Le Dem [mailto:jul...@dremio.com] Sent: Monday, February 13, 2017 6:11 PM To: dev@arrow.apache.org Subject: Re: Arrow to/from Parquet in Java I

Re: Arrow to/from Parquet in Java

2017-02-13 Thread Julien Le Dem
...@dremio.com] > Sent: Monday, February 13, 2017 5:22 PM > To: dev@arrow.apache.org > Subject: Re: Arrow to/from Parquet in Java > > Hi Nikola, > The Parquet to Arrow reader should live in the Parquet repo here: > https://github.com/apache/parquet-mr/tree/master/parquet-a

RE: Arrow to/from Parquet in Java

2017-02-13 Thread Nikola Zezelj
Sent: Monday, February 13, 2017 5:22 PM To: dev@arrow.apache.org Subject: Re: Arrow to/from Parquet in Java Hi Nikola, The Parquet to Arrow reader should live in the Parquet repo here: https://github.com/apache/parquet-mr/tree/master/parquet-arrow For now it just has schema conversion code between Pa

Re: Arrow to/from Parquet in Java

2017-02-13 Thread Julien Le Dem
ruary 12, 2017 2:25 PM > To: dev@arrow.apache.org > Subject: Re: Arrow to/from Parquet in Java > > hi Nikola, > > I believe Julien started working on this, but I'm not sure what stage of > development it's in. > > We've been building the Arrow/Parquet bri

RE: Arrow to/from Parquet in Java

2017-02-13 Thread Nikola Zezelj
y are feasible). Thanks again, Nikola -Original Message- From: Wes McKinney [mailto:wesmck...@gmail.com] Sent: Sunday, February 12, 2017 2:25 PM To: dev@arrow.apache.org Subject: Re: Arrow to/from Parquet in Java hi Nikola, I believe Julien started working on this, but I'm not sure wha

Re: Arrow to/from Parquet in Java

2017-02-12 Thread Wes McKinney
hi Nikola, I believe Julien started working on this, but I'm not sure what stage of development it's in. We've been building the Arrow/Parquet bridge in parquet-cpp, and it's working very well (e.g. http://wesmckinney.com/blog/python-parquet-multithreading/) -- the nested data implementation is n