Hi Nikola, The Parquet to Arrow reader should live in the Parquet repo here: https://github.com/apache/parquet-mr/tree/master/parquet-arrow For now it just has schema conversion code between Parquet and Arrow. I've been working on a Java Parquet to Arrow reader. What is your use case? Did you have types of specific schemas in mind (flat/nested)?
On Mon, Feb 13, 2017 at 11:11 AM, Nikola Zezelj <[email protected]> wrote: > Thanks Wes, > > Could I potentially do the same from Java (either through JNI or JNA)? > Alternatively, could I use hadoop's ParquetWriter to accomplish this task? > Performance is definitely a concern so I would appreciate any input as to > how these two approaches would compare (in case they are feasible). > > Thanks again, > Nikola > > -----Original Message----- > From: Wes McKinney [mailto:[email protected]] > Sent: Sunday, February 12, 2017 2:25 PM > To: [email protected] > Subject: Re: Arrow to/from Parquet in Java > > hi Nikola, > > I believe Julien started working on this, but I'm not sure what stage of > development it's in. > > We've been building the Arrow/Parquet bridge in parquet-cpp, and it's > working very well (e.g. > http://wesmckinney.com/blog/python-parquet-multithreading/) -- the nested > data implementation is not yet completed, though. > > - Wes > > On Sat, Feb 11, 2017 at 7:34 PM, Nikola Zezelj <[email protected]> > wrote: > > Hi, > > > > I am trying to convert between Arrow and Parquet formats in Java. How > do I go about doing it? > > Any help would be greatly appreciated. Thanks! > > > > -- > > Nikola Žeželj > > > > > > This message is for the intended recipient(s) only and subject to > > terms and conditions available at > > www.seaportglobal.com/pages/disclaimer > > > > Additional important disclosures: > > www.seaportglobal.com/pages/disclosures > > This message is for the intended recipient(s) only and subject to terms > and conditions available at www.seaportglobal.com/pages/disclaimer > > Additional important disclosures: www.seaportglobal.com/pages/disclosures > -- Julien
