Thanks Wes, Could I potentially do the same from Java (either through JNI or JNA)? Alternatively, could I use hadoop's ParquetWriter to accomplish this task? Performance is definitely a concern so I would appreciate any input as to how these two approaches would compare (in case they are feasible).
Thanks again, Nikola -----Original Message----- From: Wes McKinney [mailto:[email protected]] Sent: Sunday, February 12, 2017 2:25 PM To: [email protected] Subject: Re: Arrow to/from Parquet in Java hi Nikola, I believe Julien started working on this, but I'm not sure what stage of development it's in. We've been building the Arrow/Parquet bridge in parquet-cpp, and it's working very well (e.g. http://wesmckinney.com/blog/python-parquet-multithreading/) -- the nested data implementation is not yet completed, though. - Wes On Sat, Feb 11, 2017 at 7:34 PM, Nikola Zezelj <[email protected]> wrote: > Hi, > > I am trying to convert between Arrow and Parquet formats in Java. How do I > go about doing it? > Any help would be greatly appreciated. Thanks! > > -- > Nikola Žeželj > > > This message is for the intended recipient(s) only and subject to > terms and conditions available at > www.seaportglobal.com/pages/disclaimer > > Additional important disclosures: > www.seaportglobal.com/pages/disclosures This message is for the intended recipient(s) only and subject to terms and conditions available at www.seaportglobal.com/pages/disclaimer Additional important disclosures: www.seaportglobal.com/pages/disclosures
