Hi Nitish, Currently, partitioning is handled above the Parquet layer. The Parquet project is primarily focused on the file format. There are libraries you can use to do partitioning with Parquet. One of them you may be interested in is Kite because its support is based on parquet-avro: http://kitesdk.org/docs/current/
rb On Thu, Oct 20, 2016 at 4:31 AM, Nitish Alluri <[email protected]> wrote: > Hi, > > Is there anyway I can write the output in partitioned folders by column > values? Something like Hive partitioning : > > Ex : /user/hive/warehouse/partitioned_user/country=US/state=CA/ > > I am also willing to contribute for this feature if its not possible and > have a vague idea of how to approach the problem. > > Regards, > Nitish > -- Ryan Blue Software Engineer Netflix
