Mikko Kupsu created PARQUET-781:
-----------------------------------

             Summary: ParquetOuptputFormat should support custom OutputCommitter
                 Key: PARQUET-781
                 URL: https://issues.apache.org/jira/browse/PARQUET-781
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-mr
            Reporter: Mikko Kupsu


ParquetOutputFormat should support custom OutputCommitter.

There is a need to bypass current Hadoop functionality of writing output data 
under *_temporary* folder. Especially with AWS S3, there can be huge overhead 
of moving the files from *_temporary* folder to output folder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to