[ 
https://issues.apache.org/jira/browse/PARQUET-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122174#comment-14122174
 ] 

Parth Chandra commented on PARQUET-78:
--------------------------------------

Added a pull request - 
https://github.com/apache/incubator-parquet-mr/pull/50

> Provide a ByteBuffer based write path
> -------------------------------------
>
>                 Key: PARQUET-78
>                 URL: https://issues.apache.org/jira/browse/PARQUET-78
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>            Reporter: Parth Chandra
>
> Similar to the effort to use a ByteBuffer in the read path, we should provide 
> a path to use a ByteBuffer in the write path.
> The proposed idea is to provide an allocator in the writer that is passed 
> down to CapacityByteArrayOutputStream and is used to allocate a ByteBuffer 
> instead of the byte array that it currently uses. 
> I've attached a patch based on the 1.5 release that does that. There are two 
> implementations of the allocator - one for Heap memory and one for Direct 
> memory. In addition, the allocator interface allows for a 'release' method so 
> that reference counted memory allocators like Netty's ByteBuf can be used to 
> provide an allocator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to