[
https://issues.apache.org/jira/browse/PARQUET-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manish Agarwal updated PARQUET-163:
-----------------------------------
Description:
currently i have 2 int fileds and 1 string field . To insert it into parquet i
use 2 intwritables and 1 binarywriatbel object .
For next record i can reuse my 2 IntWritable objects but i have to create a new
BinaryWritable object because BinaryWritable do not have set method . this
is a bottleneck for me in performance as i am doing new again for every record
.
How do you guys recommend i solve this since BytesWritable is not in parquet
's writePrimitive in DataWritableWriter class . it has ByteWritable and we need
BytesWritable
was:
currently i have 2 int fileds and 1 string field . To insert it into parquet i
use 2 intwritables and 1 binarywriatbel object .
For next record i can reuse my 2 intwritable objects but i have to cretae a new
binarywritable object because binarywritable do not have set method . this is
a bottleneck for me in performance .
How do you guys recommend i solve this since BytesWritable is not in parquet
's writePrimitive in DataWritableWriter class . it has ByteWritable and we need
BytesWritable
> BytesWritable is not in parquet 's writePrimitive in DataWritableWriter
> class
> -------------------------------------------------------------------------------
>
> Key: PARQUET-163
> URL: https://issues.apache.org/jira/browse/PARQUET-163
> Project: Parquet
> Issue Type: Bug
> Reporter: Manish Agarwal
>
> currently i have 2 int fileds and 1 string field . To insert it into parquet
> i use 2 intwritables and 1 binarywriatbel object .
> For next record i can reuse my 2 IntWritable objects but i have to create a
> new BinaryWritable object because BinaryWritable do not have set method .
> this is a bottleneck for me in performance as i am doing new again for every
> record .
> How do you guys recommend i solve this since BytesWritable is not in parquet
> 's writePrimitive in DataWritableWriter class . it has ByteWritable and we
> need BytesWritable
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
