[
https://issues.apache.org/jira/browse/HIVE-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031417#comment-14031417
]
Gopal V commented on HIVE-7219:
-------------------------------
Ran both mode inserts (1243 vs 1269s) with Snappy (which is only 2% faster, but
the columns had 1:1:2 ratio of int, double, string).
String columns will speed up with HIVE-7144, hopefully.
||Table || Size || Speed || Difference ||
|customer | 10.5 | 10.6| + 0.98 % |
|lineitem | 204.7 | 220.7 | + 7.81% |
|orders | 48.7 | 50.8 | + 4.31% |
|part | 4.3 | 4.6| + 6.97 % |
|partsupp | 39.1 | 39.5 | + 1.02%|
|supplier | 0.68 | 0.69 | + 1.47% |
> Improve performance of serialization utils in ORC
> -------------------------------------------------
>
> Key: HIVE-7219
> URL: https://issues.apache.org/jira/browse/HIVE-7219
> Project: Hive
> Issue Type: Improvement
> Components: File Formats
> Affects Versions: 0.14.0
> Reporter: Prasanth J
> Assignee: Prasanth J
> Attachments: HIVE-7219.1.patch, HIVE-7219.2.patch, HIVE-7219.3.patch,
> orc-read-perf-jmh-benchmark.png
>
>
> ORC uses serialization utils heavily for reading and writing data. The
> bitpacking and unpacking code in writeInts() and readInts() can be unrolled
> for better performance. Also double reader/writer performance can be improved
> by bulk reading/writing from/to byte array.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
