[
https://issues.apache.org/jira/browse/HIVE-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280508#comment-15280508
]
Prasanth Jayachandran commented on HIVE-13563:
----------------------------------------------
IMO, we are often hit by OOM because of compression buffer size and not stripe
size.
How about this?
default ratio: 4
*Base files:*
default compression chunk: 64k
default stripe size: 64MB
*Delta files:*
delta compression: 16k
delta stripe: 16MB
> Hive Streaming does not honor orc.compress.size and orc.stripe.size table
> properties
> ------------------------------------------------------------------------------------
>
> Key: HIVE-13563
> URL: https://issues.apache.org/jira/browse/HIVE-13563
> Project: Hive
> Issue Type: Bug
> Components: ORC
> Affects Versions: 2.1.0
> Reporter: Wei Zheng
> Assignee: Wei Zheng
> Labels: TODOC2.1
> Attachments: HIVE-13563.1.patch
>
>
> According to the doc:
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC#LanguageManualORC-HiveQLSyntax
> One should be able to specify tblproperties for many ORC options.
> But the settings for orc.compress.size and orc.stripe.size don't take effect.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
