[
https://issues.apache.org/jira/browse/HIVE-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682444#comment-14682444
]
Sergey Shelukhin commented on HIVE-11505:
-----------------------------------------
I cannot repro this or see how it can happen in code. The setting must be set
in daemon config and before init, it won't work from CLI.
Can you double check the logs for this line:
{noformat}
LlapIoImpl.LOG.info("Buddy allocator with " + (isDirect ? "direct" : "byte")
+ " buffers; allocation sizes " + minAllocation + " - " +
maxAllocation
+ ", arena size " + arenaSize + ". total size " + maxSizeVal);
{noformat}
> Disabling llap cache allocate direct is not honored anymore
> -----------------------------------------------------------
>
> Key: HIVE-11505
> URL: https://issues.apache.org/jira/browse/HIVE-11505
> Project: Hive
> Issue Type: Sub-task
> Affects Versions: llap
> Reporter: Prasanth Jayachandran
> Assignee: Sergey Shelukhin
>
> ORC refactorings probably broke something. I disabled cache direct allocation
> but still I am getting this exception
> {code}
> Caused by: java.lang.UnsatisfiedLinkError:
> org.apache.hadoop.io.compress.zlib.ZlibDecompressor.$$YJP$$init(I)J
> at
> org.apache.hadoop.io.compress.zlib.ZlibDecompressor.$$YJP$$init(Native Method)
> at
> org.apache.hadoop.io.compress.zlib.ZlibDecompressor.init(ZlibDecompressor.java)
> at
> org.apache.hadoop.io.compress.zlib.ZlibDecompressor.<init>(ZlibDecompressor.java:115)
> at
> org.apache.hadoop.io.compress.zlib.ZlibDecompressor$ZlibDirectDecompressor.<init>(ZlibDecompressor.java:358)
> at
> org.apache.hadoop.hive.shims.ZeroCopyShims.getDirectDecompressor(ZeroCopyShims.java:114)
> at
> org.apache.hadoop.hive.shims.Hadoop23Shims.getDirectDecompressor(Hadoop23Shims.java:975)
> at
> org.apache.hadoop.hive.ql.io.orc.ZlibCodec.directDecompress(ZlibCodec.java:128)
> at
> org.apache.hadoop.hive.ql.io.orc.ZlibCodec.decompress(ZlibCodec.java:84)
> at
> org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.decompressChunk(EncodedReaderImpl.java:1128)
> at
> org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedStream(EncodedReaderImpl.java:780)
> at
> org.apache.hadoop.hive.ql.io.orc.EncodedReaderImpl.readEncodedColumns(EncodedReaderImpl.java:467)
> at
> org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:355)
> at
> org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.callInternal(OrcEncodedDataReader.java:70)
> at
> org.apache.hadoop.hive.common.CallableWithNdc.call(CallableWithNdc.java:37)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
