Gopal V created HIVE-13241:
------------------------------
Summary: LLAP: Incremental Caching marks some small chunks as
"incomplete CB"
Key: HIVE-13241
URL: https://issues.apache.org/jira/browse/HIVE-13241
Project: Hive
Issue Type: Bug
Reporter: Gopal V
Run #3 of a query with 1 node still has cache misses.
{code}
LLAP IO Summary
----------------------------------------------------------------------------------------------
VERTICES ROWGROUPS META_HIT META_MISS DATA_HIT DATA_MISS ALLOCATION
USED TOTAL_IO
----------------------------------------------------------------------------------------------
Map 1 11 1116 0 1.65GB 93.61MB 0B
0B 32.72s
----------------------------------------------------------------------------------------------
{code}
{code}
2016-03-08T21:05:39,417 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:prepareRangesForCompressedRead(695)) - Locking
0x1c44401d(1) due to reuse
2016-03-08T21:05:39,417 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:prepareRangesForCompressedRead(701)) - Adding an
already-uncompressed buffer 0x1c44401d(2)
2016-03-08T21:05:39,417 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:prepareRangesForCompressedRead(695)) - Locking
0x4e51b032(1) due to reuse
2016-03-08T21:05:39,417 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:prepareRangesForCompressedRead(701)) - Adding an
already-uncompressed buffer 0x4e51b032(2)
2016-03-08T21:05:39,418 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:addOneCompressionBuffer(1161)) - Found CB at 1373931,
chunk length 86587, total 86590, compressed
2016-03-08T21:05:39,418 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:addIncompleteCompressionBuffer(1241)) - Replacing data
range [1373931, 1408408), size: 34474(!) type: direct (and 0 previous chunks)
with incomplete CB start: 1373931 end: 1408408 in the buffers
2016-03-08T21:05:39,418 INFO
[IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]:
encoded.EncodedReaderImpl
(EncodedReaderImpl.java:createRgColumnStreamData(441)) - Getting data for
column 7 RG 14 stream DATA at 1460521, 319811 index position 0: compressed
[1626961, 1780332)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
