See <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/1750/display/redirect>
------------------------------------------ [...truncated 131.42 KB...] schema file not found ## Block Detail Shard #1 (20085054250887714_batchno0-0-null-20085052602098658) BLK BLKLT NumPages NumRows Size 0 0 28 896,000 2.57MB 0 1 28 896,000 2.57MB 1 0 28 896,000 2.57MB 1 1 28 896,000 2.57MB ## version Details written_by Version TestUtil 1.6.0-SNAPSHOT ## Column Statistics for 'age' Shard #1 (20085054250887714_batchno0-0-null-20085052602098658) BLK BLKLT Meta Size Data Size LocalDict DictEntries DictSize AvgPageSize Min% Max% Min Max 0 0 3.36KB 5.14MB false 0 0.0B 93.76KB 0.0 100.0 0 2999990 0 1 3.36KB 2.57MB false 0 0.0B 93.76KB 0.0 100.0 1 2999992 1 0 3.36KB 5.14MB false 0 0.0B 93.76KB 0.0 100.0 3 2999994 1 1 3.36KB 2.57MB false 0 0.0B 93.76KB 0.0 100.0 5 2999996 2 0 3.36KB 4.06MB false 0 0.0B 93.76KB 0.0 100.0 7 2999998 2 1 2.04KB 1.49MB false 0 0.0B 89.62KB 0.0 100.0 9 2999999 Shard #2 (20085077277737433_batchno0-0-null-20085077201524525) BLK BLKLT Meta Size Data Size LocalDict DictEntries DictSize AvgPageSize Min% Max% Min Max 0 0 3.36KB 5.14MB false 0 0.0B 93.76KB 0.0 100.0 0 2999990 0 1 3.36KB 2.57MB false 0 0.0B 93.76KB 0.0 100.0 1 2999992 1 0 3.36KB 5.14MB false 0 0.0B 93.76KB 0.0 100.0 3 2999994 1 1 3.36KB 2.57MB false 0 0.0B 93.76KB 0.0 100.0 5 2999996 2 0 3.36KB 4.06MB false 0 0.0B 93.76KB 0.0 100.0 7 2999998 2 1 2.04KB 1.49MB false 0 0.0B 89.62KB 0.0 100.0 9 2999999 Input Folder: ./CarbonCliTest ## Summary total: 6 blocks, 2 shards, 12 blocklets, 314 pages, 10,000,000 rows, 28.68MB avg: 4.78MB/block, 2.39MB/blocklet, 1,666,666 rows/block, 833,333 rows/blocklet ## Column Statistics for 'name' Shard #1 (20085116429834045_batchno0-0-null-20085116404945589) BLK BLKLT Meta Size Data Size LocalDict DictEntries DictSize AvgPageSize Min% Max% Min Max 0 0 1.90KB 2.15KB true 2 18.0B 9.0B NA NA robot0 robot1 0 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot1 robot3 1 0 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot3 robot5 1 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot5 robot7 2 0 1.90KB 2.14KB true 2 18.0B 9.0B NA NA robot7 robot8 2 1 1.18KB 1.33KB true 2 18.0B 9.0B NA NA robot8 robot9 Shard #2 (20085096986948367_batchno0-0-null-20085096972996480) BLK BLKLT Meta Size Data Size LocalDict DictEntries DictSize AvgPageSize Min% Max% Min Max 0 0 1.90KB 2.15KB true 2 18.0B 9.0B NA NA robot0 robot1 0 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot1 robot3 1 0 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot3 robot5 1 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot5 robot7 2 0 1.90KB 2.14KB true 2 18.0B 9.0B NA NA robot7 robot8 2 1 1.18KB 1.33KB true 2 18.0B 9.0B NA NA robot8 robot9 ## Page Meta for column 'name' in file <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/ws/CarbonCliTest/part-0-20085096986948367_batchno0-0-null-20085096972996480.carbondata> Blocklet 0: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 30], max_values:[72 6F 62 6F 74 30], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 30], max_values:[72 6F 62 6F 74 30], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 30], max_values:[72 6F 62 6F 74 30], min_max_presence:[true]), numberOfRowsInpage:32000) Blocklet 1: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 31], max_values:[72 6F 62 6F 74 31], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 31], max_values:[72 6F 62 6F 74 31], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 31], max_values:[72 6F 62 6F 74 31], min_max_presence:[true]), numberOfRowsInpage:32000) ## Page Meta for column 'name' in file <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/ws/CarbonCliTest/part-1-20085096986948367_batchno0-0-null-20085096972996480.carbondata> Blocklet 0: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 33], max_values:[72 6F 62 6F 74 33], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 33], max_values:[72 6F 62 6F 74 33], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 33], max_values:[72 6F 62 6F 74 33], min_max_presence:[true]), numberOfRowsInpage:32000) Blocklet 1: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 35], max_values:[72 6F 62 6F 74 35], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 35], max_values:[72 6F 62 6F 74 35], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 35], max_values:[72 6F 62 6F 74 35], min_max_presence:[true]), numberOfRowsInpage:32000) ## Page Meta for column 'name' in file <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/ws/CarbonCliTest/part-2-20085096986948367_batchno0-0-null-20085096972996480.carbondata> Blocklet 0: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 37], max_values:[72 6F 62 6F 74 37], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 37], max_values:[72 6F 62 6F 74 37], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 37], max_values:[72 6F 62 6F 74 37], min_max_presence:[true]), numberOfRowsInpage:32000) Blocklet 1: Page 0 (offset 0, length 16): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:16, compressor_name:snappy), rowMajor:false, data_page_length:8, rle_page_length:8, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 38], max_values:[72 6F 62 6F 74 39], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 16, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 39], max_values:[72 6F 62 6F 74 39], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 25, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 39], max_values:[72 6F 62 6F 74 39], min_max_presence:[true]), numberOfRowsInpage:32000) ## Page Meta for column 'name' in file <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/ws/CarbonCliTest/part-0-20085116429834045_batchno0-0-null-20085116404945589.carbondata> Blocklet 0: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 30], max_values:[72 6F 62 6F 74 30], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 30], max_values:[72 6F 62 6F 74 30], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 30], max_values:[72 6F 62 6F 74 30], min_max_presence:[true]), numberOfRowsInpage:32000) Blocklet 1: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 31], max_values:[72 6F 62 6F 74 31], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 31], max_values:[72 6F 62 6F 74 31], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 31], max_values:[72 6F 62 6F 74 31], min_max_presence:[true]), numberOfRowsInpage:32000) ## Page Meta for column 'name' in file <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/ws/CarbonCliTest/part-1-20085116429834045_batchno0-0-null-20085116404945589.carbondata> Blocklet 0: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 33], max_values:[72 6F 62 6F 74 33], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 33], max_values:[72 6F 62 6F 74 33], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 33], max_values:[72 6F 62 6F 74 33], min_max_presence:[true]), numberOfRowsInpage:32000) Blocklet 1: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 35], max_values:[72 6F 62 6F 74 35], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 35], max_values:[72 6F 62 6F 74 35], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 35], max_values:[72 6F 62 6F 74 35], min_max_presence:[true]), numberOfRowsInpage:32000) ## Page Meta for column 'name' in file <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-cli/ws/CarbonCliTest/part-2-20085116429834045_batchno0-0-null-20085116404945589.carbondata> Blocklet 0: Page 0 (offset 0, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 37], max_values:[72 6F 62 6F 74 37], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 9, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 37], max_values:[72 6F 62 6F 74 37], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 18, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 37], max_values:[72 6F 62 6F 74 37], min_max_presence:[true]), numberOfRowsInpage:32000) Blocklet 1: Page 0 (offset 0, length 16): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:16, compressor_name:snappy), rowMajor:false, data_page_length:8, rle_page_length:8, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 38], max_values:[72 6F 62 6F 74 39], min_max_presence:[true]), numberOfRowsInpage:32000) Page 1 (offset 16, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 39], max_values:[72 6F 62 6F 74 39], min_max_presence:[true]), numberOfRowsInpage:32000) Page 2 (offset 25, length 9): DataChunk2(chunk_meta:ChunkCompressionMeta(compression_codec:DEPRECATED, total_uncompressed_size:96000, total_compressed_size:9, compressor_name:snappy), rowMajor:false, data_page_length:5, rle_page_length:4, presence:PresenceMeta(represents_presence:false, present_bit_stream:00), sort_state:SORT_NATIVE, encoders:[RLE], encoder_meta:[], min_max:BlockletMinMaxIndex(min_values:[72 6F 62 6F 74 39], max_values:[72 6F 62 6F 74 39], min_max_presence:[true]), numberOfRowsInpage:32000) Input Folder: ./CarbonCliTest sorted by name Input Folder: ./CarbonCliTest ## Summary total: 6 blocks, 2 shards, 12 blocklets, 314 pages, 10,000,000 rows, 28.68MB avg: 4.78MB/block, 2.39MB/blocklet, 1,666,666 rows/block, 833,333 rows/blocklet Input Folder: ./CarbonCliTest ## Summary total: 6 blocks, 2 shards, 12 blocklets, 314 pages, 10,000,000 rows, 28.68MB avg: 4.78MB/block, 2.39MB/blocklet, 1,666,666 rows/block, 833,333 rows/blocklet ## Schema schema in part-2-20085191135047750_batchno0-0-null-20085191120337037.carbondata version: V3 timestamp: 2019-06-12 07:19:33.443 Column Name Data Type Column Type SortColumn Encoding Ordinal Id name STRING dimension true [] 0 NA age INT measure false [] 1 NA Input Folder: ./CarbonCliTest ## Summary total: 6 blocks, 2 shards, 12 blocklets, 314 pages, 10,000,000 rows, 28.68MB avg: 4.78MB/block, 2.39MB/blocklet, 1,666,666 rows/block, 833,333 rows/blocklet ## Table Properties schema file not found Input Folder: ./CarbonCliTest ## Summary total: 6 blocks, 2 shards, 12 blocklets, 314 pages, 10,000,000 rows, 28.68MB avg: 4.78MB/block, 2.39MB/blocklet, 1,666,666 rows/block, 833,333 rows/blocklet ## Block Detail Shard #1 (20085172513932356_batchno0-0-null-20085172503700850) BLK BLKLT NumPages NumRows Size 0 0 28 896,000 2.57MB 0 1 28 896,000 2.57MB 1 0 28 896,000 2.57MB 1 1 28 896,000 2.57MB 2 0 28 896,000 2.57MB 2 1 17 520,000 1.49MB Shard #2 (20085191135047750_batchno0-0-null-20085191120337037) BLK BLKLT NumPages NumRows Size 0 0 28 896,000 2.57MB 0 1 28 896,000 2.57MB 1 0 28 896,000 2.57MB 1 1 28 896,000 2.57MB 2 0 28 896,000 2.57MB 2 1 17 520,000 1.49MB Input Folder: ./CarbonCliTest ## Summary total: 6 blocks, 2 shards, 12 blocklets, 314 pages, 10,000,000 rows, 28.68MB avg: 4.78MB/block, 2.39MB/blocklet, 1,666,666 rows/block, 833,333 rows/blocklet ## Column Statistics for 'name' Shard #1 (20085172513932356_batchno0-0-null-20085172503700850) BLK BLKLT Meta Size Data Size LocalDict DictEntries DictSize AvgPageSize Min% Max% Min Max 0 0 1.90KB 2.15KB true 2 18.0B 9.0B NA NA robot0 robot1 0 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot1 robot3 1 0 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot3 robot5 1 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot5 robot7 2 0 1.90KB 2.14KB true 2 18.0B 9.0B NA NA robot7 robot8 2 1 1.18KB 1.33KB true 2 18.0B 9.0B NA NA robot8 robot9 Shard #2 (20085191135047750_batchno0-0-null-20085191120337037) BLK BLKLT Meta Size Data Size LocalDict DictEntries DictSize AvgPageSize Min% Max% Min Max 0 0 1.90KB 2.15KB true 2 18.0B 9.0B NA NA robot0 robot1 0 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot1 robot3 1 0 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot3 robot5 1 1 1.90KB 2.16KB true 3 22.0B 9.0B NA NA robot5 robot7 2 0 1.90KB 2.14KB true 2 18.0B 9.0B NA NA robot7 robot8 2 1 1.18KB 1.33KB true 2 18.0B 9.0B NA NA robot8 robot9 Input Folder: ./CarbonCliTestBinary ## Summary total: 14 blocks, 1 shards, 28 blocklets, 313 pages, 10,000,000 rows, 69.28MB avg: 4.95MB/block, 2.47MB/blocklet, 714,285 rows/block, 357,142 rows/blocklet Input Folder: ./CarbonCliTestBinary ## Summary total: 14 blocks, 1 shards, 28 blocklets, 313 pages, 10,000,000 rows, 69.28MB avg: 4.95MB/block, 2.47MB/blocklet, 714,285 rows/block, 357,142 rows/blocklet ## Schema schema in part-13-20085245708249588_batchno0-0-null-20085245691649652.carbondata version: V3 timestamp: 2019-06-12 07:20:28.014 Column Name Data Type Column Type SortColumn Encoding Ordinal Id name STRING dimension true [] 0 NA binaryfield BINARY dimension false [] 2 *ield age INT measure false [] 1 NA Input Folder: ./CarbonCliTest ## Benchmark ReadHeaderAndFooter takes 919 us ConvertFooter takes 2,700 us ReadAllMetaAndConvertFooter takes 6,143 us Scan column 'name' Blocklet#0: total size 2.15KB, 28 pages, 896,000 rows ColumnChunk IO takes 9,683 us Decompress Pages takes 48,095 us Blocklet#1: total size 2.16KB, 28 pages, 896,000 rows ColumnChunk IO takes 999 us Decompress Pages takes 20,831 us 2019-06-12 07:21:48 INFO CarbonDataProcessorUtil:566 - batch sort size is set to 0 2019-06-12 07:21:48 INFO SortParameters:440 - Sort size for table: 100000 2019-06-12 07:21:48 INFO SortParameters:446 - Number of intermediate file to be merged: 20 2019-06-12 07:21:48 INFO SortParameters:456 - temp file location: /tmp/20085326558691271_attempt_1e729bab-46ee-4b2f-b794-0b9502a1cc2e_0000_m_1686709230_226876279/Fact/Part0/Segment_null/20085326558661173/sortrowtmp 2019-06-12 07:21:48 INFO SortParameters:472 - Compression SNAPPY will be used for writing the sort temp File 2019-06-12 07:21:48 WARN UnsafeIntermediateMerger:89 - the configure spill size is 0 less than the page size 67108864,so no merge and spill in-memory pages to disk 2019-06-12 07:21:48 INFO DataLoadExecutor:50 - Data Loading is started for table _tempTable_20085326551556342 Killed Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [JENKINS] Recording test results
