CesarChoy opened a new issue #5827: URL: https://github.com/apache/incubator-doris/issues/5827
    完全命中rollup，还要走本地agg(处理和返回条数相同，还要6s啊)，hash后再次agg，这样的执行逻辑合理吗?... ------------------------------------------------------------------------------------------------------------------------ ----------------------------------------------------------------------------------------- CREATE TABLE dw.dwa_tg_sku_1d_detail_w_detail( `dctime` date, `domain` int, `products_id` bigint, `sku` varchar(500), `site_port` varchar(255), `site` varchar(255), `country_code` varchar(255), `resource_group` varchar(255), `utm_source` varchar(255), `utm_medium` varchar(800), `utm_campaign` varchar(800), `utm_content` varchar(255), `utm_ho` varchar(255), `site_keywords` varchar(255), `zone` varchar(255), `country_name_cn` varchar(255), `lang_area_en` varchar(255), `categories_id` bigint, `brand_director_name` varchar(255), `px_id` bigint, `px_name` varchar(255), `brand_id` bigint, `brand_name` varchar(255), `oa_ms_id` bigint, `oa_ms_name` varchar(255), `sj_id` bigint, `sj_name` varchar(255), `oa_kf_id` bigint, `oa_kf_name` varchar(255), `oa_bj_id` bigint, `oa_bj_name` varchar(255), `shooted_userid` bigint, `shooted_username` varchar(255), `pv` bigint, `cart_cnt` bigint, `wish_cnt` bigint, `show_cnt` bigint, `click_cnt` bigint, `bounce_cnt` bigint, `stay_time` bigint, `view_user_id` bigint, `view_sess_id` bigint, `pay_orders_id` bigint, `pay_orders_amount` decimal(15,4), `pay_quantity` int, `customers_id` bigint, `pay_customers_id` bigint, `click_pay_cnt` bigint, `create_time` varchar(255), `record_cnt` int ) ENGINE=olap DUPLICATE KEY( dctime, domain, products_id ) PARTITION BY RANGE (`dctime`) ( PARTITION p20210401 VALUES LESS THAN ("20210402"), PARTITION p20210402 VALUES LESS THAN ("20210403"), PARTITION p20210403 VALUES LESS THAN ("20210404"), PARTITION p20210404 VALUES LESS THAN ("20210405"), PARTITION p20210405 VALUES LESS THAN ("20210406"), PARTITION p20210406 VALUES LESS THAN ("20210407"), PARTITION p20210407 VALUES LESS THAN ("20210408"), PARTITION p20210408 VALUES LESS THAN ("20210409"), PARTITION p20210409 VALUES LESS THAN ("20210410"), PARTITION p20210410 VALUES LESS THAN ("20210411"), PARTITION p20210411 VALUES LESS THAN ("20210412"), PARTITION p20210412 VALUES LESS THAN ("20210413"), PARTITION p20210413 VALUES LESS THAN ("20210414"), PARTITION p20210414 VALUES LESS THAN ("20210415"), PARTITION p20210415 VALUES LESS THAN ("20210416"), PARTITION p20210416 VALUES LESS THAN ("20210417"), PARTITION p20210417 VALUES LESS THAN ("20210418"), PARTITION p20210418 VALUES LESS THAN ("20210419"), PARTITION p20210419 VALUES LESS THAN ("20210420"), PARTITION p20210420 VALUES LESS THAN ("20210421"), PARTITION p20210421 VALUES LESS THAN ("20210422"), PARTITION p20210422 VALUES LESS THAN ("20210423"), PARTITION p20210423 VALUES LESS THAN ("20210424"), PARTITION p20210424 VALUES LESS THAN ("20210425"), PARTITION p20210425 VALUES LESS THAN ("20210426"), PARTITION p20210426 VALUES LESS THAN ("20210427"), PARTITION p20210427 VALUES LESS THAN ("20210428"), PARTITION p20210428 VALUES LESS THAN ("20210429"), PARTITION p20210429 VALUES LESS THAN ("20210430"), ) DISTRIBUTED BY HASH (products_id) PROPERTIES ( "replication_num" = "2", "dynamic_partition.enable" = "true", "dynamic_partition.time_unit" = "DAY", "dynamic_partition.end" = "3", "dynamic_partition.prefix" = "p", "dynamic_partition.buckets" = "6" ); ------------------------------------------------------------------------------------------------------------------------ Query: Summary: - Query ID: 92034a1aa98e4542-9cec2851a56f43ff - Start Time: 2021-05-15 03:00:48 - End Time: 2021-05-15 03:01:02 - Total: 14s646ms - Query Type: Query - Query State: EOF - Doris Version: 0.14.7 - User: admin - Default Db: - Sql Statement: /* ApplicationName=DBeaver 7.3.4 - SQLEditor */ -- explain SELECT dctime ,domain ,products_id ,sum(pv) pv -- 711ms ,bitmap_union_count(customers_id) customer_cnt -- 1.8s ,bitmap_union_count(pay_customers_id) pay_customers_cnt -- 1.9s FROM dw.dwa_tg_sku_1d_detail_w -- 28.9s -- FROM test.dwa_tg_sku_1d_detail_w_without WHERE dctime BETWEEN '2021-04-01' AND '2021-04-30' GROUP BY dctime ,domain ,products_id order by pv desc LIMIT 0, 200 - Is Cached: No Execution Summary: - Analysis Time: 487.951us - Plan Time: 960.488us - Schedule Time: 4.973ms - Wait and Fetch Result Time: 14s639ms Execution Profile 92034a1aa98e4542-9cec2851a56f43ff:(Active: 14s645ms, % non-child: 100.00%) Fragment 0: Instance 92034a1aa98e4542-9cec2851a56f4406 (host=TNetworkAddress(hostname:172.29.1.148, port:9060)):(Active: 14s642ms, % non-child: 0.00%) - AverageThreadTokens: 4607182418800017400.00 - FragmentCpuTime: 677.507us - MemoryLimit: 2.00 GB - PeakMemoryUsage: 63.13 KB - PeakReservation: 0.00 - PeakUsedReservation: 0.00 - RowsProduced: 200 BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataBufferSender (dst_fragment_instance_id=92034a1aa98e4542-9cec2851a56f4406): - AppendBatchTime: 522.44us - ResultRendTime: 75.47us - TupleConvertTime: 250.662us - NumSentRows: 200 EXCHANGE_NODE (id=5):(Active: 14s642ms, % non-child: 99.97%) - BytesReceived: 8.41 KB - ConvertRowBatchTime: 0ns - DataArrivalWaitTime: 14s642ms - DeserializeRowBatchTimer: 65.375us - FirstBatchArrivalWaitTime: 14s641ms - MergeGetNext: 318.536us - MergeGetNextBatch: 273.554us - PeakMemoryUsage: 55.13 KB - RowsReturned: 600 - RowsReturnedRate: 40 - SendersBlockedTotalTimer(*): 0ns Fragment 1: Instance 92034a1aa98e4542-9cec2851a56f4404 (host=TNetworkAddress(hostname:172.29.1.139, port:9060)):(Active: 14s640ms, % non-child: 0.00%) - AverageThreadTokens: 4607182418800017400.00 - FragmentCpuTime: 9s625ms - MemoryLimit: 2.00 GB - PeakMemoryUsage: 482.35 MB - PeakReservation: 482.00 MB - PeakUsedReservation: 0.00 - RowsProduced: 200 BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataStreamSender (dst_id=5, dst_fragments=[92034a1aa98e4542-9cec2851a56f4406]):(Active: 138.605us, % non-child: 0.00%) - BytesSent: 4.16 KB - IgnoreRows: 0 - OverallThroughput: 29.276607513427734 MB/sec - PeakMemoryUsage: 2.28 KB - SerializeBatchTime: 50.657us - UncompressedRowBatchSize: 11.72 KB SORT_NODE (id=2):(Active: 14s639ms, % non-child: 3.84%) - PeakMemoryUsage: 80.00 KB - RowsReturned: 200 - RowsReturnedRate: 13 AGGREGATION_NODE (id=4):(Active: 14s78ms, % non-child: 63.48%) - Probe Method: HashTable Linear Probing - BuildTime: 4s964ms - GetResultsTime: 4s307ms - HTResize: 144 - HTResizeTime: 283.228ms - HashBuckets: 8.388608M (8388608) - HashCollisions: 0 - HashFailedProbe: 0 - HashFilledBuckets: 4.799994M (4799994) - HashProbe: 4.799994M (4799994) - HashTravelLength: 10.895845M (10895845) - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 482.19 MB - RowsProcessed: 4.799994M (4799994) - RowsRepartitioned: 0 - RowsReturned: 4.799994M (4799994) - RowsReturnedRate: 340.952K /sec - SpilledPartitions: 0 EXCHANGE_NODE (id=3):(Active: 4s781ms, % non-child: 32.64%) - BytesReceived: 99.44 MB - ConvertRowBatchTime: 90.123ms - DataArrivalWaitTime: 4s555ms - DeserializeRowBatchTimer: 733.668ms - FirstBatchArrivalWaitTime: 247.133ms - PeakMemoryUsage: 27.86 MB - RowsReturned: 4.799994M (4799994) - RowsReturnedRate: 1.003949M /sec - SendersBlockedTotalTimer(*): 0ns Buffer pool: - AllocTime: 1.485ms - CumulativeAllocationBytes: 594.00 MB - CumulativeAllocations: 233 - PeakReservation: 482.00 MB - PeakUnpinnedBytes: 0.00 - PeakUsedReservation: 480.00 MB - ReservationLimit: 80.00 GB Instance 92034a1aa98e4542-9cec2851a56f4405 (host=TNetworkAddress(hostname:172.29.1.42, port:9060)):(Active: 14s570ms, % non-child: 0.00%) - AverageThreadTokens: 4607182418800017400.00 - FragmentCpuTime: 8s934ms - MemoryLimit: 2.00 GB - PeakMemoryUsage: 482.29 MB - PeakReservation: 482.00 MB - PeakUsedReservation: 0.00 - RowsProduced: 200 BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataStreamSender (dst_id=5, dst_fragments=[92034a1aa98e4542-9cec2851a56f4406]):(Active: 134.702us, % non-child: 0.00%) - BytesSent: 4.25 KB - IgnoreRows: 0 - OverallThroughput: 30.818727493286133 MB/sec - PeakMemoryUsage: 2.28 KB - SerializeBatchTime: 50.560us - UncompressedRowBatchSize: 11.72 KB SORT_NODE (id=2):(Active: 14s569ms, % non-child: 3.80%) - PeakMemoryUsage: 80.00 KB - RowsReturned: 200 - RowsReturnedRate: 13 AGGREGATION_NODE (id=4):(Active: 14s13ms, % non-child: 54.47%) - Probe Method: HashTable Linear Probing - BuildTime: 3s712ms - GetResultsTime: 4s241ms - HTResize: 144 - HTResizeTime: 270.868ms - HashBuckets: 8.388608M (8388608) - HashCollisions: 0 - HashFailedProbe: 0 - HashFilledBuckets: 4.801287M (4801287) - HashProbe: 4.801287M (4801287) - HashTravelLength: 10.919506M (10919506) - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 482.21 MB - RowsProcessed: 4.801287M (4801287) - RowsRepartitioned: 0 - RowsReturned: 4.801287M (4801287) - RowsReturnedRate: 342.625K /sec - SpilledPartitions: 0 EXCHANGE_NODE (id=3):(Active: 6s35ms, % non-child: 41.21%) - BytesReceived: 100.36 MB - ConvertRowBatchTime: 85.916ms - DataArrivalWaitTime: 5s791ms - DeserializeRowBatchTimer: 789.41ms - FirstBatchArrivalWaitTime: 248.44ms - PeakMemoryUsage: 8.90 MB - RowsReturned: 4.801287M (4801287) - RowsReturnedRate: 795.461K /sec - SendersBlockedTotalTimer(*): 0ns Buffer pool: - AllocTime: 1.116ms - CumulativeAllocationBytes: 594.00 MB - CumulativeAllocations: 233 - PeakReservation: 482.00 MB - PeakUnpinnedBytes: 0.00 - PeakUsedReservation: 480.00 MB - ReservationLimit: 80.00 GB Instance 92034a1aa98e4542-9cec2851a56f4403 (host=TNetworkAddress(hostname:172.29.1.148, port:9060)):(Active: 14s467ms, % non-child: 0.00%) - AverageThreadTokens: 4607182418800017400.00 - FragmentCpuTime: 8s783ms - MemoryLimit: 2.00 GB - PeakMemoryUsage: 482.32 MB - PeakReservation: 482.00 MB - PeakUsedReservation: 0.00 - RowsProduced: 200 BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataStreamSender (dst_id=5, dst_fragments=[92034a1aa98e4542-9cec2851a56f4406]):(Active: 50.230us, % non-child: 0.00%) - BytesSent: 0.00 - IgnoreRows: 0 - OverallThroughput: 0.0 /sec - PeakMemoryUsage: 2.28 KB - SerializeBatchTime: 0ns - UncompressedRowBatchSize: 0.00 SORT_NODE (id=2):(Active: 14s467ms, % non-child: 3.82%) - PeakMemoryUsage: 80.00 KB - RowsReturned: 200 - RowsReturnedRate: 13 AGGREGATION_NODE (id=4):(Active: 13s908ms, % non-child: 53.45%) - Probe Method: HashTable Linear Probing - BuildTime: 3s668ms - GetResultsTime: 4s137ms - HTResize: 144 - HTResizeTime: 276.840ms - HashBuckets: 8.388608M (8388608) - HashCollisions: 0 - HashFailedProbe: 0 - HashFilledBuckets: 4.802958M (4802958) - HashProbe: 4.802958M (4802958) - HashTravelLength: 10.946245M (10946245) - LargestPartitionPercent: 6 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 482.21 MB - RowsProcessed: 4.802958M (4802958) - RowsRepartitioned: 0 - RowsReturned: 4.802958M (4802958) - RowsReturnedRate: 345.326K /sec - SpilledPartitions: 0 EXCHANGE_NODE (id=3):(Active: 6s80ms, % non-child: 41.52%) - BytesReceived: 99.85 MB - ConvertRowBatchTime: 84.694ms - DataArrivalWaitTime: 5s845ms - DeserializeRowBatchTimer: 745.638ms - FirstBatchArrivalWaitTime: 248.207ms - PeakMemoryUsage: 9.11 MB - RowsReturned: 4.802958M (4802958) - RowsReturnedRate: 789.918K /sec - SendersBlockedTotalTimer(*): 0ns Buffer pool: - AllocTime: 1.132ms - CumulativeAllocationBytes: 594.00 MB - CumulativeAllocations: 233 - PeakReservation: 482.00 MB - PeakUnpinnedBytes: 0.00 - PeakUsedReservation: 480.00 MB - ReservationLimit: 80.00 GB Fragment 2: Instance 92034a1aa98e4542-9cec2851a56f4402 (host=TNetworkAddress(hostname:172.29.1.139, port:9060)):(Active: 9s682ms, % non-child: 2.30%) - AverageThreadTokens: 4610974923749382100.00 - FragmentCpuTime: 8s396ms - MemoryLimit: 2.00 GB - PeakMemoryUsage: 195.38 MB - PeakReservation: 34.00 MB - PeakUsedReservation: 0.00 - RowsProduced: 4.844059M (4844059) BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataStreamSender (dst_id=3, dst_fragments=[92034a1aa98e4542-9cec2851a56f4403, 92034a1aa98e4542-9cec2851a56f4404, 92034a1aa98e4542-9cec2851a56f4405]):(Active: 2s575ms, % non-child: 17.59%) - BytesSent: 100.79 MB - IgnoreRows: 0 - OverallThroughput: 39.130348205566406 MB/sec - PeakMemoryUsage: 105.32 KB - SerializeBatchTime: 716.824ms - UncompressedRowBatchSize: 272.96 MB AGGREGATION_NODE (id=1):(Active: 6s770ms, % non-child: 44.80%) - Probe Method: HashTable Linear Probing - ExecOption: Streaming Preaggregation - GetResultsTime: 33.430ms - HTResize: 32 - HTResizeTime: 550.903us - HashBuckets: 65.536K (65536) - HashCollisions: 0 - HashFailedProbe: 0 - HashFilledBuckets: 49.152K (49152) - HashProbe: 4.844059M (4844059) - HashTravelLength: 33.238464M (33238464) - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195.30 MB - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 4607632778762754600.00 - RowsPassedThrough: 4.794907M (4794907) - RowsProcessed: 4.844059M (4844059) - RowsReturned: 4.844059M (4844059) - RowsReturnedRate: 715.509K /sec - StreamingTime: 6s508ms OLAP_SCAN_NODE (id=0):(Active: 208.707ms, % non-child: 1.43%) - BytesRead: 257.76 MB - NumDiskAccess: 2 - NumScanners: 101 - PeakMemoryUsage: 0.00 - RowsRead: 4.844059M (4844059) - RowsReturned: 4.844059M (4844059) - RowsReturnedRate: 23.209829M /sec - ScannerBatchWaitTime: 345.795ms - ScannerWorkerWaitTime: 10s537ms - TabletCount : 101 - TotalReadThroughput: 27.132742881774902 MB/sec OlapScanner: - BlockConvertTime: 458.120ms - BlockFetchTime: 1s184ms - ReaderInitTime: 192.854ms - RowsDelFiltered: 0 - RowsPushedCondFiltered: 0 - ScanCpuTime: 14s448ms - ScanTime: 49s994ms - ShowHintsTime_V1: 0ns SegmentIterator: - BitmapIndexFilterTimer: 133.243us - BlockLoadTime: 699.201ms - BlockSeekCount: 29.937K (29937) - BlockSeekTime: 189.77ms - BlocksLoad: 4.778K (4778) - CachedPagesNum: 3.563K (3563) - CompressedBytesRead: 1.87 MB - DecompressorTimer: 52.704ms - IOTimer: 3.137ms - IndexLoadTime_V1: 0ns - NumSegmentFiltered: 0 - NumSegmentTotal: 101 - RawRowsRead: 4.844059M (4844059) - RowsBitmapIndexFiltered: 0 - RowsBloomFilterFiltered: 0 - RowsConditionsFiltered: 0 - RowsKeyRangeFiltered: 0 - RowsStatsFiltered: 0 - RowsVectorPredFiltered: 0 - TotalPagesNum: 3.657K (3657) - UncompressedBytesRead: 3.81 MB - VectorPredEvalTime: 90.261ms Buffer pool: - AllocTime: 53.323us - CumulativeAllocationBytes: 34.00 MB - CumulativeAllocations: 17 - PeakReservation: 34.00 MB - PeakUnpinnedBytes: 0.00 - PeakUsedReservation: 34.00 MB - ReservationLimit: 80.00 GB Instance 92034a1aa98e4542-9cec2851a56f4401 (host=TNetworkAddress(hostname:172.29.1.148, port:9060)):(Active: 8s177ms, % non-child: 2.27%) - AverageThreadTokens: 4610841593497255900.00 - FragmentCpuTime: 7s517ms - MemoryLimit: 2.00 GB - PeakMemoryUsage: 193.89 MB - PeakReservation: 34.00 MB - PeakUsedReservation: 0.00 - RowsProduced: 4.804361M (4804361) BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataStreamSender (dst_id=3, dst_fragments=[92034a1aa98e4542-9cec2851a56f4403, 92034a1aa98e4542-9cec2851a56f4404, 92034a1aa98e4542-9cec2851a56f4405]):(Active: 2s421ms, % non-child: 16.53%) - BytesSent: 99.93 MB - IgnoreRows: 0 - OverallThroughput: 41.274596214294434 MB/sec - PeakMemoryUsage: 121.32 KB - SerializeBatchTime: 763.829ms - UncompressedRowBatchSize: 270.60 MB AGGREGATION_NODE (id=1):(Active: 5s423ms, % non-child: 35.75%) - Probe Method: HashTable Linear Probing - ExecOption: Streaming Preaggregation - GetResultsTime: 31.511ms - HTResize: 32 - HTResizeTime: 537.876us - HashBuckets: 65.536K (65536) - HashCollisions: 0 - HashFailedProbe: 0 - HashFilledBuckets: 49.152K (49152) - HashProbe: 4.804361M (4804361) - HashTravelLength: 33.277759M (33277759) - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193.80 MB - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 4607632778762754600.00 - RowsPassedThrough: 4.755209M (4755209) - RowsProcessed: 4.804361M (4804361) - RowsReturned: 4.804361M (4804361) - RowsReturnedRate: 885.844K /sec - StreamingTime: 5s182ms OLAP_SCAN_NODE (id=0):(Active: 188.236ms, % non-child: 1.29%) - BytesRead: 255.64 MB - NumDiskAccess: 2 - NumScanners: 100 - PeakMemoryUsage: 0.00 - RowsRead: 4.804361M (4804361) - RowsReturned: 4.804361M (4804361) - RowsReturnedRate: 25.523036M /sec - ScannerBatchWaitTime: 224.102ms - ScannerWorkerWaitTime: 6s778ms - TabletCount : 100 - TotalReadThroughput: 31.955594062805176 MB/sec OlapScanner: - BlockConvertTime: 467.436ms - BlockFetchTime: 1s142ms - ReaderInitTime: 205.94ms - RowsDelFiltered: 0 - RowsPushedCondFiltered: 0 - ScanCpuTime: 9s386ms - ScanTime: 28s652ms - ShowHintsTime_V1: 0ns SegmentIterator: - BitmapIndexFilterTimer: 135.69us - BlockLoadTime: 649.738ms - BlockSeekCount: 29.233K (29233) - BlockSeekTime: 174.759ms - BlocksLoad: 4.74K (4740) - CachedPagesNum: 3.593K (3593) - CompressedBytesRead: 920.15 KB - DecompressorTimer: 25.778ms - IOTimer: 2.786ms - IndexLoadTime_V1: 0ns - NumSegmentFiltered: 0 - NumSegmentTotal: 100 - RawRowsRead: 4.804361M (4804361) - RowsBitmapIndexFiltered: 0 - RowsBloomFilterFiltered: 0 - RowsConditionsFiltered: 0 - RowsKeyRangeFiltered: 0 - RowsStatsFiltered: 0 - RowsVectorPredFiltered: 0 - TotalPagesNum: 3.633K (3633) - UncompressedBytesRead: 1.90 MB - VectorPredEvalTime: 94.808ms Buffer pool: - AllocTime: 50.301us - CumulativeAllocationBytes: 34.00 MB - CumulativeAllocations: 17 - PeakReservation: 34.00 MB - PeakUnpinnedBytes: 0.00 - PeakUsedReservation: 34.00 MB - ReservationLimit: 80.00 GB Instance 92034a1aa98e4542-9cec2851a56f4400 (host=TNetworkAddress(hostname:172.29.1.42, port:9060)):(Active: 7s786ms, % non-child: 2.39%) - AverageThreadTokens: 4610785298501913600.00 - FragmentCpuTime: 7s63ms - MemoryLimit: 2.00 GB - PeakMemoryUsage: 192.38 MB - PeakReservation: 34.00 MB - PeakUsedReservation: 0.00 - RowsProduced: 4.755819M (4755819) BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0.00 - MaxBlockSize: 8.00 MB - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns DataStreamSender (dst_id=3, dst_fragments=[92034a1aa98e4542-9cec2851a56f4403, 92034a1aa98e4542-9cec2851a56f4404, 92034a1aa98e4542-9cec2851a56f4405]):(Active: 2s550ms, % non-child: 17.42%) - BytesSent: 98.93 MB - IgnoreRows: 0 - OverallThroughput: 38.786367416381836 MB/sec - PeakMemoryUsage: 121.32 KB - SerializeBatchTime: 732.164ms - UncompressedRowBatchSize: 267.97 MB AGGREGATION_NODE (id=1):(Active: 4s885ms, % non-child: 32.18%) - Probe Method: HashTable Linear Probing - ExecOption: Streaming Preaggregation - GetResultsTime: 28.274ms - HTResize: 32 - HTResizeTime: 550.407us - HashBuckets: 65.536K (65536) - HashCollisions: 0 - HashFailedProbe: 0 - HashFilledBuckets: 49.152K (49152) - HashProbe: 4.755819M (4755819) - HashTravelLength: 33.711602M (33711602) - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192.30 MB - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 4607632778762754600.00 - RowsPassedThrough: 4.706667M (4706667) - RowsProcessed: 4.755819M (4755819) - RowsReturned: 4.755819M (4755819) - RowsReturnedRate: 973.366K /sec - StreamingTime: 4s666ms OLAP_SCAN_NODE (id=0):(Active: 172.202ms, % non-child: 1.18%) - BytesRead: 253.07 MB - NumDiskAccess: 2 - NumScanners: 99 - PeakMemoryUsage: 0.00 - RowsRead: 4.755819M (4755819) - RowsReturned: 4.755819M (4755819) - RowsReturnedRate: 27.617564M /sec - ScannerBatchWaitTime: 172.308ms - ScannerWorkerWaitTime: 5s730ms - TabletCount : 99 - TotalReadThroughput: 33.74207019805908 MB/sec OlapScanner: - BlockConvertTime: 477.348ms - BlockFetchTime: 1s262ms - ReaderInitTime: 285.860ms - RowsDelFiltered: 0 - RowsPushedCondFiltered: 0 - ScanCpuTime: 8s22ms - ScanTime: 24s726ms - ShowHintsTime_V1: 0ns SegmentIterator: - BitmapIndexFilterTimer: 146.334us - BlockLoadTime: 759.381ms - BlockSeekCount: 29.368K (29368) - BlockSeekTime: 243.245ms - BlocksLoad: 4.69K (4690) - CachedPagesNum: 3.583K (3583) - CompressedBytesRead: 515.40 KB - DecompressorTimer: 20.138ms - IOTimer: 4.428ms - IndexLoadTime_V1: 0ns - NumSegmentFiltered: 0 - NumSegmentTotal: 99 - RawRowsRead: 4.755819M (4755819) - RowsBitmapIndexFiltered: 0 - RowsBloomFilterFiltered: 0 - RowsConditionsFiltered: 0 - RowsKeyRangeFiltered: 0 - RowsStatsFiltered: 0 - RowsVectorPredFiltered: 0 - TotalPagesNum: 3.606K (3606) - UncompressedBytesRead: 1.07 MB - VectorPredEvalTime: 97.173ms Buffer pool: - AllocTime: 59.116us - CumulativeAllocationBytes: 34.00 MB - CumulativeAllocations: 17 - PeakReservation: 34.00 MB - PeakUnpinnedBytes: 0.00 - PeakUsedReservation: 34.00 MB - ReservationLimit: 80.00 GB -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
