kangkaisen edited a comment on issue #242: Poor query performance under high concurrence URL: https://github.com/apache/incubator-doris/issues/242#issuecomment-429767014 This is a query profile for SQL3 under 32 concurrency ``` Query: Summary: Query ID: a37b604526e49e4:8cc515f4acd87738 Start Time: 2018-10-15 17:06:51 End Time: 2018-10-15 17:06:59 Total: 8s800ms Query Type: Query Query State: EOF Palo Version: Palo version 2.0 User: root Default Db: default_cluster:mart_waimai Sql Statement: select count(*) FROM A t1 left JOIN [shuffle] B t6 ON ((t1.dt = t6.dt) AND (t1.wm_poi_id = t6.wm_poi_id)) where t1.dt = 20180909; Execution Profile a37b604526e49e4:8cc515f4acd87738:(Active: 8s799ms, % non-child: 0.00%) Fragment 0: Instance a37b604526e49e4:8cc515f4acd87745 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 8s734ms, % non-child: 0.00%) - BytesReceived: 64.00 B - PeakUsedReservation: 0.00 - SendersBlockedTimer: 0ns - DeserializeRowBatchTimer: 15.759us - RowsProduced: 1 - SendersBlockedTotalTimer(*): 0ns - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 - FirstBatchArrivalWaitTime: 0ns BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataBufferSender (dst_id=TUniqueId(hi=736257193777449444, lo=-8303206197371570363)): AGGREGATION_NODE (id=7):(Active: 8s734ms, % non-child: 0.00%) - GetResultsTime: 0ns - RowsReturned: 1 - BuildTime: 27.245us - RowsRepartitioned: 0 - NumRepartitions: 0 - HTResizeTime: 0ns - MaxPartitionLevel: 0 - SpilledPartitions: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 0 - MemoryUsed: 0.00 - RowsReturnedRate: 0 - HashBuckets: 0 EXCHANGE_NODE (id=6):(Active: 8s734ms, % non-child: 100.00%) - ConvertRowBatchTime: 6.651us - RowsReturned: 4 - MemoryUsed: 0.00 - RowsReturnedRate: 0 Fragment 1: Instance a37b604526e49e4:8cc515f4acd87741 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 8s730ms, % non-child: 0.00%) - BytesReceived: 26.43 MB - PeakUsedReservation: 0.00 - SendersBlockedTimer: 0ns - DeserializeRowBatchTimer: 417.600ms - RowsProduced: 1 - SendersBlockedTotalTimer(*): 0ns - AverageThreadTokens: 4610891265551969800.00 - PeakReservation: 0.00 - FirstBatchArrivalWaitTime: 0ns BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=6):(Active: 53.289us, % non-child: 0.00%) - OverallThroughput: 293.2119140625 KB/sec - SerializeBatchTime: 3.56us - IgnoreRows: 0 - BytesSent: 16.00 B - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 16.00 B AGGREGATION_NODE (id=3):(Active: 8s730ms, % non-child: 7.54%) - GetResultsTime: 0ns - RowsReturned: 1 - BuildTime: 646.340ms - RowsRepartitioned: 0 - NumRepartitions: 0 - HTResizeTime: 0ns - MaxPartitionLevel: 0 - SpilledPartitions: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 0 - MemoryUsed: 0.00 - RowsReturnedRate: 0 - HashBuckets: 0 HASH_JOIN_NODE (id=2):(Active: 8s73ms, % non-child: 12.87%) ExecOption: Hash Table Built Asynchronously - ProbeTime: 655.492ms - ProbeRows: 1.444235M (1444235) - LoadFactor: 4602047304361312300.00 - BuildBuckets: 1.048576M (1048576) - PushDownTime: 0ns - BuildRows: 1.457248M (1457248) - RowsReturned: 2.308287M (2308287) - MemoryUsed: 64.87 MB - BuildTime: 634.586ms - RowsReturnedRate: 285.926K /sec - PushDownComputeTime: 0ns EXCHANGE_NODE (id=5):(Active: 6s429ms, % non-child: 73.65%) - ConvertRowBatchTime: 29.491ms - RowsReturned: 1.457248M (1457248) - MemoryUsed: 0.00 - RowsReturnedRate: 226.645K /sec EXCHANGE_NODE (id=4):(Active: 519.699ms, % non-child: 5.95%) - ConvertRowBatchTime: 30.372ms - RowsReturned: 1.444235M (1444235) - MemoryUsed: 0.00 - RowsReturnedRate: 2.778978M /sec Instance a37b604526e49e4:8cc515f4acd87743 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 8s495ms, % non-child: 0.00%) - BytesReceived: 26.41 MB - PeakUsedReservation: 0.00 - SendersBlockedTimer: 0ns - DeserializeRowBatchTimer: 518.450ms - RowsProduced: 1 - SendersBlockedTotalTimer(*): 0ns - AverageThreadTokens: 4610891265551969800.00 - PeakReservation: 0.00 - FirstBatchArrivalWaitTime: 0ns BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=6):(Active: 94.571us, % non-child: 0.00%) - OverallThroughput: 165.2197265625 KB/sec - SerializeBatchTime: 5.270us - IgnoreRows: 0 - BytesSent: 16.00 B - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 16.00 B AGGREGATION_NODE (id=3):(Active: 8s495ms, % non-child: 7.33%) - GetResultsTime: 0ns - RowsReturned: 1 - BuildTime: 612.214ms - RowsRepartitioned: 0 - NumRepartitions: 0 - HTResizeTime: 0ns - MaxPartitionLevel: 0 - SpilledPartitions: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 0 - MemoryUsed: 0.00 - RowsReturnedRate: 0 - HashBuckets: 0 HASH_JOIN_NODE (id=2):(Active: 7s872ms, % non-child: 12.56%) ExecOption: Hash Table Built Asynchronously - ProbeTime: 572.780ms - ProbeRows: 1.444265M (1444265) - LoadFactor: 4602029574736314400.00 - BuildBuckets: 1.048576M (1048576) - PushDownTime: 0ns - BuildRows: 1.455008M (1455008) - RowsReturned: 2.306936M (2306936) - MemoryUsed: 64.84 MB - BuildTime: 584.158ms - RowsReturnedRate: 293.03K /sec - PushDownComputeTime: 0ns EXCHANGE_NODE (id=5):(Active: 6s481ms, % non-child: 76.29%) - ConvertRowBatchTime: 30.287ms - RowsReturned: 1.455008M (1455008) - MemoryUsed: 0.00 - RowsReturnedRate: 224.481K /sec EXCHANGE_NODE (id=4):(Active: 323.943ms, % non-child: 3.81%) - ConvertRowBatchTime: 26.900ms - RowsReturned: 1.444265M (1444265) - MemoryUsed: 0.00 - RowsReturnedRate: 4.458386M /sec Instance a37b604526e49e4:8cc515f4acd87742 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 8s394ms, % non-child: 0.00%) - BytesReceived: 26.43 MB - PeakUsedReservation: 0.00 - SendersBlockedTimer: 0ns - DeserializeRowBatchTimer: 398.363ms - RowsProduced: 1 - SendersBlockedTotalTimer(*): 0ns - AverageThreadTokens: 4610891265551969800.00 - PeakReservation: 0.00 - FirstBatchArrivalWaitTime: 0ns BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=6):(Active: 58.220us, % non-child: 0.00%) - OverallThroughput: 268.3779296875 KB/sec - SerializeBatchTime: 2.483us - IgnoreRows: 0 - BytesSent: 16.00 B - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 16.00 B AGGREGATION_NODE (id=3):(Active: 8s394ms, % non-child: 6.01%) - GetResultsTime: 0ns - RowsReturned: 1 - BuildTime: 483.804ms - RowsRepartitioned: 0 - NumRepartitions: 0 - HTResizeTime: 0ns - MaxPartitionLevel: 0 - SpilledPartitions: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 0 - MemoryUsed: 0.00 - RowsReturnedRate: 0 - HashBuckets: 0 HASH_JOIN_NODE (id=2):(Active: 7s889ms, % non-child: 11.63%) ExecOption: Hash Table Built Asynchronously - ProbeTime: 562.578ms - ProbeRows: 1.444314M (1444314) - LoadFactor: 4602041497565528100.00 - BuildBuckets: 1.048576M (1048576) - PushDownTime: 0ns - BuildRows: 1.456645M (1456645) - RowsReturned: 2.307948M (2307948) - MemoryUsed: 64.86 MB - BuildTime: 515.971ms - RowsReturnedRate: 292.525K /sec - PushDownComputeTime: 0ns EXCHANGE_NODE (id=5):(Active: 6s553ms, % non-child: 78.07%) - ConvertRowBatchTime: 29.213ms - RowsReturned: 1.456645M (1456645) - MemoryUsed: 0.00 - RowsReturnedRate: 222.281K /sec EXCHANGE_NODE (id=4):(Active: 360.229ms, % non-child: 4.29%) - ConvertRowBatchTime: 27.45ms - RowsReturned: 1.444314M (1444314) - MemoryUsed: 0.00 - RowsReturnedRate: 4.009426M /sec Instance a37b604526e49e4:8cc515f4acd87744 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 8s324ms, % non-child: 0.01%) - BytesReceived: 26.42 MB - PeakUsedReservation: 0.00 - SendersBlockedTimer: 0ns - DeserializeRowBatchTimer: 322.354ms - RowsProduced: 1 - SendersBlockedTotalTimer(*): 0ns - AverageThreadTokens: 4611156183177109000.00 - PeakReservation: 0.00 - FirstBatchArrivalWaitTime: 0ns BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=6):(Active: 73.66us, % non-child: 0.00%) - OverallThroughput: 213.84765625 KB/sec - SerializeBatchTime: 3.112us - IgnoreRows: 0 - BytesSent: 16.00 B - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 16.00 B AGGREGATION_NODE (id=3):(Active: 8s322ms, % non-child: 3.84%) - GetResultsTime: 0ns - RowsReturned: 1 - BuildTime: 310.180ms - RowsRepartitioned: 0 - NumRepartitions: 0 - HTResizeTime: 0ns - MaxPartitionLevel: 0 - SpilledPartitions: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 0 - MemoryUsed: 0.00 - RowsReturnedRate: 0 - HashBuckets: 0 HASH_JOIN_NODE (id=2):(Active: 8s3ms, % non-child: 11.98%) ExecOption: Hash Table Built Asynchronously - ProbeTime: 551.896ms - ProbeRows: 1.444294M (1444294) - LoadFactor: 4602031842479046700.00 - BuildBuckets: 1.048576M (1048576) - PushDownTime: 0ns - BuildRows: 1.455675M (1455675) - RowsReturned: 2.307816M (2307816) - MemoryUsed: 64.85 MB - BuildTime: 528.670ms - RowsReturnedRate: 288.35K /sec - PushDownComputeTime: 0ns EXCHANGE_NODE (id=5):(Active: 6s553ms, % non-child: 78.73%) - ConvertRowBatchTime: 29.130ms - RowsReturned: 1.455675M (1455675) - MemoryUsed: 0.00 - RowsReturnedRate: 222.115K /sec EXCHANGE_NODE (id=4):(Active: 452.769ms, % non-child: 5.44%) - ConvertRowBatchTime: 25.354ms - RowsReturned: 1.444294M (1444294) - MemoryUsed: 0.00 - RowsReturnedRate: 3.189912M /sec Fragment 2: Instance a37b604526e49e4:8cc515f4acd8773d (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 7s18ms, % non-child: 0.56%) - PeakUsedReservation: 0.00 - RowsProduced: 1.748965M (1748965) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=5):(Active: 6s843ms, % non-child: 97.51%) - OverallThroughput: 2.3783998489379883 MB/sec - SerializeBatchTime: 126.23ms - IgnoreRows: 0 - BytesSent: 16.28 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 33.37 MB OLAP_SCAN_NODE (id=1):(Active: 135.663ms, % non-child: 1.93%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 2.25 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 1s731ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 10.689ms - RawRowsRead: 1.766346M (1766346) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 31.269ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 12.89196M /sec - BlockLoadTime: 125.707ms - BlocksLoad: 1.739K (1739) - UncompressedBytesRead: 73.65 KB - RowsReturned: 1.748965M (1748965) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 6 - DecompressorTimer: 69.186us - RowsVectorPredFiltered: 0 - RowsRead: 1.748965M (1748965) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 577.298ms - ShowHintsTime: 390.895us - TotalReadThroughput: 5.7754926681518555 MB/sec - IOTimer: 7.145ms - BytesRead: 40.43 MB Instance a37b604526e49e4:8cc515f4acd8773e (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 5s640ms, % non-child: 0.16%) - PeakUsedReservation: 0.00 - RowsProduced: 1.456972M (1456972) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=5):(Active: 5s547ms, % non-child: 98.36%) - OverallThroughput: 2.443950653076172 MB/sec - SerializeBatchTime: 98.389ms - IgnoreRows: 0 - BytesSent: 13.56 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 27.79 MB OLAP_SCAN_NODE (id=1):(Active: 83.114ms, % non-child: 1.47%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.87 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 871.915ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 3.326ms - RawRowsRead: 1.471128M (1471128) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 13.733ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 17.529695M /sec - BlockLoadTime: 76.285ms - BlocksLoad: 1.449K (1449) - UncompressedBytesRead: 61.34 KB - RowsReturned: 1.456972M (1456972) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 5 - DecompressorTimer: 55.364us - RowsVectorPredFiltered: 0 - RowsRead: 1.456972M (1456972) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 292.136ms - ShowHintsTime: 152.662us - TotalReadThroughput: 5.606301307678223 MB/sec - IOTimer: 4.107ms - BytesRead: 33.67 MB Instance a37b604526e49e4:8cc515f4acd87740 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 5s355ms, % non-child: 0.31%) - PeakUsedReservation: 0.00 - RowsProduced: 1.454817M (1454817) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=5):(Active: 5s238ms, % non-child: 97.80%) - OverallThroughput: 2.5842628479003906 MB/sec - SerializeBatchTime: 102.680ms - IgnoreRows: 0 - BytesSent: 13.54 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 27.75 MB OLAP_SCAN_NODE (id=1):(Active: 101.191ms, % non-child: 1.89%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.89 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 896.790ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 3.327ms - RawRowsRead: 1.468866M (1468866) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 41.455ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 14.376887M /sec - BlockLoadTime: 81.125ms - BlocksLoad: 1.447K (1447) - UncompressedBytesRead: 61.28 KB - RowsReturned: 1.454817M (1454817) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 5 - DecompressorTimer: 64.267us - RowsVectorPredFiltered: 0 - RowsRead: 1.454817M (1454817) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 385.17ms - ShowHintsTime: 694.408us - TotalReadThroughput: 6.101573944091797 MB/sec - IOTimer: 15.204ms - BytesRead: 33.62 MB Instance a37b604526e49e4:8cc515f4acd8773f (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 5s266ms, % non-child: 0.33%) - PeakUsedReservation: 0.00 - RowsProduced: 1.163822M (1163822) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=5):(Active: 5s170ms, % non-child: 98.19%) - OverallThroughput: 2.0938472747802734 MB/sec - SerializeBatchTime: 83.972ms - IgnoreRows: 0 - BytesSent: 10.83 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 22.20 MB OLAP_SCAN_NODE (id=1):(Active: 78.170ms, % non-child: 1.48%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.50 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 733.392ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 2.667ms - RawRowsRead: 1.176668M (1176668) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 50.64ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 14.888287M /sec - BlockLoadTime: 60.511ms - BlocksLoad: 1.156K (1156) - UncompressedBytesRead: 48.99 KB - RowsReturned: 1.163822M (1163822) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 4 - DecompressorTimer: 47.772us - RowsVectorPredFiltered: 0 - RowsRead: 1.163822M (1163822) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 292.909ms - ShowHintsTime: 99.319us - TotalReadThroughput: 4.896689414978027 MB/sec - IOTimer: 13.202ms - BytesRead: 26.93 MB Fragment 3: Instance a37b604526e49e4:8cc515f4acd8773b (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 8s110ms, % non-child: 0.07%) - PeakUsedReservation: 0.00 - RowsProduced: 1.733706M (1733706) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=4):(Active: 7s952ms, % non-child: 98.05%) - OverallThroughput: 1.9429044723510742 MB/sec - SerializeBatchTime: 120.699ms - IgnoreRows: 0 - BytesSent: 15.45 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 33.07 MB OLAP_SCAN_NODE (id=0):(Active: 152.200ms, % non-child: 1.88%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.64 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 581.62ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 3.870ms - RawRowsRead: 1.753236M (1753236) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 78.504ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 11.390946M /sec - BlockLoadTime: 32.949ms - BlocksLoad: 1.722K (1722) - UncompressedBytesRead: 23.20 KB - RowsReturned: 1.733706M (1733706) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 6 - DecompressorTimer: 24.90us - RowsVectorPredFiltered: 0 - RowsRead: 1.733706M (1733706) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 283.179ms - ShowHintsTime: 9.711ms - TotalReadThroughput: 2.360215187072754 MB/sec - IOTimer: 1.614ms - BytesRead: 20.06 MB Instance a37b604526e49e4:8cc515f4acd87739 (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 7s858ms, % non-child: 0.16%) - PeakUsedReservation: 0.00 - RowsProduced: 1.154135M (1154135) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=4):(Active: 7s687ms, % non-child: 97.82%) - OverallThroughput: 1.3378639221191406 MB/sec - SerializeBatchTime: 88.341ms - IgnoreRows: 0 - BytesSent: 10.28 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 22.02 MB OLAP_SCAN_NODE (id=0):(Active: 158.454ms, % non-child: 2.02%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.09 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 734.255ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 9.951ms - RawRowsRead: 1.167534M (1167534) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 98.144ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 7.283716M /sec - BlockLoadTime: 55.479ms - BlocksLoad: 1.146K (1146) - UncompressedBytesRead: 15.45 KB - RowsReturned: 1.154135M (1154135) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 4 - DecompressorTimer: 19.740us - RowsVectorPredFiltered: 0 - RowsRead: 1.154135M (1154135) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 373.966ms - ShowHintsTime: 133.645us - TotalReadThroughput: 1.781515121459961 MB/sec - IOTimer: 6.772ms - BytesRead: 13.36 MB Instance a37b604526e49e4:8cc515f4acd8773a (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 7s692ms, % non-child: 0.36%) - PeakUsedReservation: 0.00 - RowsProduced: 1.443379M (1443379) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=4):(Active: 7s599ms, % non-child: 98.79%) - OverallThroughput: 1.692586898803711 MB/sec - SerializeBatchTime: 98.775ms - IgnoreRows: 0 - BytesSent: 12.86 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 27.54 MB OLAP_SCAN_NODE (id=0):(Active: 64.789ms, % non-child: 0.84%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.37 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 653.756ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 3.710ms - RawRowsRead: 1.460326M (1460326) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 40.974ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 22.277869M /sec - BlockLoadTime: 29.398ms - BlocksLoad: 1.433K (1433) - UncompressedBytesRead: 22.39 KB - RowsReturned: 1.443379M (1443379) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 5 - DecompressorTimer: 26.801us - RowsVectorPredFiltered: 0 - RowsRead: 1.443379M (1443379) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 181.170ms - ShowHintsTime: 3.294ms - TotalReadThroughput: 2.087447166442871 MB/sec - IOTimer: 2.739ms - BytesRead: 16.71 MB Instance a37b604526e49e4:8cc515f4acd8773c (host=TNetworkAddress(hostname:xxx, port:9060)):(Active: 7s314ms, % non-child: 0.22%) - PeakUsedReservation: 0.00 - RowsProduced: 1.445888M (1445888) - AverageThreadTokens: 4607182418800017400.00 - PeakReservation: 0.00 BlockMgr: - BlocksCreated: 0 - MemoryLimit: 2.00 GB - BlockWritesOutstanding: 0 - BytesWritten: 0.00 - TotalEncryptionTime: 0ns - BufferedPins: 0 - TotalReadBlockTime: 0ns - TotalBufferWaitTime: 0ns - BlocksRecycled: 0 - TotalIntegrityCheckTime: 0ns - MaxBlockSize: 8.00 MB DataStreamSender (dst_id=4):(Active: 7s180ms, % non-child: 98.17%) - OverallThroughput: 1.7946147918701172 MB/sec - SerializeBatchTime: 99.169ms - IgnoreRows: 0 - BytesSent: 12.89 MB - NetworkThroughput(*): 0.0 /sec - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 27.58 MB OLAP_SCAN_NODE (id=0):(Active: 117.305ms, % non-child: 1.60%) - NumThread: 0 - TotalRawReadTime(*): 0ns - CompressedBytesRead: 1.37 MB - RowsPushedCondFiltered: 0 - ScanRangesComplete: 0 - ScanTime: 581.822ms - RowsStatsFiltered: 0 - VectorPredEvalTime: 3.241ms - RawRowsRead: 1.462272M (1462272) - ScannerThreadsVoluntaryContextSwitches: 0 - IndexLoadTime: 23.385ms - RowsDelFiltered: 0 - ScannerThreadsTotalWallClockTime: 0ns - MaterializeTupleTime(*): 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsSysTime: 0ns - MemoryUsed: 0.00 - RowsReturnedRate: 12.325868M /sec - BlockLoadTime: 39.980ms - BlocksLoad: 1.436K (1436) - UncompressedBytesRead: 19.70 KB - RowsReturned: 1.445888M (1445888) - ScannerThreadsInvoluntaryContextSwitches: 0 - TabletCount : 5 - DecompressorTimer: 22.477us - RowsVectorPredFiltered: 0 - RowsRead: 1.445888M (1445888) - PerReadThreadRawHdfsThroughput: 0.0 /sec - BlockFetchTime: 193.260ms - ShowHintsTime: 6.674ms - TotalReadThroughput: 2.228278160095215 MB/sec - IOTimer: 1.376ms - BytesRead: 16.73 MB ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
