Hi Mostafa
Cheng already put the profile in thread.
Here is another profile for impala release version. you can also see the
attachment.
2017-11-02 9:30 GMT+08:00 Mostafa Mokhtar <[email protected]>:
> Attaching the query profile will be most helpful to investigate this issue.
>
> If you can capture the profile from the WebUI on the coordinator node it
> would be great.
>
> On Wed, Nov 1, 2017 at 6:22 PM, 俊杰陈 <[email protected]> wrote:
>
> > Thanks Hongxu,
> >
> > Here are configurations on my cluster, most of them are default values.
> > Which item do you think it may impact?
> >
> > ABORT_ON_DEFAULT_LIMIT_EXCEEDED: [0]
> > ABORT_ON_ERROR: [0]
> > ALLOW_UNSUPPORTED_FORMATS: [0]
> > APPX_COUNT_DISTINCT: [0]
> > BATCH_SIZE: [0]
> > COMPRESSION_CODEC: [NONE]
> > DEBUG_ACTION: []
> > DEFAULT_ORDER_BY_LIMIT: [-1]
> > DISABLE_CACHED_READS: [0]
> > DISABLE_CODEGEN: [0]
> > DISABLE_OUTERMOST_TOPN: [0]
> > DISABLE_ROW_RUNTIME_FILTERING: [0]
> > DISABLE_STREAMING_PREAGGREGATIONS: [0]
> > DISABLE_UNSAFE_SPILLS: [0]
> > ENABLE_EXPR_REWRITES: [1]
> > EXEC_SINGLE_NODE_ROWS_THRESHOLD: [100]
> > EXPLAIN_LEVEL: [1]
> > HBASE_CACHE_BLOCKS: [0]
> > HBASE_CACHING: [0]
> > MAX_BLOCK_MGR_MEMORY: [0]
> > MAX_ERRORS: [100]
> > MAX_IO_BUFFERS: [0]
> > MAX_NUM_RUNTIME_FILTERS: [10]
> > MAX_SCAN_RANGE_LENGTH: [0]
> > MEM_LIMIT: [0]
> > MT_DOP: [0]
> > NUM_NODES: [0]
> > NUM_SCANNER_THREADS: [0]
> > OPTIMIZE_PARTITION_KEY_SCANS: [0]
> > PARQUET_ANNOTATE_STRINGS_UTF8: [0]
> > PARQUET_FALLBACK_SCHEMA_RESOLUTION: [0]
> > PARQUET_FILE_SIZE: [0]
> > PREFETCH_MODE: [1]
> > QUERY_TIMEOUT_S: [0]
> > REPLICA_PREFERENCE: [0]
> > REQUEST_POOL: []
> > RESERVATION_REQUEST_TIMEOUT: [0]
> > RM_INITIAL_MEM: [0]
> > RUNTIME_BLOOM_FILTER_SIZE: [1048576]
> > RUNTIME_FILTER_MAX_SIZE: [16777216]
> > RUNTIME_FILTER_MIN_SIZE: [1048576]
> > RUNTIME_FILTER_MODE: [2]
> > RUNTIME_FILTER_WAIT_TIME_MS: [0]
> > S3_SKIP_INSERT_STAGING: [1]
> > SCAN_NODE_CODEGEN_THRESHOLD: [1800000]
> > SCHEDULE_RANDOM_REPLICA: [0]
> > SCRATCH_LIMIT: [-1]
> > SEQ_COMPRESSION_MODE: [0]
> > STRICT_MODE: [0]
> > SUPPORT_START_OVER: [false]
> > SYNC_DDL: [0]
> > V_CPU_CORES: [0]
> >
> > 2017-10-31 15:30 GMT+08:00 Hongxu Ma <[email protected]>:
> >
> > > Hi JJ
> > > Consider it only takes 3mins on SparkSQL, maybe there are some mistakes
> > in
> > > query options.
> > > Try run "set;" in impala-shell and check all query options, e.g:
> > > BATCH_SIZE: [0]
> > > DISABLE_CODEGEN: [0]
> > > RUNTIME_FILTER_MODE: GLOBAL
> > >
> > > Just a guess, thanks.
> > >
> > > 在 27/10/2017 10:25, 俊杰陈 写道:
> > > The profile file is damaged. Here is a screenshot for exec summary
> > > [cid:ii_j999ymep1_15f5ba563aeabb91]
> > >
> > >
> > > 2017-10-27 10:04 GMT+08:00 俊杰陈 <[email protected]<mailto:cjj
> > > [email protected]>>:
> > > Hi Devs
> > >
> > > I met a performance issue on big table join. The query takes more than
> 3
> > > hours on Impala and only 3 minutes on Spark SQL on the same 5 nodes
> > > cluster. when running query, the left scanner and exchange node are
> very
> > > slow. Did I miss some key arguments?
> > >
> > > you can see profile file in attachment.
> > >
> > > [cid:ii_j9998pph2_15f5b92f2cf47020]
> > >
> > > --
> > > Thanks & Best Regards
> > >
> > >
> > >
> > > --
> > > Thanks & Best Regards
> > >
> > >
> > > --
> > > Regards,
> > > Hongxu.
> > >
> >
> >
> >
> > --
> > Thanks & Best Regards
> >
>
--
Thanks & Best Regards
Query (id=db497c13276e70de:38c671cf00000000):
Summary:
Session ID: ee4f844616a8170f:5cf00c4759ee93af
Session Type: BEESWAX
Start Time: 2017-11-01 15:57:09.150268000
End Time: 2017-11-01 18:56:53.614915000
Query Type: QUERY
Query State: FINISHED
Query Status: OK
Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build
4a61dbd636d052c97b829617bb39b970d8348767)
User: root
Connected User: root
Delegated User:
Network Address: ::ffff:10.239.47.102:48563
Default Db: tpcds_bin_partitioned_parquet_100
Sql Statement: select ss_item_sk, sum(cs_net_profit), sum(ss_net_profit)
from
catalog_sales cs , store_sales ss
where ss.ss_item_sk = cs.cs_item_sk and cs.cs_net_profit > ss.ss_net_profit
group by ss_item_sk
order by ss_item_sk
limit 100
Coordinator: bdpe833n4:22000
Query Options (non default):
Plan:
----------------
Estimated Per-Host Requirements: Memory=662.24MB VCores=2
PLAN-ROOT SINK
|
07:MERGING-EXCHANGE [UNPARTITIONED]
| order by: ss_item_sk ASC
| limit: 100
| hosts=4 per-host-mem=unavailable
| tuple-ids=3 row-size=24B cardinality=100
|
04:TOP-N [LIMIT=100]
| order by: ss_item_sk ASC
| hosts=4 per-host-mem=2.34KB
| tuple-ids=3 row-size=24B cardinality=100
|
03:AGGREGATE [FINALIZE]
| output: sum(cs_net_profit), sum(ss_net_profit)
| group by: ss_item_sk
| hosts=4 per-host-mem=10.00MB
| tuple-ids=2 row-size=24B cardinality=204925
|
02:HASH JOIN [INNER JOIN, PARTITIONED]
| hash predicates: ss.ss_item_sk = cs.cs_item_sk
| other predicates: cs.cs_net_profit > ss.ss_net_profit
| runtime filters: RF000 <- cs.cs_item_sk
| hosts=4 per-host-mem=604.24MB
| tuple-ids=1,0 row-size=32B cardinality=287997024
|
|--06:EXCHANGE [HASH(cs.cs_item_sk)]
| | hosts=4 per-host-mem=0B
| | tuple-ids=0 row-size=16B cardinality=143997065
| |
| 00:SCAN HDFS [tpcds_bin_partitioned_parquet_100.catalog_sales cs, RANDOM]
| partitions=1837/1837 files=1936 size=17.03GB
| table stats: 143997065 rows total
| column stats: all
| hosts=4 per-host-mem=48.00MB
| tuple-ids=0 row-size=16B cardinality=143997065
|
05:EXCHANGE [HASH(ss.ss_item_sk)]
| hosts=4 per-host-mem=0B
| tuple-ids=1 row-size=16B cardinality=287997024
|
01:SCAN HDFS [tpcds_bin_partitioned_parquet_100.store_sales ss, RANDOM]
partitions=1824/1824 files=1923 size=20.89GB
runtime filters: RF000 -> ss.ss_item_sk
table stats: 287997024 rows total
column stats: all
hosts=4 per-host-mem=48.00MB
tuple-ids=1 row-size=16B cardinality=287997024
----------------
Estimated Per-Host Mem: 694404525
Estimated Per-Host VCores: 2
Request Pool: default-pool
Admission result: Admitted immediately
ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak
Mem Est. Peak Mem Detail
----------------------------------------------------------------------------------------------------------------------------------
07:MERGING-EXCHANGE 1 276.223us 276.223us 100 100
0 -1.00 B UNPARTITIONED
04:TOP-N 4 948.305us 1.052ms 400 100 12.00
KB 2.34 KB
03:AGGREGATE 4 13m13s 14m50s 204.00K 204.93K 12.06
MB 10.00 MB FINALIZE
02:HASH JOIN 4 2h35m 2h43m 140.16B 288.00M 2.52
GB 604.24 MB INNER JOIN, PARTITIONED
|--06:EXCHANGE 4 550.794ms 584.682ms 144.00M 144.00M
0 0 HASH(cs.cs_item_sk)
| 00:SCAN HDFS 4 10s717ms 12s331ms 144.00M 144.00M 20.51
MB 48.00 MB tpcds_bin_partitioned_parqu...
05:EXCHANGE 4 2s086ms 2s288ms 288.00M 288.00M
0 0 HASH(ss.ss_item_sk)
01:SCAN HDFS 4 2s078ms 2s182ms 288.00M 288.00M 203.56
MB 48.00 MB tpcds_bin_partitioned_parqu...
Planner Timeline: 43.380ms
- Analysis finished: 3.812ms (3.812ms)
- Equivalence classes computed: 4.425ms (612.674us)
- Single node plan created: 35.758ms (31.332ms)
- Runtime filters computed: 35.937ms (178.868us)
- Distributed plan created: 36.139ms (201.990us)
- Planning finished: 43.380ms (7.241ms)
Query Timeline: 2h59m
- Query submitted: 44.188us (44.188us)
- Planning finished: 94.597ms (94.553ms)
- Submit for admission: 105.713ms (11.115ms)
- Completed admission: 105.839ms (125.622us)
- Ready to start 13 fragment instances: 112.628ms (6.789ms)
- All 13 fragment instances started: 204.042ms (91.414ms)
- First dynamic filter received: 18s203ms (17s999ms)
- Rows available: 2h59m (2h59m)
- First row fetched: 2h59m (624.498ms)
- Unregister query: 2h59m (37.399ms)
- ComputeScanRangeAssignmentTimer: 4.822ms
ImpalaServer:
- ClientFetchWaitTimer: 655.796ms
- RowMaterializationTimer: 6.069ms
Execution Profile db497c13276e70de:38c671cf00000000:(Total: 2h59m, non-child:
0.000ns, % non-child: 0.00%)
Number of filters: 1
Filter routing table:
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending
(Expected) First arrived Completed Enabled
----------------------------------------------------------------------------------------------------------------------------
0 2 1 4 REMOTE false
4 (4) N/A N/A true
Fragment instance start latencies: Count: 13, 25th %-ile: 1ms, 50th %-ile:
45ms, 75th %-ile: 57ms, 90th %-ile: 64ms, 95th %-ile: 64ms, 99.9th %-ile: 69ms
Per Node Peak Memory Usage: bdpe611n1:22000(2.75 GB) bdpe722n4:22000(2.77
GB) bdpe611n4:22000(2.76 GB) bdpe611n3:22000(2.77 GB) bdpe833n4:22000(16.01 MB)
Final filter table:
ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending
(Expected) First arrived Completed Enabled
----------------------------------------------------------------------------------------------------------------------------
0 2 1 4 REMOTE false
0 (4) 18s203ms 18s240ms false
- FiltersReceived: 4 (4)
- FinalizationTimer: 0.000ns
Coordinator Fragment F03:
Instance db497c13276e70de:38c671cf00000000 (host=bdpe833n4:22000):(Total:
2h59m, non-child: 629.335ms, % non-child: 0.01%)
MemoryUsage(4m16s): 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08
KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB,
8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08
KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB,
8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08 KB, 8.08
KB, 8.08 KB, 8.69 KB
- AverageThreadTokens: 0.00
- BloomFilterBytes: 0
- PeakMemoryUsage: 269.00 KB (275456)
- PerHostPeakMemUsage: 16.01 MB (16785494)
- RowsProduced: 100 (100)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 0 (0)
- TotalThreadsTotalWallClockTime: 2h59m
- TotalThreadsSysTime: 1.939ms
- TotalThreadsUserTime: 59.201ms
- TotalThreadsVoluntaryContextSwitches: 8 (8)
Fragment Instance Lifecycle Timings:
- ExecTime: 627.971ms
- ExecTreeExecTime: 184.620us
- OpenTime: 2h59m
- ExecTreeOpenTime: 2h59m
- PrepareTime: 38.307ms
- ExecTreePrepareTime: 107.462us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 0 (0)
- BlocksRecycled: 0 (0)
- BufferedPins: 0 (0)
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 19.95 GB (21423355904)
- PeakMemoryUsage: 0
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
PLAN_ROOT_SINK:
- PeakMemoryUsage: 0
CodeGen:(Total: 96.604ms, non-child: 96.604ms, % non-child: 100.00%)
- CodegenTime: 963.116us
- CompileTime: 3.477ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 28 (28)
- NumInstructions: 522 (522)
- OptimizationTime: 54.929ms
- PeakMemoryUsage: 261.00 KB (267264)
- PrepareTime: 37.171ms
EXCHANGE_NODE (id=7):(Total: 2h59m, non-child: 276.223us, % non-child:
0.00%)
ExecOption: Codegen Enabled
BytesReceived(4m16s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
330.00 B
- BytesReceived: 10.18 KB (10423)
- ConvertRowBatchTime: 0.000ns
- DeserializeRowBatchTimer: 158.911us
- FirstBatchArrivalWaitTime: 2h59m
- MergeGetNext: 176.492us
- MergeGetNextBatch: 31.301us
- PeakMemoryUsage: 0
- RowsReturned: 100 (100)
- RowsReturnedRate: 0
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
Averaged Fragment F02:(Total: 2h59m, non-child: 9.565ms, % non-child: 0.00%)
split sizes: min: 0, max: 0, avg: 0, stddev: 0
completion times: min:2h58m max:2h59m mean: 2h59m stddev:20s999ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec
stddev:0.00 /sec
num instances: 4
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 2.56 GB (2749501948)
- PerHostPeakMemUsage: 2.76 GB (2966704479)
- RowsProduced: 100 (100)
- TotalNetworkReceiveTime: 10m53s
- TotalNetworkSendTime: 529.034us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 15.12K (15122)
- TotalThreadsTotalWallClockTime: 2h59m
- TotalThreadsSysTime: 1m24s
- TotalThreadsUserTime: 2h46m
- TotalThreadsVoluntaryContextSwitches: 48.11K (48114)
Fragment Instance Lifecycle Timings:
- ExecTime: 994.928us
- ExecTreeExecTime: 7.009us
- OpenTime: 2h59m
- ExecTreeOpenTime: 2h59m
- PrepareTime: 42.393ms
- ExecTreePrepareTime: 716.514us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 304 (304)
- BlocksRecycled: 0 (0)
- BufferedPins: 0 (0)
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 40.10 GB (43057360896)
- PeakMemoryUsage: 2.50 GB (2686517248)
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=7):(Total: 148.562us, non-child: 148.562us, %
non-child: 100.00%)
- BytesSent: 2.54 KB (2605)
- NetworkThroughput(*): 42.02 MB/sec
- OverallThroughput: 16.90 MB/sec
- PeakMemoryUsage: 5.12 KB (5240)
- RowsReturned: 100 (100)
- SerializeBatchTime: 71.838us
- TransmitDataRPCTime: 59.454us
- UncompressedRowBatchSize: 2.84 KB (2904)
CodeGen:(Total: 377.079ms, non-child: 377.079ms, % non-child: 100.00%)
- CodegenTime: 2.819ms
- CompileTime: 85.347ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 146 (146)
- NumInstructions: 4.49K (4486)
- OptimizationTime: 257.519ms
- PeakMemoryUsage: 2.19 MB (2296832)
- PrepareTime: 33.212ms
SORT_NODE (id=4):(Total: 2h59m, non-child: 948.305us, % non-child: 0.00%)
- InsertBatchTime: 830.363us
- PeakMemoryUsage: 12.00 KB (12288)
- RowsReturned: 100 (100)
- RowsReturnedRate: 0
AGGREGATION_NODE (id=3):(Total: 2h59m, non-child: 13m13s, % non-child:
7.38%)
- BuildTime: 12m31s
- GetNewBlockTime: 560.277us
- GetResultsTime: 1.696ms
- HTResizeTime: 22s961ms
- HashBuckets: 131.07K (131072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.06 MB (12649574)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 51.00K (51000)
- RowsReturnedRate: 4.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.200us
HASH_JOIN_NODE (id=2):(Total: 2h46m, non-child: 2h35m, % non-child:
93.42%)
- BuildRows: 36.00M (35999266)
- BuildTime: 5s996ms
- PeakMemoryUsage: 2.52 GB (2703304934)
- ProbeRows: 72.00M (71999256)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2h34m
- RowsReturned: 35.04B (35041038642)
- RowsReturnedRate: 3.52 M/sec
Hash Join Builder (join_node_id=2):
- BuildRowsPartitionTime: 3s310ms
- BuildRowsPartitioned: 36.00M (35999266)
- GetNewBlockTime: 1.241ms
- HashBuckets: 67.11M (67108864)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 2s655ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.52 GB (2703250560)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 13s754ms, non-child: 13s754ms, %
non-child: 100.00%)
- BytesReceived: 506.36 MB (530958466)
- ConvertRowBatchTime: 437.634ms
- DeserializeRowBatchTimer: 629.545ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 36.00M (35999266)
- RowsReturnedRate: 2.62 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=5):(Total: 10m42s, non-child: 10m42s, % non-child:
100.00%)
- BytesReceived: 1.05 GB (1129577278)
- ConvertRowBatchTime: 1s387ms
- DeserializeRowBatchTimer: 2s434ms
- FirstBatchArrivalWaitTime: 807.997ms
- PeakMemoryUsage: 0
- RowsReturned: 72.00M (71999256)
- RowsReturnedRate: 262.32 K/sec
- SendersBlockedTimer: 45m17s
- SendersBlockedTotalTimer(*): 2h52m
Fragment F02:
Instance db497c13276e70de:38c671cf0000000c (host=bdpe611n1:22000):(Total:
2h59m, non-child: 6.402ms, % non-child: 0.00%)
MemoryUsage(4m16s): 2.40 GB, 2.56 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB,
2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB,
2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.56 GB, 2.56 GB
ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 2.56 GB (2749475947)
- PerHostPeakMemUsage: 2.75 GB (2952564125)
- RowsProduced: 100 (100)
- TotalNetworkReceiveTime: 19m16s
- TotalNetworkSendTime: 462.444us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 18.94K (18942)
- TotalThreadsTotalWallClockTime: 3h
- TotalThreadsSysTime: 2m21s
- TotalThreadsUserTime: 2h38m
- TotalThreadsVoluntaryContextSwitches: 61.24K (61238)
Fragment Instance Lifecycle Timings:
- ExecTime: 924.408us
- ExecTreeExecTime: 7.547us
- OpenTime: 2h59m
- ExecTreeOpenTime: 2h59m
- PrepareTime: 24.908ms
- ExecTreePrepareTime: 487.218us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 304 (304)
- BlocksRecycled: 0 (0)
- BufferedPins: 0 (0)
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 40.10 GB (43056730112)
- PeakMemoryUsage: 2.50 GB (2686517248)
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=7):(Total: 138.110us, non-child: 138.110us, %
non-child: 100.00%)
- BytesSent: 2.55 KB (2607)
- NetworkThroughput(*): 42.45 MB/sec
- OverallThroughput: 18.00 MB/sec
- PeakMemoryUsage: 5.12 KB (5240)
- RowsReturned: 100 (100)
- SerializeBatchTime: 69.921us
- TransmitDataRPCTime: 58.567us
- UncompressedRowBatchSize: 2.84 KB (2904)
CodeGen:(Total: 340.864ms, non-child: 340.864ms, % non-child: 100.00%)
- CodegenTime: 1.751ms
- CompileTime: 85.298ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 146 (146)
- NumInstructions: 4.49K (4486)
- OptimizationTime: 235.850ms
- PeakMemoryUsage: 2.19 MB (2296832)
- PrepareTime: 19.110ms
SORT_NODE (id=4):(Total: 2h59m, non-child: 983.750us, % non-child:
0.00%)
ExecOption: Codegen Enabled
- InsertBatchTime: 866.193us
- PeakMemoryUsage: 12.00 KB (12288)
- RowsReturned: 100 (100)
- RowsReturnedRate: 0
AGGREGATION_NODE (id=3):(Total: 2h59m, non-child: 12m58s, % non-child:
7.22%)
ExecOption: Codegen Enabled
- BuildTime: 12m15s
- GetNewBlockTime: 468.123us
- GetResultsTime: 1.678ms
- HTResizeTime: 24s104ms
- HashBuckets: 131.07K (131072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.06 MB (12649574)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 50.97K (50974)
- RowsReturnedRate: 4.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 719.000ns
HASH_JOIN_NODE (id=2):(Total: 2h46m, non-child: 2h27m, % non-child:
88.43%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared
Asynchronously
- BuildRows: 35.98M (35983120)
- BuildTime: 6s393ms
- PeakMemoryUsage: 2.52 GB (2703304934)
- ProbeRows: 71.99M (71990094)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2h27m
- RowsReturned: 35.04B (35036197113)
- RowsReturnedRate: 3.50 M/sec
Hash Join Builder (join_node_id=2):
ExecOption: Build Side Codegen Enabled, Hash Table Construction
Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 3s869ms
- BuildRowsPartitioned: 35.98M (35983120)
- GetNewBlockTime: 1.925ms
- HashBuckets: 67.11M (67108864)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 2s496ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.52 GB (2703250560)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 13s242ms, non-child: 525.357ms, %
non-child: 3.97%)
BytesReceived(4m16s): 487.63 MB, 506.11 MB, 506.11 MB, 506.11 MB,
506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB,
506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB,
506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB,
506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB,
506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB, 506.11 MB,
506.11 MB, 506.11 MB, 506.11 MB
- BytesReceived: 506.11 MB (530690006)
- ConvertRowBatchTime: 418.505ms
- DeserializeRowBatchTimer: 612.646ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 35.98M (35983120)
- RowsReturnedRate: 2.72 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=5):(Total: 19m4s, non-child: 1s984ms, % non-child:
0.17%)
BytesReceived(4m16s): 20.45 MB, 44.48 MB, 68.31 MB, 92.11 MB, 115.96
MB, 139.91 MB, 163.84 MB, 187.81 MB, 211.91 MB, 235.81 MB, 259.90 MB, 284.03
MB, 308.13 MB, 332.40 MB, 356.62 MB, 380.80 MB, 405.05 MB, 429.46 MB, 453.72
MB, 477.51 MB, 501.48 MB, 526.66 MB, 551.05 MB, 575.54 MB, 600.03 MB, 624.34
MB, 648.70 MB, 673.51 MB, 698.85 MB, 724.38 MB, 749.79 MB, 775.51 MB, 802.63
MB, 833.05 MB, 862.60 MB, 889.27 MB, 916.05 MB, 942.51 MB, 968.97 MB, 997.17
MB, 1.01 GB, 1.04 GB
- BytesReceived: 1.05 GB (1129341695)
- ConvertRowBatchTime: 1s313ms
- DeserializeRowBatchTimer: 2s534ms
- FirstBatchArrivalWaitTime: 847.738ms
- PeakMemoryUsage: 0
- RowsReturned: 71.99M (71990094)
- RowsReturnedRate: 62.89 K/sec
- SendersBlockedTimer: 5m14s
- SendersBlockedTotalTimer(*): 6m10s
Instance db497c13276e70de:38c671cf0000000a (host=bdpe611n4:22000):(Total:
2h59m, non-child: 10.637ms, % non-child: 0.00%)
MemoryUsage(4m16s): 2.39 GB, 2.56 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB,
2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB,
2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB, 2.56 GB
ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 2.56 GB (2749507726)
- PerHostPeakMemUsage: 2.76 GB (2964688788)
- RowsProduced: 100 (100)
- TotalNetworkReceiveTime: 17m7s
- TotalNetworkSendTime: 528.192us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 12.41K (12412)
- TotalThreadsTotalWallClockTime: 2h59m
- TotalThreadsSysTime: 1m
- TotalThreadsUserTime: 2h41m
- TotalThreadsVoluntaryContextSwitches: 59.74K (59739)
Fragment Instance Lifecycle Timings:
- ExecTime: 855.837us
- ExecTreeExecTime: 7.560us
- OpenTime: 2h59m
- ExecTreeOpenTime: 2h59m
- PrepareTime: 49.988ms
- ExecTreePrepareTime: 974.778us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 304 (304)
- BlocksRecycled: 0 (0)
- BufferedPins: 0 (0)
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 40.10 GB (43057991680)
- PeakMemoryUsage: 2.50 GB (2686517248)
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=7):(Total: 143.202us, non-child: 143.202us, %
non-child: 100.00%)
- BytesSent: 2.54 KB (2605)
- NetworkThroughput(*): 38.35 MB/sec
- OverallThroughput: 17.35 MB/sec
- PeakMemoryUsage: 5.12 KB (5240)
- RowsReturned: 100 (100)
- SerializeBatchTime: 59.396us
- TransmitDataRPCTime: 64.783us
- UncompressedRowBatchSize: 2.84 KB (2904)
CodeGen:(Total: 388.595ms, non-child: 388.595ms, % non-child: 100.00%)
- CodegenTime: 3.245ms
- CompileTime: 84.957ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 146 (146)
- NumInstructions: 4.49K (4486)
- OptimizationTime: 263.180ms
- PeakMemoryUsage: 2.19 MB (2296832)
- PrepareTime: 38.972ms
SORT_NODE (id=4):(Total: 2h59m, non-child: 915.813us, % non-child:
0.00%)
ExecOption: Codegen Enabled
- InsertBatchTime: 786.551us
- PeakMemoryUsage: 12.00 KB (12288)
- RowsReturned: 100 (100)
- RowsReturnedRate: 0
AGGREGATION_NODE (id=3):(Total: 2h59m, non-child: 14m50s, % non-child:
8.27%)
ExecOption: Codegen Enabled
- BuildTime: 14m3s
- GetNewBlockTime: 980.652us
- GetResultsTime: 1.690ms
- HTResizeTime: 24s257ms
- HashBuckets: 131.07K (131072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.06 MB (12649574)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 51.03K (51030)
- RowsReturnedRate: 4.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.318us
HASH_JOIN_NODE (id=2):(Total: 2h44m, non-child: 2h27m, % non-child:
89.59%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared
Asynchronously
- BuildRows: 36.01M (36009769)
- BuildTime: 5s719ms
- PeakMemoryUsage: 2.52 GB (2703304934)
- ProbeRows: 72.00M (71998704)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2h27m
- RowsReturned: 35.03B (35026247872)
- RowsReturnedRate: 3.54 M/sec
Hash Join Builder (join_node_id=2):
ExecOption: Build Side Codegen Enabled, Hash Table Construction
Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 2s703ms
- BuildRowsPartitioned: 36.01M (36009769)
- GetNewBlockTime: 955.266us
- HashBuckets: 67.11M (67108864)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 2s986ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.52 GB (2703250560)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 14s350ms, non-child: 516.912ms, %
non-child: 3.60%)
BytesReceived(4m16s): 487.29 MB, 506.54 MB, 506.54 MB, 506.54 MB,
506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB,
506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB,
506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB,
506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB,
506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB, 506.54 MB,
506.54 MB, 506.54 MB, 506.54 MB
- BytesReceived: 506.54 MB (531141275)
- ConvertRowBatchTime: 408.929ms
- DeserializeRowBatchTimer: 613.335ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 36.01M (36009769)
- RowsReturnedRate: 2.51 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=5):(Total: 16m55s, non-child: 1s846ms, % non-child:
0.18%)
BytesReceived(4m16s): 20.39 MB, 44.41 MB, 68.22 MB, 92.02 MB, 115.86
MB, 139.83 MB, 163.77 MB, 187.76 MB, 211.90 MB, 235.81 MB, 259.85 MB, 284.01
MB, 308.15 MB, 332.44 MB, 356.65 MB, 380.80 MB, 405.07 MB, 429.51 MB, 453.75
MB, 477.50 MB, 501.45 MB, 526.63 MB, 551.07 MB, 575.58 MB, 600.06 MB, 624.35
MB, 648.68 MB, 673.50 MB, 698.84 MB, 724.37 MB, 749.82 MB, 775.50 MB, 802.61
MB, 833.02 MB, 862.55 MB, 889.25 MB, 916.07 MB, 942.55 MB, 969.02 MB, 997.22
MB, 1.01 GB, 1.04 GB
- BytesReceived: 1.05 GB (1129493019)
- ConvertRowBatchTime: 1s195ms
- DeserializeRowBatchTimer: 2s265ms
- FirstBatchArrivalWaitTime: 794.761ms
- PeakMemoryUsage: 0
- RowsReturned: 72.00M (71998704)
- RowsReturnedRate: 70.93 K/sec
- SendersBlockedTimer: 1m
- SendersBlockedTotalTimer(*): 3m42s
Instance db497c13276e70de:38c671cf0000000b (host=bdpe722n4:22000):(Total:
2h58m, non-child: 9.770ms, % non-child: 0.00%)
MemoryUsage(4m16s): 2.40 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB,
2.55 GB, 2.55 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.55
GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.56 GB, 2.55 GB, 2.56 GB, 2.56 GB,
2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56
GB, 2.56 GB
ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 2.56 GB (2749524097)
- PerHostPeakMemUsage: 2.77 GB (2971818370)
- RowsProduced: 100 (100)
- TotalNetworkReceiveTime: 5m13s
- TotalNetworkSendTime: 536.026us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 14.72K (14720)
- TotalThreadsTotalWallClockTime: 2h59m
- TotalThreadsSysTime: 1m17s
- TotalThreadsUserTime: 2h52m
- TotalThreadsVoluntaryContextSwitches: 37.21K (37209)
Fragment Instance Lifecycle Timings:
- ExecTime: 1.029ms
- ExecTreeExecTime: 5.128us
- OpenTime: 2h58m
- ExecTreeOpenTime: 2h58m
- PrepareTime: 45.766ms
- ExecTreePrepareTime: 688.236us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 304 (304)
- BlocksRecycled: 0 (0)
- BufferedPins: 0 (0)
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 40.10 GB (43057991680)
- PeakMemoryUsage: 2.50 GB (2686517248)
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=7):(Total: 136.839us, non-child: 136.839us, %
non-child: 100.00%)
- BytesSent: 2.54 KB (2605)
- NetworkThroughput(*): 46.70 MB/sec
- OverallThroughput: 18.16 MB/sec
- PeakMemoryUsage: 5.12 KB (5240)
- RowsReturned: 100 (100)
- SerializeBatchTime: 64.933us
- TransmitDataRPCTime: 53.196us
- UncompressedRowBatchSize: 2.84 KB (2904)
CodeGen:(Total: 388.998ms, non-child: 388.998ms, % non-child: 100.00%)
- CodegenTime: 2.910ms
- CompileTime: 82.799ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 146 (146)
- NumInstructions: 4.49K (4486)
- OptimizationTime: 268.666ms
- PeakMemoryUsage: 2.19 MB (2296832)
- PrepareTime: 36.662ms
SORT_NODE (id=4):(Total: 2h58m, non-child: 841.264us, % non-child:
0.00%)
ExecOption: Codegen Enabled
- InsertBatchTime: 749.229us
- PeakMemoryUsage: 12.00 KB (12288)
- RowsReturned: 100 (100)
- RowsReturnedRate: 0
AGGREGATION_NODE (id=3):(Total: 2h58m, non-child: 11m30s, % non-child:
6.43%)
ExecOption: Codegen Enabled
- BuildTime: 10m57s
- GetNewBlockTime: 438.663us
- GetResultsTime: 1.541ms
- HTResizeTime: 21s696ms
- HashBuckets: 131.07K (131072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.06 MB (12649574)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 51.02K (51015)
- RowsReturnedRate: 4.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.413us
HASH_JOIN_NODE (id=2):(Total: 2h47m, non-child: 2h42m, % non-child:
96.86%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared
Asynchronously
- BuildRows: 36.00M (35999552)
- BuildTime: 5s710ms
- PeakMemoryUsage: 2.52 GB (2703304934)
- ProbeRows: 71.99M (71989555)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2h42m
- RowsReturned: 35.02B (35020611474)
- RowsReturnedRate: 3.49 M/sec
Hash Join Builder (join_node_id=2):
ExecOption: Build Side Codegen Enabled, Hash Table Construction
Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 3s531ms
- BuildRowsPartitioned: 36.00M (35999552)
- GetNewBlockTime: 924.426us
- HashBuckets: 67.11M (67108864)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 2s148ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.52 GB (2703250560)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 13s518ms, non-child: 576.224ms, %
non-child: 4.26%)
BytesReceived(4m16s): 487.35 MB, 506.37 MB, 506.37 MB, 506.37 MB,
506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB,
506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB,
506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB,
506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB,
506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB, 506.37 MB,
506.37 MB, 506.37 MB
- BytesReceived: 506.37 MB (530963184)
- ConvertRowBatchTime: 455.062ms
- DeserializeRowBatchTimer: 679.621ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 36.00M (35999552)
- RowsReturnedRate: 2.66 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=5):(Total: 5m2s, non-child: 2s227ms, % non-child:
0.74%)
BytesReceived(4m16s): 20.43 MB, 44.48 MB, 68.29 MB, 92.09 MB, 115.91
MB, 139.89 MB, 163.82 MB, 187.78 MB, 211.89 MB, 235.78 MB, 259.83 MB, 283.97
MB, 308.12 MB, 332.39 MB, 356.62 MB, 380.78 MB, 405.00 MB, 429.40 MB, 453.65
MB, 477.41 MB, 501.36 MB, 526.54 MB, 550.97 MB, 575.51 MB, 599.99 MB, 624.30
MB, 648.66 MB, 673.48 MB, 698.82 MB, 724.35 MB, 749.77 MB, 775.47 MB, 802.58
MB, 833.01 MB, 862.55 MB, 889.23 MB, 916.02 MB, 942.47 MB, 968.93 MB, 997.19
MB, 1.01 GB
- BytesReceived: 1.05 GB (1129451307)
- ConvertRowBatchTime: 1s457ms
- DeserializeRowBatchTimer: 2s994ms
- FirstBatchArrivalWaitTime: 795.995ms
- PeakMemoryUsage: 0
- RowsReturned: 71.99M (71989555)
- RowsReturnedRate: 238.10 K/sec
- SendersBlockedTimer: 38m44s
- SendersBlockedTotalTimer(*): 2h15m
Instance db497c13276e70de:38c671cf00000009 (host=bdpe611n3:22000):(Total:
2h58m, non-child: 11.453ms, % non-child: 0.00%)
MemoryUsage(4m16s): 2.40 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56
GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB,
2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56
GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB,
2.56 GB, 2.56 GB, 2.56 GB, 2.56 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55 GB, 2.55
GB, 2.55 GB
ThreadUsage(4m16s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1
- AverageThreadTokens: 1.00
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 2.56 GB (2749500022)
- PerHostPeakMemUsage: 2.77 GB (2977746635)
- RowsProduced: 100 (100)
- TotalNetworkReceiveTime: 1m58s
- TotalNetworkSendTime: 589.476us
- TotalStorageWaitTime: 0.000ns
- TotalThreadsInvoluntaryContextSwitches: 14.42K (14416)
- TotalThreadsTotalWallClockTime: 2h59m
- TotalThreadsSysTime: 58s351ms
- TotalThreadsUserTime: 2h55m
- TotalThreadsVoluntaryContextSwitches: 34.27K (34270)
Fragment Instance Lifecycle Timings:
- ExecTime: 1.169ms
- ExecTreeExecTime: 7.804us
- OpenTime: 2h58m
- ExecTreeOpenTime: 2h58m
- PrepareTime: 48.908ms
- ExecTreePrepareTime: 715.824us
BlockMgr:
- BlockWritesOutstanding: 0 (0)
- BlocksCreated: 304 (304)
- BlocksRecycled: 0 (0)
- BufferedPins: 0 (0)
- MaxBlockSize: 8.00 MB (8388608)
- MemoryLimit: 40.10 GB (43056730112)
- PeakMemoryUsage: 2.50 GB (2686517248)
- ScratchBytesRead: 0
- ScratchBytesWritten: 0
- ScratchFileUsedBytes: 0
- ScratchReads: 0 (0)
- ScratchWrites: 0 (0)
- TotalBufferWaitTime: 0.000ns
- TotalEncryptionTime: 0.000ns
- TotalReadBlockTime: 0.000ns
DataStreamSender (dst_id=7):(Total: 176.098us, non-child: 176.098us, %
non-child: 100.00%)
- BytesSent: 2.54 KB (2606)
- NetworkThroughput(*): 40.56 MB/sec
- OverallThroughput: 14.11 MB/sec
- PeakMemoryUsage: 5.12 KB (5240)
- RowsReturned: 100 (100)
- SerializeBatchTime: 93.105us
- TransmitDataRPCTime: 61.271us
- UncompressedRowBatchSize: 2.84 KB (2904)
CodeGen:(Total: 389.859ms, non-child: 389.859ms, % non-child: 100.00%)
- CodegenTime: 3.371ms
- CompileTime: 88.334ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 146 (146)
- NumInstructions: 4.49K (4486)
- OptimizationTime: 262.380ms
- PeakMemoryUsage: 2.19 MB (2296832)
- PrepareTime: 38.105ms
SORT_NODE (id=4):(Total: 2h58m, non-child: 1.052ms, % non-child: 0.00%)
ExecOption: Codegen Enabled
- InsertBatchTime: 919.482us
- PeakMemoryUsage: 12.00 KB (12288)
- RowsReturned: 100 (100)
- RowsReturnedRate: 0
AGGREGATION_NODE (id=3):(Total: 2h58m, non-child: 13m34s, % non-child:
7.58%)
ExecOption: Codegen Enabled
- BuildTime: 12m50s
- GetNewBlockTime: 353.670us
- GetResultsTime: 1.876ms
- HTResizeTime: 21s788ms
- HashBuckets: 131.07K (131072)
- LargestPartitionPercent: 0 (0)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 12.06 MB (12649574)
- PinTime: 0.000ns
- RowsRepartitioned: 0 (0)
- RowsReturned: 50.98K (50981)
- RowsReturnedRate: 4.00 /sec
- SpilledPartitions: 0 (0)
- UnpinTime: 1.350us
HASH_JOIN_NODE (id=2):(Total: 2h45m, non-child: 2h43m, % non-child:
98.79%)
ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared
Asynchronously
- BuildRows: 36.00M (36004624)
- BuildTime: 6s163ms
- PeakMemoryUsage: 2.52 GB (2703304934)
- ProbeRows: 72.02M (72018671)
- ProbeRowsPartitioned: 0 (0)
- ProbeTime: 2h43m
- RowsReturned: 35.08B (35081098110)
- RowsReturnedRate: 3.54 M/sec
Hash Join Builder (join_node_id=2):
ExecOption: Build Side Codegen Enabled, Hash Table Construction
Codegen Enabled
Runtime filters: 1 of 1 Runtime Filter Published
- BuildRowsPartitionTime: 3s135ms
- BuildRowsPartitioned: 36.00M (36004624)
- GetNewBlockTime: 1.159ms
- HashBuckets: 67.11M (67108864)
- HashCollisions: 0 (0)
- HashTablesBuildTime: 2s992ms
- LargestPartitionPercent: 6 (6)
- MaxPartitionLevel: 0 (0)
- NumRepartitions: 0 (0)
- PartitionsCreated: 16 (16)
- PeakMemoryUsage: 2.52 GB (2703250560)
- PinTime: 0.000ns
- RepartitionTime: 0.000ns
- SpilledPartitions: 0 (0)
- UnpinTime: 0.000ns
EXCHANGE_NODE (id=6):(Total: 13s908ms, non-child: 584.682ms, %
non-child: 4.20%)
BytesReceived(4m16s): 487.51 MB, 506.44 MB, 506.44 MB, 506.44 MB,
506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB,
506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB,
506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB,
506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB,
506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB, 506.44 MB,
506.44 MB, 506.44 MB
- BytesReceived: 506.44 MB (531039402)
- ConvertRowBatchTime: 468.040ms
- DeserializeRowBatchTimer: 612.581ms
- FirstBatchArrivalWaitTime: 0.000ns
- PeakMemoryUsage: 0
- RowsReturned: 36.00M (36004624)
- RowsReturnedRate: 2.59 M/sec
- SendersBlockedTimer: 0.000ns
- SendersBlockedTotalTimer(*): 0.000ns
EXCHANGE_NODE (id=5):(Total: 1m46s, non-child: 2s288ms, % non-child:
2.15%)
BytesReceived(4m16s): 20.40 MB, 44.45 MB, 68.28 MB, 92.09 MB, 115.93
MB, 139.92 MB, 163.88 MB, 187.87 MB, 211.98 MB, 235.90 MB, 259.96 MB, 284.08
MB, 308.23 MB, 332.53 MB, 356.76 MB, 380.93 MB, 405.18 MB, 429.61 MB, 453.89
MB, 477.72 MB, 501.70 MB, 526.86 MB, 551.29 MB, 575.82 MB, 600.29 MB, 624.59
MB, 648.93 MB, 673.78 MB, 699.13 MB, 724.68 MB, 750.12 MB, 775.83 MB, 803.01
MB, 833.43 MB, 863.00 MB, 889.73 MB, 916.53 MB, 943.02 MB, 969.46 MB, 997.69
MB, 1.01 GB
- BytesReceived: 1.05 GB (1130023091)
- ConvertRowBatchTime: 1s583ms
- DeserializeRowBatchTimer: 1s945ms
- FirstBatchArrivalWaitTime: 793.496ms
- PeakMemoryUsage: 0
- RowsReturned: 72.02M (72018671)
- RowsReturnedRate: 677.38 K/sec
- SendersBlockedTimer: 2h16m
- SendersBlockedTotalTimer(*): 9h2m
Averaged Fragment F00:(Total: 2h50m, non-child: 2h50m, % non-child: 99.88%)
split sizes: min: 5.22 GB, max: 5.23 GB, avg: 5.22 GB, stddev: 3.08 MB
completion times: min:2h43m max:2h58m mean: 2h50m stddev:5m27s
execution rates: min:511.87 KB/sec max:559.20 KB/sec mean:536.24 KB/sec
stddev:16.82 KB/sec
num instances: 4
- AverageThreadTokens: 39.42
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 215.79 MB (226270928)
- PerHostPeakMemUsage: 2.76 GB (2966704479)
- RowsProduced: 72.00M (71999256)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 2h50m
- TotalStorageWaitTime: 1m51s
- TotalThreadsInvoluntaryContextSwitches: 515 (515)
- TotalThreadsTotalWallClockTime: 111h56m
- TotalThreadsSysTime: 6s867ms
- TotalThreadsUserTime: 22s341ms
- TotalThreadsVoluntaryContextSwitches: 93.68K (93676)
Fragment Instance Lifecycle Timings:
- ExecTime: 2h50m
- ExecTreeExecTime: 2s143ms
- OpenTime: 28.995ms
- ExecTreeOpenTime: 239.621us
- PrepareTime: 31.781ms
- ExecTreePrepareTime: 1.900ms
DataStreamSender (dst_id=5):(Total: 10s223ms, non-child: 10s223ms, %
non-child: 100.00%)
- BytesSent: 1.05 GB (1129577278)
- NetworkThroughput(*): 310.24 MB/sec
- OverallThroughput: 106.66 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 72.00M (71999256)
- SerializeBatchTime: 6s708ms
- TransmitDataRPCTime: 3s502ms
- UncompressedRowBatchSize: 1.41 GB (1512283445)
CodeGen:(Total: 52.896ms, non-child: 52.896ms, % non-child: 100.00%)
- CodegenTime: 907.274us
- CompileTime: 7.672ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 29 (29)
- NumInstructions: 456 (456)
- OptimizationTime: 19.922ms
- PeakMemoryUsage: 228.00 KB (233472)
- PrepareTime: 24.561ms
HDFS_SCAN_NODE (id=1):(Total: 2s078ms, non-child: 2s078ms, % non-child:
100.00%)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 38.42
- BytesRead: 987.98 MB (1035971730)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 987.98 MB (1035971730)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 480 (480)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 199.64 MB (209340420)
- PerReadThreadRawHdfsThroughput: 53.23 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 587.095ms
- RowBatchQueuePutWaitTime: 109h3m
- RowsRead: 72.00M (71999256)
- RowsReturned: 72.00M (71999256)
- RowsReturnedRate: 34.80 M/sec
- ScanRangesComplete: 480 (480)
- ScannerThreadsInvoluntaryContextSwitches: 436 (436)
- ScannerThreadsTotalWallClockTime: 109h6m
- MaterializeTupleTime(*): 10s013ms
- ScannerThreadsSysTime: 5s695ms
- ScannerThreadsUserTime: 8s254ms
- ScannerThreadsVoluntaryContextSwitches: 74.26K (74264)
- TotalRawHdfsReadTime(*): 18s856ms
- TotalReadThroughput: 99.10 KB/sec
Filter 0 (16.00 MB):
- Rows processed: 7.76M (7756800)
- Rows rejected: 0 (0)
- Rows total: 72.00M (71999256)
Fragment F00:
Instance db497c13276e70de:38c671cf00000001 (host=bdpe611n3:22000):(Total:
2h58m, non-child: 2h58m, % non-child: 99.90%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:482/5.23
GB
Filter 0 arrival: 18s654ms
MemoryUsage(4m16s): 177.81 MB, 180.92 MB, 187.26 MB, 206.17 MB, 206.19
MB, 209.20 MB, 209.35 MB, 205.14 MB, 204.08 MB, 199.90 MB, 178.93 MB, 176.78
MB, 178.60 MB, 178.52 MB, 174.65 MB, 178.33 MB, 176.79 MB, 176.30 MB, 179.98
MB, 187.79 MB, 187.72 MB, 193.06 MB, 200.92 MB, 201.98 MB, 205.83 MB, 196.84
MB, 196.14 MB, 203.42 MB, 202.08 MB, 202.55 MB, 198.97 MB, 189.36 MB, 185.37
MB, 184.81 MB, 183.54 MB, 190.59 MB, 193.39 MB, 196.92 MB, 194.92 MB, 191.91
MB, 198.95 MB
ThreadUsage(4m16s): 39, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40
- AverageThreadTokens: 39.82
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 217.73 MB (228310884)
- PerHostPeakMemUsage: 2.77 GB (2977746635)
- RowsProduced: 72.06M (72055527)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 2h58m
- TotalStorageWaitTime: 1m33s
- TotalThreadsInvoluntaryContextSwitches: 408 (408)
- TotalThreadsTotalWallClockTime: 118h24m
- TotalThreadsSysTime: 4s779ms
- TotalThreadsUserTime: 19s548ms
- TotalThreadsVoluntaryContextSwitches: 93.84K (93842)
Fragment Instance Lifecycle Timings:
- ExecTime: 2h58m
- ExecTreeExecTime: 1s905ms
- OpenTime: 25.584ms
- ExecTreeOpenTime: 144.073us
- PrepareTime: 26.783ms
- ExecTreePrepareTime: 1.555ms
DataStreamSender (dst_id=5):(Total: 8s611ms, non-child: 8s611ms, %
non-child: 100.00%)
- BytesSent: 1.05 GB (1130467333)
- NetworkThroughput(*): 357.85 MB/sec
- OverallThroughput: 125.20 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 72.06M (72055527)
- SerializeBatchTime: 5s589ms
- TransmitDataRPCTime: 3s012ms
- UncompressedRowBatchSize: 1.41 GB (1513465371)
CodeGen:(Total: 45.006ms, non-child: 45.006ms, % non-child: 100.00%)
- CodegenTime: 787.554us
- CompileTime: 7.055ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 29 (29)
- NumInstructions: 456 (456)
- OptimizationTime: 17.385ms
- PeakMemoryUsage: 228.00 KB (233472)
- PrepareTime: 19.963ms
HDFS_SCAN_NODE (id=1):(Total: 1s854ms, non-child: 1s854ms, % non-child:
100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:482/5.23
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 482 out of 482
Runtime filters: Only following filters arrived: , waited 964ms
Hdfs Read Thread Concurrency Bucket: 0:99.86% 1:0.1448% 2:0% 3:0%
4:0%
File Formats: PARQUET/NONE:964
BytesRead(4m16s): 100.39 MB, 101.96 MB, 114.29 MB, 139.71 MB, 139.91
MB, 146.32 MB, 169.70 MB, 182.41 MB, 185.69 MB, 204.48 MB, 223.39 MB, 236.82
MB, 256.41 MB, 278.17 MB, 286.68 MB, 303.62 MB, 321.06 MB, 333.02 MB, 353.62
MB, 379.10 MB, 401.59 MB, 417.04 MB, 434.97 MB, 450.07 MB, 465.78 MB, 479.48
MB, 496.88 MB, 511.31 MB, 526.29 MB, 546.72 MB, 552.00 MB, 566.62 MB, 586.46
MB, 611.54 MB, 637.47 MB, 662.38 MB, 688.45 MB, 709.51 MB, 732.75 MB, 781.77
MB, 881.30 MB
- FooterProcessingTime: (Avg: 80.257ms ; Min: 3.497ms ; Max: 1s381ms
; Number of samples: 482)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 38.82
- BytesRead: 988.85 MB (1036880161)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 988.85 MB (1036880161)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 482 (482)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 201.61 MB (211402904)
- PerReadThreadRawHdfsThroughput: 60.69 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 462.542ms
- RowBatchQueuePutWaitTime: 115h23m
- RowsRead: 72.06M (72055527)
- RowsReturned: 72.06M (72055527)
- RowsReturnedRate: 38.85 M/sec
- ScanRangesComplete: 482 (482)
- ScannerThreadsInvoluntaryContextSwitches: 337 (337)
- ScannerThreadsTotalWallClockTime: 115h25m
- MaterializeTupleTime(*): 8s255ms
- ScannerThreadsSysTime: 4s078ms
- ScannerThreadsUserTime: 7s580ms
- ScannerThreadsVoluntaryContextSwitches: 74.32K (74321)
- TotalRawHdfsReadTime(*): 16s293ms
- TotalReadThroughput: 94.62 KB/sec
Filter 0 (16.00 MB):
- Rows processed: 7.77M (7768064)
- Rows rejected: 0 (0)
- Rows total: 72.06M (72055527)
Instance db497c13276e70de:38c671cf00000003 (host=bdpe722n4:22000):(Total:
2h50m, non-child: 2h50m, % non-child: 99.87%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:478/5.22
GB
Filter 0 arrival: 18s658ms
MemoryUsage(4m16s): 160.35 MB, 167.03 MB, 195.80 MB, 197.54 MB, 198.44
MB, 196.87 MB, 185.69 MB, 185.81 MB, 187.66 MB, 194.20 MB, 204.28 MB, 209.16
MB, 208.07 MB, 201.44 MB, 200.74 MB, 202.57 MB, 197.00 MB, 180.18 MB, 184.27
MB, 176.88 MB, 173.37 MB, 178.22 MB, 188.83 MB, 194.40 MB, 207.74 MB, 198.97
MB, 194.45 MB, 192.52 MB, 208.50 MB, 210.35 MB, 201.89 MB, 196.78 MB, 196.92
MB, 194.15 MB, 180.87 MB, 185.19 MB, 187.15 MB, 193.74 MB, 190.38 MB, 125.51 MB
ThreadUsage(4m16s): 39, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 38, 21
- AverageThreadTokens: 39.49
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 216.81 MB (227339148)
- PerHostPeakMemUsage: 2.77 GB (2971818370)
- RowsProduced: 72.13M (72129934)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 2h50m
- TotalStorageWaitTime: 1m57s
- TotalThreadsInvoluntaryContextSwitches: 598 (598)
- TotalThreadsTotalWallClockTime: 112h22m
- TotalThreadsSysTime: 9s672ms
- TotalThreadsUserTime: 25s857ms
- TotalThreadsVoluntaryContextSwitches: 93.33K (93333)
Fragment Instance Lifecycle Timings:
- ExecTime: 2h50m
- ExecTreeExecTime: 2s236ms
- OpenTime: 35.929ms
- ExecTreeOpenTime: 276.166us
- PrepareTime: 42.311ms
- ExecTreePrepareTime: 2.421ms
DataStreamSender (dst_id=5):(Total: 11s412ms, non-child: 11s412ms, %
non-child: 100.00%)
- BytesSent: 1.05 GB (1131621805)
- NetworkThroughput(*): 296.50 MB/sec
- OverallThroughput: 94.57 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 72.13M (72129934)
- SerializeBatchTime: 7s755ms
- TransmitDataRPCTime: 3s639ms
- UncompressedRowBatchSize: 1.41 GB (1515028230)
CodeGen:(Total: 68.197ms, non-child: 68.197ms, % non-child: 100.00%)
- CodegenTime: 1.175ms
- CompileTime: 9.145ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 29 (29)
- NumInstructions: 456 (456)
- OptimizationTime: 25.133ms
- PeakMemoryUsage: 228.00 KB (233472)
- PrepareTime: 33.062ms
HDFS_SCAN_NODE (id=1):(Total: 2s170ms, non-child: 2s170ms, % non-child:
100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:478/5.22
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 478 out of 478
Runtime filters: Only following filters arrived: , waited 943ms
Hdfs Read Thread Concurrency Bucket: 0:99.8% 1:0.2002% 2:0% 3:0% 4:0%
5:0%
File Formats: PARQUET/NONE:956
BytesRead(4m16s): 94.39 MB, 101.79 MB, 143.35 MB, 152.12 MB, 179.27
MB, 190.73 MB, 225.55 MB, 246.54 MB, 292.61 MB, 310.11 MB, 338.84 MB, 356.70
MB, 379.68 MB, 397.64 MB, 427.79 MB, 452.21 MB, 467.82 MB, 485.15 MB, 511.46
MB, 537.63 MB, 551.90 MB, 576.98 MB, 606.52 MB, 629.90 MB, 655.13 MB, 673.51
MB, 697.23 MB, 715.83 MB, 753.27 MB, 775.07 MB, 799.37 MB, 815.49 MB, 841.94
MB, 868.77 MB, 906.04 MB, 925.35 MB, 943.63 MB, 959.33 MB, 977.97 MB, 988.24 MB
- FooterProcessingTime: (Avg: 110.048ms ; Min: 3.529ms ; Max:
1s660ms ; Number of samples: 478)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 38.50
- BytesRead: 988.24 MB (1036240978)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 988.24 MB (1036240978)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 478 (478)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 200.65 MB (210398400)
- PerReadThreadRawHdfsThroughput: 45.39 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 507.734ms
- RowBatchQueuePutWaitTime: 109h29m
- RowsRead: 72.13M (72129934)
- RowsReturned: 72.13M (72129934)
- RowsReturnedRate: 33.23 M/sec
- ScanRangesComplete: 478 (478)
- ScannerThreadsInvoluntaryContextSwitches: 468 (468)
- ScannerThreadsTotalWallClockTime: 109h32m
- MaterializeTupleTime(*): 12s544ms
- ScannerThreadsSysTime: 7s668ms
- ScannerThreadsUserTime: 9s740ms
- ScannerThreadsVoluntaryContextSwitches: 74.04K (74043)
- TotalRawHdfsReadTime(*): 21s771ms
- TotalReadThroughput: 98.80 KB/sec
Filter 0 (16.00 MB):
- Rows processed: 7.70M (7703552)
- Rows rejected: 0 (0)
- Rows total: 72.13M (72129934)
Instance db497c13276e70de:38c671cf00000002 (host=bdpe611n4:22000):(Total:
2h49m, non-child: 2h48m, % non-child: 99.88%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:481/5.22
GB
Filter 0 arrival: 18s663ms
MemoryUsage(4m16s): 169.37 MB, 172.74 MB, 179.81 MB, 192.07 MB, 202.21
MB, 208.73 MB, 207.03 MB, 185.04 MB, 187.00 MB, 184.86 MB, 186.90 MB, 182.74
MB, 177.12 MB, 184.03 MB, 192.20 MB, 199.59 MB, 199.11 MB, 184.87 MB, 183.56
MB, 191.99 MB, 187.60 MB, 186.56 MB, 182.78 MB, 188.28 MB, 200.77 MB, 201.98
MB, 198.74 MB, 188.65 MB, 184.88 MB, 194.01 MB, 184.03 MB, 185.24 MB, 199.61
MB, 192.24 MB, 198.79 MB, 205.84 MB, 205.60 MB, 210.60 MB, 180.83 MB
ThreadUsage(4m16s): 39, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 39, 30
- AverageThreadTokens: 39.30
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 219.72 MB (230388508)
- PerHostPeakMemUsage: 2.76 GB (2964688788)
- RowsProduced: 71.85M (71854745)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 2h48m
- TotalStorageWaitTime: 2m7s
- TotalThreadsInvoluntaryContextSwitches: 308 (308)
- TotalThreadsTotalWallClockTime: 110h49m
- TotalThreadsSysTime: 5s300ms
- TotalThreadsUserTime: 21s215ms
- TotalThreadsVoluntaryContextSwitches: 93.69K (93692)
Fragment Instance Lifecycle Timings:
- ExecTime: 2h49m
- ExecTreeExecTime: 2s170ms
- OpenTime: 31.920ms
- ExecTreeOpenTime: 324.682us
- PrepareTime: 31.819ms
- ExecTreePrepareTime: 1.961ms
DataStreamSender (dst_id=5):(Total: 9s833ms, non-child: 9s833ms, %
non-child: 100.00%)
- BytesSent: 1.05 GB (1127277866)
- NetworkThroughput(*): 308.95 MB/sec
- OverallThroughput: 109.33 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 71.85M (71854745)
- SerializeBatchTime: 6s340ms
- TransmitDataRPCTime: 3s479ms
- UncompressedRowBatchSize: 1.41 GB (1509248113)
CodeGen:(Total: 56.107ms, non-child: 56.107ms, % non-child: 100.00%)
- CodegenTime: 993.758us
- CompileTime: 8.715ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 29 (29)
- NumInstructions: 456 (456)
- OptimizationTime: 21.662ms
- PeakMemoryUsage: 228.00 KB (233472)
- PrepareTime: 24.779ms
HDFS_SCAN_NODE (id=1):(Total: 2s104ms, non-child: 2s104ms, % non-child:
100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:481/5.22
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 481 out of 481
Runtime filters: Only following filters arrived: , waited 943ms
Hdfs Read Thread Concurrency Bucket: 0:99.84% 1:0.1626% 2:0% 3:0%
4:0%
File Formats: PARQUET/NONE:962
BytesRead(4m16s): 90.36 MB, 93.14 MB, 118.48 MB, 132.40 MB, 157.41
MB, 185.70 MB, 194.63 MB, 219.31 MB, 235.81 MB, 270.10 MB, 288.14 MB, 314.37
MB, 333.21 MB, 368.22 MB, 394.17 MB, 417.41 MB, 436.19 MB, 456.63 MB, 477.52
MB, 505.05 MB, 529.85 MB, 554.77 MB, 577.90 MB, 604.62 MB, 633.46 MB, 660.57
MB, 678.20 MB, 704.87 MB, 724.98 MB, 754.36 MB, 780.37 MB, 811.23 MB, 836.95
MB, 862.74 MB, 896.46 MB, 930.59 MB, 952.54 MB, 980.84 MB, 987.23 MB
- FooterProcessingTime: (Avg: 115.320ms ; Min: 3.019ms ; Max:
1s913ms ; Number of samples: 481)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 38.30
- BytesRead: 987.23 MB (1035188456)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 987.23 MB (1035188456)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 481 (481)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 203.56 MB (213447760)
- PerReadThreadRawHdfsThroughput: 47.98 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 708.926ms
- RowBatchQueuePutWaitTime: 107h57m
- RowsRead: 71.85M (71854745)
- RowsReturned: 71.85M (71854745)
- RowsReturnedRate: 34.14 M/sec
- ScanRangesComplete: 481 (481)
- ScannerThreadsInvoluntaryContextSwitches: 258 (258)
- ScannerThreadsTotalWallClockTime: 108h
- MaterializeTupleTime(*): 8s610ms
- ScannerThreadsSysTime: 4s481ms
- ScannerThreadsUserTime: 7s804ms
- ScannerThreadsVoluntaryContextSwitches: 74.26K (74260)
- TotalRawHdfsReadTime(*): 20s576ms
- TotalReadThroughput: 99.61 KB/sec
Filter 0 (16.00 MB):
- Rows processed: 7.76M (7760896)
- Rows rejected: 0 (0)
- Rows total: 71.85M (71854745)
Instance db497c13276e70de:38c671cf00000004 (host=bdpe611n1:22000):(Total:
2h43m, non-child: 2h42m, % non-child: 99.86%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:482/5.22
GB
Filter 0 arrival: 18s639ms
MemoryUsage(4m16s): 163.34 MB, 170.20 MB, 183.72 MB, 191.51 MB, 191.96
MB, 182.23 MB, 191.12 MB, 190.53 MB, 196.19 MB, 198.05 MB, 195.31 MB, 183.78
MB, 185.54 MB, 183.82 MB, 187.00 MB, 196.11 MB, 197.22 MB, 202.69 MB, 195.95
MB, 187.38 MB, 190.06 MB, 192.08 MB, 195.68 MB, 201.95 MB, 196.24 MB, 192.54
MB, 183.44 MB, 182.30 MB, 191.17 MB, 198.77 MB, 204.88 MB, 202.67 MB, 195.46
MB, 192.60 MB, 193.54 MB, 201.13 MB, 179.13 MB, 126.89 MB
ThreadUsage(4m16s): 39, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 39, 32, 19
- AverageThreadTokens: 39.06
- BloomFilterBytes: 16.00 MB (16777216)
- PeakMemoryUsage: 208.90 MB (219045172)
- PerHostPeakMemUsage: 2.75 GB (2952564125)
- RowsProduced: 71.96M (71956818)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 2h42m
- TotalStorageWaitTime: 1m46s
- TotalThreadsInvoluntaryContextSwitches: 749 (749)
- TotalThreadsTotalWallClockTime: 106h10m
- TotalThreadsSysTime: 7s717ms
- TotalThreadsUserTime: 22s745ms
- TotalThreadsVoluntaryContextSwitches: 93.84K (93838)
Fragment Instance Lifecycle Timings:
- ExecTime: 2h43m
- ExecTreeExecTime: 2s261ms
- OpenTime: 22.548ms
- ExecTreeOpenTime: 213.563us
- PrepareTime: 26.209ms
- ExecTreePrepareTime: 1.662ms
DataStreamSender (dst_id=5):(Total: 11s037ms, non-child: 11s037ms, %
non-child: 100.00%)
- BytesSent: 1.05 GB (1128942108)
- NetworkThroughput(*): 277.66 MB/sec
- OverallThroughput: 97.55 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 71.96M (71956818)
- SerializeBatchTime: 7s146ms
- TransmitDataRPCTime: 3s877ms
- UncompressedRowBatchSize: 1.41 GB (1511392066)
CodeGen:(Total: 42.275ms, non-child: 42.275ms, % non-child: 100.00%)
- CodegenTime: 672.285us
- CompileTime: 5.773ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 29 (29)
- NumInstructions: 456 (456)
- OptimizationTime: 15.507ms
- PeakMemoryUsage: 228.00 KB (233472)
- PrepareTime: 20.441ms
HDFS_SCAN_NODE (id=1):(Total: 2s182ms, non-child: 2s182ms, % non-child:
100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:482/5.22
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 482 out of 482
Runtime filters: Only following filters arrived: , waited 963ms
Hdfs Read Thread Concurrency Bucket: 0:99.82% 1:0.1789% 2:0% 3:0%
4:0%
File Formats: PARQUET/NONE:964
BytesRead(4m16s): 86.18 MB, 90.83 MB, 119.45 MB, 129.50 MB, 157.29
MB, 177.23 MB, 201.29 MB, 239.53 MB, 263.56 MB, 283.97 MB, 301.25 MB, 323.76
MB, 347.49 MB, 385.10 MB, 411.89 MB, 439.13 MB, 458.07 MB, 483.67 MB, 513.82
MB, 541.02 MB, 563.87 MB, 595.70 MB, 617.07 MB, 639.71 MB, 670.39 MB, 691.56
MB, 714.09 MB, 732.70 MB, 780.61 MB, 810.82 MB, 831.54 MB, 851.19 MB, 871.56
MB, 901.80 MB, 941.94 MB, 980.74 MB, 987.60 MB, 987.60 MB
- FooterProcessingTime: (Avg: 97.926ms ; Min: 3.136ms ; Max: 1s300ms
; Number of samples: 482)
- AverageHdfsReadThreadConcurrency: 0.00
- AverageScannerThreadConcurrency: 38.06
- BytesRead: 987.60 MB (1035577328)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 987.60 MB (1035577328)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 482 (482)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 192.75 MB (202112616)
- PerReadThreadRawHdfsThroughput: 58.84 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 669.178ms
- RowBatchQueuePutWaitTime: 103h24m
- RowsRead: 71.96M (71956818)
- RowsReturned: 71.96M (71956818)
- RowsReturnedRate: 32.96 M/sec
- ScanRangesComplete: 482 (482)
- ScannerThreadsInvoluntaryContextSwitches: 681 (681)
- ScannerThreadsTotalWallClockTime: 103h27m
- MaterializeTupleTime(*): 10s645ms
- ScannerThreadsSysTime: 6s554ms
- ScannerThreadsUserTime: 7s893ms
- ScannerThreadsVoluntaryContextSwitches: 74.43K (74433)
- TotalRawHdfsReadTime(*): 16s783ms
- TotalReadThroughput: 103.38 KB/sec
Filter 0 (16.00 MB):
- Rows processed: 7.79M (7794688)
- Rows rejected: 0 (0)
- Rows total: 71.96M (71956818)
Averaged Fragment F01:(Total: 15s966ms, non-child: 2s218ms, % non-child:
13.89%)
split sizes: min: 4.26 GB, max: 4.26 GB, avg: 4.26 GB, stddev: 437.23 KB
completion times: min:13s407ms max:17s439ms mean: 15s967ms
stddev:1s561ms
execution rates: min:249.88 MB/sec max:325.12 MB/sec mean:275.85 MB/sec
stddev:29.53 MB/sec
num instances: 4
- AverageThreadTokens: 38.83
- BloomFilterBytes: 0
- PeakMemoryUsage: 15.98 MB (16758380)
- PerHostPeakMemUsage: 818.65 MB (858416520)
- RowsProduced: 36.00M (35999266)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 845.722ms
- TotalStorageWaitTime: 9m51s
- TotalThreadsInvoluntaryContextSwitches: 35 (35)
- TotalThreadsTotalWallClockTime: 10m22s
- TotalThreadsSysTime: 366.794ms
- TotalThreadsUserTime: 5s514ms
- TotalThreadsVoluntaryContextSwitches: 33.08K (33084)
Fragment Instance Lifecycle Timings:
- ExecTime: 15s926ms
- ExecTreeExecTime: 10s724ms
- OpenTime: 13.555ms
- ExecTreeOpenTime: 179.172us
- PrepareTime: 26.875ms
- ExecTreePrepareTime: 1.707ms
DataStreamSender (dst_id=6):(Total: 2s997ms, non-child: 2s997ms, %
non-child: 100.00%)
- BytesSent: 506.36 MB (530958466)
- NetworkThroughput(*): 617.34 MB/sec
- OverallThroughput: 168.99 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 36.00M (35999266)
- SerializeBatchTime: 2s172ms
- TransmitDataRPCTime: 822.953ms
- UncompressedRowBatchSize: 721.11 MB (756134128)
CodeGen:(Total: 33.524ms, non-child: 33.524ms, % non-child: 100.00%)
- CodegenTime: 312.003us
- CompileTime: 4.939ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 5 (5)
- NumInstructions: 98 (98)
- OptimizationTime: 7.484ms
- PeakMemoryUsage: 49.00 KB (50176)
- PrepareTime: 20.442ms
HDFS_SCAN_NODE (id=0):(Total: 10s717ms, non-child: 10s717ms, % non-child:
100.00%)
- AverageHdfsReadThreadConcurrency: 0.58
- AverageScannerThreadConcurrency: 38.11
- BytesRead: 565.74 MB (593220376)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 565.74 MB (593220376)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 484 (484)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 15.83 MB (16595218)
- PerReadThreadRawHdfsThroughput: 65.34 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 10s631ms
- RowBatchQueuePutWaitTime: 4s768ms
- RowsRead: 36.00M (35999266)
- RowsReturned: 36.00M (35999266)
- RowsReturnedRate: 3.46 M/sec
- ScanRangesComplete: 484 (484)
- ScannerThreadsInvoluntaryContextSwitches: 12 (12)
- ScannerThreadsTotalWallClockTime: 10m6s
- MaterializeTupleTime(*): 815.998ms
- ScannerThreadsSysTime: 254.817ms
- ScannerThreadsUserTime: 1s120ms
- ScannerThreadsVoluntaryContextSwitches: 23.53K (23531)
- TotalRawHdfsReadTime(*): 8s751ms
- TotalReadThroughput: 34.81 MB/sec
Fragment F01:
Instance db497c13276e70de:38c671cf00000007 (host=bdpe722n4:22000):(Total:
17s438ms, non-child: 2s117ms, % non-child: 12.14%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:485/4.26
GB
MemoryUsage(500.000ms): 30.09 KB, 1.62 MB, 1.87 MB, 1023.34 KB, 3.04
MB, 1.36 MB, 1.84 MB, 757.34 KB, 1.72 MB, 1010.34 KB, 3.03 MB, 5.52 MB, 1.41
MB, 927.34 KB, 5.53 MB, 2.41 MB, 5.29 MB, 10.99 MB, 1.21 MB, 1.13 MB, 1.88 MB,
967.34 KB, 9.59 MB, 3.52 MB, 5.96 MB, 1.90 MB, 953.34 KB, 1.53 MB, 2.76 MB,
1.12 MB, 900.34 KB, 2.06 MB, 1.39 MB, 1.81 MB, 6.29 MB
ThreadUsage(500.000ms): 1, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 26
- AverageThreadTokens: 38.49
- BloomFilterBytes: 0
- PeakMemoryUsage: 20.68 MB (21682706)
- PerHostPeakMemUsage: 843.67 MB (884656921)
- RowsProduced: 35.98M (35976570)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 720.372ms
- TotalStorageWaitTime: 10m44s
- TotalThreadsInvoluntaryContextSwitches: 52 (52)
- TotalThreadsTotalWallClockTime: 11m21s
- TotalThreadsSysTime: 389.998ms
- TotalThreadsUserTime: 5s784ms
- TotalThreadsVoluntaryContextSwitches: 28.27K (28271)
Fragment Instance Lifecycle Timings:
- ExecTime: 17s388ms
- ExecTreeExecTime: 12s337ms
- OpenTime: 16.367ms
- ExecTreeOpenTime: 200.778us
- PrepareTime: 34.102ms
- ExecTreePrepareTime: 2.064ms
DataStreamSender (dst_id=6):(Total: 2s948ms, non-child: 2s948ms, %
non-child: 100.00%)
- BytesSent: 506.04 MB (530617576)
- NetworkThroughput(*): 628.67 MB/sec
- OverallThroughput: 171.64 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 35.98M (35976570)
- SerializeBatchTime: 2s140ms
- TransmitDataRPCTime: 804.934ms
- UncompressedRowBatchSize: 720.65 MB (755657414)
CodeGen:(Total: 40.987ms, non-child: 40.987ms, % non-child: 100.00%)
- CodegenTime: 337.395us
- CompileTime: 5.589ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 5 (5)
- NumInstructions: 98 (98)
- OptimizationTime: 9.400ms
- PeakMemoryUsage: 49.00 KB (50176)
- PrepareTime: 25.180ms
HDFS_SCAN_NODE (id=0):(Total: 12s331ms, non-child: 12s331ms, %
non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:485/4.26
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 485 out of 485
Hdfs Read Thread Concurrency Bucket: 0:50% 1:50% 2:0% 3:0% 4:0% 5:0%
File Formats: PARQUET/NONE:970
BytesRead(500.000ms): 0, 10.61 MB, 26.88 MB, 35.36 MB, 41.81 MB,
49.01 MB, 52.61 MB, 58.58 MB, 64.35 MB, 69.97 MB, 74.79 MB, 91.69 MB, 116.96
MB, 136.87 MB, 151.18 MB, 158.81 MB, 169.67 MB, 201.80 MB, 234.46 MB, 252.50
MB, 266.91 MB, 290.74 MB, 306.91 MB, 322.04 MB, 346.84 MB, 363.30 MB, 378.01
MB, 391.59 MB, 417.75 MB, 435.04 MB, 456.89 MB, 481.68 MB, 500.38 MB, 519.71
MB, 536.23 MB
- FooterProcessingTime: (Avg: 652.024ms ; Min: 5.396ms ; Max:
2s375ms ; Number of samples: 485)
- AverageHdfsReadThreadConcurrency: 0.50
- AverageScannerThreadConcurrency: 38.59
- BytesRead: 565.83 MB (593319596)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 565.83 MB (593319596)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 485 (485)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 20.51 MB (21511352)
- PerReadThreadRawHdfsThroughput: 58.11 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 12s241ms
- RowBatchQueuePutWaitTime: 4s450ms
- RowsRead: 35.98M (35976570)
- RowsReturned: 35.98M (35976570)
- RowsReturnedRate: 2.92 M/sec
- ScanRangesComplete: 485 (485)
- ScannerThreadsInvoluntaryContextSwitches: 24 (24)
- ScannerThreadsTotalWallClockTime: 11m4s
- MaterializeTupleTime(*): 1s061ms
- ScannerThreadsSysTime: 286.969ms
- ScannerThreadsUserTime: 1s407ms
- ScannerThreadsVoluntaryContextSwitches: 19.85K (19846)
- TotalRawHdfsReadTime(*): 9s737ms
- TotalReadThroughput: 30.64 MB/sec
Instance db497c13276e70de:38c671cf00000005 (host=bdpe611n4:22000):(Total:
16s982ms, non-child: 2s021ms, % non-child: 11.90%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:489/4.26
GB
MemoryUsage(500.000ms): 2.74 MB, 2.26 MB, 1.43 MB, 814.34 KB, 764.34
KB, 765.34 KB, 2.87 MB, 912.34 KB, 1.09 MB, 1.01 MB, 1.85 MB, 1.41 MB, 909.34
KB, 1.51 MB, 2.71 MB, 3.66 MB, 858.34 KB, 3.07 MB, 1.78 MB, 1.48 MB, 1.95 MB,
2.90 MB, 2.90 MB, 1.03 MB, 1.82 MB, 4.01 MB, 2.81 MB, 1.15 MB, 2.73 MB, 6.13
MB, 3.90 MB, 9.12 MB, 1.83 MB, 5.36 MB
ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
29, 5
- AverageThreadTokens: 38.65
- BloomFilterBytes: 0
- PeakMemoryUsage: 12.26 MB (12850426)
- PerHostPeakMemUsage: 850.52 MB (891836660)
- RowsProduced: 35.99M (35993985)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 749.125ms
- TotalStorageWaitTime: 10m32s
- TotalThreadsInvoluntaryContextSwitches: 25 (25)
- TotalThreadsTotalWallClockTime: 11m3s
- TotalThreadsSysTime: 357.350ms
- TotalThreadsUserTime: 5s400ms
- TotalThreadsVoluntaryContextSwitches: 33.85K (33851)
Fragment Instance Lifecycle Timings:
- ExecTime: 16s942ms
- ExecTreeExecTime: 11s843ms
- OpenTime: 13.063ms
- ExecTreeOpenTime: 174.896us
- PrepareTime: 26.530ms
- ExecTreePrepareTime: 1.783ms
DataStreamSender (dst_id=6):(Total: 3s091ms, non-child: 3s091ms, %
non-child: 100.00%)
- BytesSent: 506.28 MB (530876870)
- NetworkThroughput(*): 560.53 MB/sec
- OverallThroughput: 163.74 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 35.99M (35993985)
- SerializeBatchTime: 2s186ms
- TransmitDataRPCTime: 903.215ms
- UncompressedRowBatchSize: 721.00 MB (756023201)
CodeGen:(Total: 32.505ms, non-child: 32.505ms, % non-child: 100.00%)
- CodegenTime: 310.678us
- CompileTime: 4.877ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 5 (5)
- NumInstructions: 98 (98)
- OptimizationTime: 7.134ms
- PeakMemoryUsage: 49.00 KB (50176)
- PrepareTime: 19.873ms
HDFS_SCAN_NODE (id=0):(Total: 11s836ms, non-child: 11s836ms, %
non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:489/4.26
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 489 out of 489
Hdfs Read Thread Concurrency Bucket: 0:38.24% 1:61.76% 2:0% 3:0% 4:0%
File Formats: PARQUET/NONE:978
BytesRead(500.000ms): 16.03 MB, 41.41 MB, 47.82 MB, 53.65 MB, 59.67
MB, 65.78 MB, 69.14 MB, 73.18 MB, 74.76 MB, 80.83 MB, 86.65 MB, 93.26 MB,
111.03 MB, 130.71 MB, 149.05 MB, 165.12 MB, 193.84 MB, 212.23 MB, 234.50 MB,
252.64 MB, 270.24 MB, 289.58 MB, 315.54 MB, 342.41 MB, 367.27 MB, 389.67 MB,
417.98 MB, 435.09 MB, 459.50 MB, 482.62 MB, 503.74 MB, 527.21 MB, 540.31 MB,
564.25 MB
- FooterProcessingTime: (Avg: 633.734ms ; Min: 4.452ms ; Max:
2s535ms ; Number of samples: 489)
- AverageHdfsReadThreadConcurrency: 0.62
- AverageScannerThreadConcurrency: 37.65
- BytesRead: 566.33 MB (593836009)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 566.33 MB (593836009)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 489 (489)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 12.12 MB (12703648)
- PerReadThreadRawHdfsThroughput: 62.10 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 11s760ms
- RowBatchQueuePutWaitTime: 4s343ms
- RowsRead: 35.99M (35993985)
- RowsReturned: 35.99M (35993985)
- RowsReturnedRate: 3.04 M/sec
- ScanRangesComplete: 489 (489)
- ScannerThreadsInvoluntaryContextSwitches: 12 (12)
- ScannerThreadsTotalWallClockTime: 10m46s
- MaterializeTupleTime(*): 723.729ms
- ScannerThreadsSysTime: 249.452ms
- ScannerThreadsUserTime: 1s017ms
- ScannerThreadsVoluntaryContextSwitches: 24.61K (24614)
- TotalRawHdfsReadTime(*): 9s120ms
- TotalReadThroughput: 33.19 MB/sec
Instance db497c13276e70de:38c671cf00000008 (host=bdpe611n1:22000):(Total:
16s038ms, non-child: 2s318ms, % non-child: 14.45%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:481/4.26
GB
MemoryUsage(500.000ms): 671.34 KB, 1.60 MB, 1.02 MB, 1.95 MB, 1.43 MB,
1.30 MB, 3.28 MB, 4.27 MB, 3.87 MB, 1.01 MB, 1.54 MB, 1.74 MB, 2.01 MB, 5.50
MB, 3.07 MB, 1.77 MB, 1.12 MB, 917.34 KB, 6.59 MB, 1.04 MB, 12.11 MB, 942.34
KB, 4.94 MB, 1.90 MB, 8.17 MB, 1.02 MB, 1.91 MB, 1.30 MB, 2.89 MB, 3.01 MB,
1.84 MB, 7.44 MB
ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 33, 12
- AverageThreadTokens: 38.91
- BloomFilterBytes: 0
- PeakMemoryUsage: 14.68 MB (15392778)
- PerHostPeakMemUsage: 843.06 MB (884008783)
- RowsProduced: 36.01M (36005387)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 942.526ms
- TotalStorageWaitTime: 9m52s
- TotalThreadsInvoluntaryContextSwitches: 52 (52)
- TotalThreadsTotalWallClockTime: 10m22s
- TotalThreadsSysTime: 373.512ms
- TotalThreadsUserTime: 5s396ms
- TotalThreadsVoluntaryContextSwitches: 34.12K (34122)
Fragment Instance Lifecycle Timings:
- ExecTime: 16s006ms
- ExecTreeExecTime: 10s777ms
- OpenTime: 11.345ms
- ExecTreeOpenTime: 172.602us
- PrepareTime: 20.639ms
- ExecTreePrepareTime: 1.276ms
DataStreamSender (dst_id=6):(Total: 2s925ms, non-child: 2s925ms, %
non-child: 100.00%)
- BytesSent: 506.45 MB (531052064)
- NetworkThroughput(*): 625.02 MB/sec
- OverallThroughput: 173.12 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 36.01M (36005387)
- SerializeBatchTime: 2s112ms
- TransmitDataRPCTime: 810.293ms
- UncompressedRowBatchSize: 721.23 MB (756262687)
CodeGen:(Total: 27.002ms, non-child: 27.002ms, % non-child: 100.00%)
- CodegenTime: 304.840us
- CompileTime: 4.466ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 5 (5)
- NumInstructions: 98 (98)
- OptimizationTime: 5.928ms
- PeakMemoryUsage: 49.00 KB (50176)
- PrepareTime: 16.089ms
HDFS_SCAN_NODE (id=0):(Total: 10s768ms, non-child: 10s768ms, %
non-child: 100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:481/4.26
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 481 out of 481
Hdfs Read Thread Concurrency Bucket: 0:43.75% 1:56.25% 2:0% 3:0% 4:0%
File Formats: PARQUET/NONE:962
BytesRead(500.000ms): 9.03 MB, 24.98 MB, 36.96 MB, 43.18 MB, 49.90
MB, 54.15 MB, 62.55 MB, 68.46 MB, 73.84 MB, 79.17 MB, 85.07 MB, 111.88 MB,
126.50 MB, 155.55 MB, 167.48 MB, 196.09 MB, 219.07 MB, 240.18 MB, 269.86 MB,
294.58 MB, 322.16 MB, 347.42 MB, 369.72 MB, 389.70 MB, 420.24 MB, 436.82 MB,
459.80 MB, 476.94 MB, 491.13 MB, 511.67 MB, 534.50 MB, 558.53 MB
- FooterProcessingTime: (Avg: 603.320ms ; Min: 3.797ms ; Max:
2s422ms ; Number of samples: 481)
- AverageHdfsReadThreadConcurrency: 0.56
- AverageScannerThreadConcurrency: 37.91
- BytesRead: 565.44 MB (592904515)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 565.44 MB (592904515)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 481 (481)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 14.52 MB (15221424)
- PerReadThreadRawHdfsThroughput: 64.28 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 10s669ms
- RowBatchQueuePutWaitTime: 4s550ms
- RowsRead: 36.01M (36005387)
- RowsReturned: 36.01M (36005387)
- RowsReturnedRate: 3.34 M/sec
- ScanRangesComplete: 481 (481)
- ScannerThreadsInvoluntaryContextSwitches: 11 (11)
- ScannerThreadsTotalWallClockTime: 10m6s
- MaterializeTupleTime(*): 784.793ms
- ScannerThreadsSysTime: 239.729ms
- ScannerThreadsUserTime: 1s077ms
- ScannerThreadsVoluntaryContextSwitches: 23.89K (23890)
- TotalRawHdfsReadTime(*): 8s796ms
- TotalReadThroughput: 34.91 MB/sec
Instance db497c13276e70de:38c671cf00000006 (host=bdpe611n3:22000):(Total:
13s406ms, non-child: 2s414ms, % non-child: 18.01%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:481/4.26
GB
MemoryUsage(500.000ms): 665.34 KB, 3.82 MB, 2.12 MB, 1.26 MB, 739.34
KB, 857.34 KB, 1.99 MB, 3.04 MB, 931.34 KB, 5.44 MB, 2.01 MB, 3.84 MB, 16.30
MB, 958.34 KB, 7.37 MB, 2.07 MB, 5.50 MB, 1.07 MB, 5.61 MB, 4.52 MB, 7.05 MB,
1.92 MB, 2.20 MB, 5.38 MB, 7.88 MB, 1.42 MB, 7.39 MB
ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40,
40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 21
- AverageThreadTokens: 39.30
- BloomFilterBytes: 0
- PeakMemoryUsage: 16.32 MB (17107610)
- PerHostPeakMemUsage: 737.35 MB (773163716)
- RowsProduced: 36.02M (36021123)
- TotalNetworkReceiveTime: 0.000ns
- TotalNetworkSendTime: 970.865ms
- TotalStorageWaitTime: 8m14s
- TotalThreadsInvoluntaryContextSwitches: 13 (13)
- TotalThreadsTotalWallClockTime: 8m41s
- TotalThreadsSysTime: 346.317ms
- TotalThreadsUserTime: 5s477ms
- TotalThreadsVoluntaryContextSwitches: 36.09K (36095)
Fragment Instance Lifecycle Timings:
- ExecTime: 13s367ms
- ExecTreeExecTime: 7s940ms
- OpenTime: 13.443ms
- ExecTreeOpenTime: 168.413us
- PrepareTime: 26.229ms
- ExecTreePrepareTime: 1.704ms
DataStreamSender (dst_id=6):(Total: 3s025ms, non-child: 3s025ms, %
non-child: 100.00%)
- BytesSent: 506.68 MB (531287357)
- NetworkThroughput(*): 655.15 MB/sec
- OverallThroughput: 167.46 MB/sec
- PeakMemoryUsage: 142.09 KB (145504)
- RowsReturned: 36.02M (36021123)
- SerializeBatchTime: 2s249ms
- TransmitDataRPCTime: 773.368ms
- UncompressedRowBatchSize: 721.54 MB (756593211)
CodeGen:(Total: 33.603ms, non-child: 33.603ms, % non-child: 100.00%)
- CodegenTime: 295.101us
- CompileTime: 4.822ms
- LoadTime: 0.000ns
- ModuleBitcodeSize: 1.90 MB (1995516)
- NumFunctions: 5 (5)
- NumInstructions: 98 (98)
- OptimizationTime: 7.472ms
- PeakMemoryUsage: 49.00 KB (50176)
- PrepareTime: 20.628ms
HDFS_SCAN_NODE (id=0):(Total: 7s933ms, non-child: 7s933ms, % non-child:
100.00%)
Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:481/4.26
GB
ExecOption: PARQUET Codegen Enabled, Codegen enabled: 481 out of 481
Hdfs Read Thread Concurrency Bucket: 0:37.04% 1:62.96% 2:0% 3:0% 4:0%
File Formats: PARQUET/NONE:962
BytesRead(500.000ms): 300.00 KB, 16.59 MB, 43.39 MB, 50.43 MB, 57.63
MB, 62.17 MB, 66.56 MB, 75.57 MB, 86.30 MB, 97.25 MB, 124.88 MB, 154.03 MB,
183.61 MB, 207.05 MB, 229.59 MB, 251.40 MB, 278.52 MB, 298.77 MB, 328.99 MB,
354.22 MB, 384.11 MB, 403.96 MB, 428.41 MB, 459.40 MB, 490.85 MB, 513.55 MB,
546.67 MB
- FooterProcessingTime: (Avg: 505.877ms ; Min: 3.818ms ; Max:
1s715ms ; Number of samples: 481)
- AverageHdfsReadThreadConcurrency: 0.63
- AverageScannerThreadConcurrency: 38.30
- BytesRead: 565.36 MB (592821387)
- BytesReadDataNodeCache: 0
- BytesReadLocal: 565.36 MB (592821387)
- BytesReadRemoteUnexpected: 0
- BytesReadShortCircuit: 0
- DecompressionTime: 0.000ns
- MaxCompressedTextFileLength: 0
- NumColumns: 2 (2)
- NumDisksAccessed: 1 (1)
- NumRowGroups: 481 (481)
- NumScannerThreadsStarted: 39 (39)
- PeakMemoryUsage: 16.16 MB (16944448)
- PerReadThreadRawHdfsThroughput: 76.90 MB/sec
- RemoteScanRanges: 0 (0)
- RowBatchQueueGetWaitTime: 7s856ms
- RowBatchQueuePutWaitTime: 5s730ms
- RowsRead: 36.02M (36021123)
- RowsReturned: 36.02M (36021123)
- RowsReturnedRate: 4.54 M/sec
- ScanRangesComplete: 481 (481)
- ScannerThreadsInvoluntaryContextSwitches: 2 (2)
- ScannerThreadsTotalWallClockTime: 8m27s
- MaterializeTupleTime(*): 693.903ms
- ScannerThreadsSysTime: 243.121ms
- ScannerThreadsUserTime: 979.165ms
- ScannerThreadsVoluntaryContextSwitches: 25.77K (25774)
- TotalRawHdfsReadTime(*): 7s352ms
- TotalReadThroughput: 40.49 MB/sec
