Hi all: I know that some map tasks can be executed parallel, for example, Map1 and Map10 are running together like, so maybe we can not sum the DURATION of every tasks as execution time.
15:07:18,917 INFO [e1890b6a-a9fe-4e0d-8bd7-167603079db1 main] monitoring.RenderStrategy$LogToFileFunction: Map 1: 23(+23)/46 Map 10: 23(+23)/46 Map 15: 1/1 Map 16: 1/1 Map 7: 1/1 Map 8: 1/1 Reducer 11: 127/127 Reducer 12: 0/35 Reducer 13: Best Regards Kelly Zhang/Zhang,Liyun From: Zhang, Liyun Sent: Thursday, October 12, 2017 4:40 PM To: 'dev@hive.apache.org' <dev@hive.apache.org> Subject: How to measure the execution time of query on Hive on Tez Hi all: Anyone knows how to view the detail execution time of every map/reduce task in hive on tez? I screenshot the result: Run DAG is 324.s . But this is not the sum of DURATION time of every tasks( 665=163+22+1+1+2+3+143+31+4+0+254+29+8+2+1+1). So which parameter DURATION(ms) or CPU_TIME(ms) should be used? [cid:image001.png@01D3437B.97FA0660] Appreciate to get some feedback from you! Best Regards Kelly Zhang/Zhang,Liyun
