[
https://issues.apache.org/jira/browse/HIVE-13407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252828#comment-15252828
]
Hari Sankar Sivarama Subramaniyan commented on HIVE-13407:
----------------------------------------------------------
Here is the sample output :
{code}
2016-04-21T14:32:29,269 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(130)) - <PERFLOG
method=TezCompiler from=org.apache.hadoop.hive.ql.parse.TezCompiler>
2016-04-21T14:32:29,308 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(170)) - </PERFLOG method=TezCompiler
start=1461274349269 end=1461274349308 duration=39
from=org.apache.hadoop.hive.ql.parse.TezCompiler Setup dynamic partition
pruning>
2016-04-21T14:32:29,308 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(130)) - <PERFLOG
method=TezCompiler from=org.apache.hadoop.hive.ql.parse.TezCompiler>
2016-04-21T14:32:29,379 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(170)) - </PERFLOG method=TezCompiler
start=1461274349308 end=1461274349379 duration=71
from=org.apache.hadoop.hive.ql.parse.TezCompiler Setup stats in the operator
plan>
2016-04-21T14:32:29,379 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(130)) - <PERFLOG
method=TezCompiler from=org.apache.hadoop.hive.ql.parse.TezCompiler>
2016-04-21T14:32:29,411 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(170)) - </PERFLOG method=TezCompiler
start=1461274349379 end=1461274349411 duration=32
from=org.apache.hadoop.hive.ql.parse.TezCompiler Run the optimizations that use
stats for optimization>
2016-04-21T14:32:29,411 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(130)) - <PERFLOG
method=TezCompiler from=org.apache.hadoop.hive.ql.parse.TezCompiler>
2016-04-21T14:32:29,424 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(170)) - </PERFLOG method=TezCompiler
start=1461274349411 end=1461274349424 duration=13
from=org.apache.hadoop.hive.ql.parse.TezCompiler Run cycle analysis for
partition pruning>
2016-04-21T14:32:29,427 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(130)) - <PERFLOG
method=TezCompiler from=org.apache.hadoop.hive.ql.parse.TezCompiler>
2016-04-21T14:32:29,499 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(170)) - </PERFLOG method=TezCompiler
start=1461274349427 end=1461274349499 duration=72
from=org.apache.hadoop.hive.ql.parse.TezCompiler generateTaskTree>
2016-04-21T14:32:29,502 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(130)) - <PERFLOG
method=TezCompiler from=org.apache.hadoop.hive.ql.parse.TezCompiler>
2016-04-21T14:32:29,558 DEBUG [1ddcd17e-7e14-49c5-aaf4-b8cf68f6ef87 main[]]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(170)) - </PERFLOG method=TezCompiler
start=1461274349502 end=1461274349558 duration=56
from=org.apache.hadoop.hive.ql.parse.TezCompiler optimizeTaskPlan>
{code}
> Add more subtlety to TezCompiler Perf Logging
> ---------------------------------------------
>
> Key: HIVE-13407
> URL: https://issues.apache.org/jira/browse/HIVE-13407
> Project: Hive
> Issue Type: Bug
> Reporter: Hari Sankar Sivarama Subramaniyan
> Assignee: Hari Sankar Sivarama Subramaniyan
> Attachments: HIVE-13407.1.patch, HIVE-13407.2.patch,
> HIVE-13407.3.patch
>
>
> We can add more subtlety to perf logging information in TezCompiler
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
