Dharmesh Kakadia created TEZ-3453:
-------------------------------------
Summary: Hive + Tez not able to push-down common sub expression
Key: TEZ-3453
URL: https://issues.apache.org/jira/browse/TEZ-3453
Project: Apache Tez
Issue Type: Bug
Reporter: Dharmesh Kakadia
Priority: Minor
hadoop jar /usr/hdp/current/tez-client/tez-job-analyzer-*.jar CriticalPath
--dagId=dag_1475171170456_0002_1 --outputDir=tmp/
fails with
INFO history.ATSImportTool: Using
baseURL=http://headnodehost:8188/ws/v1/timeline,
dagId=dag_1475171170456_0002_1, batchSize=100, downloadDir=tmp
java.lang.IllegalArgumentException: Zipfile
tmp/dag_1475171170456_0002_1/dag_1475171170456_0002_1.zip does not exist
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
at org.apache.tez.history.parser.ATSFileParser.(ATSFileParser.java:65)
at org.apache.tez.analyzer.plugins.TezAnalyzerBase.run(TezAnalyzerBase.java:169)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at
org.apache.tez.analyzer.plugins.CriticalPathAnalyzer.main(CriticalPathAnalyzer.java:653)
The code is incorrectly expecting it to be in
subfolder(dag_1475171170456_0002_1/dag_1475171170456_0002_1.zip). Moving the
downloaded data location to the subfolder fixes the issue. This PR corrects the
expected path.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
