[
https://issues.apache.org/jira/browse/HIVE-7352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-7352:
-----------------------------------
Status: Open (was: Patch Available)
I wonder if this will adversely affect {{MetadataonlyOptimizer}} since it may
than launch many tasks for job, instead of just one. Currently, that
optimization, removes all input paths from plan and put OneRowNullIF. Now,
since this IF can now generate many splits, it may launch as many tasks,
instead of 1. Since, paths from conf object wasnt removed. Can you test that?
Also, .q file is missing in patch.
> Queries without tables fail under Tez
> -------------------------------------
>
> Key: HIVE-7352
> URL: https://issues.apache.org/jira/browse/HIVE-7352
> Project: Hive
> Issue Type: Bug
> Components: Tez
> Affects Versions: 0.13.1, 0.13.0
> Reporter: Craig Condit
> Assignee: Navis
> Attachments: HIVE-7352.1.patch.txt
>
>
> Hive 0.13.0 added support for queries that do not reference tables (such as
> 'SELECT 1'). These queries fail under Tez:
> {noformat}
> Vertex failed as one or more tasks failed. failedTasks:1]
> 14/07/07 09:54:42 ERROR tez.TezJobMonitor: Vertex failed, vertexName=Map 1,
> vertexId=vertex_1404652697071_4487_1_00, diagnostics=[Task failed,
> taskId=task_1404652697071_4487_1_00_000000,
> diagnostics=[AttemptID:attempt_1404652697071_4487_1_00_000000_0 Info:Error:
> java.lang.RuntimeException: java.lang.IllegalArgumentException: Can not
> create a Path from an empty string
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:174)
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.<init>(TezGroupedSplitsInputFormat.java:113)
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat.getRecordReader(TezGroupedSplitsInputFormat.java:79)
> at
> org.apache.tez.mapreduce.input.MRInput.setupOldRecordReader(MRInput.java:205)
> at
> org.apache.tez.mapreduce.input.MRInput.initFromEventInternal(MRInput.java:362)
> at
> org.apache.tez.mapreduce.input.MRInput.initFromEvent(MRInput.java:341)
> at
> org.apache.tez.mapreduce.input.MRInputLegacy.checkAndAwaitRecordReaderInitialization(MRInputLegacy.java:99)
> at
> org.apache.tez.mapreduce.input.MRInputLegacy.init(MRInputLegacy.java:68)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:141)
> at
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:307)
> at
> org.apache.hadoop.mapred.YarnTezDagChild$5.run(YarnTezDagChild.java:562)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
> at
> org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:551)
> Caused by: java.lang.IllegalArgumentException: Can not create a Path from an
> empty string
> at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> at org.apache.hadoop.fs.Path.<init>(Path.java:135)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat$HiveInputSplit.getPath(HiveInputFormat.java:110)
> at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:228)
> at
> org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:171)
> ... 14 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
