[
https://issues.apache.org/jira/browse/HIVE-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12967142#action_12967142
]
Bennie Schut commented on HIVE-1675:
------------------------------------
The good news is I'm unable to reproduce this once I "set
hive.exec.parallel=false". Perhaps it's cleaning uo some things during one of
the steps while the other steps still need it?
hive.exec.parallel works great for non local stuff for us but the combination
of local and parallel seems like it has some issues.
I was getting all kinds of different exceptions on local mode like the
saxparser but also:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_local_0001/attempt_local_0001_m_000000_0/output/file.out
in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:389)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
at
org.apache.hadoop.mapred.MapOutputFile.getOutputFile(MapOutputFile.java:50)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:193)
and:
java.io.FileNotFoundException: HIVE_PLAN1fe0a487-2e46-44e4-a557-9b3c9dddac07
(No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:106)
at java.io.FileInputStream.<init>(FileInputStream.java:66)
at
org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:155)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:238)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:244)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:139)
I only get these issues when enabling parallel and local.
At least an angle to look at.
> SAXParseException on plan.xml during local mode.
> ------------------------------------------------
>
> Key: HIVE-1675
> URL: https://issues.apache.org/jira/browse/HIVE-1675
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
> Affects Versions: 0.7.0
> Reporter: Bennie Schut
> Assignee: Bennie Schut
> Fix For: 0.7.0
>
> Attachments: HIVE-1675.patch, local_10005_plan.xml,
> local_10006_plan.xml
>
>
> When hive switches to local mode (hive.exec.mode.local.auto=true) I receive a
> sax parser exception on the plan.xml
> If I set hive.exec.mode.local.auto=false I get the correct results.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
