[
https://issues.apache.org/jira/browse/HIVE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Zhang updated HIVE-1019:
-----------------------------
Attachment: HIVE-1019-8.patch
The changes look fine in general. However, I found a new issue related to this
JIRA. I'm uploading a new patch HIVE-1019-8.patch to include the fix as well.
Basically the issue is that when we set hive.exec.parallel=true and two
parallel jobs are reading the PLAN for the same file. This is an existing issue
and it exists when applying to your patch. The reason is that the session ID
(which now used as the Plan file suffix) is not changed for different session.
We need to generate a new session ID for each started session in the parallel
execution case. A unit test is also added to reproduce the issue in the current
trunk.
Bennie, is it possible to add a new unit test for the case you are solving?
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> --------------------------------------------------------------------
>
> Key: HIVE-1019
> URL: https://issues.apache.org/jira/browse/HIVE-1019
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Bennie Schut
> Assignee: Bennie Schut
> Priority: Minor
> Fix For: 0.6.0
>
> Attachments: HIVE-1019-1.patch, HIVE-1019-2.patch, HIVE-1019-3.patch,
> HIVE-1019-4.patch, HIVE-1019-5.patch, HIVE-1019-6.patch, HIVE-1019-7.patch,
> HIVE-1019-8.patch, HIVE-1019.patch, stacktrace2.txt
>
>
> I keep getting errors like this:
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> and :
> java.io.IOException: cannot find dir =
> hdfs://victoria.ebuddy.com:9000/tmp/hive-dwh/801467596/10002 in
> partToPartitionInfo!
> when running multiple threads with roughly similar queries.
> I have a patch for this which works for me.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
