[
https://issues.apache.org/jira/browse/HIVE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806296#action_12806296
]
Bennie Schut commented on HIVE-1019:
------------------------------------
On errors like this:
Job Submission failed with exception 'java.io.IOException(cannot find dir =
hdfs://audi.ebuddy.net:9000/user/hive/warehouse/client in partToPartitionInfo!)'
10/01/28 16:48:15 ERROR exec.ExecDriver: Job Submission failed with exception
'java.io.IOException(cannot find dir =
hdfs://audi.ebuddy.net:9000/user/hive/warehouse/client in partToPartitionInfo!)'
java.io.IOException: cannot find dir =
hdfs://audi.ebuddy.net:9000/user/hive/warehouse/client in partToPartitionInfo!
The original code uses the "mapred.job.name" as a unique id to store a map of
plan's in the Utilities class. This would however not work
since a name like this: "insert overwrite table use...iptolong(cs.ip)(Stage-1)"
you can have a 2nd query with multiple joins and a where clause which make the
query really different but the name the same.
I originally solved this by using the hive.sesion.id but I just found out
simply using the hive.session.id isn't going to work if you rapidly start
sessions since it generates uniqueid's only if you start in different minutes.
For now I append a UUID to the hive.session.id to make it really unique and
this works perfectly.
for example:
"hive.session.id" "hadoop_201001291121_6ac26279-ce6e-4445-9d14-a656c2854f8d"
I think anyone using the jdbc driver multithreaded will at some point run into
this problem.
I'll make a new patch.
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> --------------------------------------------------------------------
>
> Key: HIVE-1019
> URL: https://issues.apache.org/jira/browse/HIVE-1019
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Bennie Schut
> Priority: Minor
> Fix For: 0.6.0
>
> Attachments: HIVE-1019-1.patch, HIVE-1019-2.patch, HIVE-1019.patch,
> stacktrace2.txt
>
>
> I keep getting errors like this:
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> and :
> java.io.IOException: cannot find dir =
> hdfs://victoria.ebuddy.com:9000/tmp/hive-dwh/801467596/10002 in
> partToPartitionInfo!
> when running multiple threads with roughly similar queries.
> I have a patch for this which works for me.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
