Better error message when a non-essential job fails
---------------------------------------------------
Key: HIVE-1921
URL: https://issues.apache.org/jira/browse/HIVE-1921
Project: Hive
Issue Type: Improvement
Components: CLI
Affects Versions: 0.7.0
Reporter: Paul Yang
Assignee: Paul Yang
Priority: Minor
To determine whether a join can be converted into a map-join, a task is
launched to determine memory requirements. If the task fails, then a normal
join must be performed. This is not an error but the user sees a message like:
{code}
...
2011-01-19 02:48:51 Processing rows: 1800000 Hashtable size: 1799999
Memory usage: 818546352 rate: 0.789
2011-01-19 02:48:57 Processing rows: 1900000 Hashtable size: 1899999
Memory usage: 861746352 rate: 0.831
2011-01-19 02:49:05 Processing rows: 2000000 Hashtable size: 1999999
Memory usage: 904921384 rate: 0.873
2011-01-19 02:49:12 Processing rows: 2100000 Hashtable size: 2099999
Memory usage: 952382416 rate: 0.918
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapredLocalTask
ATTEMPT: Execute BackupTask: org.apache.hadoop.hive.ql.exec.MapRedTask
Launching Job 2 out of 2
...
{code}
The wording makes it seem as if something went wrong, which is not necessarily
the case.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
