I got the following exception while executing join on Hive Query and
reducer hang after 68% completion.
java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
processing row (tag=1)
{"key":{"joinkey0":"12"},"value":{"_col2":"rs317647905"},"alias":1}
at
org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:270)
at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:506)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:447)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
Error while processing row (tag=1)
{"key":{"joinkey0":"12"},"value":{"_col2":"rs317647905"},"alias":1}
at
org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:258)
... 7 more
Caused by: org.apache.hadoop.
---------------------------------------------------------------------------------------
my query and table structure:
create table table_llv_N_C as select
table_line_n_passed.chromosome_number,table_line_n_passed.position,
table_line_c_passed.id from table_line_n_passed join table_line_c_passed on
(table_line_n_passed.chromosome_number=table_line_c_passed.chromosome_number)
hive> desc table_line_n_passed;
OK
chromosome_number string
position int
id string
ref string
alt string
quality double
filter string
info string
format string
line6 string
Time taken: 0.854 seconds
Why am I getting this error, and how can I solve it?
--
with regards
krish!!!!!!
