Hello everyone, I'm struggling with an exception I'm getting on a particular query that's driving me crazy!
Here is the exception I get: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable org.apache.hadoop.hive.serde2.colum nar.BytesRefArrayWritable@71412b61 at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:161) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:441) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:377) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable org.apache.hadoop.hive.serde2.columnar.BytesRefArray Writable@71412b61 at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:524) at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143) ... 8 more Caused by: java.lang.ArrayIndexOutOfBoundsException: 2 at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:506) ... 9 more Here is the query I'm running: INSERT INTO TABLE variance SELECT id, collect_set(name)[0], SUM( POW(age - age_mean, 2) ) / count(1) FROM age_mean join data_table on (age_mean.id = '01' AND data_table.q1 = 1) where age is not null and age_mean is not null GROUP BY id; It's probably relevant to mention that I'm doing this on an EMR cluster. Any idea what might be causing the exception? Thanks! Fernando