KaimingChen created SQOOP-3002: ---------------------------------- Summary: Sqoop Merge Tool support composite merge-key Key: SQOOP-3002 URL: https://issues.apache.org/jira/browse/SQOOP-3002 Project: Sqoop Issue Type: Improvement Components: hive-integration Affects Versions: 1.99.7, 1.99.5, 1.4.6, 1.4.5 Reporter: KaimingChen
When i use sqoop merge tool, i can just specify one column using --merge-key arguement. But when my table has composite keys, i got a Exception: 16/08/22 15:54:15 INFO mapreduce.Job: Task Id : attempt_1470135750174_2508_m_000004_2, Status : FAILED Error: java.io.IOException: Cannot join values on null key. Did you specify a key column that exists? at org.apache.sqoop.mapreduce.MergeMapperBase.processRecord(MergeMapperBase.java:79) at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:58) at org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157) -- This message was sent by Atlassian JIRA (v6.3.4#6332)