ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner
--------------------------------------------------------------------
Key: HADOOP-6130
URL: https://issues.apache.org/jira/browse/HADOOP-6130
Project: Hadoop Common
Issue Type: Bug
Components: mapred
Affects Versions: 0.20.0
Reporter: Suman Sehgal
Priority: Critical
KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of
the specified key is missing.
Scenario :
=======
when value of num.key.fields.for.partition is greater than the separators
provided in the input.
Command:
========
hadoop jar streaming.jar -Dmapred.reduce.tasks=3
-Dnum.key.fields.for.partition=5 -input <input-dir> -output <output-dir>
-mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer
org.apache.hadoop.mapred.lib.IdentityReducer -inputformat
org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner
org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
