[
https://issues.apache.org/jira/browse/HADOOP-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12611464#action_12611464
]
Amareshwari Sriramadasu commented on HADOOP-3711:
-------------------------------------------------
In org.apache.hadoop.streaming.PipeMapRed.splitKeyVal(), the length passed in
the parameter should be passed down to the UTF8ByteArrayUtils.findBytes()
routine instead of byte[].length
> Streaming input is not parsed properly to find the separator
> ------------------------------------------------------------
>
> Key: HADOOP-3711
> URL: https://issues.apache.org/jira/browse/HADOOP-3711
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Priority: Blocker
> Fix For: 0.18.0
>
>
> Sometimes, finding field separator position in the input line for streaming
> fails with following exception:
> org.apache.hadoop.streaming.PipeMapRed: java.lang.IllegalArgumentException:
> splitPos must be in the range [0, 17]: 74
> at
> org.apache.hadoop.streaming.UTF8ByteArrayUtils.splitKeyVal(UTF8ByteArrayUtils.java:152)
> at
> org.apache.hadoop.streaming.PipeMapRed.splitKeyVal(PipeMapRed.java:337)
> at
> org.apache.hadoop.streaming.PipeMapRed$MROutputThread.run(PipeMapRed.java:363)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
