[jira] [Created] (MAPREDUCE-5007) fix coverage org.apache.hadoop.mapreduce.v2.hs

2013-02-15 Thread Aleksey Gorshkov (JIRA)
Aleksey Gorshkov created MAPREDUCE-5007:
---

 Summary: fix coverage org.apache.hadoop.mapreduce.v2.hs
 Key: MAPREDUCE-5007
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5007
 Project: Hadoop Map/Reduce
  Issue Type: Test
Affects Versions: 3.0.0, 2.0.3-alpha, 0.23.7
Reporter: Aleksey Gorshkov


fix coverage org.apache.hadoop.mapreduce.v2.hs 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


Planning for hadoop-2.0.4-beta

2013-02-15 Thread Arun C Murthy
Folks,

 Apropos to our previous discussions, I'd appreciate if folks could spend time 
over the next month or so reviewing APIs for future compatibility, bugs etc. so 
that we can lock them down - particularly in the protobuf land. I know, this is 
easier said that done - but a focussed effort should help nevertheless.

 I volunteer to do this for YARN/MapReduce (of course, any help is very much 
appreciated and I see Vinod has opened YARN-386), and would appreciate some 
folks stepping up for HDFS (Suresh? Todd?).

thanks,
Arun


--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/




[jira] [Created] (MAPREDUCE-5008) Merger progress miscounts with respect to EOF_MARKER

2013-02-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5008:
-

 Summary: Merger progress miscounts with respect to EOF_MARKER
 Key: MAPREDUCE-5008
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5008
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Affects Versions: 2.0.3-alpha
Reporter: Sandy Ryza


After MAPREDUCE-2264, a segment's raw data length is calculated without the 
EOF_MARKER bytes.  However, when the merge is counting how many bytes it 
processed, it includes the marker.  This can cause the merge progress to go 
above 100%.

Whether these EOF_MARKER bytes should count should be consistent between the 
two.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (MAPREDUCE-5009) Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member

2013-02-15 Thread Robert Parker (JIRA)
Robert Parker created MAPREDUCE-5009:


 Summary: Killing the Task Attempt slated for commit does not clear 
the value from the Task commitAttempt member
 Key: MAPREDUCE-5009
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5009
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv1
Affects Versions: 0.23.5, 2.0.3-alpha, trunk
Reporter: Robert Parker
Assignee: Robert Parker


A reduce task attempt was killed by the RM(pre-emptively), but had already been 
assigned to the commitAttempt member.  This causes all subsequent attempts to 
be killed by the AM.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira