[jira] Commented: (MAPREDUCE-1354) Incremental enhancements to the JobTracker for better scalability

2010-05-10 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865672#action_12865672 ] Amareshwari Sriramadasu commented on MAPREDUCE-1354: Some comments

[jira] Updated: (MAPREDUCE-1610) Forrest documentation should be updated to reflect the changes in MAPREDUCE-856

2010-05-10 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Gummadi updated MAPREDUCE-1610: Attachment: MR1610.v1.patch Attaching new patch for trunk with review comment

[jira] Updated: (MAPREDUCE-1610) Forrest documentation should be updated to reflect the changes in MAPREDUCE-856

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1610: - Status: Patch Available (was: Open) Hadoop Flags: [Reviewed] Patch looks good.

[jira] Commented: (MAPREDUCE-1606) TestJobACLs may timeout as there are no slots for launching JOB_CLEANUP task

2010-05-10 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865690#action_12865690 ] Ravi Gummadi commented on MAPREDUCE-1606: - Unit tests failures are because of

[jira] Updated: (MAPREDUCE-1607) Task controller may not set permissions for a task cleanup attempt's log directory

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1607: - Hadoop Flags: [Incompatible change] Marking this as an incompatible change: We are changing

[jira] Updated: (MAPREDUCE-1753) Implement a functionality for suspend and resume the process.

2010-05-10 Thread Vinay Kumar Thota (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-1753: - Attachment: 1753-ydist-security.patch Patch for Yahoo distribution security

[jira] Updated: (MAPREDUCE-1731) Process tree clean up suspended task tests.

2010-05-10 Thread Vinay Kumar Thota (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-1731: - Attachment: 1731-ydist-security.patch Process tree clean up suspended task

[jira] Commented: (MAPREDUCE-1533) Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865700#action_12865700 ] Vinod K V commented on MAPREDUCE-1533: -- I found a couple of unprotected debug logs

[jira] Commented: (MAPREDUCE-118) Job.getJobID() will always return null

2010-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865701#action_12865701 ] Hadoop QA commented on MAPREDUCE-118: - +1 overall. Here are the results of testing

[jira] Commented: (MAPREDUCE-1533) Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()

2010-05-10 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865703#action_12865703 ] Amar Kamat commented on MAPREDUCE-1533: --- bq. JobTracker.checkMemoryRequirements

[jira] Commented: (MAPREDUCE-1122) streaming with custom input format does not support the new API

2010-05-10 Thread Jaideep (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865708#action_12865708 ] Jaideep commented on MAPREDUCE-1122: Some changes that are needed in order to

[jira] Commented: (MAPREDUCE-1533) Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()

2010-05-10 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865714#action_12865714 ] Amareshwari Sriramadasu commented on MAPREDUCE-1533: bq. The main

[jira] Created: (MAPREDUCE-1780) AccessControlList.toString() is used for serialization of ACL in JobStatus.java

2010-05-10 Thread Ravi Gummadi (JIRA)
AccessControlList.toString() is used for serialization of ACL in JobStatus.java --- Key: MAPREDUCE-1780 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1780 Project:

[jira] Updated: (MAPREDUCE-1607) Task controller may not set permissions for a task cleanup attempt's log directory

2010-05-10 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1607: --- Attachment: patch-1607-2.txt Patch is updated to trunk and

[jira] Updated: (MAPREDUCE-1607) Task controller may not set permissions for a task cleanup attempt's log directory

2010-05-10 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated MAPREDUCE-1607: --- Status: Patch Available (was: Open) Fix Version/s:

[jira] Commented: (MAPREDUCE-1610) Forrest documentation should be updated to reflect the changes in MAPREDUCE-856

2010-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865735#action_12865735 ] Hadoop QA commented on MAPREDUCE-1610: -- -1 overall. Here are the results of

[jira] Commented: (MAPREDUCE-1610) Forrest documentation should be updated to reflect the changes in MAPREDUCE-856

2010-05-10 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865740#action_12865740 ] Ravi Gummadi commented on MAPREDUCE-1610: - Patch changes only documentation.

[jira] Commented: (MAPREDUCE-5) Shuffle's getMapOutput() fails with EofException, followed by IllegalStateException

2010-05-10 Thread Patrick Angeles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865791#action_12865791 ] Patrick Angeles commented on MAPREDUCE-5: - If these messages are harmful, then we

[jira] Commented: (MAPREDUCE-1607) Task controller may not set permissions for a task cleanup attempt's log directory

2010-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865804#action_12865804 ] Hadoop QA commented on MAPREDUCE-1607: -- +1 overall. Here are the results of

[jira] Updated: (MAPREDUCE-1610) Forrest documentation should be updated to reflect the changes in MAPREDUCE-856

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1610: - Status: Resolved (was: Patch Available) Release Note: Updated forrest

[jira] Commented: (MAPREDUCE-1606) TestJobACLs may timeout as there are no slots for launching JOB_CLEANUP task

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865824#action_12865824 ] Vinod K V commented on MAPREDUCE-1606: -- Can you please upload the difference

[jira] Updated: (MAPREDUCE-1606) TestJobACLs may timeout as there are no slots for launching JOB_CLEANUP task

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod K V updated MAPREDUCE-1606: - Status: Open (was: Patch Available) TestJobACLs may timeout as there are no slots for

[jira] Commented: (MAPREDUCE-1607) Task controller may not set permissions for a task cleanup attempt's log directory

2010-05-10 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865826#action_12865826 ] Vinod K V commented on MAPREDUCE-1607: -- +1 for the patch. This one's good to go

[jira] Updated: (MAPREDUCE-1372) ConcurrentModificationException in JobInProgress

2010-05-10 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1372: - Status: Patch Available (was: Open) ConcurrentModificationException in JobInProgress

[jira] Updated: (MAPREDUCE-1372) ConcurrentModificationException in JobInProgress

2010-05-10 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King updated MAPREDUCE-1372: - Attachment: mapreduce-1372--2010-05-08.patch This patch is the port to Trunk. In the

[jira] Updated: (MAPREDUCE-1711) Gridmix should provide an option to submit jobs to the same queues as specified in the trace.

2010-05-10 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Tang updated MAPREDUCE-1711: - Attachment: diff-gridmix.patch diff-rumen.patch Gridmix should provide an

[jira] Commented: (MAPREDUCE-1711) Gridmix should provide an option to submit jobs to the same queues as specified in the trace.

2010-05-10 Thread Hong Tang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865860#action_12865860 ] Hong Tang commented on MAPREDUCE-1711: -- I applied your patch to yhadoop 20.10 and

[jira] Created: (MAPREDUCE-1781) option -D mapred.tasktracker.map.tasks.maximum=1 does not work when no of mappers is bigger than no of nodes - always spawns 2 mapers/node

2010-05-10 Thread Tudor Vlad (JIRA)
option -D mapred.tasktracker.map.tasks.maximum=1 does not work when no of mappers is bigger than no of nodes - always spawns 2 mapers/node

[jira] Commented: (MAPREDUCE-1712) HAR sequence files throw errors in MR jobs

2010-05-10 Thread Rodrigo Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865916#action_12865916 ] Rodrigo Schmidt commented on MAPREDUCE-1712: @Nicholas: HADOOP-6467 didn't

[jira] Updated: (MAPREDUCE-1539) authorization checks for inter-server protocol (based on HADOOP-6600)

2010-05-10 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated MAPREDUCE-1539: -- Attachment: MAPREDUCE-1539-3.patch merged with trunk authorization checks for

[jira] Commented: (MAPREDUCE-1372) ConcurrentModificationException in JobInProgress

2010-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865954#action_12865954 ] Hadoop QA commented on MAPREDUCE-1372: -- -1 overall. Here are the results of

[jira] Commented: (MAPREDUCE-1623) Apply audience and stability annotations to classes in mapred package

2010-05-10 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865965#action_12865965 ] Tom White commented on MAPREDUCE-1623: -- Output from test-patch: {noformat}

[jira] Assigned: (MAPREDUCE-1354) Incremental enhancements to the JobTracker for better scalability

2010-05-10 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dick King reassigned MAPREDUCE-1354: Assignee: Dick King (was: Arun C Murthy) Incremental enhancements to the JobTracker

[jira] Updated: (MAPREDUCE-1683) Remove JNI calls from ClusterStatus cstr

2010-05-10 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated MAPREDUCE-1683: --- Attachment: mr-1683-trunk-v1.patch The JobTracker memory usage fields in ClusterStatus are not

[jira] Commented: (MAPREDUCE-1779) Should we provide a way to know JobTracker's memory info from client?

2010-05-10 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865983#action_12865983 ] Luke Lu commented on MAPREDUCE-1779: Per discussions with Chris and Arun, the JT

[jira] Updated: (MAPREDUCE-1617) TestBadRecords failed once in our test runs

2010-05-10 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated MAPREDUCE-1617: --- Status: Patch Available (was: Open) Affects Version/s: 0.20.2 TestBadRecords

[jira] Updated: (MAPREDUCE-1543) Log messages of JobACLsManager should use security logging of HADOOP-6586

2010-05-10 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated MAPREDUCE-1543: --- Attachment: mr-1543-trunk-v2.patch Incorporated some feedback from Chris: use LOG.is*Enabled

[jira] Commented: (MAPREDUCE-1533) Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()

2010-05-10 Thread Dick King (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12865998#action_12865998 ] Dick King commented on MAPREDUCE-1533: -- I went ahead and added guards for the

[jira] Commented: (MAPREDUCE-1781) option -D mapred.tasktracker.map.tasks.maximum=1 does not work when no of mappers is bigger than no of nodes - always spawns 2 mapers/node

2010-05-10 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866020#action_12866020 ] Hemanth Yamijala commented on MAPREDUCE-1781: -

[jira] Created: (MAPREDUCE-1782) GlobPath support for har

2010-05-10 Thread Santhosh Srinivasan (JIRA)
GlobPath support for har Key: MAPREDUCE-1782 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1782 Project: Hadoop Map/Reduce Issue Type: Bug Components: harchive Affects Versions: 0.20.1

[jira] Updated: (MAPREDUCE-1782) GlobPath support for har

2010-05-10 Thread Santhosh Srinivasan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated MAPREDUCE-1782: --- Attachment: Test.java Test case that returns null while using

[jira] Commented: (MAPREDUCE-1606) TestJobACLs may timeout as there are no slots for launching JOB_CLEANUP task

2010-05-10 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866046#action_12866046 ] Ravi Gummadi commented on MAPREDUCE-1606: - For the whole TestJobACLs, the

[jira] Commented: (MAPREDUCE-1683) Remove JNI calls from ClusterStatus cstr

2010-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866048#action_12866048 ] Hadoop QA commented on MAPREDUCE-1683: -- -1 overall. Here are the results of

[jira] Commented: (MAPREDUCE-1731) Process tree clean up suspended task tests.

2010-05-10 Thread Balaji Rajagopalan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866050#action_12866050 ] Balaji Rajagopalan commented on MAPREDUCE-1731: --- +cluster.setUp(); +

[jira] Updated: (MAPREDUCE-1648) Use rolling to limit tasklogs

2010-05-10 Thread Guilin Sun (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guilin Sun updated MAPREDUCE-1648: -- Status: Open (was: Patch Available) Use rolling to limit tasklogs

[jira] Updated: (MAPREDUCE-1648) Use rolling to limit tasklogs

2010-05-10 Thread Guilin Sun (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guilin Sun updated MAPREDUCE-1648: -- Status: Patch Available (was: Open) Use rolling to limit tasklogs

[jira] Commented: (MAPREDUCE-1617) TestBadRecords failed once in our test runs

2010-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866054#action_12866054 ] Hadoop QA commented on MAPREDUCE-1617: -- +1 overall. Here are the results of

[jira] Updated: (MAPREDUCE-1731) Process tree clean up suspended task tests.

2010-05-10 Thread Vinay Kumar Thota (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay Kumar Thota updated MAPREDUCE-1731: - Attachment: 1731-ydist-security.patch It was a patch mistake. I have

[jira] Assigned: (MAPREDUCE-1782) GlobPath support for har

2010-05-10 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar reassigned MAPREDUCE-1782: Assignee: Mahadev konar GlobPath support for har