[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121021#comment-14121021 ] Sean Zhong commented on MAPREDUCE-6069: --- Todd, I cannot express enough my

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121028#comment-14121028 ] Sean Zhong commented on MAPREDUCE-6067: --- {quote} //assertEquals(Native

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v2.patch Update the patch, changes: 1. add counter support

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v3.patch The earlier patch can't apply, rebase to lastest

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v4.patch Fix a minor bug in MAP_OUTPUT_BYTES counter

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121254#comment-14121254 ] Hudson commented on MAPREDUCE-6063: --- FAILURE: Integrated in Hadoop-Yarn-trunk #670

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121306#comment-14121306 ] Sean Zhong commented on MAPREDUCE-6067: --- Hi Binglin, Thanks for your patch. I

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121309#comment-14121309 ] Sean Zhong commented on MAPREDUCE-6067: --- By the way, the patches doesn't applies

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121356#comment-14121356 ] Hudson commented on MAPREDUCE-6063: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1861

[jira] [Updated] (MAPREDUCE-5279) Jobs can deadlock if headroom is limited by cpu instead of memory

2014-09-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5279: -- Priority: Critical (was: Major) Target Version/s: 2.6.0 Summary:

[jira] [Commented] (MAPREDUCE-5279) Jobs can deadlock if headroom is limited by cpu instead of memory

2014-09-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121484#comment-14121484 ] Hadoop QA commented on MAPREDUCE-5279: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121540#comment-14121540 ] Hudson commented on MAPREDUCE-6063: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121968#comment-14121968 ] Chris Douglas commented on MAPREDUCE-6063: -- bq. This issue is also in MR1

[jira] [Moved] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

2014-09-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA moved YARN-2078 to MAPREDUCE-6070: - Component/s: (was: documentation)

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

2014-09-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122129#comment-14122129 ] Tsuyoshi OZAWA commented on MAPREDUCE-6070: --- [~jlowe], could you check this

[jira] [Updated] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

2014-09-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-6070: -- Affects Version/s: 2.5.0 yarn.app.am.resource.mb/cpu-vcores affects uber mode but

[jira] [Moved] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

2014-09-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA moved YARN-2077 to MAPREDUCE-6071: - Component/s: (was: client)

[jira] [Commented] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

2014-09-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122130#comment-14122130 ] Tsuyoshi OZAWA commented on MAPREDUCE-6071: --- Moved this from YARN to

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

2014-09-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122159#comment-14122159 ] Hadoop QA commented on MAPREDUCE-6070: -- {color:green}+1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created MAPREDUCE-6072: Summary: Remove INSTALL document Key: MAPREDUCE-6072 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6072 Project: Hadoop Map/Reduce Issue

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Attachment: MAPREDUCE-6072.patch Attaching a patch. Remove INSTALL document

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Labels: newbie (was: ) Target Version/s: 2.6.0 Status:

[jira] [Commented] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122290#comment-14122290 ] Tsuyoshi OZAWA commented on MAPREDUCE-6072: --- [~ajisakaa] how about adding a

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Status: Open (was: Patch Available) Remove INSTALL document

[jira] [Commented] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122295#comment-14122295 ] Akira AJISAKA commented on MAPREDUCE-6072: -- Thanks [~ozawa] for the comment.

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Attachment: MAPREDUCE-6072.2.patch Updated the patch. Remove INSTALL document

[jira] [Updated] (MAPREDUCE-6072) Update INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Description: ./hadoop-mapreduce-project/INSTALL has become stale. The document shows

[jira] [Updated] (MAPREDUCE-6072) Update INSTALL document

2014-09-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Status: Patch Available (was: Open) Update INSTALL document

[jira] [Commented] (MAPREDUCE-6072) Update INSTALL document

2014-09-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122310#comment-14122310 ] Hadoop QA commented on MAPREDUCE-6072: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122316#comment-14122316 ] Binglin Chang commented on MAPREDUCE-6067: -- Thanks for the comments Manu and

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-04 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122327#comment-14122327 ] zhihai xu commented on MAPREDUCE-6063: -- Hi [~chris.douglas], thanks to commit

[jira] [Commented] (MAPREDUCE-6072) Update INSTALL document

2014-09-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122333#comment-14122333 ] Hadoop QA commented on MAPREDUCE-6072: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122344#comment-14122344 ] Sean Zhong commented on MAPREDUCE-6067: --- Hi Binling, {quote} Thanks for the

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122351#comment-14122351 ] Binglin Chang commented on MAPREDUCE-6067: -- bq. I did saw some seeming

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122356#comment-14122356 ] Sean Zhong commented on MAPREDUCE-6067: --- Here, the variable name is different

[jira] [Resolved] (MAPREDUCE-6058) native-task: KVTest and LargeKVTest should check mr job is sucessful

2014-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-6058. Resolution: Fixed ah, I see you're right. Thanks and sorry for the noise native-task:

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v5.patch Attach new patch, changes: 1. move all added

[jira] [Updated] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

2014-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6069: --- Attachment: mr-6069.txt Oops, I'd uploaded the wrong path file previously. This one

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122449#comment-14122449 ] Sean Zhong commented on MAPREDUCE-6067: --- +1 for the change. Have you runned

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122455#comment-14122455 ] Sean Zhong commented on MAPREDUCE-6069: --- Hi Todd, where is the new patch?

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122459#comment-14122459 ] Manu Zhang commented on MAPREDUCE-6067: --- patch applied and all tests passed from

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122473#comment-14122473 ] Todd Lipcon commented on MAPREDUCE-6067: I tested Binglin's latest patch (v5)

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122474#comment-14122474 ] Sean Zhong commented on MAPREDUCE-6067: --- +1 native-task: spilled records

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

2014-09-04 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122476#comment-14122476 ] Sean Zhong commented on MAPREDUCE-6069: --- The file you uploaded is only 8K, looks