[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633443#comment-17633443 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- aajisaka commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1312943154 Thank you @ashutoshcipher for taking this issue over. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633442#comment-17633442 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- aajisaka merged PR #5014: URL: https://github.com/apache/hadoop/pull/5014 > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632064#comment-17632064 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1311208988 @aajisaka Addressed your comments, please help in reviewing it. Thanks. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17631100#comment-17631100 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1308839013 Checkstyle in latest Yetus can be ignored as `public static final` is added to keep it consistent with other parameters. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630669#comment-17630669
]
ASF GitHub Bot commented on MAPREDUCE-5608:
---
hadoop-yetus commented on PR #5014:
URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1308016900
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexec | 0m 49s | | Docker mode activated. |
_ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files
found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available.
|
| +0 :ok: | markdownlint | 0m 0s | | markdownlint was not available.
|
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to
include 1 new or modified test files. |
_ trunk Compile Tests _ |
| +0 :ok: | mvndep | 15m 56s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 26m 6s | | trunk passed |
| +1 :green_heart: | compile | 23m 30s | | trunk passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | compile | 20m 51s | | trunk passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | checkstyle | 4m 15s | | trunk passed |
| +1 :green_heart: | mvnsite | 3m 12s | | trunk passed |
| +1 :green_heart: | javadoc | 2m 42s | | trunk passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 1m 59s | | trunk passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 5m 16s | | trunk passed |
| +1 :green_heart: | shadedclient | 22m 24s | | branch has no errors
when building and testing our client artifacts. |
_ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 31s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 44s | | the patch passed |
| +1 :green_heart: | compile | 22m 32s | | the patch passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javac | 22m 32s | | the patch passed |
| +1 :green_heart: | compile | 20m 58s | | the patch passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | javac | 20m 58s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks
issues. |
| -0 :warning: | checkstyle | 4m 14s |
[/results-checkstyle-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5014/3/artifact/out/results-checkstyle-root.txt)
| root: The patch generated 1 new + 671 unchanged - 1 fixed = 672 total (was
672) |
| +1 :green_heart: | mvnsite | 3m 11s | | the patch passed |
| +1 :green_heart: | javadoc | 2m 34s | | the patch passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 10s | | the patch passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 4m 54s | | the patch passed |
| +1 :green_heart: | shadedclient | 22m 30s | | patch has no errors
when building and testing our client artifacts. |
_ Other Tests _ |
| +1 :green_heart: | unit | 18m 56s | | hadoop-common in the patch
passed. |
| +1 :green_heart: | unit | 7m 29s | | hadoop-mapreduce-client-core in
the patch passed. |
| +1 :green_heart: | asflicense | 1m 16s | | The patch does not
generate ASF License warnings. |
| | | 243m 55s | | |
| Subsystem | Report/Notes |
|--:|:-|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5014/3/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/5014 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets
markdownlint compile javac javadoc mvninstall unit shadedclient spotbugs
checkstyle |
| uname | Linux a834873ee1b6 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4
01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 61317068f44989f9eb39fa398481d4061ffe8301 |
| Default Java | Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
|
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630603#comment-17630603 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1307776743 > Thank you @ashutoshcipher for the cleanup. I have 1 comment Thanks @aajisaka for reviewing. I have addressed your comment in my last commit. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630602#comment-17630602
]
ASF GitHub Bot commented on MAPREDUCE-5608:
---
ashutoshcipher commented on code in PR #5014:
URL: https://github.com/apache/hadoop/pull/5014#discussion_r1017073570
##
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java:
##
@@ -577,6 +577,8 @@ public interface MRJobConfig {
public static final String MAX_SHUFFLE_FETCH_HOST_FAILURES =
"mapreduce.reduce.shuffle.max-host-failures";
public static final int DEFAULT_MAX_SHUFFLE_FETCH_HOST_FAILURES = 5;
+ String SHUFFLE_INDEX_CACHE = "mapreduce.reduce.shuffle.indexcache.mb";
Review Comment:
yes, makes sense.
> Replace and deprecate mapred.tasktracker.indexcache.mb
> --
>
> Key: MAPREDUCE-5608
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
>Affects Versions: 2.2.0
>Reporter: Sandy Ryza
>Assignee: Ashutosh Gupta
>Priority: Major
> Labels: BB2015-05-TBR, configuration, newbie,
> pull-request-available
> Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch,
> MAPREDUCE-5608.patch
>
>
> In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size
> of the shuffle service index cache. As the tasktracker no longer exists, we
> should replace this with something like mapreduce.shuffle.indexcache.mb.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630373#comment-17630373
]
ASF GitHub Bot commented on MAPREDUCE-5608:
---
aajisaka commented on code in PR #5014:
URL: https://github.com/apache/hadoop/pull/5014#discussion_r1016514206
##
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java:
##
@@ -577,6 +577,8 @@ public interface MRJobConfig {
public static final String MAX_SHUFFLE_FETCH_HOST_FAILURES =
"mapreduce.reduce.shuffle.max-host-failures";
public static final int DEFAULT_MAX_SHUFFLE_FETCH_HOST_FAILURES = 5;
+ String SHUFFLE_INDEX_CACHE = "mapreduce.reduce.shuffle.indexcache.mb";
Review Comment:
Could you make it public static final to be consistent with other parameters?
> Replace and deprecate mapred.tasktracker.indexcache.mb
> --
>
> Key: MAPREDUCE-5608
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
>Affects Versions: 2.2.0
>Reporter: Sandy Ryza
>Assignee: Ashutosh Gupta
>Priority: Major
> Labels: BB2015-05-TBR, configuration, newbie,
> pull-request-available
> Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch,
> MAPREDUCE-5608.patch
>
>
> In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size
> of the shuffle service index cache. As the tasktracker no longer exists, we
> should replace this with something like mapreduce.shuffle.indexcache.mb.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17630372#comment-17630372
]
ASF GitHub Bot commented on MAPREDUCE-5608:
---
aajisaka commented on code in PR #5014:
URL: https://github.com/apache/hadoop/pull/5014#discussion_r1016514206
##
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java:
##
@@ -577,6 +577,8 @@ public interface MRJobConfig {
public static final String MAX_SHUFFLE_FETCH_HOST_FAILURES =
"mapreduce.reduce.shuffle.max-host-failures";
public static final int DEFAULT_MAX_SHUFFLE_FETCH_HOST_FAILURES = 5;
+ String SHUFFLE_INDEX_CACHE = "mapreduce.reduce.shuffle.indexcache.mb";
Review Comment:
Could you make it static final?
> Replace and deprecate mapred.tasktracker.indexcache.mb
> --
>
> Key: MAPREDUCE-5608
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
>Affects Versions: 2.2.0
>Reporter: Sandy Ryza
>Assignee: Ashutosh Gupta
>Priority: Major
> Labels: BB2015-05-TBR, configuration, newbie,
> pull-request-available
> Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch,
> MAPREDUCE-5608.patch
>
>
> In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size
> of the shuffle service index cache. As the tasktracker no longer exists, we
> should replace this with something like mapreduce.shuffle.indexcache.mb.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17627410#comment-17627410 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1299443139 Hi @cnauroth, Please help in reviewing this PR. Thanks > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618788#comment-17618788 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1280573422 Thanks @ZanderXu. Will ask you for help in HDFS jiras :) > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618391#comment-17618391 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ZanderXu commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1280213449 @ashutoshcipher Thanks for involving me here. I just focus on HDFS right now, so I can't give any review ideas here. Sorry. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618077#comment-17618077 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher commented on PR #5014: URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1279728117 @aajisaka @goiri @ZanderXu - Please help in reviewing it. Thank you so much. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie, > pull-request-available > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617302#comment-17617302
]
ASF GitHub Bot commented on MAPREDUCE-5608:
---
hadoop-yetus commented on PR #5014:
URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1278189000
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexec | 0m 51s | | Docker mode activated. |
_ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files
found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available.
|
| +0 :ok: | markdownlint | 0m 0s | | markdownlint was not available.
|
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to
include 1 new or modified test files. |
_ trunk Compile Tests _ |
| +0 :ok: | mvndep | 16m 0s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 29m 57s | | trunk passed |
| +1 :green_heart: | compile | 27m 51s | | trunk passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | compile | 23m 29s | | trunk passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | checkstyle | 4m 39s | | trunk passed |
| +1 :green_heart: | mvnsite | 3m 28s | | trunk passed |
| +1 :green_heart: | javadoc | 2m 38s | | trunk passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 5s | | trunk passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 5m 21s | | trunk passed |
| +1 :green_heart: | shadedclient | 26m 1s | | branch has no errors
when building and testing our client artifacts. |
_ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 28s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 57s | | the patch passed |
| +1 :green_heart: | compile | 26m 39s | | the patch passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javac | 26m 39s | | the patch passed |
| +1 :green_heart: | compile | 23m 27s | | the patch passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | javac | 23m 27s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks
issues. |
| +1 :green_heart: | checkstyle | 4m 34s | | root: The patch generated
0 new + 671 unchanged - 1 fixed = 671 total (was 672) |
| +1 :green_heart: | mvnsite | 3m 27s | | the patch passed |
| +1 :green_heart: | javadoc | 2m 25s | | the patch passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 4s | | the patch passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 5m 32s | | the patch passed |
| +1 :green_heart: | shadedclient | 25m 55s | | patch has no errors
when building and testing our client artifacts. |
_ Other Tests _ |
| +1 :green_heart: | unit | 19m 23s | | hadoop-common in the patch
passed. |
| +1 :green_heart: | unit | 7m 45s | | hadoop-mapreduce-client-core in
the patch passed. |
| +1 :green_heart: | asflicense | 1m 19s | | The patch does not
generate ASF License warnings. |
| | | 270m 56s | | |
| Subsystem | Report/Notes |
|--:|:-|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5014/2/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/5014 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets
markdownlint compile javac javadoc mvninstall unit shadedclient spotbugs
checkstyle |
| uname | Linux 5beb15af47f9 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4
01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 9cec92045901c1a2ac6a7248b09de2c9f2be10be |
| Default Java | Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| Test Results |
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5014/2/testReport/ |
| Max. process+thread count | 3144
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617187#comment-17617187
]
ASF GitHub Bot commented on MAPREDUCE-5608:
---
hadoop-yetus commented on PR #5014:
URL: https://github.com/apache/hadoop/pull/5014#issuecomment-1277896213
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|::|--:|:|::|:---:|
| +0 :ok: | reexec | 0m 55s | | Docker mode activated. |
_ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files
found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available.
|
| +0 :ok: | markdownlint | 0m 0s | | markdownlint was not available.
|
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain
any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to
include 1 new or modified test files. |
_ trunk Compile Tests _ |
| +0 :ok: | mvndep | 15m 55s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 29m 35s | | trunk passed |
| +1 :green_heart: | compile | 27m 50s | | trunk passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | compile | 23m 47s | | trunk passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | checkstyle | 4m 45s | | trunk passed |
| +1 :green_heart: | mvnsite | 3m 28s | | trunk passed |
| +1 :green_heart: | javadoc | 2m 30s | | trunk passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 7s | | trunk passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 5m 21s | | trunk passed |
| +1 :green_heart: | shadedclient | 25m 10s | | branch has no errors
when building and testing our client artifacts. |
_ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 28s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 50s | | the patch passed |
| +1 :green_heart: | compile | 27m 24s | | the patch passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javac | 27m 24s | | the patch passed |
| +1 :green_heart: | compile | 23m 37s | | the patch passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | javac | 23m 37s | | the patch passed |
| +1 :green_heart: | blanks | 0m 1s | | The patch has no blanks
issues. |
| -0 :warning: | checkstyle | 4m 37s |
[/results-checkstyle-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5014/1/artifact/out/results-checkstyle-root.txt)
| root: The patch generated 1 new + 671 unchanged - 1 fixed = 672 total (was
672) |
| +1 :green_heart: | mvnsite | 3m 29s | | the patch passed |
| +1 :green_heart: | javadoc | 2m 28s | | the patch passed with JDK
Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 2s | | the patch passed with JDK
Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| +1 :green_heart: | spotbugs | 5m 36s | | the patch passed |
| +1 :green_heart: | shadedclient | 26m 39s | | patch has no errors
when building and testing our client artifacts. |
_ Other Tests _ |
| +1 :green_heart: | unit | 19m 26s | | hadoop-common in the patch
passed. |
| +1 :green_heart: | unit | 7m 41s | | hadoop-mapreduce-client-core in
the patch passed. |
| +1 :green_heart: | asflicense | 1m 22s | | The patch does not
generate ASF License warnings. |
| | | 271m 32s | | |
| Subsystem | Report/Notes |
|--:|:-|
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5014/1/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/hadoop/pull/5014 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets
markdownlint compile javac javadoc mvninstall unit shadedclient spotbugs
checkstyle |
| uname | Linux 9da8043d20c6 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4
01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 2cec8a370f7e45cbdc91ca696d8dc71d4eceb859 |
| Default Java | Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07 |
|
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617001#comment-17617001 ] ASF GitHub Bot commented on MAPREDUCE-5608: --- ashutoshcipher opened a new pull request, #5014: URL: https://github.com/apache/hadoop/pull/5014 ### Description of PR Replace and deprecate mapred.tasktracker.indexcache.mb In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size of the shuffle service index cache. As the tasktracker no longer exists, we should replace this with something like mapreduce.reduce.shuffle.indexcache.mb. ### How was this patch tested? UT ### For code changes: - [X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')? - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation? - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)? - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files? > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Ashutosh Gupta >Priority: Major > Labels: BB2015-05-TBR, configuration, newbie > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.003.patch, > MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581610#comment-15581610
]
Hadoop QA commented on MAPREDUCE-5608:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 16s
{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s {color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 14s
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m
36s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 7m 9s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
50s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 29s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
29s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
28s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 5s
{color} | {color:green} trunk passed {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 14s
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
2s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 9m 1s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 9m 1s
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 37s
{color} | {color:red} root: The patch generated 1 new + 1052 unchanged - 3
fixed = 1053 total (was 1055) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 33s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
29s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s {color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m
27s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 19s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 8m 13s
{color} | {color:green} hadoop-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 34s
{color} | {color:green} hadoop-mapreduce-client-core in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
25s {color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 52m 25s {color}
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:9560f25 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12833694/MAPREDUCE-5608.003.patch
|
| JIRA Issue | MAPREDUCE-5608 |
| Optional Tests | asflicense mvnsite compile javac javadoc mvninstall
unit findbugs checkstyle |
| uname | Linux 803e456bf9e3 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12
17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 1f304b0 |
| Default Java | 1.8.0_101 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6762/artifact/patchprocess/diff-checkstyle-root.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6762/testReport/ |
| modules | C: hadoop-common-project/hadoop-common
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core
U: . |
| Console output |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6762/console |
| Powered by | Apache Yetus 0.3.0
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581276#comment-15581276
]
Hadoop QA commented on MAPREDUCE-5608:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 21s
{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s {color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 48s
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
27s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m 32s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
44s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 36s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
29s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
30s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 13s
{color} | {color:green} trunk passed {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 15s
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
11s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m 40s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 8m 40s
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 43s
{color} | {color:red} root: The patch generated 7 new + 1052 unchanged - 3
fixed = 1059 total (was 1055) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 29s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
30s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s {color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
48s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 7s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 8m 5s
{color} | {color:green} hadoop-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 32s
{color} | {color:green} hadoop-mapreduce-client-core in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
23s {color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 56m 19s {color}
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:9560f25 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12707730/MAPREDUCE-5608-002.patch
|
| JIRA Issue | MAPREDUCE-5608 |
| Optional Tests | asflicense mvnsite compile javac javadoc mvninstall
unit findbugs checkstyle |
| uname | Linux 5f7d2a920f07 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12
17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 1f304b0 |
| Default Java | 1.8.0_101 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6759/artifact/patchprocess/diff-checkstyle-root.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6759/testReport/ |
| modules | C: hadoop-common-project/hadoop-common
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core
U: . |
| Console output |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6759/console |
| Powered by | Apache Yetus 0.3.0
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581277#comment-15581277
]
Hadoop QA commented on MAPREDUCE-5608:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 18s
{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s
{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s {color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m 39s
{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
22s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m 30s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
40s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 36s
{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
30s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
25s {color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 9s
{color} | {color:green} trunk passed {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 16s
{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
13s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 8m 34s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 8m 34s
{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 41s
{color} | {color:red} root: The patch generated 7 new + 1052 unchanged - 3
fixed = 1059 total (was 1055) {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 33s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
28s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s {color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
47s {color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 10s
{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 8m 3s
{color} | {color:green} hadoop-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m 33s
{color} | {color:green} hadoop-mapreduce-client-core in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
22s {color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 55m 40s {color}
| {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:9560f25 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12707730/MAPREDUCE-5608-002.patch
|
| JIRA Issue | MAPREDUCE-5608 |
| Optional Tests | asflicense mvnsite compile javac javadoc mvninstall
unit findbugs checkstyle |
| uname | Linux f50a46df6a1f 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12
17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 1f304b0 |
| Default Java | 1.8.0_101 |
| findbugs | v3.0.0 |
| checkstyle |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6760/artifact/patchprocess/diff-checkstyle-root.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6760/testReport/ |
| modules | C: hadoop-common-project/hadoop-common
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core
U: . |
| Console output |
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/6760/console |
| Powered by | Apache Yetus 0.3.0
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581183#comment-15581183 ] Akira Ajisaka commented on MAPREDUCE-5608: -- This patch still applies to trunk. > Replace and deprecate mapred.tasktracker.indexcache.mb > -- > > Key: MAPREDUCE-5608 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Sandy Ryza >Assignee: Akira Ajisaka > Labels: BB2015-05-TBR, configuration, newbie > Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.patch > > > In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size > of the shuffle service index cache. As the tasktracker no longer exists, we > should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383662#comment-14383662
]
Hadoop QA commented on MAPREDUCE-5608:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12707730/MAPREDUCE-5608-002.patch
against trunk revision af618f2.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5342//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5342//console
This message is automatically generated.
Replace and deprecate mapred.tasktracker.indexcache.mb
--
Key: MAPREDUCE-5608
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608
Project: Hadoop Map/Reduce
Issue Type: Improvement
Affects Versions: 2.2.0
Reporter: Sandy Ryza
Assignee: Akira AJISAKA
Labels: configuration, newbie
Attachments: MAPREDUCE-5608-002.patch, MAPREDUCE-5608.patch
In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size
of the shuffle service index cache. As the tasktracker no longer exists, we
should replace this with something like mapreduce.shuffle.indexcache.mb.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[ https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815557#comment-13815557 ] Akira AJISAKA commented on MAPREDUCE-5608: -- Attaching a patch to deprecate mapreduce.tasktracker.indexcache.mb and replace this with mapreduce.reduce.shuffle.indexcache.mb. I think it is better the parameter includes 'reduce' because all other shuffle parameter include 'reduce'. Replace and deprecate mapred.tasktracker.indexcache.mb -- Key: MAPREDUCE-5608 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608 Project: Hadoop Map/Reduce Issue Type: Improvement Affects Versions: 2.2.0 Reporter: Sandy Ryza Assignee: Akira AJISAKA Labels: newbie Attachments: MAPREDUCE-5608.patch In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size of the shuffle service index cache. As the tasktracker no longer exists, we should replace this with something like mapreduce.shuffle.indexcache.mb. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (MAPREDUCE-5608) Replace and deprecate mapred.tasktracker.indexcache.mb
[
https://issues.apache.org/jira/browse/MAPREDUCE-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815586#comment-13815586
]
Hadoop QA commented on MAPREDUCE-5608:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12612506/MAPREDUCE-5608.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4182//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4182//console
This message is automatically generated.
Replace and deprecate mapred.tasktracker.indexcache.mb
--
Key: MAPREDUCE-5608
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5608
Project: Hadoop Map/Reduce
Issue Type: Improvement
Affects Versions: 2.2.0
Reporter: Sandy Ryza
Assignee: Akira AJISAKA
Labels: configuration, newbie
Attachments: MAPREDUCE-5608.patch
In MR2 mapred.tasktracker.indexcache.mb still works for configuring the size
of the shuffle service index cache. As the tasktracker no longer exists, we
should replace this with something like mapreduce.shuffle.indexcache.mb.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
