[GitHub] [hadoop] iwasakims merged pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-29 Thread GitBox
iwasakims merged pull request #2065: URL: https://github.com/apache/hadoop/pull/2065 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (HADOOP-17101) Replace Guava Function with Java8+ Function

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17101: --- Description: {code:java} Targets Occurrences of 'com.google.common.base.Function'

[jira] [Created] (HADOOP-17101) Replace Guava Function with Java8+ Function

2020-06-29 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17101: -- Summary: Replace Guava Function with Java8+ Function Key: HADOOP-17101 URL: https://issues.apache.org/jira/browse/HADOOP-17101 Project: Hadoop Common

[jira] [Updated] (HADOOP-17094) vulnerabilities reported in jackson and jackson-databind in branch-2.10

2020-06-29 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17094: -- Fix Version/s: 2.10.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Work started] (HADOOP-17100) Replace Guava Supplier with Java8+ Supplier

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17100 started by Ahmed Hussein. -- > Replace Guava Supplier with Java8+ Supplier >

[jira] [Updated] (HADOOP-17100) Replace Guava Supplier with Java8+ Supplier

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17100: --- Attachment: HADOOP-17100.001.patch Status: Patch Available (was: In Progress) >

[jira] [Created] (HADOOP-17099) Replace Guava Predicate with Java8+ Predicate

2020-06-29 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17099: -- Summary: Replace Guava Predicate with Java8+ Predicate Key: HADOOP-17099 URL: https://issues.apache.org/jira/browse/HADOOP-17099 Project: Hadoop Common

[jira] [Updated] (HADOOP-17079) Optimize UGI#getGroups by adding UGI#getGroupsSet

2020-06-29 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-17079: Attachment: HADOOP-17079.007.patch > Optimize UGI#getGroups by adding UGI#getGroupsSet >

[jira] [Updated] (HADOOP-17099) Replace Guava Predicate with Java8+ Predicate

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17099: --- Attachment: HADOOP-17099.001.patch > Replace Guava Predicate with Java8+ Predicate >

[jira] [Updated] (HADOOP-17097) start-build-env.sh fails in branch-3.1

2020-06-29 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17097: -- Fix Version/s: 3.1.5 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Updated] (HADOOP-17099) Replace Guava Predicate with Java8+ Predicate

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17099: --- Status: Patch Available (was: Open) > Replace Guava Predicate with Java8+ Predicate >

[GitHub] [hadoop] iwasakims commented on pull request #2065: MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable.

2020-06-29 Thread GitBox
iwasakims commented on pull request #2065: URL: https://github.com/apache/hadoop/pull/2065#issuecomment-651470472 Thanks. I merged this. This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HADOOP-17094) vulnerabilities reported in jackson and jackson-databind in branch-2.10

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148305#comment-17148305 ] Ahmed Hussein commented on HADOOP-17094: Thanks [~iwasakims]! > vulnerabilities reported in

[jira] [Updated] (HADOOP-17099) Replace Guava Predicate with Java8+ Predicate

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17099: --- Attachment: HADOOP-17099.002.patch > Replace Guava Predicate with Java8+ Predicate >

[jira] [Created] (HADOOP-17100) Replace Guava Supplier with Java8+ Supplier

2020-06-29 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17100: -- Summary: Replace Guava Supplier with Java8+ Supplier Key: HADOOP-17100 URL: https://issues.apache.org/jira/browse/HADOOP-17100 Project: Hadoop Common

[GitHub] [hadoop] aajisaka commented on pull request #2098: HDFS-15424. Javadoc failing with "cannot find symbol com.google.protobuf.GeneratedMessageV3 implements"

2020-06-29 Thread GitBox
aajisaka commented on pull request #2098: URL: https://github.com/apache/hadoop/pull/2098#issuecomment-651492684 I could reproduce the error by running the command with double quotes: ``` /usr/bin/mvn --batch-mode -Ptest-patch -Pdocs -DskipTests clean "process-sources

[GitHub] [hadoop] iwasakims merged pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
iwasakims merged pull request #2108: URL: https://github.com/apache/hadoop/pull/2108 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] huangtianhua closed pull request #2109: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-06-29 Thread GitBox
huangtianhua closed pull request #2109: URL: https://github.com/apache/hadoop/pull/2109 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] iwasakims commented on pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
iwasakims commented on pull request #2108: URL: https://github.com/apache/hadoop/pull/2108#issuecomment-651469192 Thanks, @aajisaka. I merged this. This is an automated message from the Apache Git Service. To respond to the

[jira] [Work started] (HADOOP-17101) Replace Guava Function with Java8+ Function

2020-06-29 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17101 started by Ahmed Hussein. -- > Replace Guava Function with Java8+ Function >

[GitHub] [hadoop] hadoop-yetus commented on pull request #2060: HADOOP-17032. Fix getContentSummary in ViewFileSystem to handle multiple children mountpoints pointing to different filesystems

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2060: URL: https://github.com/apache/hadoop/pull/2060#issuecomment-651378095 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] ishaniahuja commented on pull request #2072: HADOOP-17058. ABFS: Support for AppendBlob in Hadoop ABFS Driver

2020-06-29 Thread GitBox
ishaniahuja commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-650982822 namespace, rest version:= 2018-11-09 Tests run: 84, Failures: 0, Errors: 0, Skipped: 0 Tests run: 443, Failures: 0, Errors: 0, Skipped: 42 Tests run: 207,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2108: URL: https://github.com/apache/hadoop/pull/2108#issuecomment-651024880 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 12m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2108: URL: https://github.com/apache/hadoop/pull/2108#issuecomment-651016009 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] aajisaka commented on pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
aajisaka commented on pull request #2108: URL: https://github.com/apache/hadoop/pull/2108#issuecomment-651019256 +1 pending Jenkins This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] aajisaka commented on pull request #2105: HADOOP-17097. start-buid-env.sh fails in branch-3.1

2020-06-29 Thread GitBox
aajisaka commented on pull request #2105: URL: https://github.com/apache/hadoop/pull/2105#issuecomment-651018756 Closing as dup of #2108 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] aajisaka closed pull request #2105: HADOOP-17097. start-buid-env.sh fails in branch-3.1

2020-06-29 Thread GitBox
aajisaka closed pull request #2105: URL: https://github.com/apache/hadoop/pull/2105 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] huangtianhua opened a new pull request #2109: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-06-29 Thread GitBox
huangtianhua opened a new pull request #2109: URL: https://github.com/apache/hadoop/pull/2109 The non-volatile memory NVDIMM is faster than SSD, it can be used simultaneously with RAM, DISK and SSD. Storing the data of HDFS on NVDIMM directly will get better response rate and

[jira] [Assigned] (HADOOP-17097) start-build-env.sh fails in branch-3.1

2020-06-29 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HADOOP-17097: - Assignee: Masatake Iwasaki > start-build-env.sh fails in branch-3.1 >

[jira] [Updated] (HADOOP-17097) start-build-env.sh fails in branch-3.1

2020-06-29 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17097: -- Status: Patch Available (was: Open) > start-build-env.sh fails in branch-3.1 >

[GitHub] [hadoop] iwasakims opened a new pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
iwasakims opened a new pull request #2108: URL: https://github.com/apache/hadoop/pull/2108 I aligned the versions with the one pulled by frontend-maven-plugin (used in `mvn install -Pyarn-ui`). *

[GitHub] [hadoop] bilaharith commented on pull request #2101: HADOOP-17086. ABFS: Making the ListStatus response model to ignore un…

2020-06-29 Thread GitBox
bilaharith commented on pull request #2101: URL: https://github.com/apache/hadoop/pull/2101#issuecomment-651034314 The java doc failure has been reported on trunk. PF the JIRA [HADOOP-17085](https://issues.apache.org/jira/browse/HADOOP-17085)

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS: Support for AppendBlob in Hadoop ABFS Driver

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-651011311 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] iwasakims commented on pull request #2105: HADOOP-17097. start-buid-env.sh fails in branch-3.1

2020-06-29 Thread GitBox
iwasakims commented on pull request #2105: URL: https://github.com/apache/hadoop/pull/2105#issuecomment-651046317 Sorry, I missed this PR... This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] steveloughran commented on pull request #2102: HADOOP-13327. Specify Output Stream and Syncable

2020-06-29 Thread GitBox
steveloughran commented on pull request #2102: URL: https://github.com/apache/hadoop/pull/2102#issuecomment-651103366 rawlocal FS failure is because even though localfs.xml says hsync is supported, it's not being passed all the way down. I need a subclass of java.io.ByteBufferOutputStream

[GitHub] [hadoop] hadoop-yetus commented on pull request #2072: HADOOP-17058. ABFS: Support for AppendBlob in Hadoop ABFS Driver

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-651149429 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 22m

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2069: HADOOP-16830. IOStatistics API.

2020-06-29 Thread GitBox
hadoop-yetus removed a comment on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-643439735 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus commented on pull request #2109: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2109: URL: https://github.com/apache/hadoop/pull/2109#issuecomment-651124775 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m

[GitHub] [hadoop] ishaniahuja commented on pull request #2072: HADOOP-17058. ABFS: Support for AppendBlob in Hadoop ABFS Driver

2020-06-29 Thread GitBox
ishaniahuja commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-651085904 namespace, rest version:= 2018-11-09 Tests run: 84, Failures: 0, Errors: 0, Skipped: 0 Tests run: 443, Failures: 0, Errors: 0, Skipped: 42 Tests run: 207,

[GitHub] [hadoop] ishaniahuja commented on pull request #2072: HADOOP-17058. ABFS: Support for AppendBlob in Hadoop ABFS Driver

2020-06-29 Thread GitBox
ishaniahuja commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-651042428 namespace, rest version:= 2018-11-09 Tests run: 84, Failures: 0, Errors: 0, Skipped: 0 Tests run: 443, Failures: 0, Errors: 0, Skipped: 42 Tests run: 207,

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2083: HADOOP-17077. S3A delegation token binding to support secondary binding list

2020-06-29 Thread GitBox
hadoop-yetus removed a comment on pull request #2083: URL: https://github.com/apache/hadoop/pull/2083#issuecomment-648981862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] ishaniahuja commented on pull request #2072: HADOOP-17058. ABFS: Support for AppendBlob in Hadoop ABFS Driver

2020-06-29 Thread GitBox
ishaniahuja commented on pull request #2072: URL: https://github.com/apache/hadoop/pull/2072#issuecomment-651043815 yetus: https://builds.apache.org/job/hadoop-multibranch/job/PR-2072/14/ (javadoc -1 - see linked JIRA in above comments.)

[GitHub] [hadoop] hadoop-yetus commented on pull request #2060: HADOOP-17032. Fix getContentSummary in ViewFileSystem to handle multiple children mountpoints pointing to different filesystems

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2060: URL: https://github.com/apache/hadoop/pull/2060#issuecomment-651115869 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] aajisaka commented on pull request #2105: HADOOP-17097. start-buid-env.sh fails in branch-3.1

2020-06-29 Thread GitBox
aajisaka commented on pull request #2105: URL: https://github.com/apache/hadoop/pull/2105#issuecomment-651186556 No problem. Your patch looks better. This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] joshelser commented on a change in pull request #2102: HADOOP-13327. Specify Output Stream and Syncable

2020-06-29 Thread GitBox
joshelser commented on a change in pull request #2102: URL: https://github.com/apache/hadoop/pull/2102#discussion_r446999630 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/StoreImplementationUtils.java ## @@ -0,0 +1,95 @@ +/* + *

[GitHub] [hadoop] hadoop-yetus commented on pull request #2069: HADOOP-16830. IOStatistics API.

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2069: URL: https://github.com/apache/hadoop/pull/2069#issuecomment-651198409 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] aajisaka commented on pull request #2098: HDFS-15424. Javadoc failing with "cannot find symbol com.google.protobuf.GeneratedMessageV3 implements"

2020-06-29 Thread GitBox
aajisaka commented on pull request #2098: URL: https://github.com/apache/hadoop/pull/2098#issuecomment-651213950 I could not reproduce the following error: ``` [ERROR] No plugin found for prefix 'process-sources javadoc' in the current project and in the plugin groups

[GitHub] [hadoop] aajisaka commented on pull request #2108: HADOOP-17097. start-build-env.sh fails in branch-3.1.

2020-06-29 Thread GitBox
aajisaka commented on pull request #2108: URL: https://github.com/apache/hadoop/pull/2108#issuecomment-651187316 https://builds.apache.org/job/hadoop-multibranch/job/PR-2108/lastBuild/artifact/out/branch-shadedclient.txt ``` [ERROR]

[jira] [Created] (HADOOP-17098) Reduce Guava dependency in Hadoop source code

2020-06-29 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17098: -- Summary: Reduce Guava dependency in Hadoop source code Key: HADOOP-17098 URL: https://issues.apache.org/jira/browse/HADOOP-17098 Project: Hadoop Common

[jira] [Commented] (HADOOP-17098) Reduce Guava dependency in Hadoop source code

2020-06-29 Thread Jonathan Turner Eagles (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147935#comment-17147935 ] Jonathan Turner Eagles commented on HADOOP-17098: - I agree these kinds of changes make

[jira] [Commented] (HADOOP-17098) Reduce Guava dependency in Hadoop source code

2020-06-29 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147948#comment-17147948 ] Wei-Chiu Chuang commented on HADOOP-17098: -- Ahmed, if you can pull this off, it will be huge.

[jira] [Commented] (HADOOP-17098) Reduce Guava dependency in Hadoop source code

2020-06-29 Thread Sean Busbey (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148016#comment-17148016 ] Sean Busbey commented on HADOOP-17098: -- sounds like a good goal and a well given scope. > Reduce

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #2060: HADOOP-17032. Fix getContentSummary in ViewFileSystem to handle multiple children mountpoints pointing to different filesys

2020-06-29 Thread GitBox
abhishekdas99 commented on a change in pull request #2060: URL: https://github.com/apache/hadoop/pull/2060#discussion_r447154909 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -850,9 +850,27 @@ public

[GitHub] [hadoop] hadoop-yetus commented on pull request #2083: HADOOP-17077. S3A delegation token binding to support secondary binding list

2020-06-29 Thread GitBox
hadoop-yetus commented on pull request #2083: URL: https://github.com/apache/hadoop/pull/2083#issuecomment-651337181 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 21m