[GitHub] [hadoop] hadoop-yetus commented on pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #1679: URL: https://github.com/apache/hadoop/pull/1679#issuecomment-638998521 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2052: HDFS-15386 ReplicaNotFoundException keeps happening in DN after remov…

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2052: URL: https://github.com/apache/hadoop/pull/2052#issuecomment-638925567 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran closed pull request #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU

2020-06-04 Thread GitBox
steveloughran closed pull request #609: URL: https://github.com/apache/hadoop/pull/609 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-638897056 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] steveloughran commented on pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-06-04 Thread GitBox
steveloughran commented on pull request #1679: URL: https://github.com/apache/hadoop/pull/1679#issuecomment-639086252 test s3 ireland; unguarded faiures in ITestS3AConfiguration as expected errors didnt surface -probably because I've disabled bucket existence checks

[GitHub] [hadoop] sodonnel commented on pull request #2052: HDFS-15386 ReplicaNotFoundException keeps happening in DN after remov…

2020-06-04 Thread GitBox
sodonnel commented on pull request #2052: URL: https://github.com/apache/hadoop/pull/2052#issuecomment-639141448 These changes LGTM +1 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran commented on pull request #2043: HADOOP-17050 S3A to support multiple DTs

2020-06-04 Thread GitBox
steveloughran commented on pull request #2043: URL: https://github.com/apache/hadoop/pull/2043#issuecomment-639050381 i couldn't think of any tests without having a provider actually issue tokens here This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-639090777 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 34m

[GitHub] [hadoop] hadoop-yetus commented on pull request #1679: HDFS-13934. Multipart uploaders to be created through FileSystem/FileContext.

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #1679: URL: https://github.com/apache/hadoop/pull/1679#issuecomment-639122890 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-639021747 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] umamaheswararao opened a new pull request #2053: HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide

2020-06-04 Thread GitBox
umamaheswararao opened a new pull request #2053: URL: https://github.com/apache/hadoop/pull/2053 https://issues.apache.org/jira/browse/HDFS-15330 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2053: HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2053: URL: https://github.com/apache/hadoop/pull/2053#issuecomment-639169739 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2019: HADOOP-17029. Return correct permission and owner for listing on internal directories in ViewFs

2020-06-04 Thread GitBox
umamaheswararao commented on a change in pull request #2019: URL: https://github.com/apache/hadoop/pull/2019#discussion_r435595707 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -1200,13 +1200,24 @@ public

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-638840709 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-638840604 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Created] (HADOOP-17065) Adding Network Counters in ABFS

2020-06-04 Thread Mehakmeet Singh (Jira)
Mehakmeet Singh created HADOOP-17065: Summary: Adding Network Counters in ABFS Key: HADOOP-17065 URL: https://issues.apache.org/jira/browse/HADOOP-17065 Project: Hadoop Common Issue

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-638901440 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Updated] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-04 Thread Rungroj Maipradit (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rungroj Maipradit updated HADOOP-17047: --- Status: Open (was: Patch Available) > TODO comments exist in trunk while the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-638636989 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Updated] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-04 Thread Rungroj Maipradit (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rungroj Maipradit updated HADOOP-17047: --- Attachment: HADOOP-17047.002.patch Status: Patch Available (was: Open) >

[jira] [Created] (HADOOP-17064) Drop MRv1 binary compatibility in 4.0.0

2020-06-04 Thread Rungroj Maipradit (Jira)
Rungroj Maipradit created HADOOP-17064: -- Summary: Drop MRv1 binary compatibility in 4.0.0 Key: HADOOP-17064 URL: https://issues.apache.org/jira/browse/HADOOP-17064 Project: Hadoop Common

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-04 Thread Rungroj Maipradit (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125610#comment-17125610 ] Rungroj Maipradit commented on HADOOP-17047: Thank you for your suggestion, I submitted a

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125753#comment-17125753 ] Akira Ajisaka commented on HADOOP-17047: The patch looks good to me. +1 pending Jenkins.

[GitHub] [hadoop] aajisaka commented on a change in pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-04 Thread GitBox
aajisaka commented on a change in pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#discussion_r435150341 ## File path: hadoop-common-project/hadoop-common/pom.xml ## @@ -1015,7 +1031,81 @@ - + + + aarch64 + +

[GitHub] [hadoop] aajisaka commented on a change in pull request #2026: HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes

2020-06-04 Thread GitBox
aajisaka commented on a change in pull request #2026: URL: https://github.com/apache/hadoop/pull/2026#discussion_r435150587 ## File path: hadoop-common-project/hadoop-common/pom.xml ## @@ -1015,7 +1031,81 @@ - + + + aarch64 + +

[jira] [Updated] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17063: Priority: Minor (was: Major) > S3ABlockOutputStream.putObject looks stuck and never

[jira] [Updated] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17063: Target Version/s: 3.3.1 > S3ABlockOutputStream.putObject looks stuck and never timeout >

[jira] [Commented] (HADOOP-17064) Drop MRv1 binary compatibility in 4.0.0

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125764#comment-17125764 ] Steve Loughran commented on HADOOP-17064: - better make sure that Spark's committer binding

[GitHub] [hadoop] sodonnel commented on a change in pull request #2052: HDFS-15386 ReplicaNotFoundException keeps happening in DN after remov…

2020-06-04 Thread GitBox
sodonnel commented on a change in pull request #2052: URL: https://github.com/apache/hadoop/pull/2052#discussion_r435188755 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java ## @@ -578,7

[GitHub] [hadoop] hadoop-yetus commented on pull request #2052: HDFS-15386 ReplicaNotFoundException keeps happening in DN after remov…

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2052: URL: https://github.com/apache/hadoop/pull/2052#issuecomment-638773755 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-04 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125816#comment-17125816 ] Hadoop QA commented on HADOOP-17047: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125823#comment-17125823 ] Steve Loughran commented on HADOOP-17063: - Looking at the relevant code, we are scheduling the

[jira] [Updated] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17063: Parent: HADOOP-16829 Issue Type: Sub-task (was: Bug) >

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125838#comment-17125838 ] Steve Loughran commented on HADOOP-17063: - note: if you supply the patch to

[jira] [Updated] (HADOOP-17061) Fix broken links in AWS documentation

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17061: Component/s: fs/s3 documentation > Fix broken links in AWS

[jira] [Commented] (HADOOP-17061) Fix broken links in AWS documentation

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125839#comment-17125839 ] Steve Loughran commented on HADOOP-17061: - thanks for finding this -patches submitted as a

[jira] [Updated] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-04 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17056: --- Fix Version/s: 3.1.5 3.2.2 Resolution: Fixed Status:

[GitHub] [hadoop] aajisaka commented on pull request #2049: HADOOP-17062. Fix shelldocs path in Jenkinsfile

2020-06-04 Thread GitBox
aajisaka commented on pull request #2049: URL: https://github.com/apache/hadoop/pull/2049#issuecomment-638672749 > If this PR is merged. I'll update the config in the PreCommit-(HADOOP|HDFS|MAPREDUCE|YARN)-Build Jenkins jobs. Done. Also updated the config of

[jira] [Commented] (HADOOP-17056) shelldoc fails in hadoop-common

2020-06-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125644#comment-17125644 ] Hudson commented on HADOOP-17056: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18326 (See

[GitHub] [hadoop] hadoop-yetus commented on pull request #2051: HDFS-15385 Upgrade boost library

2020-06-04 Thread GitBox
hadoop-yetus commented on pull request #2051: URL: https://github.com/apache/hadoop/pull/2051#issuecomment-638680505 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 23m

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-06-04 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125687#comment-17125687 ] Hadoop QA commented on HADOOP-17047: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] aajisaka closed pull request #2040: [DEBUG] HADOOP-17056. shelldocs fails in hadoop-common.

2020-06-04 Thread GitBox
aajisaka closed pull request #2040: URL: https://github.com/apache/hadoop/pull/2040 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka commented on pull request #2040: [DEBUG] HADOOP-17056. shelldocs fails in hadoop-common.

2020-06-04 Thread GitBox
aajisaka commented on pull request #2040: URL: https://github.com/apache/hadoop/pull/2040#issuecomment-638673682 The original issue has been resolved. Closing. This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-16254) Add proxy address in IPC connection

2020-06-04 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125736#comment-17125736 ] zhengchenyu commented on HADOOP-16254: -- I use RpcRequestHeaderProto to pass proxyAddress, then

[GitHub] [hadoop] sodonnel commented on a change in pull request #2052: HDFS-15386 ReplicaNotFoundException keeps happening in DN after remov…

2020-06-04 Thread GitBox
sodonnel commented on a change in pull request #2052: URL: https://github.com/apache/hadoop/pull/2052#discussion_r435068270 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java ## @@ -578,7

[GitHub] [hadoop] brfrn169 commented on a change in pull request #2052: HDFS-15386 ReplicaNotFoundException keeps happening in DN after remov…

2020-06-04 Thread GitBox
brfrn169 commented on a change in pull request #2052: URL: https://github.com/apache/hadoop/pull/2052#discussion_r435223943 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java ## @@ -578,7