[GitHub] [hadoop] aajisaka merged pull request #2018: HDFS-15353. use sudo instead of su to allow nologin user for secure DataNode

2020-05-20 Thread GitBox
aajisaka merged pull request #2018: URL: https://github.com/apache/hadoop/pull/2018 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka commented on pull request #2018: HDFS-15353. use sudo instead of su to allow nologin user for secure DataNode

2020-05-20 Thread GitBox
aajisaka commented on pull request #2018: URL: https://github.com/apache/hadoop/pull/2018#issuecomment-631818015 +1, thank you @2k0ri This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2013: [DO NOT MERGE] Testing HADOOP-16888

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #2013: URL: https://github.com/apache/hadoop/pull/2013#issuecomment-631810587 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] jojochuang commented on pull request #1885: HDFS-13639. SlotReleaser is not fast enough

2020-05-20 Thread GitBox
jojochuang commented on pull request #1885: URL: https://github.com/apache/hadoop/pull/1885#issuecomment-631732535 +1 failed tests are unrelated and are being tracked in other jiras. This is an automated message from the

[GitHub] [hadoop] hadoop-yetus commented on pull request #1885: HDFS-13639. SlotReleaser is not fast enough

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #1885: URL: https://github.com/apache/hadoop/pull/1885#issuecomment-631703136 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17004) ABFS: Improve the ABFS driver documentation

2020-05-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112545#comment-17112545 ] Hudson commented on HADOOP-17004: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18282 (See

[GitHub] [hadoop] DadanielZ merged pull request #2030: HADOOP-17004. ABFS: Fixing a formatting issue

2020-05-20 Thread GitBox
DadanielZ merged pull request #2030: URL: https://github.com/apache/hadoop/pull/2030 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] jojochuang commented on pull request #1885: HDFS-13639. SlotReleaser is not fast enough

2020-05-20 Thread GitBox
jojochuang commented on pull request #1885: URL: https://github.com/apache/hadoop/pull/1885#issuecomment-631622123 The last precommit timed out. I triggered a rebuild let's see if it goes through this time. This is an

[GitHub] [hadoop] hadoop-yetus commented on pull request #1982: HADOOP-16830. IOStatistics API.

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #1982: URL: https://github.com/apache/hadoop/pull/1982#issuecomment-631616268 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17003) No Log compression and retention in Hadoop

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112446#comment-17112446 ] Hadoop QA commented on HADOOP-17003: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-05-20 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112442#comment-17112442 ] Mingliang Liu commented on HADOOP-17047: [~aajisaka] Given that is a bigger subject than this

[jira] [Updated] (HADOOP-17003) No Log compression and retention in Hadoop

2020-05-20 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HADOOP-17003: --- Attachment: HADOOP-17003.005.patch > No Log compression and retention in Hadoop >

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112170#comment-17112170 ] Andrew Olson commented on HADOOP-16900: --- Thanks for fixing this, [~ste...@apache.org] > Very

[jira] [Commented] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112168#comment-17112168 ] Hudson commented on HADOOP-16900: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18280 (See

[jira] [Updated] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16900: -- Description: If a written file size exceeds 10,000 * {{fs.s3a.multipart.size}}, a corrupt

[jira] [Resolved] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16900. - Fix Version/s: 3.4.0 Resolution: Fixed in trunk; rebuilding and retesting

[GitHub] [hadoop] steveloughran commented on pull request #1944: HADOOP-16900. Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread GitBox
steveloughran commented on pull request #1944: URL: https://github.com/apache/hadoop/pull/1944#issuecomment-631450325 merged in. thanks for your work @mukund-thakur This is an automated message from the Apache Git Service.

[GitHub] [hadoop] steveloughran closed pull request #1987: Hadoop 16900 Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread GitBox
steveloughran closed pull request #1987: URL: https://github.com/apache/hadoop/pull/1987 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] steveloughran closed pull request #1944: HADOOP-16900. Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread GitBox
steveloughran closed pull request #1944: URL: https://github.com/apache/hadoop/pull/1944 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Assigned] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-05-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16900: --- Assignee: Mukund Thakur (was: Steve Loughran) > Very large files can be

[GitHub] [hadoop] steveloughran commented on a change in pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-05-20 Thread GitBox
steveloughran commented on a change in pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#discussion_r427961101 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsInstrumentation.java ## @@ -0,0 +1,286 @@ +/** + * Licensed

[GitHub] [hadoop] steveloughran commented on pull request #1991: HADOOP-17016. Adding Common Counters in ABFS

2020-05-20 Thread GitBox
steveloughran commented on pull request #1991: URL: https://github.com/apache/hadoop/pull/1991#issuecomment-631436553 > can be done in one line ?? we're ok with imports of constants; its the package/method imports that are most brittle. Just use .*

[GitHub] [hadoop] hadoop-yetus commented on pull request #2030: HADOOP-17004. ABFS: Fixing a formatting issue

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #2030: URL: https://github.com/apache/hadoop/pull/2030#issuecomment-631435576 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m

[jira] [Commented] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-05-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112122#comment-17112122 ] Steve Loughran commented on HADOOP-17050: - Two options, h2. in s3a S3A FS takes ordered list

[jira] [Created] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-05-20 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17050: --- Summary: Add support for multiple delegation tokens in S3AFilesystem Key: HADOOP-17050 URL: https://issues.apache.org/jira/browse/HADOOP-17050 Project: Hadoop Common

[GitHub] [hadoop] bilaharith opened a new pull request #2030: HADOOP-17004. ABFS: Fixing a formatting issue

2020-05-20 Thread GitBox
bilaharith opened a new pull request #2030: URL: https://github.com/apache/hadoop/pull/2030 ABFS: Fixing a formatting issue This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus commented on pull request #2025: HDFS-15322. Make NflyFS to work when ViewFsOverloadScheme's scheme and target uris schemes are same.

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #2025: URL: https://github.com/apache/hadoop/pull/2025#issuecomment-631404340 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2025: HDFS-15322. Make NflyFS to work when ViewFsOverloadScheme's scheme and target uris schemes are same.

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #2025: URL: https://github.com/apache/hadoop/pull/2025#issuecomment-631396337 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] bilaharith closed pull request #2029: HADOOP-17004 Fixing a formatting issue in documentation

2020-05-20 Thread GitBox
bilaharith closed pull request #2029: URL: https://github.com/apache/hadoop/pull/2029 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] bilaharith opened a new pull request #2029: HADOOP-17004 Fixing a formatting issue in documentation

2020-05-20 Thread GitBox
bilaharith opened a new pull request #2029: URL: https://github.com/apache/hadoop/pull/2029 Fixing a formatting issue in documentation This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2012: HADOOP-16888. [JDK11] Support JDK11 in the precommit job

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #2012: URL: https://github.com/apache/hadoop/pull/2012#issuecomment-631311325 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 22m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2012: HADOOP-16888. [JDK11] Support JDK11 in the precommit job

2020-05-20 Thread GitBox
hadoop-yetus commented on pull request #2012: URL: https://github.com/apache/hadoop/pull/2012#issuecomment-631284219 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-05-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111843#comment-17111843 ] Akira Ajisaka commented on HADOOP-17047: {quote}So for fixing it now, what is the proposal? By

[jira] [Commented] (HADOOP-17047) TODO comments exist in trunk while the related issues are already fixed.

2020-05-20 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111818#comment-17111818 ] Mingliang Liu commented on HADOOP-17047: Thanks [~aajisaka]. It seems right to me this method