[GitHub] [hadoop] hadoop-yetus commented on pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-679762667 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] 1996fanrui commented on a change in pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-24 Thread GitBox
1996fanrui commented on a change in pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#discussion_r476180506 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java ## @@ -218,6 +211,28 @@ public static

[jira] [Commented] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-24 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183735#comment-17183735 ] Pranav Bheda commented on HADOOP-17223: --- I've created a PR here - 

[jira] [Commented] (HADOOP-17169) Remove whitelist/blacklist terminology from Hadoop Common

2020-08-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183733#comment-17183733 ] Hadoop QA commented on HADOOP-17169: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] YaYun-Wang commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-24 Thread GitBox
YaYun-Wang commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r476144965 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java ## @@ -63,6

[GitHub] [hadoop] 1996fanrui commented on a change in pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-24 Thread GitBox
1996fanrui commented on a change in pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#discussion_r476140378 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java ## @@ -218,6 +211,28 @@ public static

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-24 Thread GitBox
Hexiaoqiao commented on a change in pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#discussion_r476127785 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/NetUtils.java ## @@ -218,6 +211,28 @@ public static

[GitHub] [hadoop] YaYun-Wang commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-24 Thread GitBox
YaYun-Wang commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r476125679 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ArchivalStorage.md ## @@ -27,15 +27,17 @@ The frameworks provided by Heterogeneous

[GitHub] [hadoop] hadoop-yetus commented on pull request #2242: HADOOP-17223 update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2242: URL: https://github.com/apache/hadoop/pull/2242#issuecomment-679513845 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] YaYun-Wang commented on a change in pull request #2189: HDFS-15025. Applying NVDIMM storage media to HDFS

2020-08-24 Thread GitBox
YaYun-Wang commented on a change in pull request #2189: URL: https://github.com/apache/hadoop/pull/2189#discussion_r476109273 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java ## @@ -63,6

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183695#comment-17183695 ] fanrui commented on HADOOP-17222: - Hi [~liuml07], thanks for your comment.  The case you provided may

[jira] [Created] (HADOOP-17225) Update jackson-mapper-asl-1.9.13 to atlassian version to mitigate: CVE-2019-10172

2020-08-24 Thread Brahma Reddy Battula (Jira)
Brahma Reddy Battula created HADOOP-17225: - Summary: Update jackson-mapper-asl-1.9.13 to atlassian version to mitigate: CVE-2019-10172 Key: HADOOP-17225 URL:

[jira] [Commented] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183686#comment-17183686 ] Brahma Reddy Battula commented on HADOOP-17221: --- One more point as I mentioned before,

[GitHub] [hadoop] pranavbheda opened a new pull request #2242: HADOOP-17223 update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-24 Thread GitBox
pranavbheda opened a new pull request #2242: URL: https://github.com/apache/hadoop/pull/2242 Update the dependencies for org.apache.httpcomponent - org.apache.httpcomponents:httpclient from 4.5.6 to 4.5.12 - org.apache.httpcomponents:httpcore from 4.4.10 to 4.4.13

[jira] [Comment Edited] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183675#comment-17183675 ] Brahma Reddy Battula edited comment on HADOOP-17221 at 8/25/20, 2:13 AM:

[GitHub] [hadoop] hadoop-yetus commented on pull request #2197: HADOOP-17159 Ability for forceful relogin in UserGroupInformation class

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2197: URL: https://github.com/apache/hadoop/pull/2197#issuecomment-679460677 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 26m

[jira] [Comment Edited] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183675#comment-17183675 ] Brahma Reddy Battula edited comment on HADOOP-17221 at 8/25/20, 2:09 AM:

[jira] [Commented] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183675#comment-17183675 ] Brahma Reddy Battula commented on HADOOP-17221: --- [~kihwal] thanks for taking a look.  

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-24 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Attachment: HADOOP-17223.001.patch > update org.apache.httpcomponents:httpclient to 4.5.12

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

2020-08-24 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Summary: update org.apache.httpcomponents:httpclient to 4.5.12 and httpcore to 4.4.13

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12

2020-08-24 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Description: Update the dependencies * org.apache.httpcomponents:httpclient from 4.5.6 to

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12

2020-08-24 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Attachment: (was: HADOOP-17223.001.patch) > update org.apache.httpcomponents:httpclient

[jira] [Updated] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12

2020-08-24 Thread Pranav Bheda (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Bheda updated HADOOP-17223: -- Attachment: HADOOP-17223.001.patch > update org.apache.httpcomponents:httpclient to 4.5.12

[jira] [Created] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-08-24 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HADOOP-17224: - Summary: Install Intel ISA-L library in Dockerfile Key: HADOOP-17224 URL: https://issues.apache.org/jira/browse/HADOOP-17224 Project: Hadoop Common

[jira] [Created] (HADOOP-17223) update org.apache.httpcomponents:httpclient to 4.5.12

2020-08-24 Thread Pranav Bheda (Jira)
Pranav Bheda created HADOOP-17223: - Summary: update org.apache.httpcomponents:httpclient to 4.5.12 Key: HADOOP-17223 URL: https://issues.apache.org/jira/browse/HADOOP-17223 Project: Hadoop Common

[jira] [Commented] (HADOOP-17169) Remove whitelist/blacklist terminology from Hadoop Common

2020-08-24 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183644#comment-17183644 ] Eric Badger commented on HADOOP-17169: -- Attaching patch 002 to address checkstyle issues > Remove

[jira] [Updated] (HADOOP-17169) Remove whitelist/blacklist terminology from Hadoop Common

2020-08-24 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HADOOP-17169: - Attachment: HADOOP-17169.002.patch > Remove whitelist/blacklist terminology from Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-679405675 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 20m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-679401904 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 10m

[jira] [Commented] (HADOOP-17214) Allow file system caching to be disabled for all file systems

2020-08-24 Thread Haibo Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183617#comment-17183617 ] Haibo Chen commented on HADOOP-17214: - The caching inside FileSystem is based on a vanilla HashMap,

[GitHub] [hadoop] hadoop-yetus commented on pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-679386091 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183606#comment-17183606 ] Mingliang Liu commented on HADOOP-17222: Hi [~fanrui] The performance improvement seems

[jira] [Commented] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183582#comment-17183582 ] Kihwal Lee commented on HADOOP-17221: - I know some security scanners recommend the Atlassian

[GitHub] [hadoop] steveloughran commented on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-24 Thread GitBox
steveloughran commented on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-679341364 tested: S3A london; latest branch is happy for all except those DDB tests which expect throttling/don't expect a DDB capacity of 0.

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-677705568 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2210: HADOOP-17199. S3A Directory Marker backport to branch-3.2

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2210: URL: https://github.com/apache/hadoop/pull/2210#issuecomment-671627545 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-679325618 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17158) Intermittent test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-08-24 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183556#comment-17183556 ] Mehakmeet Singh commented on HADOOP-17158: -- Thanks for checking, since it never fails for me,

[GitHub] [hadoop] smengcl commented on pull request #2220: HDFS-15525. Make trash root inside each snapshottable directory for WebHDFS

2020-08-24 Thread GitBox
smengcl commented on pull request #2220: URL: https://github.com/apache/hadoop/pull/2220#issuecomment-679311037 Thank you @iwasakims for reviewing and merging this! This is an automated message from the Apache Git Service.

[jira] [Commented] (HADOOP-17158) Intermittent test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-08-24 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183550#comment-17183550 ] Bilahari T H commented on HADOOP-17158: --- I will try that. But shouldn't we expect an outcome in

[GitHub] [hadoop] bilaharith commented on pull request #2179: HADOOP-17166. ABFS: making max concurrent requests and max requests that can be que…

2020-08-24 Thread GitBox
bilaharith commented on pull request #2179: URL: https://github.com/apache/hadoop/pull/2179#issuecomment-679307318 > Prefer you use the strategy outlined in HADOOP-17195. Rather than pool settings for each output stream, the store has a single shared pool with semaphores to limit #of

[GitHub] [hadoop] DadanielZ merged pull request #2213: HADOOP-16915. ABFS: Ignoring the test ITestAzureBlobFileSystemRandomRead.testRandomReadPerformance

2020-08-24 Thread GitBox
DadanielZ merged pull request #2213: URL: https://github.com/apache/hadoop/pull/2213 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183506#comment-17183506 ] fanrui commented on HADOOP-17222: - [https://github.com/apache/hadoop/pull/2241] Don't know why there

[GitHub] [hadoop] vivekratnavel commented on pull request #2230: HDFS-15531. Namenode UI: List snapshots in separate table for each snapshottable directory

2020-08-24 Thread GitBox
vivekratnavel commented on pull request #2230: URL: https://github.com/apache/hadoop/pull/2230#issuecomment-679275543 @bshashikant @mukul1987 Can you please review this change? This is an automated message from the Apache

[GitHub] [hadoop] 1996fanrui opened a new pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-08-24 Thread GitBox
1996fanrui opened a new pull request #2241: URL: https://github.com/apache/hadoop/pull/2241 https://issues.apache.org/jira/browse/HADOOP-17222 Create socket address combined with cache to speed up hdfs client choose DataNode

[jira] [Work started] (HADOOP-17199) Backport HADOOP-13230 list/getFileStatus changes for preserved directory markers

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17199 started by Steve Loughran. --- > Backport HADOOP-13230 list/getFileStatus changes for preserved

[jira] [Updated] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated HADOOP-17222: Description: Note:Not only the hdfs client can get the current benefit, all callers of

[jira] [Updated] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated HADOOP-17222: Description: Hdfs client selects best DN for hdfs Block. method call stack:

[jira] [Updated] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated HADOOP-17222: Description: Hdfs client selects best DN for hdfs Block. method call stack:

[jira] [Updated] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fanrui updated HADOOP-17222: Attachment: Before optimization.svg After optimization.svg > Create socket address

[jira] [Created] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-08-24 Thread fanrui (Jira)
fanrui created HADOOP-17222: --- Summary: Create socket address combined with cache to speed up hdfs client choose DataNode Key: HADOOP-17222 URL: https://issues.apache.org/jira/browse/HADOOP-17222 Project:

[jira] [Commented] (HADOOP-13230) S3A to optionally retain directory markers

2020-08-24 Thread Steve Jacobs (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183476#comment-17183476 ] Steve Jacobs commented on HADOOP-13230: --- Oh and as a follow up. The reason for the call in the

[jira] [Commented] (HADOOP-13230) S3A to optionally retain directory markers

2020-08-24 Thread Steve Jacobs (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183473#comment-17183473 ] Steve Jacobs commented on HADOOP-13230: --- Catching up on this as it's been a while. Compatibility

[jira] [Commented] (HADOOP-17190) Intermittent ITestTerasortOnS3A.test_120_terasort failure

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183452#comment-17183452 ] Steve Loughran commented on HADOOP-17190: - I've looked more and can see the problem: clock skew

[jira] [Updated] (HADOOP-17190) ITestTerasortOnS3A.test_120_terasort failing

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17190: Priority: Minor (was: Major) > ITestTerasortOnS3A.test_120_terasort failing >

[jira] [Updated] (HADOOP-17190) Intermittent ITestTerasortOnS3A.test_120_terasort failure

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17190: Summary: Intermittent ITestTerasortOnS3A.test_120_terasort failure (was:

[jira] [Comment Edited] (HADOOP-13230) S3A to optionally retain directory markers

2020-08-24 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183420#comment-17183420 ] Ivan Sadikov edited comment on HADOOP-13230 at 8/24/20, 4:25 PM: -

[jira] [Comment Edited] (HADOOP-13230) S3A to optionally retain directory markers

2020-08-24 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183420#comment-17183420 ] Ivan Sadikov edited comment on HADOOP-13230 at 8/24/20, 4:24 PM: -

[jira] [Commented] (HADOOP-13230) S3A to optionally retain directory markers

2020-08-24 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183420#comment-17183420 ] Ivan Sadikov commented on HADOOP-13230: --- [~ste...@apache.org] [~steveatbat] Could you explain why

[GitHub] [hadoop] jiwq commented on pull request #2223: YARN-10398. Fix the bug to make sure only application master upload resource to Yarn Shared Cache

2020-08-24 Thread GitBox
jiwq commented on pull request #2223: URL: https://github.com/apache/hadoop/pull/2223#issuecomment-679207182 > @jiwq I double checked and confirmed the PR is the fix for the problem. The reason why the non-application master tries to upload is that the clear cache code didn't work. The

[GitHub] [hadoop] hadoop-yetus commented on pull request #2235: HDFS-15484. Add new method batchRename for DistributedFileSystem and W…

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2235: URL: https://github.com/apache/hadoop/pull/2235#issuecomment-679201173 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] tasanuma commented on a change in pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-08-24 Thread GitBox
tasanuma commented on a change in pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#discussion_r475681222 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/DecayRpcScheduler.java ## @@ -483,6 +501,12 @@ private void

[jira] [Commented] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183339#comment-17183339 ] Hadoop QA commented on HADOOP-17221: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-08-24 Thread GitBox
Hexiaoqiao commented on a change in pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#discussion_r475635387 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/DecayRpcScheduler.java ## @@ -483,6 +501,12 @@ private void

[jira] [Updated] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-08-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-17165: -- Issue Type: New Feature (was: Improvement) > Implement service-user feature in

[GitHub] [hadoop] tasanuma commented on pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-08-24 Thread GitBox
tasanuma commented on pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#issuecomment-679142181 The failed test succeeded in my local computer. This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-17220) Upgrade slf4j to 1.7.30 ( To Address: CVE-2018-8088)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17220: -- Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed

[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #2182: HDFS-15505. Fix NullPointerException when call getAdditionalDatanode method with null extendedBlock parameter

2020-08-24 Thread GitBox
Hexiaoqiao commented on a change in pull request #2182: URL: https://github.com/apache/hadoop/pull/2182#discussion_r475613128 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientNamenodeProtocolTranslatorPB.java ## @@

[GitHub] [hadoop] Hexiaoqiao commented on pull request #2112: HDFS-15448.When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-08-24 Thread GitBox
Hexiaoqiao commented on pull request #2112: URL: https://github.com/apache/hadoop/pull/2112#issuecomment-679129657 merge trunk already. ref: https://issues.apache.org/jira/browse/HDFS-15448 close this PR. This is an

[GitHub] [hadoop] Hexiaoqiao closed pull request #2112: HDFS-15448.When starting a DataNode, call BlockPoolManager#startAll() twice.

2020-08-24 Thread GitBox
Hexiaoqiao closed pull request #2112: URL: https://github.com/apache/hadoop/pull/2112 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] hadoop-yetus commented on pull request #2207: HADOOP-17074 Optimise s3a Listing to be fully asynchronous.

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2207: URL: https://github.com/apache/hadoop/pull/2207#issuecomment-679127524 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Updated] (HADOOP-17220) Upgrade slf4j to 1.7.30 ( To Address: CVE-2018-8088)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17220: -- Summary: Upgrade slf4j to 1.7.30 ( To Address: CVE-2018-8088) (was: Upgrade

[jira] [Updated] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Address: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17221: -- Summary: update log4j-1.2.17 to atlassian version( To Address:

[jira] [Comment Edited] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183270#comment-17183270 ] Brahma Reddy Battula edited comment on HADOOP-17221 at 8/24/20, 1:23 PM:

[jira] [Updated] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17221: -- Status: Patch Available (was: Open) > update log4j-1.2.17 to atlassian

[jira] [Updated] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17221: -- Attachment: HADOOP-17221-001.patch > update log4j-1.2.17 to atlassian

[jira] [Commented] (HADOOP-17221) Upgrade log4j-1.2.17 to atlassian ( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183270#comment-17183270 ] Brahma Reddy Battula commented on HADOOP-17221: --- Any thoughts on this..? > Upgrade

[jira] [Assigned] (HADOOP-17221) Upgrade log4j-1.2.17 to atlassian ( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HADOOP-17221: - Assignee: Brahma Reddy Battula > Upgrade log4j-1.2.17 to atlassian (

[jira] [Updated] (HADOOP-17221) update log4j-1.2.17 to atlassian version( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17221: -- Summary: update log4j-1.2.17 to atlassian version( To Adress:

[jira] [Created] (HADOOP-17221) Upgrade log4j-1.2.17 to atlassian ( To Adress: CVE-2019-17571)

2020-08-24 Thread Brahma Reddy Battula (Jira)
Brahma Reddy Battula created HADOOP-17221: - Summary: Upgrade log4j-1.2.17 to atlassian ( To Adress: CVE-2019-17571) Key: HADOOP-17221 URL: https://issues.apache.org/jira/browse/HADOOP-17221

[GitHub] [hadoop] hadoop-yetus commented on pull request #2216: HADOOP-17194. Adding Context class for AbfsClient in ABFS

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2216: URL: https://github.com/apache/hadoop/pull/2216#issuecomment-679118455 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] steveloughran commented on pull request #1896: HADOOP-16925 MetricsConfig incorrectly loads the configuration whose value is String list in the properties file

2020-08-24 Thread GitBox
steveloughran commented on pull request #1896: URL: https://github.com/apache/hadoop/pull/1896#issuecomment-679116152 +1, merged to 3.2, 3.3 and trunk branches. Thanks! This is an automated message from the Apache

[jira] [Commented] (HADOOP-16925) MetricsConfig incorrectly loads the configuration whose value is String list in the properties file

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183265#comment-17183265 ] Steve Loughran commented on HADOOP-16925: - thanks, committed to the 3.2 and 3.3 branches! >

[jira] [Assigned] (HADOOP-16925) MetricsConfig incorrectly loads the configuration whose value is String list in the properties file

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16925: --- Assignee: Jiayi Liu > MetricsConfig incorrectly loads the configuration whose

[jira] [Resolved] (HADOOP-16925) MetricsConfig incorrectly loads the configuration whose value is String list in the properties file

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16925. - Fix Version/s: 3.3.1 3.2.2 Resolution: Fixed > MetricsConfig

[jira] [Commented] (HADOOP-17130) Configuration.getValByRegex() shouldn't update the results while fetching.

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183259#comment-17183259 ] Steve Loughran commented on HADOOP-17130: - oops, didn't push up my 3.2 patch. fixed >

[GitHub] [hadoop] steveloughran merged pull request #1896: HADOOP-16925 MetricsConfig incorrectly loads the configuration whose value is String list in the properties file

2020-08-24 Thread GitBox
steveloughran merged pull request #1896: URL: https://github.com/apache/hadoop/pull/1896 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HADOOP-17220) Upgrade slf4j to 1.7.30 ( To Adress: CVE-2018-8088)

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183244#comment-17183244 ] Steve Loughran commented on HADOOP-17220: - LGTM, +1. I'll leave you to commit at your leisure

[GitHub] [hadoop] hadoop-yetus commented on pull request #2235: HDFS-15484. Add new method batchRename for DistributedFileSystem and W…

2020-08-24 Thread GitBox
hadoop-yetus commented on pull request #2235: URL: https://github.com/apache/hadoop/pull/2235#issuecomment-679105788 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] steveloughran commented on pull request #2207: HADOOP-17074 Optimise s3a Listing to be fully asynchronous.

2020-08-24 Thread GitBox
steveloughran commented on pull request #2207: URL: https://github.com/apache/hadoop/pull/2207#issuecomment-679102653 ...LGTM, let's see what Yetus says This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] steveloughran commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
steveloughran commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-679102282 ok...labelled as WiP. Thanks for the docs, makes it a lot clearer This is an automated message from the

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-678820333 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-675409763 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-671854060 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-678474705 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-670979099 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
hadoop-yetus removed a comment on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-670609097 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Commented] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2020-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183208#comment-17183208 ] Steve Loughran commented on HADOOP-17195: - yeah, I'm in favour of having a single thread pool

[GitHub] [hadoop] bilaharith commented on pull request #2202: HADOOP-17191. ABFS: Run tests with all AuthTypes

2020-08-24 Thread GitBox
bilaharith commented on pull request #2202: URL: https://github.com/apache/hadoop/pull/2202#issuecomment-679095848 > This is a big change to the test set up. > > My ability to review this is hampered by the fact there is no explanation in the JIRA or PR as to what it is directly

[jira] [Updated] (HADOOP-17209) Erasure Coding: Native library memory leak

2020-08-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17209: --- Resolution: Fixed Status: Resolved (was: Patch Available) Commited to

  1   2   >