[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=622388&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622388 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mukund-thakur commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mukund-thakur commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-879636061 I setup the CSE tests with S3guard off. All good except one test failing always > [ERROR] testStatistics(org.apache.hadoop.fs.s3a.fileContext.ITestS3AFileContextStat

[jira] [Commented] (HADOOP-11890) Uber-JIRA: Hadoop should support IPv6

2021-07-13 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380303#comment-17380303 ] Brahma Reddy Battula commented on HADOOP-11890: --- [~arp] thanks... Created

[jira] [Updated] (HADOOP-17800) CLONE - Uber-JIRA: Hadoop should support IPv6

2021-07-13 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-17800: -- Description: Hadoop currently treats IPv6 as unsupported. Track related small

[jira] [Created] (HADOOP-17800) CLONE - Uber-JIRA: Hadoop should support IPv6

2021-07-13 Thread Brahma Reddy Battula (Jira)
Brahma Reddy Battula created HADOOP-17800: - Summary: CLONE - Uber-JIRA: Hadoop should support IPv6 Key: HADOOP-17800 URL: https://issues.apache.org/jira/browse/HADOOP-17800 Project: Hadoop Comm

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-13 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380265#comment-17380265 ] Arghya Saha commented on HADOOP-17789: -- [~ste...@apache.org] Let me share the deta

[jira] [Created] (HADOOP-17799) Improve the GitHub pull request template

2021-07-13 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17799: -- Summary: Improve the GitHub pull request template Key: HADOOP-17799 URL: https://issues.apache.org/jira/browse/HADOOP-17799 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-17798) Always use GitHub PR rather than JIRA to review patches

2021-07-13 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17798: -- Summary: Always use GitHub PR rather than JIRA to review patches Key: HADOOP-17798 URL: https://issues.apache.org/jira/browse/HADOOP-17798 Project: Hadoop Common

[jira] [Commented] (HADOOP-17028) ViewFS should initialize target filesystems lazily

2021-07-13 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380242#comment-17380242 ] Konstantin Shvachko commented on HADOOP-17028: -- I committed this to trunk

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=622315&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622315 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread GitBox
hadoop-yetus commented on pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#issuecomment-879494586 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=622314&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622314 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread GitBox
hadoop-yetus commented on pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#issuecomment-879494439 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=622287&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622287 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub B

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread GitBox
sumangala-patki commented on a change in pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#discussion_r669171596 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java ## @@ -669,44 +672,51 @@ public

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=622286&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622286 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub B

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread GitBox
sumangala-patki commented on a change in pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#discussion_r669171150 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/TestAbfsInputStream.java ## @@ -192,6 +198,95 @@ publ

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=622285&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622285 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub B

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread GitBox
sumangala-patki commented on a change in pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#discussion_r669170174 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -204,38 +205,51 @@ public void

[GitHub] [hadoop] hadoop-yetus commented on pull request #3201: Fgl saveloadfs

2021-07-13 Thread GitBox
hadoop-yetus commented on pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#issuecomment-879459213 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] xinglin opened a new pull request #3201: Fgl saveloadfs

2021-07-13 Thread GitBox
xinglin opened a new pull request #3201: URL: https://github.com/apache/hadoop/pull/3201 Test: We create 1 million dirs and then stop and re-start the namenode. Namenode restarts successfully. ``` xinglin@xinglin-mn1 ~/p/h/h/t/hadoop-3.4.0-SNAPSHOT (fgl-saveloadfs)> ./bin/had

[GitHub] [hadoop] LeonGao91 commented on pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-07-13 Thread GitBox
LeonGao91 commented on pull request #2639: URL: https://github.com/apache/hadoop/pull/2639#issuecomment-879431902 Thanks a lot for the review! @fengnanli -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] LeonGao91 opened a new pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-07-13 Thread GitBox
LeonGao91 opened a new pull request #2639: URL: https://github.com/apache/hadoop/pull/2639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [hadoop] fengnanli commented on pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-07-13 Thread GitBox
fengnanli commented on pull request #2639: URL: https://github.com/apache/hadoop/pull/2639#issuecomment-879411962 Merged to trunk. Thanks for the contribution @LeonGao91 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [hadoop] fengnanli merged pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-07-13 Thread GitBox
fengnanli merged pull request #2639: URL: https://github.com/apache/hadoop/pull/2639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues

[GitHub] [hadoop] fengnanli closed pull request #2639: HDFS-15785. Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes.

2021-07-13 Thread GitBox
fengnanli closed pull request #2639: URL: https://github.com/apache/hadoop/pull/2639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues

[GitHub] [hadoop] steveloughran commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
steveloughran commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r669093714 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md ## @@ -2029,3 +2029,51 @@ signer for all services. For a specific

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=622235&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622235 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3199: [Do not commit] Use exclusive src for each platform

2021-07-13 Thread GitBox
hadoop-yetus commented on pull request #3199: URL: https://github.com/apache/hadoop/pull/3199#issuecomment-879378201 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Assigned] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

2021-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17789: --- Assignee: (was: Steve Loughran) > S3 read performance with Spark with Hadoop 3

[jira] [Commented] (HADOOP-17795) Provide fallbacks for callqueue.impl and scheduler.impl

2021-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380141#comment-17380141 ] Steve Loughran commented on HADOOP-17795: - no thank you. > Provide fallbacks f

[GitHub] [hadoop] fengnanli commented on pull request #2921: HDFS-15980: Fix tests for HDFS-15754 Create packet metrics for DataNode

2021-07-13 Thread GitBox
fengnanli commented on pull request #2921: URL: https://github.com/apache/hadoop/pull/2921#issuecomment-879268264 @sunchao I will fix this one. Let's get it in. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=622087&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-622087 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on a change in pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

2021-07-13 Thread GitBox
mehakmeet commented on a change in pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#discussion_r668765888 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/CopyFromLocalOperation.java ## @@ -0,0 +1,520 @@ +/* + * Licensed to t

[GitHub] [hadoop] amahussein opened a new pull request #3200: HDFS-15160. branch-3.2. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock.

2021-07-13 Thread GitBox
amahussein opened a new pull request #3200: URL: https://github.com/apache/hadoop/pull/3200 - Backporting HDFS-15160 to branch-3.2 - First: [HDFS-15150. Introduce read write lock to Datanode. Contributed Stephen O'Donnell](https://issues.apache.org/jira/browse/HDFS-15150)

[GitHub] [hadoop] GauthamBanasandra opened a new pull request #3199: [Do not commit] Use exclusive src for each platform

2021-07-13 Thread GitBox
GauthamBanasandra opened a new pull request #3199: URL: https://github.com/apache/hadoop/pull/3199 * Need to ensure that each platform build stage runs on its own copy of the source directory. This is needed to parallellize the multi-platform build. -- This is an automa

[jira] [Commented] (HADOOP-11890) Uber-JIRA: Hadoop should support IPv6

2021-07-13 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379920#comment-17379920 ] Arpit Agarwal commented on HADOOP-11890: Agreed that 1 is better, to keep the i

[jira] [Commented] (HADOOP-17797) transient faiure of ITestAbfsListStatusRemoteIterator.testWithAbfsIteratorDisabledWithoutHasNext

2021-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379916#comment-17379916 ] Steve Loughran commented on HADOOP-17797: - Test came from HADOOP-17475; but its

[jira] [Created] (HADOOP-17797) transient faiure of ITestAbfsListStatusRemoteIterator.testWithAbfsIteratorDisabledWithoutHasNext

2021-07-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17797: --- Summary: transient faiure of ITestAbfsListStatusRemoteIterator.testWithAbfsIteratorDisabledWithoutHasNext Key: HADOOP-17797 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Updated] (HADOOP-17736) Über-JIRA: abfs phase III: Hadoop 3.4 features & fixes

2021-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17736: Summary: Über-JIRA: abfs phase III: Hadoop 3.4 features & fixes (was: Über-JIRA: abfs ph

[GitHub] [hadoop] ayushtkn merged pull request #3193: MAPREDUCE-7356. Remove few duplicate dependencies from mapreduce-client's child poms

2021-07-13 Thread GitBox
ayushtkn merged pull request #3193: URL: https://github.com/apache/hadoop/pull/3193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-

[jira] [Updated] (HADOOP-16272) Update HikariCP to 4.0.3

2021-07-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-16272: -- Summary: Update HikariCP to 4.0.3 (was: Update HikariCP to 2.5.1) > Update HikariCP to 4.0.3

[jira] [Work logged] (HADOOP-17795) Provide fallbacks for callqueue.impl and scheduler.impl

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17795?focusedWorklogId=621996&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621996 ] ASF GitHub Bot logged work on HADOOP-17795: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani commented on pull request #3192: HADOOP-17795. Provide fallback properties for callqueue.impl and scheduler.impl

2021-07-13 Thread GitBox
virajjasani commented on pull request #3192: URL: https://github.com/apache/hadoop/pull/3192#issuecomment-879092072 I have addressed comments @jojochuang @tasanuma. Please take a look when you get some time. Thanks -- This is an automated message from the Apache Git Service. To respon

[jira] [Assigned] (HADOOP-16272) Update HikariCP to 2.5.1

2021-07-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-16272: - Assignee: Viraj Jasani > Update HikariCP to 2.5.1 > > >

[jira] [Commented] (HADOOP-16272) Update HikariCP to 2.5.1

2021-07-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379882#comment-17379882 ] Viraj Jasani commented on HADOOP-16272: --- I think we can upgrade hikariCP to lates

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621994&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621994 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mehakmeet commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-879072223 > This should have been skipped rather that failed. I think I saw it a while ago too after making the change, what worked for me was a clean build from root of project ra

[jira] [Work logged] (HADOOP-16290) Enable RpcMetrics units to be configurable

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16290?focusedWorklogId=621991&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621991 ] ASF GitHub Bot logged work on HADOOP-16290: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani commented on pull request #3198: HADOOP-16290. Enable RpcMetrics units to be configurable

2021-07-13 Thread GitBox
virajjasani commented on pull request #3198: URL: https://github.com/apache/hadoop/pull/3198#issuecomment-879067402 Jenkins runs are failing recently, looks like an infra issue based on logs: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3198/1/console -- This is an automate

[jira] [Updated] (HADOOP-16290) Enable RpcMetrics units to be configurable

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-16290: Labels: pull-request-available (was: ) > Enable RpcMetrics units to be configurable > --

[jira] [Work logged] (HADOOP-16290) Enable RpcMetrics units to be configurable

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16290?focusedWorklogId=621989&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621989 ] ASF GitHub Bot logged work on HADOOP-16290: --- Author: ASF GitHub B

[GitHub] [hadoop] virajjasani opened a new pull request #3198: HADOOP-16290. Enable RpcMetrics units to be configurable

2021-07-13 Thread GitBox
virajjasani opened a new pull request #3198: URL: https://github.com/apache/hadoop/pull/3198 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commo

[jira] [Updated] (HADOOP-17795) Provide fallbacks for callqueue.impl and scheduler.impl

2021-07-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-17795: -- Status: Patch Available (was: In Progress) > Provide fallbacks for callqueue.impl and schedu

[jira] [Work started] (HADOOP-17795) Provide fallbacks for callqueue.impl and scheduler.impl

2021-07-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17795 started by Viraj Jasani. - > Provide fallbacks for callqueue.impl and scheduler.impl >

[GitHub] [hadoop] amahussein commented on pull request #3196: HDFS-15160. branch-2.10 ReplicaMap, Disk Balancer, Directory Scanner …

2021-07-13 Thread GitBox
amahussein commented on pull request #3196: URL: https://github.com/apache/hadoop/pull/3196#issuecomment-879059651 https://issues.apache.org/jira/browse/HDFS-15762 describes the same error in `hadoop.hdfs.TestMultipleNNPortQOP` -- This is an automated message from the Apache Git Serv

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621987&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621987 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mukund-thakur commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mukund-thakur commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-879058793 > Interesting you see those errors since they should be skipped if CSE is enabled, I'll try to see what's wrong. No that was without enabling CSE as said above.

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621984&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621984 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[jira] [Assigned] (HADOOP-16290) Enable RpcMetrics units to be configurable

2021-07-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-16290: - Assignee: Viraj Jasani > Enable RpcMetrics units to be configurable >

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mukund-thakur commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r668725098 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md ## @@ -2029,3 +2029,51 @@ signer for all services. For a specific

[jira] [Commented] (HADOOP-11890) Uber-JIRA: Hadoop should support IPv6

2021-07-13 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379845#comment-17379845 ] Brahma Reddy Battula commented on HADOOP-11890: --- [~arp]  thanks for your

[GitHub] [hadoop] JiaguodongF commented on pull request #3185: HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid.

2021-07-13 Thread GitBox
JiaguodongF commented on pull request #3185: URL: https://github.com/apache/hadoop/pull/3185#issuecomment-878987909 > @JiaguodongF thanks for the report , can you write an UT for this ? thank you for reviewing, I will add an UT this week. -- This is an automated message from the Ap

[GitHub] [hadoop] JiaguodongF removed a comment on pull request #3185: HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid.

2021-07-13 Thread GitBox
JiaguodongF removed a comment on pull request #3185: URL: https://github.com/apache/hadoop/pull/3185#issuecomment-878986747 > @JiaguodongF thanks for the report , can you write an UT for this ? OK ! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [hadoop] JiaguodongF commented on pull request #3185: HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid.

2021-07-13 Thread GitBox
JiaguodongF commented on pull request #3185: URL: https://github.com/apache/hadoop/pull/3185#issuecomment-878986747 > @JiaguodongF thanks for the report , can you write an UT for this ? OK ! -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [hadoop] hemanthboyina commented on pull request #3185: HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid.

2021-07-13 Thread GitBox
hemanthboyina commented on pull request #3185: URL: https://github.com/apache/hadoop/pull/3185#issuecomment-878955910 @JiaguodongF thanks for the report , can you write an UT for this ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621891&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621891 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mehakmeet commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-878934344 Interesting you see those errors since they should be skipped if CSE is enabled, I'll try to see what's wrong. -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621889&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621889 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r668593736 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/troubleshooting_s3a.md ## @@ -1682,3 +1682,105 @@ com.amazonaws.SdkClientExcept

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621885 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r668588940 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md ## @@ -2029,3 +2029,51 @@ signer for all services. For a specific serv

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621879&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621879 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mukund-thakur commented on pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mukund-thakur commented on pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#issuecomment-878924563 Ran the raw s3 tests without setting up CSE. Seeing just two failures and I think they are known issues. `[ERROR] Failures: [ERROR] ITestS3AMiscOperations.testE

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=621878&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621878 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

2021-07-13 Thread GitBox
mukund-thakur commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r668460078 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md ## @@ -2029,3 +2029,51 @@ signer for all services. For a specific

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=621849&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621849 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-13 Thread GitBox
hadoop-yetus commented on pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#issuecomment-878838024 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok