[jira] [Commented] (HADOOP-17998) Enable get command run with multi-thread

2021-11-08 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440891#comment-17440891 ] Chengwei Wang commented on HADOOP-17998: Submit path v001 [^HADOOP-17998.001.patch] > Enable

[jira] [Updated] (HADOOP-17998) Enable get command run with multi-thread

2021-11-08 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HADOOP-17998: --- Attachment: HADOOP-17998.001.patch > Enable get command run with multi-thread >

[jira] [Updated] (HADOOP-17998) Enable get command run with multi-thread

2021-11-08 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HADOOP-17998: --- Summary: Enable get command run with multi-thread (was: Enable get command run with

[jira] [Updated] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17997: Labels: pull-request-available (was: ) > RBF: Namespace usage of mount table with multi

[jira] [Work logged] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?focusedWorklogId=678886=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678886 ] ASF GitHub Bot logged work on HADOOP-17997: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xicm opened a new pull request #3634: HADOOP-17997. RBF: Namespace usage of mount table with multi subclust…

2021-11-08 Thread GitBox
xicm opened a new pull request #3634: URL: https://github.com/apache/hadoop/pull/3634 …ers can exceed quota ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding

[jira] [Created] (HADOOP-17998) Enable get command run with multi-thread.

2021-11-08 Thread Chengwei Wang (Jira)
Chengwei Wang created HADOOP-17998: -- Summary: Enable get command run with multi-thread. Key: HADOOP-17998 URL: https://issues.apache.org/jira/browse/HADOOP-17998 Project: Hadoop Common

[jira] [Updated] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-08 Thread xichaomin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xichaomin updated HADOOP-17997: --- Description: # mkdir on each subcluster /test10 # mount table: hdfs dfsrouteradmin -add /test10

[jira] [Updated] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-08 Thread xichaomin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xichaomin updated HADOOP-17997: --- Attachment: 1636424307319.jpg > RBF: Namespace usage of mount table with multi subclusters can

[jira] [Created] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-08 Thread xichaomin (Jira)
xichaomin created HADOOP-17997: -- Summary: RBF: Namespace usage of mount table with multi subclusters can exceed quota Key: HADOOP-17997 URL: https://issues.apache.org/jira/browse/HADOOP-17997 Project:

[GitHub] [hadoop] manuzhang commented on pull request #3628: YARN-11001. Add docs on removing node-to-labels mapping

2021-11-08 Thread GitBox
manuzhang commented on pull request #3628: URL: https://github.com/apache/hadoop/pull/3628#issuecomment-963754004 @szilard-nemeth could you help review this PR ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] jianghuazhu commented on pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-08 Thread GitBox
jianghuazhu commented on pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#issuecomment-963746132 It looks like jenkins failed, there are some exceptions. E.g: TestWebHdfsFileSystemContract TestMover TestDataNodeUUID TestAddOverReplicatedStripedBlocks

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=678811=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678811 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-963644661 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17006) Fix the CosCrendentials Provider in core-site.xml for unit tests.

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440764#comment-17440764 ] Chao Sun commented on HADOOP-17006: --- Hey [~yuyang733], any update on this? do you have a ETA? > Fix

[jira] [Updated] (HADOOP-16752) ABFS: test failure testLastModifiedTime()

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-16752: -- Target Version/s: 3.3.3 (was: 3.3.2) > ABFS: test failure testLastModifiedTime() >

[jira] [Updated] (HADOOP-16955) Umbrella Jira for improving the Hadoop-cos support in Hadoop

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-16955: -- Target Version/s: 3.3.3 (was: 3.3.2) > Umbrella Jira for improving the Hadoop-cos support in Hadoop

[jira] [Updated] (HADOOP-16968) Optimizing the upload buffer in Hadoop-cos

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-16968: -- Target Version/s: 3.3.3 (was: 3.3.2) > Optimizing the upload buffer in Hadoop-cos >

[jira] [Commented] (HADOOP-16963) HADOOP-16582 changed mkdirs() behavior

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440763#comment-17440763 ] Chao Sun commented on HADOOP-16963: --- Hey [~weichiu], what's the status of this JIRA? I'm currently

[jira] [Updated] (HADOOP-16970) Supporting the new credentials provider in Hadoop-cos

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-16970: -- Target Version/s: 3.3.3 (was: 3.3.2) > Supporting the new credentials provider in Hadoop-cos >

[jira] [Updated] (HADOOP-17063) S3A deleteObjects hanging/retrying forever

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17063: -- Target Version/s: 3.3.3 (was: 3.3.2) > S3A deleteObjects hanging/retrying forever >

[jira] [Updated] (HADOOP-17583) Enable shelldoc check in GitHub PR

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17583: -- Target Version/s: 3.4.0, 3.2.4, 3.3.3 (was: 3.4.0, 3.3.2, 3.2.4) > Enable shelldoc check in GitHub

[jira] [Updated] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17682: -- Target Version/s: 3.3.3 (was: 3.3.2) > ABFS: Support FileStatus input to OpenFileWithOptions() via

[jira] [Updated] (HADOOP-17446) Print the thread parker and lock information in stacks page

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17446: -- Target Version/s: 3.4.0, 3.2.4, 3.3.3 (was: 3.4.0, 3.3.2, 3.2.4) > Print the thread parker and lock

[jira] [Updated] (HADOOP-17500) S3A doesn't calculate Content-MD5 on uploads

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17500: -- Target Version/s: 3.3.3 (was: 3.3.2) > S3A doesn't calculate Content-MD5 on uploads >

[jira] [Updated] (HADOOP-17543) HDFS Put was failed with IPV6 cluster

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17543: -- Target Version/s: 3.3.3 (was: 3.3.2) > HDFS Put was failed with IPV6 cluster >

[jira] [Updated] (HADOOP-17669) Port HADOOP-17079, HADOOP-17505 to branch-3.3

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17669: -- Target Version/s: 3.3.3 (was: 3.3.2) > Port HADOOP-17079, HADOOP-17505 to branch-3.3 >

[jira] [Updated] (HADOOP-17673) IOStatistics API in branch-3.3 break compatibility

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17673: -- Target Version/s: 3.3.3 (was: 3.3.2) > IOStatistics API in branch-3.3 break compatibility >

[jira] [Updated] (HADOOP-17717) Update wildfly openssl to 1.1.3.Final

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17717: -- Target Version/s: 3.3.3 (was: 3.3.2) > Update wildfly openssl to 1.1.3.Final >

[jira] [Updated] (HADOOP-17915) ABFS AbfsDelegationTokenManager to generate canonicalServiceName if DT plugin doesn't

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17915: -- Target Version/s: 3.3.3 (was: 3.3.2) > ABFS AbfsDelegationTokenManager to generate

[jira] [Updated] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17928: -- Target Version/s: 3.3.3 (was: 3.3.2) > s3a: set fs.s3a.downgrade.syncable.exceptions = true by

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=678748=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678748 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-963573593 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3632: YARN-10822. Containers going from New to Scheduled transition for kil…

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3632: URL: https://github.com/apache/hadoop/pull/3632#issuecomment-963527914 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=678677=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678677 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#issuecomment-963483638 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=678666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678666 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-963471894 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3631: HDFS-16307. Improve HdfsBlockPlacementPolicies docs readability

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3631: URL: https://github.com/apache/hadoop/pull/3631#issuecomment-963468683 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=678656=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678656 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread GitBox
steveloughran commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-963462053 + @mukund-thakur @mehakmeet @snvijaya new tests happy; regression tests in progress. note this also moves abfs listFiles and listLocatedStatus API calls into

[jira] [Updated] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17979: Labels: pull-request-available (was: ) > Interface EtagSource to allow FileStatus

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=678655=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678655 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-08 Thread GitBox
steveloughran opened a new pull request #3633: URL: https://github.com/apache/hadoop/pull/3633 * Pull out from HADOOP-17981/#3611 * Add S3A support * Add requirement that located status API calls MUST also support the API, and do this for ABFS. s3a code retains now

[GitHub] [hadoop] goiri merged pull request #3631: HDFS-16307. Improve HdfsBlockPlacementPolicies docs readability

2021-11-08 Thread GitBox
goiri merged pull request #3631: URL: https://github.com/apache/hadoop/pull/3631 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] minni31 opened a new pull request #3632: YARN-10822. Containers going from New to Scheduled transition for kil…

2021-11-08 Thread GitBox
minni31 opened a new pull request #3632: URL: https://github.com/apache/hadoop/pull/3632 …led container on recovery ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=678641=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678641 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-963418250 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] GuoPhilipse commented on pull request #3631: HDFS-16307. improve docs readability

2021-11-08 Thread GitBox
GuoPhilipse commented on pull request #3631: URL: https://github.com/apache/hadoop/pull/3631#issuecomment-963407262 > @GuoPhilipse thanks for the work. Can you link it with a JIRA? Thanks @goiri ,have just updated -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] goiri commented on pull request #3631: improve docs readability

2021-11-08 Thread GitBox
goiri commented on pull request #3631: URL: https://github.com/apache/hadoop/pull/3631#issuecomment-963402778 @GuoPhilipse thanks for the work. Can you link it with a JIRA? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] GuoPhilipse opened a new pull request #3631: imrove docs readability

2021-11-08 Thread GitBox
GuoPhilipse opened a new pull request #3631: URL: https://github.com/apache/hadoop/pull/3631 imrove docs readability -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Updated] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-08 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-17996: --- Description: UserGroupInformation#unprotectedRelogin sets the last login time before

[jira] [Created] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-08 Thread Prabhu Joseph (Jira)
Prabhu Joseph created HADOOP-17996: -- Summary: UserGroupInformation#unprotectedRelogin sets the last login time before logging in Key: HADOOP-17996 URL: https://issues.apache.org/jira/browse/HADOOP-17996

[GitHub] [hadoop] goiri merged pull request #3625: HDFS-16304. Locate OpenSSL libs for libhdfspp

2021-11-08 Thread GitBox
goiri merged pull request #3625: URL: https://github.com/apache/hadoop/pull/3625 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] GauthamBanasandra edited a comment on pull request #3625: HDFS-16304. Locate OpenSSL libs for libhdfspp

2021-11-08 Thread GitBox
GauthamBanasandra edited a comment on pull request #3625: URL: https://github.com/apache/hadoop/pull/3625#issuecomment-963348257 > Is the build currently breaking for all PRs without this change? @sodonnel yes, please see the JIRA of this PR for more details. > We are getting

[GitHub] [hadoop] GauthamBanasandra commented on pull request #3625: HDFS-16304. Locate OpenSSL libs for libhdfspp

2021-11-08 Thread GitBox
GauthamBanasandra commented on pull request #3625: URL: https://github.com/apache/hadoop/pull/3625#issuecomment-963348257 > Is the build currently breaking for all PRs without this change? @sodonnel yes, please see the JIRA of this PR for more details. > We are getting native

[jira] [Work logged] (HADOOP-17990) Failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled on hadoop-azure ABFS

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17990?focusedWorklogId=678584=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678584 ] ASF GitHub Bot logged work on HADOOP-17990: --- Author: ASF GitHub Bot

[GitHub] [hadoop] majdyz commented on pull request #3620: HADOOP-17990. Fix failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled.

2021-11-08 Thread GitBox
majdyz commented on pull request #3620: URL: https://github.com/apache/hadoop/pull/3620#issuecomment-963312509 I saw this compilation error coming from Yetus, is this expected? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] sodonnel commented on pull request #3625: HDFS-16304. Locate OpenSSL libs for libhdfspp

2021-11-08 Thread GitBox
sodonnel commented on pull request #3625: URL: https://github.com/apache/hadoop/pull/3625#issuecomment-963309508 Is the build currently breaking for all PRs without this change? We are getting native compile issues on #3579 too. Seems this fix may be related. The last CI run is

[jira] [Work logged] (HADOOP-17990) Failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled on hadoop-azure ABFS

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17990?focusedWorklogId=678573=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678573 ] ASF GitHub Bot logged work on HADOOP-17990: --- Author: ASF GitHub Bot

[GitHub] [hadoop] majdyz commented on pull request #3620: HADOOP-17990. Fix failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled.

2021-11-08 Thread GitBox
majdyz commented on pull request #3620: URL: https://github.com/apache/hadoop/pull/3620#issuecomment-963299887 Thanks for the review, I have addressed the commets. 1. The annotation used in AzureBlobFileSystem is

[jira] [Commented] (HADOOP-17691) Abfs directory delete times out on large directory tree w/ Oauth: OperationTimedOut

2021-11-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440564#comment-17440564 ] Steve Loughran commented on HADOOP-17691: - happens with oauth as it does permissions checks.

[jira] [Updated] (HADOOP-17691) Abfs directory delete times out on large directory tree w/ Oauth: OperationTimedOut

2021-11-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17691: Summary: Abfs directory delete times out on large directory tree w/ Oauth:

[jira] [Work logged] (HADOOP-17990) Failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled on hadoop-azure ABFS

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17990?focusedWorklogId=678549=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678549 ] ASF GitHub Bot logged work on HADOOP-17990: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3620: HADOOP-17990. Fix failing concurrent FS.initialize commands when fs.azure.createRemoteFileSystemDuringInitialization is enabled.

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3620: URL: https://github.com/apache/hadoop/pull/3620#issuecomment-963269058 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=678548=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678548 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-963267230 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#issuecomment-963132135 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=678451=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678451 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-08 Thread GitBox
steveloughran commented on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-963120046 thanks, updated javadocs. bear in mind this is not going to be merged in as is; once the review is in I plan to * isolate the etag changes into their own pr & add

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17995: Labels: pull-request-available (was: ) > Stale record should be remove when >

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=678447=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678447 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] haiyang1987 opened a new pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread GitBox
haiyang1987 opened a new pull request #3630: URL: https://github.com/apache/hadoop/pull/3630 **Description of PR** As HADOOP-16947 problem with description. Stale SumAndCount also should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson. Ensure the DataNode

[GitHub] [hadoop] mariosmeim-db commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-08 Thread GitBox
mariosmeim-db commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r744679833 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -906,6 +907,36 @@ public

[jira] [Commented] (HADOOP-17880) Build Hadoop on Centos 7

2021-11-08 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440425#comment-17440425 ] Gautham Banasandra commented on HADOOP-17880: - Thanks for the PR [~baizhendong]. I've

[jira] [Resolved] (HADOOP-17880) Build Hadoop on Centos 7

2021-11-08 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautham Banasandra resolved HADOOP-17880. - Fix Version/s: 2.10.2 Resolution: Fixed > Build Hadoop on Centos 7 >

[jira] [Work logged] (HADOOP-17880) Build Hadoop on Centos 7

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?focusedWorklogId=678439=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678439 ] ASF GitHub Bot logged work on HADOOP-17880: --- Author: ASF GitHub Bot

[GitHub] [hadoop] GauthamBanasandra merged pull request #3535: HADOOP-17880. Build Hadoop on Centos 7

2021-11-08 Thread GitBox
GauthamBanasandra merged pull request #3535: URL: https://github.com/apache/hadoop/pull/3535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HADOOP-17995: Description: As [HADOOP-16947|https://issues.apache.org/jira/browse/HADOOP-16947] problem with

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HADOOP-17995: Description: As [HADOOP-16947|https://issues.apache.org/jira/browse/HADOOP-16947] problem with

[jira] [Work logged] (HADOOP-17713) Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17713?focusedWorklogId=678432=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678432 ] ASF GitHub Bot logged work on HADOOP-17713: --- Author: ASF GitHub Bot

[GitHub] [hadoop] adoroszlai commented on pull request #3577: HADOOP-17713. Update apache/hadoop:3 docker image to 3.3.1 release

2021-11-08 Thread GitBox
adoroszlai commented on pull request #3577: URL: https://github.com/apache/hadoop/pull/3577#issuecomment-963080996 Thanks @ayushtkn and @aajisaka for the reviews. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HADOOP-17995: Description: As [HADOOP-16947|https://issues.apache.org/jira/browse/HADOOP-16947] problem with

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HADOOP-17995: Description: As [HADOOP-16947|https://issues.apache.org/jira/browse/HADOOP-16947]Problem with

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HADOOP-17995: Description: As https://issues.apache.org/jira/browse/HADOOP-16947, Problem with description,

[jira] [Updated] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu updated HADOOP-17995: Description: As https://issues.apache.org/jira/browse/HADOOP-16947 Problem with description,

[jira] [Assigned] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-08 Thread Haiyang Hu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haiyang Hu reassigned HADOOP-17995: --- Key: HADOOP-17995 (was: HDFS-16306) Assignee: (was: Haiyang Hu)

[GitHub] [hadoop] ferhui commented on a change in pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-08 Thread GitBox
ferhui commented on a change in pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#discussion_r744641344 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java ## @@ -260,17 +257,14 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-08 Thread GitBox
hadoop-yetus commented on pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#issuecomment-963013131 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=678406=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678406 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ArkenKiran commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-08 Thread GitBox
ArkenKiran commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-963008044 @ndimiduk Thanks for sharing your approach. I was able to generate the traces for hbase. I could see the hadoop components only in few paths. Please let me know the next

[jira] [Commented] (HADOOP-17991) Improve CustomTokenProviderAdapter to import VisibleForTesting

2021-11-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440339#comment-17440339 ] Steve Loughran commented on HADOOP-17991: - im chasing up getting a new PR for HADOOP-17183 with

[GitHub] [hadoop] symious commented on pull request #3625: HDFS-16304. Locate OpenSSL libs for libhdfspp

2021-11-08 Thread GitBox
symious commented on pull request #3625: URL: https://github.com/apache/hadoop/pull/3625#issuecomment-962989469 +1. The fix works fine. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Work logged] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17873?focusedWorklogId=678398=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678398 ] ASF GitHub Bot logged work on HADOOP-17873: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3341: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2021-11-08 Thread GitBox
steveloughran commented on pull request #3341: URL: https://github.com/apache/hadoop/pull/3341#issuecomment-962989351 afraid i had to revert this change as the build now insists that the @VisibleForTesting annotation refers to the hadoop one. can you create a new PR with the updated

[jira] [Work logged] (HADOOP-17982) OpensslCipher initialization error should log a WARN message

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17982?focusedWorklogId=678390=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678390 ] ASF GitHub Bot logged work on HADOOP-17982: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3599: HADOOP-17982. OpensslCipher initialization error should log a WARN message.

2021-11-08 Thread GitBox
steveloughran commented on pull request #3599: URL: https://github.com/apache/hadoop/pull/3599#issuecomment-962985062 thanks for the feedback +1 from me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-site] GauthamBanasandra commented on pull request #29: Remove hugo binary

2021-11-08 Thread GitBox
GauthamBanasandra commented on pull request #29: URL: https://github.com/apache/hadoop-site/pull/29#issuecomment-962944622 Thanks @aajisaka. I'll keep it mind next time  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=678374=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678374 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-08 Thread GitBox
mukund-thakur commented on a change in pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#discussion_r744464883 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemResilientCommit.java ## @@ -0,0 +1,294

  1   2   >