[jira] [Commented] (HADOOP-19069) Use hadoop-thirdparty 1.2.0

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815145#comment-17815145 ] ASF GitHub Bot commented on HADOOP-19069: - slfan1989 opened a new pull request, #6533: URL:

[jira] [Updated] (HADOOP-19069) Use hadoop-thirdparty 1.2.0

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19069: Labels: pull-request-available (was: ) > Use hadoop-thirdparty 1.2.0 >

[PR] HADOOP-19069. Use hadoop-thirdparty 1.2.0. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 opened a new pull request, #6533: URL: https://github.com/apache/hadoop/pull/6533 ### Description of PR JIRA: HADOOP-19069. Use hadoop-thirdparty 1.2.0. ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR

[jira] [Updated] (HADOOP-19053) Release Hadoop-Thirdparty 1.2.0

2024-02-06 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-19053: Affects Version/s: thirdparty-1.2.0 thirdparty-1.3.0 > Release

[jira] [Resolved] (HADOOP-19053) Release Hadoop-Thirdparty 1.2.0

2024-02-06 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved HADOOP-19053. - Fix Version/s: thirdparty-1.3.0 thirdparty-1.2.0 Hadoop Flags:

[jira] [Updated] (HADOOP-19053) Release Hadoop-Thirdparty 1.2.0

2024-02-06 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-19053: Component/s: hadoop-thirdparty > Release Hadoop-Thirdparty 1.2.0 >

[jira] [Updated] (HADOOP-19069) Use hadoop-thirdparty 1.2.0

2024-02-06 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-19069: Component/s: hadoop-thirdparty (was: common) > Use hadoop-thirdparty 1.2.0

[jira] [Created] (HADOOP-19069) Use hadoop-thirdparty 1.2.0

2024-02-06 Thread Shilun Fan (Jira)
Shilun Fan created HADOOP-19069: --- Summary: Use hadoop-thirdparty 1.2.0 Key: HADOOP-19069 URL: https://issues.apache.org/jira/browse/HADOOP-19069 Project: Hadoop Common Issue Type: Sub-task

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
hfutatzhanghb commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1931179669 @zhangshuyan0 Sir, thanks a lot for your valuable suggestion, Agree with you and @ZanderXu . I will try to use the trick you mentioned above to modify this PR. -- This is an

Re: [PR] HDFS-17362. RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally [hadoop]

2024-02-06 Thread via GitHub
simbadzina commented on code in PR #6510: URL: https://github.com/apache/hadoop/pull/6510#discussion_r1480692356 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RouterObserverReadProxyProvider.java: ## @@ -84,7 +84,8 @@ public

Re: [PR] HDFS-17299. Adding rack failure tolerance when creating a new file [hadoop]

2024-02-06 Thread via GitHub
shahrs87 commented on code in PR #6513: URL: https://github.com/apache/hadoop/pull/6513#discussion_r1479041865 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java: ## @@ -1607,8 +1607,11 @@ private void transfer(final DatanodeInfo

[jira] [Commented] (HADOOP-19058) [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815027#comment-17815027 ] ASF GitHub Bot commented on HADOOP-19058: - slfan1989 commented on code in PR #6531: URL:

Re: [PR] HADOOP-19058. [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6531: URL: https://github.com/apache/hadoop/pull/6531#discussion_r1480648680 ## hadoop-project/pom.xml: ## @@ -168,7 +168,18 @@ [3.3.0,) --Xmx2048m -XX:+HeapDumpOnOutOfMemoryError +-Xmx2048m

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] HADOOP-19045. CreateSession Timeout - followup [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6532: URL: https://github.com/apache/hadoop/pull/6532#issuecomment-1930771320 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19045) S3A: pass request timeouts down to sdk clients

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815011#comment-17815011 ] ASF GitHub Bot commented on HADOOP-19045: - hadoop-yetus commented on PR #6532: URL:

[jira] [Commented] (HADOOP-19045) S3A: pass request timeouts down to sdk clients

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17815010#comment-17815010 ] ASF GitHub Bot commented on HADOOP-19045: - hadoop-yetus commented on PR #6532: URL:

Re: [PR] HADOOP-19045. CreateSession Timeout - followup [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6532: URL: https://github.com/apache/hadoop/pull/6532#issuecomment-1930766133 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18830) S3A: Cut S3 Select

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814933#comment-17814933 ] ASF GitHub Bot commented on HADOOP-18830: - steveloughran commented on PR #6523: URL:

Re: [PR] HADOOP-18830. Cut S3 Select (#6144) [hadoop]

2024-02-06 Thread via GitHub
steveloughran commented on PR #6523: URL: https://github.com/apache/hadoop/pull/6523#issuecomment-1930497223 blanks: ``` hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md:898: SERVER_SIDE_ENCRYPTION_ALGORITHM); ``` javac, use of the newly deprecated

[jira] [Commented] (HADOOP-19045) S3A: pass request timeouts down to sdk clients

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814928#comment-17814928 ] ASF GitHub Bot commented on HADOOP-19045: - steveloughran commented on PR #6532: URL:

Re: [PR] HADOOP-19045. CreateSession Timeout - followup [hadoop]

2024-02-06 Thread via GitHub
steveloughran commented on PR #6532: URL: https://github.com/apache/hadoop/pull/6532#issuecomment-1930485810 testing in progress -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] HDFS-17299. Adding rack failure tolerance when creating a new file [hadoop]

2024-02-06 Thread via GitHub
shahrs87 commented on code in PR #6513: URL: https://github.com/apache/hadoop/pull/6513#discussion_r1480341310 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java: ## @@ -1618,24 +1621,33 @@ private void

Re: [PR] HDFS-17299. Adding rack failure tolerance when creating a new file [hadoop]

2024-02-06 Thread via GitHub
shahrs87 commented on code in PR #6513: URL: https://github.com/apache/hadoop/pull/6513#discussion_r1479057807 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java: ## @@ -1618,24 +1621,33 @@ private void

Re: [PR] HADOOP-18980. S3A credential provider remapping: make extensible (#6406) [hadoop]

2024-02-06 Thread via GitHub
virajjasani commented on PR #6525: URL: https://github.com/apache/hadoop/pull/6525#issuecomment-1930458897 @steveloughran this one is for branch-3.4 backport. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HADOOP-19045) S3A: pass request timeouts down to sdk clients

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814899#comment-17814899 ] ASF GitHub Bot commented on HADOOP-19045: - steveloughran opened a new pull request, #6532: URL:

[PR] HADOOP-19045. CreateSession Timeout - followup [hadoop]

2024-02-06 Thread via GitHub
steveloughran opened a new pull request, #6532: URL: https://github.com/apache/hadoop/pull/6532 Remove all declarations of fs.s3a.connection.request.timeout in - hadoop-common/src/main/resources/core-default.xml - hadoop-aws/src/test/resources/core-site.xml New test in

[jira] [Reopened] (HADOOP-19045) S3A: pass request timeouts down to sdk clients

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-19045: - this is broken because core-default.xml sets it to 0 > S3A: pass request timeouts down to

Re: [PR] HDFS-17362. RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6510: URL: https://github.com/apache/hadoop/pull/6510#issuecomment-1930035843 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19067) Allow tag passing to AWS Assume Role Credential Provider

2024-02-06 Thread Jason Martin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814857#comment-17814857 ] Jason Martin commented on HADOOP-19067: --- Thank you. I'll check on the other options suggested

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-02-06 Thread via GitHub
slfan1989 commented on code in PR #6473: URL: https://github.com/apache/hadoop/pull/6473#discussion_r1479929985 ##

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
hfutatzhanghb commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1929346985 yes, it was blocked by block command。 Replied Message | From | ***@***.***> | | Date | 02/06/2024 19:42 | | To | ***@***.***> | | Cc |

Re: [PR] HDFS-17362. RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6510: URL: https://github.com/apache/hadoop/pull/6510#issuecomment-1929344958 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
zhangshuyan0 commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1929344404 > we use default, 10 hours. Has command DNA_ACCESSKEYUPDATE not been executed for ten hours? -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
hfutatzhanghb commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-192931 we use default, 10 hours. Replied Message | From | ***@***.***> | | Date | 02/06/2024 19:20 | | To | ***@***.***> | | Cc |

Re: [PR] HDFS-17362. RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6510: URL: https://github.com/apache/hadoop/pull/6510#issuecomment-1929328194 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19067) Allow tag passing to AWS Assume Role Credential Provider

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814737#comment-17814737 ] Steve Loughran commented on HADOOP-19067: - oh, and you can plug in your own auditor

[jira] [Commented] (HADOOP-19067) Allow tag passing to AWS Assume Role Credential Provider

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814735#comment-17814735 ] Steve Loughran commented on HADOOP-19067: - audit log will take any key=value pair in the thread

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
zhangshuyan0 commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1929311426 I am a bit confused about this. How often do you update the block key? @hfutatzhanghb -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HADOOP-17461) Add thread-level IOStatistics Context

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814730#comment-17814730 ] Steve Loughran commented on HADOOP-17461: - not something we've played with. contributions

[jira] [Commented] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Antonio Murgia (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814727#comment-17814727 ] Antonio Murgia commented on HADOOP-19068: - Nope, simple {{mvn clean verify -pl :hadoop-aws}} >

[jira] [Updated] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Antonio Murgia (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antonio Murgia updated HADOOP-19068: Description: Running {{mvn clean verify -pl :hadoop-aws}} on my laptop against my s3

[jira] [Updated] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19068: Component/s: test > ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS

[jira] [Assigned] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19068: --- Assignee: (was: Steve Loughran) > ITestS3AClosedFS.testClosedInstrumentation

[jira] [Commented] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814726#comment-17814726 ] Steve Loughran commented on HADOOP-19068: - thanks. that stack implies that the (shared) metrics

[jira] [Updated] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19068: Affects Version/s: 3.5.0 > ITestS3AClosedFS.testClosedInstrumentation fails on trunk on

[jira] [Updated] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19068: Component/s: fs/s3 > ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1929257936 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814720#comment-17814720 ] ASF GitHub Bot commented on HADOOP-18993: - tmnd1991 commented on PR #6301: URL:

Re: [PR] HADOOP-18993 Allow to not isolate S3AFileSystem classloader when needed [hadoop]

2024-02-06 Thread via GitHub
tmnd1991 commented on PR #6301: URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1929251297 > I've looked at the closed fs test. It is verifying that threads are all gone so its potentially a sign of some thread leakage. Can you post the stack trace/output you are seeing? >

[jira] [Created] (HADOOP-19068) ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon

2024-02-06 Thread Antonio Murgia (Jira)
Antonio Murgia created HADOOP-19068: --- Summary: ITestS3AClosedFS.testClosedInstrumentation fails on trunk on Mac OS Silicon Key: HADOOP-19068 URL: https://issues.apache.org/jira/browse/HADOOP-19068

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814712#comment-17814712 ] ASF GitHub Bot commented on HADOOP-14837: - bpahuja commented on PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-02-06 Thread via GitHub
bpahuja commented on PR #6407: URL: https://github.com/apache/hadoop/pull/6407#issuecomment-1929172260 > I 'd go for getTrimmed(READ_RESTORED_GLACIER_OBJECTS, ""); if empty string map to empty optional, otherwise .toupper and valueof. one thing to consider: meaningful failure if the value

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814710#comment-17814710 ] ASF GitHub Bot commented on HADOOP-14837: - bpahuja commented on code in PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-02-06 Thread via GitHub
bpahuja commented on code in PR #6407: URL: https://github.com/apache/hadoop/pull/6407#discussion_r1479512215 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/list/ITestS3AReadRestoredGlacierObjects.java: ## @@ -0,0 +1,198 @@ +/* + * Licensed to the Apache

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814709#comment-17814709 ] ASF GitHub Bot commented on HADOOP-14837: - bpahuja commented on code in PR #6407: URL:

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814708#comment-17814708 ] ASF GitHub Bot commented on HADOOP-14837: - bpahuja commented on code in PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-02-06 Thread via GitHub
bpahuja commented on code in PR #6407: URL: https://github.com/apache/hadoop/pull/6407#discussion_r1479511520 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/list/ITestS3AReadRestoredGlacierObjects.java: ## @@ -0,0 +1,198 @@ +/* + * Licensed to the Apache

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-02-06 Thread via GitHub
bpahuja commented on code in PR #6407: URL: https://github.com/apache/hadoop/pull/6407#discussion_r1479510851 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ObjectStorageClassFilter.java: ## @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache Software

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-02-06 Thread via GitHub
zhangshuyan0 commented on PR #6464: URL: https://github.com/apache/hadoop/pull/6464#issuecomment-1929152978 Committed to trunk. Thanks for your contribution @haiyang1987 @ZanderXu @smarthanwang . -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-02-06 Thread via GitHub
zhangshuyan0 merged PR #6464: URL: https://github.com/apache/hadoop/pull/6464 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
hfutatzhanghb commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1929053830 > Thanks @hfutatzhanghb for your report. > > Is `DNA_ACCESSKEYUPDATE` blocked by `BlockCommand`? If so, how about letting `CommandProcessingThread` only handle command that

Re: [PR] HDFS-17362. RBF: RouterObserverReadProxyProvider should use ConfiguredFailoverProxyProvider internally [hadoop]

2024-02-06 Thread via GitHub
tasanuma commented on code in PR #6510: URL: https://github.com/apache/hadoop/pull/6510#discussion_r1479405963 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/RouterObserverReadProxyProvider.java: ## @@ -84,7 +84,8 @@ public

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2024-02-06 Thread via GitHub
ZanderXu commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-1929028734 Thanks @hfutatzhanghb for your report. Is `DNA_ACCESSKEYUPDATE` blocked by `BlockCommand`? If so, how about letting `CommandProcessingThread` only handle command that might take

[jira] [Commented] (HADOOP-19058) [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn

2024-02-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814664#comment-17814664 ] ASF GitHub Bot commented on HADOOP-19058: - hadoop-yetus commented on PR #6531: URL:

Re: [PR] HADOOP-19058. [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn [hadoop]

2024-02-06 Thread via GitHub
hadoop-yetus commented on PR #6531: URL: https://github.com/apache/hadoop/pull/6531#issuecomment-1928973004 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |