[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809275#comment-17809275 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani commented on PR #6479: URL:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-21 Thread via GitHub
virajjasani commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1903417294 Several tests failing, cause is being discussed on HADOOP-18975 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-01-21 Thread via GitHub
haiyang1987 commented on code in PR #6464: URL: https://github.com/apache/hadoop/pull/6464#discussion_r1461445666 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java: ## @@ -2011,4 +2011,83 @@ public void

[PR] YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication [hadoop]

2024-01-21 Thread via GitHub
jchanggg opened a new pull request, #6481: URL: https://github.com/apache/hadoop/pull/6481 ### Description of PR When getNewApplication is called against YARN Router with Federation on, its possible we get different maxResourceCapabilities on different calls. This is

[jira] [Comment Edited] (HADOOP-18975) AWS SDK v2: extend support for FIPS endpoints

2024-01-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809271#comment-17809271 ] Viraj Jasani edited comment on HADOOP-18975 at 1/22/24 7:33 AM:

[jira] [Commented] (HADOOP-18975) AWS SDK v2: extend support for FIPS endpoints

2024-01-21 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809271#comment-17809271 ] Viraj Jasani commented on HADOOP-18975: ---   {code:java}      

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-01-21 Thread via GitHub
haiyang1987 commented on PR #6464: URL: https://github.com/apache/hadoop/pull/6464#issuecomment-1903406926 > > This is a bug fix after #5564 , do you have time to help review this? > > @smarthanwang I have a question about

Re: [PR] YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication [hadoop]

2024-01-21 Thread via GitHub
jchanggg closed pull request #6480: YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication URL: https://github.com/apache/hadoop/pull/6480 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication [hadoop]

2024-01-21 Thread via GitHub
jchanggg opened a new pull request, #6480: URL: https://github.com/apache/hadoop/pull/6480 ### Description of PR JIRA: [YARN-11649](https://issues.apache.org/jira/browse/YARN-11649). [Router] Create Override for Maximum Resource Capability in getNewApplication When

Re: [PR] HDFS-17346. Fix DirectoryScanner check mark the normal blocks as corrupt [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6476: URL: https://github.com/apache/hadoop/pull/6476#issuecomment-1903401143 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19045) S3A: pass request timeouts down to sdk clients

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809263#comment-17809263 ] ASF GitHub Bot commented on HADOOP-19045: - virajjasani commented on PR #6470: URL:

Re: [PR] HADOOP-19045. S3A: Validate CreateSession Timeout Propagation [hadoop]

2024-01-21 Thread via GitHub
virajjasani commented on PR #6470: URL: https://github.com/apache/hadoop/pull/6470#issuecomment-1903390154 Looks like this can also cover HADOOP-19022 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDFS-17293. First packet data + checksum size will be set to 516 bytes when writing to a new block. [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6368: URL: https://github.com/apache/hadoop/pull/6368#issuecomment-1903380159 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809259#comment-17809259 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani commented on PR #6479: URL:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-21 Thread via GitHub
virajjasani commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1903370772 Testing against `us-west-2` in progress. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19044: Labels: pull-request-available (was: ) > AWS SDK V2 - Update S3A region logic >

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809258#comment-17809258 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani opened a new pull request, #6479: URL:

[PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-21 Thread via GitHub
virajjasani opened a new pull request, #6479: URL: https://github.com/apache/hadoop/pull/6479 Jira: HADOOP-19044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] just for testing. [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6478: URL: https://github.com/apache/hadoop/pull/6478#issuecomment-1903344407 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809252#comment-17809252 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462: URL:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1903335855 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19039) Hadoop 3.4.0 Highlight big features and improvements.

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809247#comment-17809247 ] ASF GitHub Bot commented on HADOOP-19039: - hadoop-yetus commented on PR #6462: URL:

Re: [PR] HADOOP-19039. Hadoop 3.4.0 Highlight big features and improvements. [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6462: URL: https://github.com/apache/hadoop/pull/6462#issuecomment-1903290380 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[PR] just for testing. [hadoop]

2024-01-21 Thread via GitHub
hfutatzhanghb opened a new pull request, #6478: URL: https://github.com/apache/hadoop/pull/6478 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Commented] (HADOOP-18045) Disable TestDynamometerInfra

2024-01-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809238#comment-17809238 ] Takanobu Asanuma commented on HADOOP-18045: --- [~slfan1989]  Thanks for updating it! > Disable

Re: [PR] HDFS-17293. First packet data + checksum size will be set to 516 bytes when writing to a new block. [hadoop]

2024-01-21 Thread via GitHub
hfutatzhanghb commented on PR #6368: URL: https://github.com/apache/hadoop/pull/6368#issuecomment-1903178049 > Committed to trunk. Thanks for your contribution @hfutatzhanghb . @zhangshuyan0 Sir, Thanks a lot for your reviewing. -- This is an automated message from the Apache Git

[PR] TEST [hadoop]

2024-01-21 Thread via GitHub
hfutatzhanghb opened a new pull request, #6477: URL: https://github.com/apache/hadoop/pull/6477 ### Description of PR triiger yetus ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA

Re: [PR] HDFS-17293. First packet data + checksum size will be set to 516 bytes when writing to a new block. [hadoop]

2024-01-21 Thread via GitHub
zhangshuyan0 commented on PR #6368: URL: https://github.com/apache/hadoop/pull/6368#issuecomment-1903143954 Committed to trunk. Thanks for your contribution @hfutatzhanghb . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] HDFS-17293. First packet data + checksum size will be set to 516 bytes when writing to a new block. [hadoop]

2024-01-21 Thread via GitHub
zhangshuyan0 merged PR #6368: URL: https://github.com/apache/hadoop/pull/6368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17293. First packet data + checksum size will be set to 516 bytes when writing to a new block. [hadoop]

2024-01-21 Thread via GitHub
hfutatzhanghb commented on PR #6368: URL: https://github.com/apache/hadoop/pull/6368#issuecomment-1903059289 > > Sir, very nice catch. I think below code may resolve the problem you found. Please take a look when you are free. I will submit another PR to fix it and Add UT. > > ```java

Re: [PR] chore: Update releases.md for branding [hadoop-site]

2024-01-21 Thread via GitHub
Hexiaoqiao commented on PR #51: URL: https://github.com/apache/hadoop-site/pull/51#issuecomment-1903033902 @tisonkun Thanks for your update. Is it the same thing with https://github.com/apache/hadoop-site/pull/46 (which is from Brand Management suggestions). Not sure if we need update

Re: [PR] HDFS-17346. Fix DirectoryScanner check mark the normal blocks as corrupt [hadoop]

2024-01-21 Thread via GitHub
haiyang1987 commented on PR #6476: URL: https://github.com/apache/hadoop/pull/6476#issuecomment-1903017756 Thanks @ZanderXu for your review. Fixed the issue of UT, please help review it again, thanks~ -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] HDFS-17293. First packet data + checksum size will be set to 516 bytes when writing to a new block. [hadoop]

2024-01-21 Thread via GitHub
zhangshuyan0 commented on PR #6368: URL: https://github.com/apache/hadoop/pull/6368#issuecomment-1903015641 > Sir, very nice catch. I think below code may resolve the problem you found. Please take a look when you are free. I will submit another PR to fix it and Add UT. > >

[jira] [Commented] (HADOOP-18045) Disable TestDynamometerInfra

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809218#comment-17809218 ] Shilun Fan commented on HADOOP-18045: - [~tasanuma] I've added 3.4.0 back to fix-version. Thanks

[jira] [Comment Edited] (HADOOP-18045) Disable TestDynamometerInfra

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809074#comment-17809074 ] Shilun Fan edited comment on HADOOP-18045 at 1/22/24 2:47 AM: -- -3.3.2

[jira] [Commented] (HADOOP-17919) Fix command line example in Hadoop Cluster Setup documentation

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809217#comment-17809217 ] Shilun Fan commented on HADOOP-17919: - [~iwasakims] Thank you for your reminder!I will re-add the

[jira] [Updated] (HADOOP-17919) Fix command line example in Hadoop Cluster Setup documentation

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-17919: Fix Version/s: 3.4.0 > Fix command line example in Hadoop Cluster Setup documentation >

[jira] [Comment Edited] (HADOOP-17919) Fix command line example in Hadoop Cluster Setup documentation

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17808977#comment-17808977 ] Shilun Fan edited comment on HADOOP-17919 at 1/22/24 2:46 AM: -- -3.3.2

[jira] [Commented] (HADOOP-19019) Parallel Maven Build Support for Apache Hadoop

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809216#comment-17809216 ] ASF GitHub Bot commented on HADOOP-19019: - Hexiaoqiao commented on PR #6373: URL:

Re: [PR] HADOOP-19019: Parallel Maven Build Support for Apache Hadoop [hadoop]

2024-01-21 Thread via GitHub
Hexiaoqiao commented on PR #6373: URL: https://github.com/apache/hadoop/pull/6373#issuecomment-1902975164 If no more other concerns, I will check this PR into trunk for a short while. @steveloughran -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-01-21 Thread via GitHub
ZanderXu commented on PR #6464: URL: https://github.com/apache/hadoop/pull/6464#issuecomment-1902959898 > This is a bug fix after https://github.com/apache/hadoop/pull/5564 , do you have time to help review this? @smarthanwang I have a question about HDFS-16985, Normally

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-01-21 Thread via GitHub
smarthanwang commented on code in PR #6464: URL: https://github.com/apache/hadoop/pull/6464#discussion_r1461284042 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java: ## @@ -2011,4 +2011,83 @@ public

[jira] [Commented] (HADOOP-17919) Fix command line example in Hadoop Cluster Setup documentation

2024-01-21 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809208#comment-17809208 ] Masatake Iwasaki commented on HADOOP-17919: --- [~slfan1989] I think we should keep 3.4.0 in the

[jira] [Commented] (HADOOP-19043) S3A: Regression: ITestS3AOpenCost fails on prefetch test runs

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809175#comment-17809175 ] ASF GitHub Bot commented on HADOOP-19043: - hadoop-yetus commented on PR #6465: URL:

Re: [PR] HADOOP-19043. S3A: Regression: ITestS3AOpenCost fails on prefetch test runs [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6465: URL: https://github.com/apache/hadoop/pull/6465#issuecomment-1902752372 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809168#comment-17809168 ] ASF GitHub Bot commented on HADOOP-18610: - steveloughran commented on PR #5953: URL:

Re: [PR] HADOOP-18610. ABFS OAuth2 Token Provider support for Azure Workload Identity [hadoop]

2024-01-21 Thread via GitHub
steveloughran commented on PR #5953: URL: https://github.com/apache/hadoop/pull/5953#issuecomment-1902738972 you can use env var resolution within a hadoop core-site file; which lets you at the values with defaults when unset. on locked down config loading (oozie etc) then only the default

[jira] [Resolved] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2024-01-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18883. - Fix Version/s: 3.5.0 Resolution: Fixed > Expect-100 JDK bug resolution: prevent

[jira] [Commented] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809162#comment-17809162 ] ASF GitHub Bot commented on HADOOP-18883: - steveloughran merged PR #6022: URL:

Re: [PR] HADOOP-18883. [ABFS]: Expect-100 JDK bug resolution: prevent multiple server calls [hadoop]

2024-01-21 Thread via GitHub
steveloughran merged PR #6022: URL: https://github.com/apache/hadoop/pull/6022 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-19019) Parallel Maven Build Support for Apache Hadoop

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809161#comment-17809161 ] ASF GitHub Bot commented on HADOOP-19019: - steveloughran commented on PR #6373: URL:

Re: [PR] HADOOP-19019: Parallel Maven Build Support for Apache Hadoop [hadoop]

2024-01-21 Thread via GitHub
steveloughran commented on PR #6373: URL: https://github.com/apache/hadoop/pull/6373#issuecomment-1902729436 Who is going to merge this? @Hexiaoqiao? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HADOOP-19046) S3A: update sdk versions

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809160#comment-17809160 ] ASF GitHub Bot commented on HADOOP-19046: - steveloughran merged PR #6467: URL:

Re: [PR] HADOOP-19046. S3A: update AWS V2 SDK to 2.23.5; v1 to 1.12.599 [hadoop]

2024-01-21 Thread via GitHub
steveloughran merged PR #6467: URL: https://github.com/apache/hadoop/pull/6467 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HADOOP-19043. S3A: Regression: ITestS3AOpenCost fails on prefetch test runs [hadoop]

2024-01-21 Thread via GitHub
steveloughran commented on PR #6465: URL: https://github.com/apache/hadoop/pull/6465#issuecomment-1902727835 applied my own review comments; tested against s3 express in usw2 with and without -prefetch -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-19043) S3A: Regression: ITestS3AOpenCost fails on prefetch test runs

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809159#comment-17809159 ] ASF GitHub Bot commented on HADOOP-19043: - steveloughran commented on PR #6465: URL:

[jira] [Commented] (HADOOP-19047) Support InMemory Tracking Of S3A Magic Commits

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809158#comment-17809158 ] ASF GitHub Bot commented on HADOOP-19047: - steveloughran commented on code in PR #6468: URL:

Re: [PR] HADOOP-19047: Support InMemory Tracking Of S3A Magic Commits [hadoop]

2024-01-21 Thread via GitHub
steveloughran commented on code in PR #6468: URL: https://github.com/apache/hadoop/pull/6468#discussion_r1461054737 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/commit/magic/S3MagicCommitTracker.java: ## @@ -0,0 +1,121 @@ +/* + * Licensed to the Apache

Re: [PR] HDFS-17346. Fix DirectoryScanner check mark the normal blocks as corrupt [hadoop]

2024-01-21 Thread via GitHub
hadoop-yetus commented on PR #6476: URL: https://github.com/apache/hadoop/pull/6476#issuecomment-1902711189 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Comment Edited] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809003#comment-17809003 ] Shilun Fan edited comment on HADOOP-18691 at 1/21/24 3:47 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18689: Fix Version/s: 3.4.0 > Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project >

[jira] [Updated] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18691: Fix Version/s: 3.4.0 > Add a CallerContext getter on the Schedulable interface >

[jira] [Comment Edited] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809005#comment-17809005 ] Shilun Fan edited comment on HADOOP-18689 at 1/21/24 3:46 PM: -- -3.3.6

[jira] [Comment Edited] (HADOOP-18688) S3A audit header to include count of items in delete ops

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809008#comment-17809008 ] Shilun Fan edited comment on HADOOP-18688 at 1/21/24 3:46 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18688) S3A audit header to include count of items in delete ops

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18688: Fix Version/s: 3.4.0 > S3A audit header to include count of items in delete ops >

[jira] [Updated] (HADOOP-18684) S3A filesystem to support binding to other URI schemes

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18684: Fix Version/s: 3.3.6 > S3A filesystem to support binding to other URI schemes >

[jira] [Comment Edited] (HADOOP-18680) Insufficient heap during full test runs in Docker container.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809010#comment-17809010 ] Shilun Fan edited comment on HADOOP-18680 at 1/21/24 3:44 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18680) Insufficient heap during full test runs in Docker container.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18680: Fix Version/s: 3.3.6 > Insufficient heap during full test runs in Docker container. >

[jira] [Comment Edited] (HADOOP-18662) ListFiles with recursive fails with FNF

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809012#comment-17809012 ] Shilun Fan edited comment on HADOOP-18662 at 1/21/24 3:43 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18671: Fix Version/s: 3.4.0 > Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem >

[jira] [Updated] (HADOOP-18662) ListFiles with recursive fails with FNF

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18662: Fix Version/s: 3.4.0 > ListFiles with recursive fails with FNF >

[jira] [Updated] (HADOOP-18660) Filesystem Spelling Mistake

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18660: Fix Version/s: 3.4.0 > Filesystem Spelling Mistake > --- > >

[jira] [Updated] (HADOOP-18652) Path.suffix raises NullPointerException

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18652: Fix Version/s: 3.4.0 > Path.suffix raises NullPointerException >

[jira] [Comment Edited] (HADOOP-18660) Filesystem Spelling Mistake

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809013#comment-17809013 ] Shilun Fan edited comment on HADOOP-18660 at 1/21/24 3:41 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18658) snakeyaml dependency: upgrade to v2.0

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18658: Fix Version/s: 3.4.0 > snakeyaml dependency: upgrade to v2.0 >

[jira] [Comment Edited] (HADOOP-18652) Path.suffix raises NullPointerException

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809015#comment-17809015 ] Shilun Fan edited comment on HADOOP-18652 at 1/21/24 3:41 PM: -- -3.3.6

[jira] [Comment Edited] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809016#comment-17809016 ] Shilun Fan edited comment on HADOOP-18647 at 1/21/24 3:40 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18647: Fix Version/s: 3.4.0 > x-ms-client-request-id to have some way that identifies retry of an API.

[jira] [Updated] (HADOOP-18646) Upgrade Netty to 4.1.89.Final

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18646: Fix Version/s: 3.4.0 > Upgrade Netty to 4.1.89.Final > - > >

[jira] [Comment Edited] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809018#comment-17809018 ] Shilun Fan edited comment on HADOOP-18637 at 1/21/24 3:39 PM: -- -3.3.6

[jira] [Comment Edited] (HADOOP-18646) Upgrade Netty to 4.1.89.Final

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809017#comment-17809017 ] Shilun Fan edited comment on HADOOP-18646 at 1/21/24 3:39 PM: -- -3.3.6

[jira] [Comment Edited] (HADOOP-18636) LocalDirAllocator cannot recover from directory tree deletion during the life of a filesystem client

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809019#comment-17809019 ] Shilun Fan edited comment on HADOOP-18636 at 1/21/24 3:38 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18636) LocalDirAllocator cannot recover from directory tree deletion during the life of a filesystem client

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18636: Fix Version/s: 3.4.0 > LocalDirAllocator cannot recover from directory tree deletion during the

[jira] [Updated] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18637: Fix Version/s: 3.4.0 > S3A to support upload of files greater than 2 GB using DiskBlocks >

[jira] [Updated] (HADOOP-18628) Server connection should log host name before returning VersionMismatch error

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18628: Fix Version/s: 3.4.0 > Server connection should log host name before returning VersionMismatch

[jira] [Comment Edited] (HADOOP-18628) Server connection should log host name before returning VersionMismatch error

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809020#comment-17809020 ] Shilun Fan edited comment on HADOOP-18628 at 1/21/24 3:37 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18622) Upgrade ant to 1.10.13

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18622: Fix Version/s: 3.4.0 > Upgrade ant to 1.10.13 > -- > > Key:

[jira] [Updated] (HADOOP-18625) Fix method name of RPC.Builder#setnumReaders

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18625: Fix Version/s: 3.3.6 > Fix method name of RPC.Builder#setnumReaders >

[jira] [Comment Edited] (HADOOP-18612) Avoid mixing canonical and non-canonical when performing comparisons

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809026#comment-17809026 ] Shilun Fan edited comment on HADOOP-18612 at 1/21/24 3:35 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18620) Avoid using grizzly-http-* APIs

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18620: Fix Version/s: 3.4.0 > Avoid using grizzly-http-* APIs > --- > >

[jira] [Comment Edited] (HADOOP-18620) Avoid using grizzly-http-* APIs

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809025#comment-17809025 ] Shilun Fan edited comment on HADOOP-18620 at 1/21/24 3:35 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18612) Avoid mixing canonical and non-canonical when performing comparisons

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18612: Fix Version/s: 3.4.0 > Avoid mixing canonical and non-canonical when performing comparisons >

[jira] [Updated] (HADOOP-18606) Add reason in in x-ms-client-request-id on a retry API call.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18606: Fix Version/s: 3.4.0 > Add reason in in x-ms-client-request-id on a retry API call. >

[jira] [Comment Edited] (HADOOP-18606) Add reason in in x-ms-client-request-id on a retry API call.

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809027#comment-17809027 ] Shilun Fan edited comment on HADOOP-18606 at 1/21/24 3:34 PM: -- -3.3.6

[jira] [Comment Edited] (HADOOP-18604) Add compile platform in the hadoop version output

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809028#comment-17809028 ] Shilun Fan edited comment on HADOOP-18604 at 1/21/24 3:33 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18604) Add compile platform in the hadoop version output

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18604: Fix Version/s: 3.4.0 > Add compile platform in the hadoop version output >

[jira] [Updated] (HADOOP-18597) Simplify single node instructions for creating directories for Map Reduce

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18597: Fix Version/s: 3.4.0 > Simplify single node instructions for creating directories for Map Reduce

[jira] [Comment Edited] (HADOOP-18592) Sasl connection failure should log remote address

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809030#comment-17809030 ] Shilun Fan edited comment on HADOOP-18592 at 1/21/24 3:32 PM: -- -3.3.6

[jira] [Updated] (HADOOP-18592) Sasl connection failure should log remote address

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18592: Fix Version/s: 3.4.0 > Sasl connection failure should log remote address >

[jira] [Updated] (HADOOP-18590) Publish SBOM artifacts

2024-01-21 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18590: Fix Version/s: 3.4.0 > Publish SBOM artifacts > -- > > Key:

  1   2   >