Re: [PR] HADOOP-18947. Fixed test flakiness during string comparision [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6215: URL: https://github.com/apache/hadoop/pull/6215#issuecomment-1780456175 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18912. Upgrade snappy-java to 1.1.10.4 [hadoop]

2023-10-25 Thread via GitHub
rohit-kb commented on PR #6160: URL: https://github.com/apache/hadoop/pull/6160#issuecomment-1780453158 Thanks for reviewing and merging this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (HADOOP-18912) upgrade snappy-java to 1.1.10.4 due to CVE

2023-10-25 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-18912: --- Fix Version/s: 3.3.9 > upgrade snappy-java to 1.1.10.4 due to CVE >

Re: [PR] HADOOP-18912. Upgrade snappy-java to 1.1.10.4 [hadoop]

2023-10-25 Thread via GitHub
aajisaka merged PR #6160: URL: https://github.com/apache/hadoop/pull/6160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] YARN-11577. Improve FederationInterceptorREST Method Result. [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6190: URL: https://github.com/apache/hadoop/pull/6190#issuecomment-1780391620 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18947. Fixed test flakiness during string comparision [hadoop]

2023-10-25 Thread via GitHub
kavvya97 commented on PR #6215: URL: https://github.com/apache/hadoop/pull/6215#issuecomment-1780365855 > You are not checking the return value of `compareStrings`, so even if it returns `false`, I believe your test will pass. btw. rather than sort & then array equals and then asserting

[jira] [Commented] (HADOOP-18912) upgrade snappy-java to 1.1.10.4 due to CVE

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779727#comment-17779727 ] ASF GitHub Bot commented on HADOOP-18912: - hadoop-yetus commented on PR #6160: URL:

Re: [PR] HADOOP-18912. Upgrade snappy-java to 1.1.10.4 [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6160: URL: https://github.com/apache/hadoop/pull/6160#issuecomment-1780328851 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18952) FsCommand Stat class set the timeZone"UTC", which is different from the machine's timeZone

2023-10-25 Thread liang yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated HADOOP-18952: -- Description: Using Hadoop version 3.3.4   When executing Ls command and Stat command on the same

[jira] [Updated] (HADOOP-18952) FsCommand Stat class set the timeZone"UTC", which is different from the machine's timeZone

2023-10-25 Thread liang yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated HADOOP-18952: -- Attachment: image-2023-10-26-10-07-11-637.png > FsCommand Stat class set the timeZone"UTC", which is

[jira] [Updated] (HADOOP-18952) FsCommand Stat class set the timeZone"UTC", which is different from the machine's timeZone

2023-10-25 Thread liang yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated HADOOP-18952: -- Attachment: (was: image-2023-10-26-10-00-19-636.png) > FsCommand Stat class set the

[jira] [Updated] (HADOOP-18952) FsCommand Stat class set the timeZone"UTC", which is different from the machine's timeZone

2023-10-25 Thread liang yu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liang yu updated HADOOP-18952: -- Description: Using Hadoop version 3.3.4   When executing Ls command and Stat command on the same

[jira] [Created] (HADOOP-18952) FsCommand Stat class set the timeZone"UTC", which is different from the machine's timeZone

2023-10-25 Thread liang yu (Jira)
liang yu created HADOOP-18952: - Summary: FsCommand Stat class set the timeZone"UTC", which is different from the machine's timeZone Key: HADOOP-18952 URL: https://issues.apache.org/jira/browse/HADOOP-18952

[jira] [Commented] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779712#comment-17779712 ] ASF GitHub Bot commented on HADOOP-18933: - hadoop-yetus commented on PR #6224: URL:

Re: [PR] HADOOP-18933. upgrade to netty 4.1.100 due to CVE (#6173) [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6224: URL: https://github.com/apache/hadoop/pull/6224#issuecomment-1780275560 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11593. [Federation] Improve command line help information. [hadoop]

2023-10-25 Thread via GitHub
slfan1989 commented on PR #6199: URL: https://github.com/apache/hadoop/pull/6199#issuecomment-1780232786 @goiri Thank you very much for your help in reviewing the code! I will continue to follow up on YARN-11594. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] YARN-11593. [Federation] Improve command line help information. [hadoop]

2023-10-25 Thread via GitHub
slfan1989 merged PR #6199: URL: https://github.com/apache/hadoop/pull/6199 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18948) S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779673#comment-17779673 ] ASF GitHub Bot commented on HADOOP-18948: - hadoop-yetus commented on PR #6218: URL:

Re: [PR] HADOOP-18948. S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6218: URL: https://github.com/apache/hadoop/pull/6218#issuecomment-1780021344 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11011. Make YARN Router throw Exception to client clearly. [hadoop]

2023-10-25 Thread via GitHub
goiri commented on code in PR #6211: URL: https://github.com/apache/hadoop/pull/6211#discussion_r1372298017 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java:

Re: [PR] YARN-11484. [Federation] Router Supports Yarn Client CLI Cmds. [hadoop]

2023-10-25 Thread via GitHub
goiri commented on code in PR #6132: URL: https://github.com/apache/hadoop/pull/6132#discussion_r1372293340 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/QueueCLI.java: ## @@ -174,6 +225,63 @@ private int

[jira] [Commented] (HADOOP-11867) Add a high-performance vectored read API.

2023-10-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779666#comment-17779666 ] Mukund Thakur commented on HADOOP-11867: Hey [~yuanbo]  Vectored IO is intelligent. It merges

Re: [PR] HDFS-17232. RBF: Fix NoNamenodesAvailableException for a long time, when use observer. [hadoop]

2023-10-25 Thread via GitHub
goiri commented on code in PR #6208: URL: https://github.com/apache/hadoop/pull/6208#discussion_r1367536335 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcClient.java: ## @@ -772,13 +779,22 @@ public static boolean

[jira] [Updated] (HADOOP-18915) S3A client builder to use getTImeDuration() for HTTP timeouts

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18915: Summary: S3A client builder to use getTImeDuration() for HTTP timeouts (was: HTTP

[jira] [Commented] (HADOOP-18915) HTTP timeouts are not set correctly

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779616#comment-17779616 ] Steve Loughran commented on HADOOP-18915: - so HADOOP-18889 does switch from seconds to millis,

[jira] [Commented] (HADOOP-18944) s3a openfile is using readahead rather than async drain threshold to calculate drain threshold

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779613#comment-17779613 ] ASF GitHub Bot commented on HADOOP-18944: - steveloughran commented on PR #6203: URL:

Re: [PR] HADOOP-18850 Enable dual-layer server-side encryption with AWS KMS keys [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on code in PR #6140: URL: https://github.com/apache/hadoop/pull/6140#discussion_r1372139869 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AEncryptionDSSEKMSUserDefinedKey.java: ## @@ -39,10 +42,12 @@ protected Configuration

Re: [PR] HADOOP-18944. fix default value of Async drain threshold in S3A OpenFile [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on PR #6203: URL: https://github.com/apache/hadoop/pull/6203#issuecomment-1779802442 where did you test? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HADOOP-18928) S3AFileSystem URL encodes twice where Path has trailing /

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779607#comment-17779607 ] ASF GitHub Bot commented on HADOOP-18928: - steveloughran commented on code in PR #6167: URL:

Re: [PR] HADOOP-18928: S3AFileSystem URL encodes twice where Path has trailing / [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on code in PR #6167: URL: https://github.com/apache/hadoop/pull/6167#discussion_r1372128380 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java: ## @@ -1652,7 +1653,12 @@ public Path makeQualified(final Path path) {

[jira] [Commented] (HADOOP-18797) Support Concurrent Writes With S3A Magic Committer

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779602#comment-17779602 ] ASF GitHub Bot commented on HADOOP-18797: - steveloughran commented on PR #6122: URL:

Re: [PR] HADOOP-18797. Support Concurrent Writes With S3A Magic Committer [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on PR #6122: URL: https://github.com/apache/hadoop/pull/6122#issuecomment-1779776811 looks good and I'm not going to review backports except for backporting issues. which s3 region did you test against, and with what parameters? -- This is an automated

[jira] [Commented] (HADOOP-18948) S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779591#comment-17779591 ] ASF GitHub Bot commented on HADOOP-18948: - hadoop-yetus commented on PR #6218: URL:

Re: [PR] HADOOP-18948. S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6218: URL: https://github.com/apache/hadoop/pull/6218#issuecomment-1779752864 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18711. upgrade nimbus jwt jar due to issues in its embedded shaded json-smart code. [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6201: URL: https://github.com/apache/hadoop/pull/6201#issuecomment-1779708179 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17024. Potential data race introduced by HDFS-15865 [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6223: URL: https://github.com/apache/hadoop/pull/6223#issuecomment-1779707251 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-18951) S3A third party: document "Certificate doesn't match"

2023-10-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18951: --- Summary: S3A third party: document "Certificate doesn't match" Key: HADOOP-18951 URL: https://issues.apache.org/jira/browse/HADOOP-18951 Project: Hadoop Common

Re: [PR] YARN-11588. [Federation] [Addendum] Fix uncleaned threads in yarn router thread pool executor. [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6222: URL: https://github.com/apache/hadoop/pull/6222#issuecomment-1779674301 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Resolved] (HADOOP-18948) S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18948. - Fix Version/s: 3.4.0 Release Note: S3A directory delete and rename will

[jira] [Commented] (HADOOP-18948) S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779571#comment-17779571 ] ASF GitHub Bot commented on HADOOP-18948: - steveloughran merged PR #6218: URL:

Re: [PR] HADOOP-18948. S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete [hadoop]

2023-10-25 Thread via GitHub
steveloughran merged PR #6218: URL: https://github.com/apache/hadoop/pull/6218 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18948) S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779567#comment-17779567 ] ASF GitHub Bot commented on HADOOP-18948: - steveloughran commented on code in PR #6218: URL:

Re: [PR] HADOOP-18948. S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on code in PR #6218: URL: https://github.com/apache/hadoop/pull/6218#discussion_r1372034162 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Statistic.java: ## @@ -242,7 +242,10 @@ public enum Statistic {

[jira] [Commented] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779566#comment-17779566 ] ASF GitHub Bot commented on HADOOP-18933: - pjfanning opened a new pull request, #6224: URL:

[PR] HADOOP-18933. upgrade to netty 4.1.100 due to CVE (#6173) [hadoop]

2023-10-25 Thread via GitHub
pjfanning opened a new pull request, #6224: URL: https://github.com/apache/hadoop/pull/6224 ### Description of PR Mitigates Netty security advisory GHSA-xpw8-rcwv-8f8p "HTTP/2 Rapid Reset Attack - DDoS vector in the HTTP/2 protocol due RST frames" Contributed by PJ Fanning

[jira] [Commented] (HADOOP-18924) upgrade grpc jars to v1.53.0 due to CVEs

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779564#comment-17779564 ] ASF GitHub Bot commented on HADOOP-18924: - hadoop-yetus commented on PR #6161: URL:

Re: [PR] HADOOP-18924. upgrade to grpc 1.53.0 due to CVEs [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6161: URL: https://github.com/apache/hadoop/pull/6161#issuecomment-1779617991 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18948) S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779533#comment-17779533 ] ASF GitHub Bot commented on HADOOP-18948: - mehakmeet commented on code in PR #6218: URL:

Re: [PR] HADOOP-18948. S3A. Add option fs.s3a.directory.operations.purge.uploads to purge on rename/delete [hadoop]

2023-10-25 Thread via GitHub
mehakmeet commented on code in PR #6218: URL: https://github.com/apache/hadoop/pull/6218#discussion_r1371876530 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Statistic.java: ## @@ -242,7 +242,10 @@ public enum Statistic {

[PR] HDFS-17024. Potential data race introduced by HDFS-15865 [hadoop]

2023-10-25 Thread via GitHub
StoneDot opened a new pull request, #6223: URL: https://github.com/apache/hadoop/pull/6223 ### Description of PR This PR fixes [HDFS-17024](https://issues.apache.org/jira/browse/HDFS-17024). ### How was this patch tested? I cannot test against this issue due to the

[PR] YARN-11588. [Federation] [Addendum] Fix uncleaned threads in yarn router thread pool executor. [hadoop]

2023-10-25 Thread via GitHub
slfan1989 opened a new pull request, #6222: URL: https://github.com/apache/hadoop/pull/6222 ### Description of PR JIRA: YARN-11588. [Federation] [Addendum] Fix uncleaned threads in yarn router thread pool executor. ### How was this patch tested? ### For code

[jira] [Commented] (HADOOP-17912) ABFS: Support for Encryption Context

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779532#comment-17779532 ] ASF GitHub Bot commented on HADOOP-17912: - hadoop-yetus commented on PR #6221: URL:

Re: [PR] HADOOP-17912. ABFS: Support for Encryption Context [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6221: URL: https://github.com/apache/hadoop/pull/6221#issuecomment-1779418317 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18843. Guava version 32.0.1 bump to fix CVE-2023-2976 [hadoop-thirdparty]

2023-10-25 Thread via GitHub
fredbalves86 commented on PR #23: URL: https://github.com/apache/hadoop-thirdparty/pull/23#issuecomment-1779381106 > I've hit the approve and run button to see what the ci builds say. if things are good I'll merge @steveloughran any chance of this being merger and new version

[jira] [Commented] (HADOOP-18930) make fs.s3a.create.performance an option you can set for the entire bucket

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779509#comment-17779509 ] ASF GitHub Bot commented on HADOOP-18930: - steveloughran commented on code in PR #6168: URL:

Re: [PR] HADOOP-18930. Make fs.s3a.create.performance a bucket-wide setting [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on code in PR #6168: URL: https://github.com/apache/hadoop/pull/6168#discussion_r1371755588 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java: ## @@ -1183,12 +1183,17 @@ private Constants() { /** * Flag for create

[jira] [Commented] (HADOOP-18487) Make protobuf 2.5 an optional runtime dependency.

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779506#comment-17779506 ] ASF GitHub Bot commented on HADOOP-18487: - steveloughran commented on PR #6185: URL:

Re: [PR] MAPREDUCE-7458. Race condition in TaskReportPBImpl#getProto when generating task reports process in concurrency scenarios. [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on PR #6172: URL: https://github.com/apache/hadoop/pull/6172#issuecomment-1779239531 Not code I am safe to go anywhere near I'm afraid. Ask on the mapreduce-dev email group -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] HADOOP-18487. Protobuf 2.5 removal part 2: stop exporting protobuf-2.5" [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on PR #6185: URL: https://github.com/apache/hadoop/pull/6185#issuecomment-1779241280 @ayushtkn good catch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Assigned] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18933: --- Assignee: PJ Fanning > upgrade netty to 4.1.100 due to CVE >

[jira] [Resolved] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18933. - Resolution: Fixed > upgrade netty to 4.1.100 due to CVE >

[jira] [Updated] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18933: Component/s: build Fix Version/s: 3.4.0 Description: follow up to

Re: [PR] HADOOP-18933. upgrade to netty 4.1.100 due to CVE [hadoop]

2023-10-25 Thread via GitHub
steveloughran merged PR #6173: URL: https://github.com/apache/hadoop/pull/6173 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-16791 Add getEnclosingRoot API to filesystem interface and all implementations [hadoop]

2023-10-25 Thread via GitHub
steveloughran commented on PR #6198: URL: https://github.com/apache/hadoop/pull/6198#issuecomment-1779179402 1. javadoc failure is unrelated...been fixed on trunk. ignore. 2. checkstyles are related...mostly all indentation and line length. these should be fixed unless completely

[jira] [Created] (HADOOP-18950) upgrade avro to 1.11.3 due to CVE

2023-10-25 Thread Xuze Yang (Jira)
Xuze Yang created HADOOP-18950: -- Summary: upgrade avro to 1.11.3 due to CVE Key: HADOOP-18950 URL: https://issues.apache.org/jira/browse/HADOOP-18950 Project: Hadoop Common Issue Type: Bug

[jira] [Commented] (HADOOP-17912) ABFS: Support for Encryption Context

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779486#comment-17779486 ] ASF GitHub Bot commented on HADOOP-17912: - saxenapranav opened a new pull request, #6221: URL:

[PR] HADOOP-17912. ABFS: Support for Encryption Context [hadoop]

2023-10-25 Thread via GitHub
saxenapranav opened a new pull request, #6221: URL: https://github.com/apache/hadoop/pull/6221 This is a revival of PR https://github.com/apache/hadoop/pull/3440. The author of the PR has left the team and hence creating a new PR (as new changes (backmerge with trunk, comment-resolution)

Re: [PR] HDFS-17129. mis-order of ibr and fbr on datanode (For comiple because old is always failed.) [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6082: URL: https://github.com/apache/hadoop/pull/6082#issuecomment-1779057081 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Resolved] (HADOOP-18932) Upgrade AWS v2 SDK to 2.20.160 and v1 to 1.12.565

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18932. - Fix Version/s: 3.4.0 Assignee: Steve Loughran Resolution: Fixed >

[jira] [Updated] (HADOOP-18932) Upgrade AWS v2 SDK to 2.20.160 and v1 to 1.12.565

2023-10-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18932: Summary: Upgrade AWS v2 SDK to 2.20.160 and v1 to 1.12.565 (was: upgrade AWS v1 and v2

Re: [PR] YARN-11599. Incorrect log4j properties file in SLS sample conf [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6220: URL: https://github.com/apache/hadoop/pull/6220#issuecomment-1779004347 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11599. Incorrect log4j properties file in SLS sample conf [hadoop]

2023-10-25 Thread via GitHub
zuston commented on PR #6220: URL: https://github.com/apache/hadoop/pull/6220#issuecomment-1778792664 PTAL @slfan1989 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] YARN-11599. Incorrect log4j properties file in SLS sample conf [hadoop]

2023-10-25 Thread via GitHub
zuston opened a new pull request, #6220: URL: https://github.com/apache/hadoop/pull/6220 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Commented] (HADOOP-18395) Performance improvement in org.apache.hadoop.io.Text#find

2023-10-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779365#comment-17779365 ] ASF GitHub Bot commented on HADOOP-18395: - hadoop-yetus commented on PR #4714: URL:

Re: [PR] HADOOP-18395. Performance improvement in hadoop-common Text#find [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #4714: URL: https://github.com/apache/hadoop/pull/4714#issuecomment-1778630515 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17232. RBF: Fix NoNamenodesAvailableException for a long time, when use observer. [hadoop]

2023-10-25 Thread via GitHub
hadoop-yetus commented on PR #6208: URL: https://github.com/apache/hadoop/pull/6208#issuecomment-1778590147 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Resolved] (HADOOP-18920) RPC Metrics : Optimize logic for log slow RPCs

2023-10-25 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HADOOP-18920. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RPC Metrics : Optimize