Re: [PR] HDFS-17401. EC: Excess internal block may not be able to be deleted correctly when it's stored in fallback storage [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6597: URL: https://github.com/apache/hadoop/pull/6597#issuecomment-2076378724 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11655. modify default value of Allocated GPUs and Reserved GPUs in yarn scheduler webui from -1 to 0 [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6564: URL: https://github.com/apache/hadoop/pull/6564#issuecomment-2076330111 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6545: URL: https://github.com/apache/hadoop/pull/6545#issuecomment-2076298066 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

Re: [PR] YARN-11656 RMStateStore event queue blocked [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6569: URL: https://github.com/apache/hadoop/pull/6569#issuecomment-2076287327 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17397. Choose another DN as soon as possible, when encountering network issues [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6591: URL: https://github.com/apache/hadoop/pull/6591#issuecomment-2076278535 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17384. [FGL] Replace the global lock with global FS Lock and global BM lock [hadoop]

2024-04-24 Thread via GitHub
hfutatzhanghb commented on code in PR #6762: URL: https://github.com/apache/hadoop/pull/6762#discussion_r1578763344 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -6043,7 +6079,7 @@ void updatePipeline(

Re: [PR] HDFS-17499. removeQueuedBlock in PendingDataNodeMessages has memory leak [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6772: URL: https://github.com/apache/hadoop/pull/6772#issuecomment-2076151769 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19103) Add logic for verifying that the STS URL is in the correct format

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840614#comment-17840614 ] ASF GitHub Bot commented on HADOOP-19103: - hadoop-yetus commented on PR #6615: URL:

Re: [PR] HADOOP-19103 : Add logic for verifying that the STS URL is in the correct format [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6615: URL: https://github.com/apache/hadoop/pull/6615#issuecomment-2076140834 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] MAPREDUCE-7402. fix mapreduce.task.io.sort.factor=1 lead to an infinite loop. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6622: URL: https://github.com/apache/hadoop/pull/6622#issuecomment-2076126062 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2076112558 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19152) Do not hard code security providers.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840606#comment-17840606 ] ASF GitHub Bot commented on HADOOP-19152: - hadoop-yetus commented on PR #6739: URL:

Re: [PR] YARN-11664: Remove HDFS Binaries/Jars Dependency From Yarn [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6631: URL: https://github.com/apache/hadoop/pull/6631#issuecomment-2076109814 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17402. StartupSafeMode should not exit when resources are from l… [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6618: URL: https://github.com/apache/hadoop/pull/6618#issuecomment-2076062911 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Resolved] (HADOOP-17647) Release Hadoop 3.3.1

2024-04-24 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17647. -- Assignee: Wei-Chiu Chuang Resolution: Done The release was published on June

[jira] [Commented] (HADOOP-18184) s3a prefetching stream to support unbuffer()

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840581#comment-17840581 ] ASF GitHub Bot commented on HADOOP-18184: - hadoop-yetus commented on PR #5832: URL:

Re: [PR] HADOOP-18184. S3A Prefetching unbuffer. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #5832: URL: https://github.com/apache/hadoop/pull/5832#issuecomment-2075868288 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19128) Unified use of placeholder for log calling

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840580#comment-17840580 ] ASF GitHub Bot commented on HADOOP-19128: - hadoop-yetus commented on PR #6680: URL:

Re: [PR] HADOOP-19128. Unified use of placeholder for log calling. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6680: URL: https://github.com/apache/hadoop/pull/6680#issuecomment-2075863421 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840579#comment-17840579 ] ASF GitHub Bot commented on HADOOP-19013: - hadoop-yetus commented on PR #6646: URL:

Re: [PR] HADOOP-19013. Adding x-amz-server-side-encryption-aws-kms-key-id in the get file attributes for S3A. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6646: URL: https://github.com/apache/hadoop/pull/6646#issuecomment-2075856297 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11261 Avoid unnecessary reconstruction of ConfigurationProperties [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6652: URL: https://github.com/apache/hadoop/pull/6652#issuecomment-2075830470 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11690. Update container executor to use CGROUP2_SUPER_MAGIC in cgroup 2 scenarios [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6771: URL: https://github.com/apache/hadoop/pull/6771#issuecomment-2075790931 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19074) Transitive dependencies with CVEs in Hadoop distro

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840569#comment-17840569 ] ASF GitHub Bot commented on HADOOP-19074: - hadoop-yetus commented on PR #6586: URL:

Re: [PR] Commit to remove vulnerabilities raised for: HADOOP-19074 [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6586: URL: https://github.com/apache/hadoop/pull/6586#issuecomment-2075787815 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | -1 :x: | patch

[jira] [Commented] (HADOOP-19152) Do not hard code security providers.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840562#comment-17840562 ] ASF GitHub Bot commented on HADOOP-19152: - szetszwo commented on code in PR #6739: URL:

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-24 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1578474234 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Commented] (HADOOP-19085) Compatibility Benchmark over HCFS Implementations

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840561#comment-17840561 ] ASF GitHub Bot commented on HADOOP-19085: - hadoop-yetus commented on PR #6602: URL:

Re: [PR] HADOOP-19085 Add hadoop-compat-bench [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6602: URL: https://github.com/apache/hadoop/pull/6602#issuecomment-2075764416 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | -1 :x: | patch

[jira] [Commented] (HADOOP-19152) Do not hard code security providers.

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840560#comment-17840560 ] ASF GitHub Bot commented on HADOOP-19152: - szetszwo commented on code in PR #6739: URL:

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-24 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1578470256 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] YARN-11674. Add CPUResourceHandler for cgroup v2. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6751: URL: https://github.com/apache/hadoop/pull/6751#issuecomment-2075756590 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17438. RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6655: URL: https://github.com/apache/hadoop/pull/6655#issuecomment-2075751591 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19134) use StringBuilder instead of StringBuffer

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840554#comment-17840554 ] ASF GitHub Bot commented on HADOOP-19134: - hadoop-yetus commented on PR #6692: URL:

Re: [PR] HADOOP-19134. Use StringBuilder instead of StringBuffer. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6692: URL: https://github.com/apache/hadoop/pull/6692#issuecomment-2075737382 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues… [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6769: URL: https://github.com/apache/hadoop/pull/6769#issuecomment-2075632733 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17499. removeQueuedBlock in PendingDataNodeMessages has memory leak [hadoop]

2024-04-24 Thread via GitHub
dannytbecker commented on PR #6772: URL: https://github.com/apache/hadoop/pull/6772#issuecomment-2075562444 @ayushtkn @goiri Please take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[PR] HDFS-17499. removeQueuedBlock in PendingDataNodeMessages has memory leak [hadoop]

2024-04-24 Thread via GitHub
dannytbecker opened a new pull request, #6772: URL: https://github.com/apache/hadoop/pull/6772 ### Description of PR Introduced by [HDFS-17477](https://issues.apache.org/jira/browse/HDFS-17477). The PendingDataNodeMessages#removeQueuedBlock() will create an empty list stored in

[PR] YARN-11690. Update container executor to use CGROUP2_SUPER_MAGIC in cgroup 2 scenarios [hadoop]

2024-04-24 Thread via GitHub
brumi1024 opened a new pull request, #6771: URL: https://github.com/apache/hadoop/pull/6771 ### Description of PR The container executor function write_pid_to_cgroup_as_root writes the PID of the newly launched container to the correct cgroup.procs file. However it checks if

Re: [PR] HDFS-17439. Support -nonSuperUser for NNThroughputBenchmark: useful f… [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6677: URL: https://github.com/apache/hadoop/pull/6677#issuecomment-2075445476 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19156) ZooKeeper based state stores use different ZK address configs

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840519#comment-17840519 ] ASF GitHub Bot commented on HADOOP-19156: - hadoop-yetus commented on PR #6767: URL:

Re: [PR] HADOOP-19156. ZooKeeper based state stores use different ZK address c… [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6767: URL: https://github.com/apache/hadoop/pull/6767#issuecomment-2075430805 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] [DRAFT] Jackson 2.14 [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6761: URL: https://github.com/apache/hadoop/pull/6761#issuecomment-2075399527 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6660: URL: https://github.com/apache/hadoop/pull/6660#issuecomment-2075366509 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-19154. Upgrade bouncycastle to 1.78.1 due to CVEs [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6755: URL: https://github.com/apache/hadoop/pull/6755#issuecomment-2075352907 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues… [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6768: URL: https://github.com/apache/hadoop/pull/6768#issuecomment-2075284019 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17446. The DataNode adds a log to report its progress during addToReplicasMap execution. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6685: URL: https://github.com/apache/hadoop/pull/6685#issuecomment-2075182513 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-19136. Upgrade commons-io to 2.16.1. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6704: URL: https://github.com/apache/hadoop/pull/6704#issuecomment-2075179751 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19136) Upgrade commons-io to 2.16.1

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840477#comment-17840477 ] ASF GitHub Bot commented on HADOOP-19136: - hadoop-yetus commented on PR #6704: URL:

[jira] [Commented] (HADOOP-18184) s3a prefetching stream to support unbuffer()

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840473#comment-17840473 ] ASF GitHub Bot commented on HADOOP-18184: - steveloughran commented on PR #5832: URL:

[PR] YARN-11685. Create a config to enable/disable cgroup v2 functionality [hadoop]

2024-04-24 Thread via GitHub
p-szucs opened a new pull request, #6770: URL: https://github.com/apache/hadoop/pull/6770 ### Description of PR Various OS's mount the cgroup v2 differently, some of them mount both the v1 and v2 structure, others mount a hybrid structure. To avoid initialization issues the

[PR] YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues… [hadoop]

2024-04-24 Thread via GitHub
tomicooler opened a new pull request, #6769: URL: https://github.com/apache/hadoop/pull/6769 … (#6732) (cherry picked from commit ecf665c6facf89d3b87b6e3cc684274b8155ca60) Change-Id: I561bcad51af7810328c8b91cd9290d5198be0c6e ### Description of PR Backport,

Re: [PR] HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6664: URL: https://github.com/apache/hadoop/pull/6664#issuecomment-2075039871 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11674. Add CPUResourceHandler for cgroup v2. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6751: URL: https://github.com/apache/hadoop/pull/6751#issuecomment-2074930513 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[PR] YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues… [hadoop]

2024-04-24 Thread via GitHub
tomicooler opened a new pull request, #6768: URL: https://github.com/apache/hadoop/pull/6768 … (#6732) (cherry picked from commit ecf665c6facf89d3b87b6e3cc684274b8155ca60) ### Description of PR backport. Jira:

Re: [PR] YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues [hadoop]

2024-04-24 Thread via GitHub
brumi1024 merged PR #6732: URL: https://github.com/apache/hadoop/pull/6732 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues [hadoop]

2024-04-24 Thread via GitHub
brumi1024 commented on PR #6732: URL: https://github.com/apache/hadoop/pull/6732#issuecomment-2074890741 Thanks for the patch @tomicooler and @slfan1989 @p-szucs for the review, merging to trunk. @tomicooler can you please check if a backport is possible to the branches 3.3 and 3.4? --

Re: [PR] HADOOP-18958. UserGroupInformation debug log improve. [hadoop]

2024-04-24 Thread via GitHub
hiwangzhihui commented on PR #6255: URL: https://github.com/apache/hadoop/pull/6255#issuecomment-2074872335 @steveloughran Thank you for your review! I agree with your view. The message "Java. lang. Exception" can confuse troubleshooting and mistakenly assume that an exception has

[jira] [Commented] (HADOOP-18958) UserGroupInformation debug log improve

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840421#comment-17840421 ] ASF GitHub Bot commented on HADOOP-18958: - hiwangzhihui commented on PR #6255: URL:

Re: [PR] HDFS-17444. Add getJournalSyncerStarted jmx metrics, to Indicates whether the JournalSyncer thread has been started. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6694: URL: https://github.com/apache/hadoop/pull/6694#issuecomment-2074815022 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17454. Fix namenode fsck swallows the exception stacktrace, this can help us to troubleshooting log. [hadoop]

2024-04-24 Thread via GitHub
xiaojunxiang2023 commented on PR #6709: URL: https://github.com/apache/hadoop/pull/6709#issuecomment-2074706653 > Can you add a test for this, considering now we are propagating the real error back to the client. > > I think if the actual error is being thrown in that case on the

Re: [PR] HDFS-17454. Fix namenode fsck swallows the exception stacktrace, this can help us to troubleshooting log. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6709: URL: https://github.com/apache/hadoop/pull/6709#issuecomment-2074675857 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Updated] (HADOOP-19107) Drop support for HBase v1 & upgrade HBase v2

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-19107: -- Summary: Drop support for HBase v1 & upgrade HBase v2 (was: Drop support for HBase v1) >

[jira] [Resolved] (HADOOP-19107) Drop support for HBase v1

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-19107. --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Drop support

[jira] [Commented] (HADOOP-19107) Drop support for HBase v1

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840374#comment-17840374 ] Ayush Saxena commented on HADOOP-19107: --- Committed to trunk. Thanx [~vinayakumarb] &

[jira] [Assigned] (HADOOP-19107) Drop support for HBase v1

2024-04-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HADOOP-19107: - Assignee: Ayush Saxena > Drop support for HBase v1 > - > >

[jira] [Commented] (HADOOP-19156) ZooKeeper based state stores use different ZK address configs

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840372#comment-17840372 ] ASF GitHub Bot commented on HADOOP-19156: - liubin101 opened a new pull request, #6767: URL:

[jira] [Updated] (HADOOP-19156) ZooKeeper based state stores use different ZK address configs

2024-04-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19156: Labels: pull-request-available (was: ) > ZooKeeper based state stores use different ZK

[PR] HADOOP-19156. ZooKeeper based state stores use different ZK address c… [hadoop]

2024-04-24 Thread via GitHub
liubin101 opened a new pull request, #6767: URL: https://github.com/apache/hadoop/pull/6767 ### Description of PR Currently, the Zookeeper-based state stores of RM, YARN Federation, and HDFS Federation use the same ZK address config `hadoop.zk.address`. But in our production

Re: [PR] YARN-11672. Create a CgroupHandler implementation for cgroup v2 [hadoop]

2024-04-24 Thread via GitHub
brumi1024 commented on PR #6734: URL: https://github.com/apache/hadoop/pull/6734#issuecomment-2074523067 Thanks for the review @tomicooler @slfan1989, merged to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] YARN-11672. Create a CgroupHandler implementation for cgroup v2 [hadoop]

2024-04-24 Thread via GitHub
brumi1024 merged PR #6734: URL: https://github.com/apache/hadoop/pull/6734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17497. The number of bytes of the last committed block should be calculated into the file length [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6765: URL: https://github.com/apache/hadoop/pull/6765#issuecomment-2074475186 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17488. DN can fail IBRs with NPE when a volume is removed [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6759: URL: https://github.com/apache/hadoop/pull/6759#issuecomment-2074474125 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6664: URL: https://github.com/apache/hadoop/pull/6664#issuecomment-2074275818 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

Re: [PR] MAPREDUCE-7474. Improve Manifest committer resilience [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6716: URL: https://github.com/apache/hadoop/pull/6716#issuecomment-2074254789 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17458. Remove unnecessary BP lock in ReplicaMap. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6717: URL: https://github.com/apache/hadoop/pull/6717#issuecomment-2074182504 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] MAPREDUCE-7474. Improve Manifest committer resilience [hadoop]

2024-04-24 Thread via GitHub
saxenapranav commented on code in PR #6716: URL: https://github.com/apache/hadoop/pull/6716#discussion_r1577303182 ##