[jira] [Commented] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842247#comment-17842247 ] ASF GitHub Bot commented on HADOOP-18610: - snvijaya commented on PR #5953: URL:

Re: [PR] HADOOP-18610. ABFS OAuth2 Token Provider support for Azure Workload Identity [hadoop]

2024-04-29 Thread via GitHub
snvijaya commented on PR #5953: URL: https://github.com/apache/hadoop/pull/5953#issuecomment-2084402076 Hi @creste , there is a need for this change to merge to trunk. Can you please share the plan on completing this PR. Please let me know if I can help you anyway to address the

Re: [PR] HDFS-17456. Fix the incorrect dfsused statistics of datanode when appending a file. [hadoop]

2024-04-29 Thread via GitHub
Hexiaoqiao commented on PR #6713: URL: https://github.com/apache/hadoop/pull/6713#issuecomment-2084350950 Committed to trunk. Thanks @fuchaohong and @ZanderXu ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] HDFS-17456. Fix the incorrect dfsused statistics of datanode when appending a file. [hadoop]

2024-04-29 Thread via GitHub
Hexiaoqiao merged PR #6713: URL: https://github.com/apache/hadoop/pull/6713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17471. Correct the percentage of sample range. [hadoop]

2024-04-29 Thread via GitHub
Hexiaoqiao commented on PR #6742: URL: https://github.com/apache/hadoop/pull/6742#issuecomment-2084348247 Committed to trunk. Thanks @fuchaohong for your contribution! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] HADOOP-19150: [ABFS] Fixing Test Code for ITestAbfsRestOperationException#testAuthFailException [hadoop]

2024-04-29 Thread via GitHub
anujmodi2021 commented on PR #6756: URL: https://github.com/apache/hadoop/pull/6756#issuecomment-2084347431 > merged to branch-3.4 as well! Thanks a lot @mukund-thakur -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842235#comment-17842235 ] ASF GitHub Bot commented on HADOOP-19150: - anujmodi2021 commented on PR #6756: URL:

Re: [PR] HDFS-17471. Correct the percentage of sample range. [hadoop]

2024-04-29 Thread via GitHub
Hexiaoqiao merged PR #6742: URL: https://github.com/apache/hadoop/pull/6742 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] YARN-11691. Add HTTP POST method to yarn web proxy servlet [hadoop]

2024-04-29 Thread via GitHub
zuston commented on PR #6781: URL: https://github.com/apache/hadoop/pull/6781#issuecomment-2084267643 LGTM. It's a case that flink encounters. Please take a look @slfan1989 . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (HADOOP-19146) noaa-cors-pds bucket access with global endpoint fails

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842223#comment-17842223 ] ASF GitHub Bot commented on HADOOP-19146: - virajjasani commented on PR #6723: URL:

Re: [PR] HADOOP-19146 noaa-cors-pds bucket access with global endpoint fails [hadoop]

2024-04-29 Thread via GitHub
virajjasani commented on PR #6723: URL: https://github.com/apache/hadoop/pull/6723#issuecomment-2084240325 @steveloughran does the latest revision look good? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] HDFS-17509. RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file. [hadoop]

2024-04-29 Thread via GitHub
LiuGuH opened a new pull request, #6784: URL: https://github.com/apache/hadoop/pull/6784 ### Description of PR As described [HDFS-17509](https://issues.apache.org/jira/browse/HDFS-17509) hdfs dfs -concat /tmp/merge /tmp/t1 /tmp/t2 When /tmp/merge is a empty file, this

Re: [PR] HDFS-17508. RBF: MembershipStateStore can overwrite valid records when refreshing the local cache [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6783: URL: https://github.com/apache/hadoop/pull/6783#issuecomment-2084069382 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[PR] HDFS-17508. CachedRecordStore should check if the record state is expired [hadoop]

2024-04-29 Thread via GitHub
dannytbecker opened a new pull request, #6783: URL: https://github.com/apache/hadoop/pull/6783 ### Description of PR When the MembershipStore refreshes its cache, it will also call the overrideExpiredRecords() method, which will write the Expired state back to the state store.

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842178#comment-17842178 ] ASF GitHub Bot commented on HADOOP-18679: - mukund-thakur commented on code in PR #6726: URL:

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-04-29 Thread via GitHub
mukund-thakur commented on code in PR #6726: URL: https://github.com/apache/hadoop/pull/6726#discussion_r1583846245 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/contract/s3a/ITestS3AContractBulkDelete.java: ## @@ -85,6 +88,9 @@ public

Re: [PR] HDFS-17464. Improve some logs output in class FsDatasetImpl [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6724: URL: https://github.com/apache/hadoop/pull/6724#issuecomment-2083608127 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6780: URL: https://github.com/apache/hadoop/pull/6780#issuecomment-2083539073 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842140#comment-17842140 ] ASF GitHub Bot commented on HADOOP-18610: - cthtrifork commented on PR #5953: URL:

Re: [PR] HADOOP-18610. ABFS OAuth2 Token Provider support for Azure Workload Identity [hadoop]

2024-04-29 Thread via GitHub
cthtrifork commented on PR #5953: URL: https://github.com/apache/hadoop/pull/5953#issuecomment-2083499367 Any progress on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] YARN-11685. Create a config to enable/disable cgroup v2 functionality [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6770: URL: https://github.com/apache/hadoop/pull/6770#issuecomment-2083495643 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6780: URL: https://github.com/apache/hadoop/pull/6780#issuecomment-2083490857 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842136#comment-17842136 ] ASF GitHub Bot commented on HADOOP-18679: - hadoop-yetus commented on PR #6726: URL:

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6726: URL: https://github.com/apache/hadoop/pull/6726#issuecomment-2083482008 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842115#comment-17842115 ] ASF GitHub Bot commented on HADOOP-19150: - mukund-thakur commented on PR #6756: URL:

Re: [PR] HADOOP-19150: [ABFS] Fixing Test Code for ITestAbfsRestOperationException#testAuthFailException [hadoop]

2024-04-29 Thread via GitHub
mukund-thakur commented on PR #6756: URL: https://github.com/apache/hadoop/pull/6756#issuecomment-2083292729 merged to branch-3.4 as well! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HADOOP-19152) Do not hard code security providers.

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842116#comment-17842116 ] ASF GitHub Bot commented on HADOOP-19152: - hadoop-yetus commented on PR #6739: URL:

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2083295687 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Resolved] (HADOOP-19151) Support configurable SASL mechanism

2024-04-29 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze resolved HADOOP-19151. - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed The pull request is

[jira] [Commented] (HADOOP-19151) Support configurable SASL mechanism

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842102#comment-17842102 ] ASF GitHub Bot commented on HADOOP-19151: - szetszwo commented on PR #6740: URL:

[jira] [Commented] (HADOOP-19151) Support configurable SASL mechanism

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842101#comment-17842101 ] ASF GitHub Bot commented on HADOOP-19151: - szetszwo merged PR #6740: URL:

Re: [PR] HADOOP-19151. Support configurable SASL mechanism. [hadoop]

2024-04-29 Thread via GitHub
szetszwo commented on PR #6740: URL: https://github.com/apache/hadoop/pull/6740#issuecomment-2083229637 @jojochuang , thanks a lot for reviewing this! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HADOOP-19151. Support configurable SASL mechanism. [hadoop]

2024-04-29 Thread via GitHub
szetszwo merged PR #6740: URL: https://github.com/apache/hadoop/pull/6740 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19150. Fix Version/s: 3.4.1 Resolution: Fixed > Test

[jira] [Commented] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842096#comment-17842096 ] ASF GitHub Bot commented on HADOOP-19150: - mukund-thakur merged PR #6756: URL:

Re: [PR] HADOOP-19150: [ABFS] Fixing Test Code for ITestAbfsRestOperationException#testAuthFailException [hadoop]

2024-04-29 Thread via GitHub
mukund-thakur merged PR #6756: URL: https://github.com/apache/hadoop/pull/6756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6780: URL: https://github.com/apache/hadoop/pull/6780#issuecomment-2083057386 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11685. Create a config to enable/disable cgroup v2 functionality [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6770: URL: https://github.com/apache/hadoop/pull/6770#issuecomment-2083052404 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11685. Create a config to enable/disable cgroup v2 functionality [hadoop]

2024-04-29 Thread via GitHub
p-szucs commented on code in PR #6770: URL: https://github.com/apache/hadoop/pull/6770#discussion_r1583282084 ##

Re: [PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6780: URL: https://github.com/apache/hadoop/pull/6780#issuecomment-2083028134 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-16368. DFSadmin supports refresh topology info without restarting namenode [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #3743: URL: https://github.com/apache/hadoop/pull/3743#issuecomment-2083008344 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-16368. DFSadmin supports refresh topology info without restarting namenode [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #3743: URL: https://github.com/apache/hadoop/pull/3743#issuecomment-2083005130 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19107) Drop support for HBase v1 & upgrade HBase v2

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842024#comment-17842024 ] Steve Loughran commented on HADOOP-19107: - yay! # add in release notes? # backport to 3.4.1? #

[jira] [Assigned] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19159: --- Assignee: Xi Chen > Fix hadoop-aws document for

[jira] [Commented] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842017#comment-17842017 ] Steve Loughran commented on HADOOP-19159: - thanks! merged to all the maintained branches > Fix

[jira] [Updated] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19159: Affects Version/s: 3.3.6 > Fix hadoop-aws document for

[jira] [Resolved] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19159. - Fix Version/s: 3.3.9 3.5.0 3.4.1

[jira] [Commented] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842015#comment-17842015 ] ASF GitHub Bot commented on HADOOP-19159: - steveloughran merged PR #6778: URL:

Re: [PR] HADOOP-19159. Fix document for fs.s3a.committer.abort.pending.uploads [hadoop]

2024-04-29 Thread via GitHub
steveloughran merged PR #6778: URL: https://github.com/apache/hadoop/pull/6778 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] HDFS-17503. Unreleased volume references because of OOM. [hadoop]

2024-04-29 Thread via GitHub
zhuzilong2013 opened a new pull request, #6782: URL: https://github.com/apache/hadoop/pull/6782 ### Description of PR Refer to HDFS-17503. When BlockSender throws an error because of OOM,the volume reference obtained by the thread is not released,which causes the thread trying to

Re: [PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6780: URL: https://github.com/apache/hadoop/pull/6780#issuecomment-2082936509 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11685. Create a config to enable/disable cgroup v2 functionality [hadoop]

2024-04-29 Thread via GitHub
brumi1024 commented on code in PR #6770: URL: https://github.com/apache/hadoop/pull/6770#discussion_r1583197107 ##

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842005#comment-17842005 ] ASF GitHub Bot commented on HADOOP-18679: - hadoop-yetus commented on PR #6738: URL:

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6738: URL: https://github.com/apache/hadoop/pull/6738#issuecomment-2082900564 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11675. Update MemoryResourceHandler implementation for cgroup v2 support [hadoop]

2024-04-29 Thread via GitHub
brumi1024 merged PR #6760: URL: https://github.com/apache/hadoop/pull/6760 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] YARN-11675. Update MemoryResourceHandler implementation for cgroup v2 support [hadoop]

2024-04-29 Thread via GitHub
brumi1024 commented on PR #6760: URL: https://github.com/apache/hadoop/pull/6760#issuecomment-2082896070 Thanks @p-szucs for the patch, LGTM. Merging to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] HDFS-17470. FsVolumeList#getNextVolume can be moved out of DataSetLock. [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6733: URL: https://github.com/apache/hadoop/pull/6733#issuecomment-2082819266 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17463. Support the switch StringTable Split ID feature [hadoop]

2024-04-29 Thread via GitHub
Hexiaoqiao commented on PR #6736: URL: https://github.com/apache/hadoop/pull/6736#issuecomment-2082660933 @XbaoWu @hiwangzhihui Thanks for your works. I prefer to push this feature into tool module. a. I totally agree that fsimage is not compatible with all versions (include some

Re: [PR] HDFS-16368. DFSadmin supports refresh topology info without restarting namenode [hadoop]

2024-04-29 Thread via GitHub
hfutatzhanghb commented on code in PR #3743: URL: https://github.com/apache/hadoop/pull/3743#discussion_r1583039222 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java: ## @@ -1281,6 +1282,57 @@ nodes with its data

Re: [PR] HDFS-17463. Support the switch StringTable Split ID feature [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6736: URL: https://github.com/apache/hadoop/pull/6736#issuecomment-2082632595 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19151) Support configurable SASL mechanism

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841980#comment-17841980 ] ASF GitHub Bot commented on HADOOP-19151: - hadoop-yetus commented on PR #6740: URL:

Re: [PR] HADOOP-19151. Support configurable SASL mechanism. [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6740: URL: https://github.com/apache/hadoop/pull/6740#issuecomment-2082628244 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] YARN-11685. Create a config to enable/disable cgroup v2 functionality [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6770: URL: https://github.com/apache/hadoop/pull/6770#issuecomment-2082453879 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11691. Add HTTP POST method to yarn web proxy servlet [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6781: URL: https://github.com/apache/hadoop/pull/6781#issuecomment-2082449270 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6780: URL: https://github.com/apache/hadoop/pull/6780#issuecomment-2082387079 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. [hadoop]

2024-04-29 Thread via GitHub
ayushtkn commented on PR #6664: URL: https://github.com/apache/hadoop/pull/6664#issuecomment-2082356393 The build results aren't good https://ci-hadoop.apache.org/view/Hadoop/job/hadoop-qbt-trunk-java8-linux-x86_64/1573/testReport/ some 12K tests vanished

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841928#comment-17841928 ] ASF GitHub Bot commented on HADOOP-18516: - hadoop-yetus commented on PR #6552: URL:

Re: [PR] HADOOP-18516: [ABFS][Authentication] Support Fixed SAS Token for ABFS Authentication [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6552: URL: https://github.com/apache/hadoop/pull/6552#issuecomment-2082335808 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17471. Correct the percentage of file I/O events. [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6742: URL: https://github.com/apache/hadoop/pull/6742#issuecomment-2082229133 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-18516: [ABFS][Authentication] Support Fixed SAS Token for ABFS Authentication [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6552: URL: https://github.com/apache/hadoop/pull/6552#issuecomment-2082215735 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841911#comment-17841911 ] ASF GitHub Bot commented on HADOOP-18516: - hadoop-yetus commented on PR #6552: URL:

[PR] YARN-11691. Add HTTP POST method to yarn web proxy servlet [hadoop]

2024-04-29 Thread via GitHub
yeezychao opened a new pull request, #6781: URL: https://github.com/apache/hadoop/pull/6781 ### Description of PR The flink front-end tried to use the POST method to call the yarn server rest api, but it returned a 405 error. see [FLINK-35039,I think that flink should not be

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841899#comment-17841899 ] ASF GitHub Bot commented on HADOOP-18516: - hadoop-yetus commented on PR #6552: URL:

Re: [PR] HADOOP-18516: [ABFS][Authentication] Support Fixed SAS Token for ABFS Authentication [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6552: URL: https://github.com/apache/hadoop/pull/6552#issuecomment-2082148111 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17471. Correct the percentage of file I/O events. [hadoop]

2024-04-29 Thread via GitHub
fuchaohong commented on code in PR #6742: URL: https://github.com/apache/hadoop/pull/6742#discussion_r1582697502 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/ProfilingFileIoEvents.java: ## @@ -80,7 +80,7 @@ public void

[jira] [Commented] (HADOOP-19137) [ABFS]:Extra getAcl call while calling the very first API of FileSystem

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841884#comment-17841884 ] ASF GitHub Bot commented on HADOOP-19137: - hadoop-yetus commented on PR #6752: URL:

Re: [PR] HADOOP-19137. [ABFS]Fail fs init if cpk config is given on non-hns account [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6752: URL: https://github.com/apache/hadoop/pull/6752#issuecomment-2082085529 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] improvement: yetus exit [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6744: URL: https://github.com/apache/hadoop/pull/6744#issuecomment-2082083815 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17471. Correct the percentage of file I/O events. [hadoop]

2024-04-29 Thread via GitHub
Hexiaoqiao commented on code in PR #6742: URL: https://github.com/apache/hadoop/pull/6742#discussion_r1582649920 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/ProfilingFileIoEvents.java: ## @@ -80,7 +80,7 @@ public void

[PR] YARN-11687. Update CGroupsResourceCalculator to track usages using cgroupv2 [hadoop]

2024-04-29 Thread via GitHub
K0K0V0K opened a new pull request, #6780: URL: https://github.com/apache/hadoop/pull/6780 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

Re: [PR] HDFS-17475. Add verifyReadable command to check if files are readable [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6745: URL: https://github.com/apache/hadoop/pull/6745#issuecomment-2082067434 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841877#comment-17841877 ] ASF GitHub Bot commented on HADOOP-18516: - anmolanmol1234 commented on code in PR #6552: URL:

Re: [PR] HADOOP-18516: [ABFS][Authentication] Support Fixed SAS Token for ABFS Authentication [hadoop]

2024-04-29 Thread via GitHub
anmolanmol1234 commented on code in PR #6552: URL: https://github.com/apache/hadoop/pull/6552#discussion_r1582642060 ## hadoop-tools/hadoop-azure/src/site/markdown/abfs.md: ## @@ -609,21 +610,119 @@ In case delegation token is enabled, and the config `fs.azure.delegation.token

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841876#comment-17841876 ] ASF GitHub Bot commented on HADOOP-18516: - anmolanmol1234 commented on code in PR #6552: URL:

Re: [PR] HADOOP-18516: [ABFS][Authentication] Support Fixed SAS Token for ABFS Authentication [hadoop]

2024-04-29 Thread via GitHub
anmolanmol1234 commented on code in PR #6552: URL: https://github.com/apache/hadoop/pull/6552#discussion_r1582640059 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1419,16 +1421,17 @@ private String

Re: [PR] HADOOP-19154. Upgrade bouncycastle to 1.78.1 due to CVEs [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6755: URL: https://github.com/apache/hadoop/pull/6755#issuecomment-2082005097 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

[jira] [Commented] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841867#comment-17841867 ] ASF GitHub Bot commented on HADOOP-19150: - hadoop-yetus commented on PR #6756: URL:

Re: [PR] HADOOP-19150: [ABFS] Fixing Test Code for ITestAbfsRestOperationException#testAuthFailException [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6756: URL: https://github.com/apache/hadoop/pull/6756#issuecomment-2082003780 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17456. Fix the dfsused statistics of datanode are incorrect when appending a file. [hadoop]

2024-04-29 Thread via GitHub
fuchaohong commented on PR #6713: URL: https://github.com/apache/hadoop/pull/6713#issuecomment-2081977865 > @fuchaohong Hi, IIUC the `dfsused` will be refreshed periodically. Do you meet any issues about this metric? Thanks. @Hexiaoqiao Indeed, the dfsused metric is corrected

[jira] [Commented] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-04-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841859#comment-17841859 ] ASF GitHub Bot commented on HADOOP-18516: - anujmodi2021 commented on code in PR #6552: URL:

Re: [PR] HADOOP-18516: [ABFS][Authentication] Support Fixed SAS Token for ABFS Authentication [hadoop]

2024-04-29 Thread via GitHub
anujmodi2021 commented on code in PR #6552: URL: https://github.com/apache/hadoop/pull/6552#discussion_r1582581353 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/FixedSASTokenProvider.java: ## @@ -0,0 +1,46 @@ +/** + * Licensed to the Apache