[jira] [Updated] (HADOOP-18776) Add OptimizedS3AMagicCommitter For Zero Rename Commits to S3 Endpoints

2023-06-21 Thread Syed Shameerur Rahman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Syed Shameerur Rahman updated HADOOP-18776: --- Description: The goal is to add a new S3A committer named

[jira] [Comment Edited] (HADOOP-18776) Add OptimizedS3AMagicCommitter For Zero Rename Commits to S3 Endpoints

2023-06-21 Thread Syed Shameerur Rahman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735980#comment-17735980 ] Syed Shameerur Rahman edited comment on HADOOP-18776 at 6/22/23 5:57 AM:

[jira] [Commented] (HADOOP-18776) Add OptimizedS3AMagicCommitter For Zero Rename Commits to S3 Endpoints

2023-06-21 Thread Syed Shameerur Rahman (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735980#comment-17735980 ] Syed Shameerur Rahman commented on HADOOP-18776: [~ste...@apache.org] - Thanks a lot

[GitHub] [hadoop] hadoop-yetus commented on pull request #5764: HDFS-17055 Export HAState as a metric from Namenode for monitoring

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5764: URL: https://github.com/apache/hadoop/pull/5764#issuecomment-1601979122 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 opened a new pull request, #5766: YARN-11517. Improve Federation#RouterCLI deregisterSubCluster Code.

2023-06-21 Thread via GitHub
slfan1989 opened a new pull request, #5766: URL: https://github.com/apache/hadoop/pull/5766 ### Description of PR JIRA: YARN-11517. Improve Federation#RouterCLI deregisterSubCluster Code. ### How was this patch tested? ### For code changes: - [ ] Does

[jira] [Commented] (HADOOP-18779) Improve hadoop-function.sh#status script

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735940#comment-17735940 ] ASF GitHub Bot commented on HADOOP-18779: - slfan1989 commented on PR #5762: URL:

[GitHub] [hadoop] slfan1989 commented on pull request #5762: HADOOP-18779. Improve hadoop-function.sh#status script.

2023-06-21 Thread via GitHub
slfan1989 commented on PR #5762: URL: https://github.com/apache/hadoop/pull/5762#issuecomment-1601858533 > I wonder if not outputting anything was done by design. > I can see the case for a daemon not outputting anything. Thanks for your explanation! I will use this command again

[jira] [Commented] (HADOOP-18713) Update solr from 8.8.2 to 8.11.2

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735937#comment-17735937 ] ASF GitHub Bot commented on HADOOP-18713: - jojochuang commented on PR #5459: URL:

[GitHub] [hadoop] jojochuang commented on pull request #5459: YARN-11453. Update solr from 8.8.2 to 8.11.2

2023-06-21 Thread via GitHub
jojochuang commented on PR #5459: URL: https://github.com/apache/hadoop/pull/5459#issuecomment-160186 It does run YARN unit tests so that's good. +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HADOOP-18780) Add tags 3.3/3.3.5 to the official Hadoop docker image

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735931#comment-17735931 ] ASF GitHub Bot commented on HADOOP-18780: - jojochuang opened a new pull request, #5765: URL:

[jira] [Updated] (HADOOP-18780) Add tags 3.3/3.3.5 to the official Hadoop docker image

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18780: Labels: pull-request-available (was: ) > Add tags 3.3/3.3.5 to the official Hadoop

[GitHub] [hadoop] jojochuang opened a new pull request, #5765: HADOOP-18780. Add tags 3.3/3.3.5 to the official Hadoop docker image.

2023-06-21 Thread via GitHub
jojochuang opened a new pull request, #5765: URL: https://github.com/apache/hadoop/pull/5765 ### Description of PR Add additional tags to the Hadoop docker images. ### How was this patch tested? Manually tested locally. > $ docker images apache/hadoop > REPOSITORY

[jira] [Updated] (HADOOP-18780) Add tags 3.3/3.3.5 to the official Hadoop docker image

2023-06-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18780: - Summary: Add tags 3.3/3.3.5 to the official Hadoop docker image (was: Add tags

[jira] [Updated] (HADOOP-18780) Add tags 3.3/3.3.5 for the official Hadoop docker image

2023-06-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18780: - Summary: Add tags 3.3/3.3.5 for the official Hadoop docker image (was: Add tag

[jira] [Assigned] (HADOOP-18780) Add tags 3.3/3.3.5 for the official Hadoop docker image

2023-06-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-18780: Assignee: Wei-Chiu Chuang > Add tags 3.3/3.3.5 for the official Hadoop docker

[jira] [Created] (HADOOP-18780) Add tag 3.3/3.3.5 for the official Hadoop docker image

2023-06-21 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-18780: Summary: Add tag 3.3/3.3.5 for the official Hadoop docker image Key: HADOOP-18780 URL: https://issues.apache.org/jira/browse/HADOOP-18780 Project: Hadoop

[GitHub] [hadoop] xinglin opened a new pull request, #5764: HDFS-17055 Export HAState as a metric from Namenode for monitoring

2023-06-21 Thread via GitHub
xinglin opened a new pull request, #5764: URL: https://github.com/apache/hadoop/pull/5764 ### Description of PR We'd like measure the uptime for Namenodes: percentage of time when we have the active/standby/observer node available (up and running). We could monitor the namenode

[GitHub] [hadoop] hadoop-yetus commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1601730308 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5727: YARN-11509. The FederationInterceptor#launchUAM Added retry logic.

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5727: URL: https://github.com/apache/hadoop/pull/5727#issuecomment-1601158929 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5747: YARN-7707. BackPort [GPG] Policy generator framework.

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5747: URL: https://github.com/apache/hadoop/pull/5747#issuecomment-1601145499 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] goiri commented on a diff in pull request #5752: YARN-11515. [Federation] Improve DefaultRequestInterceptor#init Code.

2023-06-21 Thread via GitHub
goiri commented on code in PR #5752: URL: https://github.com/apache/hadoop/pull/5752#discussion_r1237252214 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/DefaultClientRequestInterceptor.java:

[jira] [Commented] (HADOOP-18779) Improve hadoop-function.sh#status script

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735800#comment-17735800 ] ASF GitHub Bot commented on HADOOP-18779: - goiri commented on PR #5762: URL:

[GitHub] [hadoop] goiri commented on pull request #5762: HADOOP-18779. Improve hadoop-function.sh#status script.

2023-06-21 Thread via GitHub
goiri commented on PR #5762: URL: https://github.com/apache/hadoop/pull/5762#issuecomment-1601120243 I wonder if not outputting anything was done by design. I can see the case for a daemon not outputting anything. -- This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HADOOP-18596) Distcp -update between different cloud stores to use modification time while checking for file skip.

2023-06-21 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735771#comment-17735771 ] Wei-Chiu Chuang commented on HADOOP-18596: -- Hi [~mehakmeetSingh] in case you missed the Hadoop

[GitHub] [hadoop] hadoop-yetus commented on pull request #5752: YARN-11515. [Federation] Improve DefaultRequestInterceptor#init Code.

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5752: URL: https://github.com/apache/hadoop/pull/5752#issuecomment-1600965752 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] arturobernalg closed pull request #2643: [HDFS-15786] - Minor improvement use isEmpty

2023-06-21 Thread via GitHub
arturobernalg closed pull request #2643: [HDFS-15786] - Minor improvement use isEmpty URL: https://github.com/apache/hadoop/pull/2643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HADOOP-18778) Test failures with CSE enabled

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735726#comment-17735726 ] ASF GitHub Bot commented on HADOOP-18778: - hadoop-yetus commented on PR #5763: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5763: HADOOP-18778. Fixes failing tests when CSE is enabled.

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5763: URL: https://github.com/apache/hadoop/pull/5763#issuecomment-1600842276 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1600757341 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18778) Test failures with CSE enabled

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18778: Labels: pull-request-available (was: ) > Test failures with CSE enabled >

[jira] [Commented] (HADOOP-18778) Test failures with CSE enabled

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735697#comment-17735697 ] ASF GitHub Bot commented on HADOOP-18778: - ahmarsuhail opened a new pull request, #5763: URL:

[GitHub] [hadoop] ahmarsuhail opened a new pull request, #5763: HADOOP-18778. Fixes failing tests when CSE is enabled.

2023-06-21 Thread via GitHub
ahmarsuhail opened a new pull request, #5763: URL: https://github.com/apache/hadoop/pull/5763 ### Description of PR JIRA: https://issues.apache.org/jira/browse/HADOOP-18778 - Skips any tests that read landsat data, as it is not encrypted with CSE so it will fail. - Updates

[GitHub] [hadoop] brumi1024 merged pull request #5745: YARN-11511. Improve TestRMWebServices test config and data.

2023-06-21 Thread via GitHub
brumi1024 merged PR #5745: URL: https://github.com/apache/hadoop/pull/5745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] brumi1024 commented on pull request #5745: YARN-11511. Improve TestRMWebServices test config and data.

2023-06-21 Thread via GitHub
brumi1024 commented on PR #5745: URL: https://github.com/apache/hadoop/pull/5745#issuecomment-1600725319 Thanks @K0K0V0K for the patch, and @tomicooler @goiri for the reviews. Merging to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (HADOOP-18779) Improve hadoop-function.sh#status script

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735662#comment-17735662 ] ASF GitHub Bot commented on HADOOP-18779: - hadoop-yetus commented on PR #5762: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5762: HADOOP-18779. Improve hadoop-function.sh#status script.

2023-06-21 Thread via GitHub
hadoop-yetus commented on PR #5762: URL: https://github.com/apache/hadoop/pull/5762#issuecomment-1600626805 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18033) Upgrade fasterxml Jackson to 2.13.0

2023-06-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735643#comment-17735643 ] Steve Loughran commented on HADOOP-18033: - java11, please please please > Upgrade fasterxml

[jira] [Commented] (HADOOP-18776) Add OptimizedS3AMagicCommitter For Zero Rename Commits to S3 Endpoints

2023-06-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735641#comment-17735641 ] Steve Loughran commented on HADOOP-18776: - I understand what you've done, like the patch, but

[jira] [Commented] (HADOOP-18773) Upgrade maven-shade-plugin to 3.4.1

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735635#comment-17735635 ] ASF GitHub Bot commented on HADOOP-18773: - rohit-kb commented on PR #5750: URL:

[GitHub] [hadoop] rohit-kb commented on pull request #5750: HADOOP-18773. Upgrade maven-shade-plugin to 3.4.1

2023-06-21 Thread via GitHub
rohit-kb commented on PR #5750: URL: https://github.com/apache/hadoop/pull/5750#issuecomment-1600535489 @pan3793 I am not sure how to verify if the issue is resolved with this upgrade. I think we can merge this PR since there are no blockers. If the issue is still there after the

[jira] [Commented] (HADOOP-18779) Improve hadoop-function.sh#status script

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735629#comment-17735629 ] ASF GitHub Bot commented on HADOOP-18779: - slfan1989 opened a new pull request, #5762: URL:

[GitHub] [hadoop] slfan1989 opened a new pull request, #5762: HADOOP-18779. Improve hadoop-function.sh#status script.

2023-06-21 Thread via GitHub
slfan1989 opened a new pull request, #5762: URL: https://github.com/apache/hadoop/pull/5762 ### Description of PR JIRA: HADOOP-18779. Improve hadoop-function.sh#status script. When We use `yarn --daemon status router/nodemanager`, I found that no information can be

[jira] [Updated] (HADOOP-18779) Improve hadoop-function.sh#status script

2023-06-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18779: Labels: pull-request-available (was: ) > Improve hadoop-function.sh#status script >

[jira] [Created] (HADOOP-18779) Improve hadoop-function.sh#status script

2023-06-21 Thread Shilun Fan (Jira)
Shilun Fan created HADOOP-18779: --- Summary: Improve hadoop-function.sh#status script Key: HADOOP-18779 URL: https://issues.apache.org/jira/browse/HADOOP-18779 Project: Hadoop Common Issue Type:

[GitHub] [hadoop] zhtttylz commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-21 Thread via GitHub
zhtttylz commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1600330026 ```java //BlockPlacementPolicyRackFaultTolerant#chooseEvenlyFromRemainingRacks int bestEffortMaxNodesPerRack = maxNodesPerRack; while (results.size() !=

[jira] [Commented] (HADOOP-18596) Distcp -update between different cloud stores to use modification time while checking for file skip.

2023-06-21 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735579#comment-17735579 ] Mehakmeet Singh commented on HADOOP-18596: -- [~weichiu] Sorry seems like this comment got lost