[jira] [Resolved] (HADOOP-18426) Improve the accuracy of MutableStat mean

2022-09-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18426. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Improve the

[jira] [Commented] (HADOOP-18426) Improve the accuracy of MutableStat mean

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601142#comment-17601142 ] ASF GitHub Bot commented on HADOOP-18426: - Hexiaoqiao commented on PR #4844: URL:

[GitHub] [hadoop] Hexiaoqiao commented on pull request #4844: HADOOP-18426. Use weighted calculation for MutableStat mean/variance to fix accuracy.

2022-09-06 Thread GitBox
Hexiaoqiao commented on PR #4844: URL: https://github.com/apache/hadoop/pull/4844#issuecomment-1238935726 Committed to trunk. Thanks @xkrogen and @zhangshuyan0 for your works! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (HADOOP-18426) Improve the accuracy of MutableStat mean

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601141#comment-17601141 ] ASF GitHub Bot commented on HADOOP-18426: - Hexiaoqiao merged PR #4844: URL:

[GitHub] [hadoop] Hexiaoqiao merged pull request #4844: HADOOP-18426. Use weighted calculation for MutableStat mean/variance to fix accuracy.

2022-09-06 Thread GitBox
Hexiaoqiao merged PR #4844: URL: https://github.com/apache/hadoop/pull/4844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] zero2049 opened a new pull request, #4866: modified:README.MD

2022-09-06 Thread GitBox
zero2049 opened a new pull request, #4866: URL: https://github.com/apache/hadoop/pull/4866 modified:README.MD -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] zero2049 closed pull request #4865: modified:README.MD

2022-09-06 Thread GitBox
zero2049 closed pull request #4865: modified:README.MD URL: https://github.com/apache/hadoop/pull/4865 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] zero2049 opened a new pull request, #4865: modified:README.MD

2022-09-06 Thread GitBox
zero2049 opened a new pull request, #4865: URL: https://github.com/apache/hadoop/pull/4865 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[GitHub] [hadoop] zero2049 commented on pull request #4864: create test.txt

2022-09-06 Thread GitBox
zero2049 commented on PR #4864: URL: https://github.com/apache/hadoop/pull/4864#issuecomment-1238926531 modified:readme.md -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] zero2049 opened a new pull request, #4864: create test.txt

2022-09-06 Thread GitBox
zero2049 opened a new pull request, #4864: URL: https://github.com/apache/hadoop/pull/4864 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Commented] (HADOOP-18342) Upgrade to Avro 1.11.1

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601124#comment-17601124 ] ASF GitHub Bot commented on HADOOP-18342: - hadoop-yetus commented on PR #4854: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4854: HADOOP-18342: shaded avro jar

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4854: URL: https://github.com/apache/hadoop/pull/4854#issuecomment-1238876026 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18426) Improve the accuracy of MutableStat mean

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601114#comment-17601114 ] ASF GitHub Bot commented on HADOOP-18426: - zhangshuyan0 commented on PR #4844: URL:

[GitHub] [hadoop] zhangshuyan0 commented on pull request #4844: HADOOP-18426. Use weighted calculation for MutableStat mean/variance to fix accuracy.

2022-09-06 Thread GitBox
zhangshuyan0 commented on PR #4844: URL: https://github.com/apache/hadoop/pull/4844#issuecomment-1238856202 LGTM. +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] hadoop-yetus commented on pull request #4863: YARN-11297. [Federation] Improve Yarn Router Reservation Submission Code.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4863: URL: https://github.com/apache/hadoop/pull/4863#issuecomment-1238846049 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] simbadzina commented on a diff in pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-09-06 Thread GitBox
simbadzina commented on code in PR #4311: URL: https://github.com/apache/hadoop/pull/4311#discussion_r964314207 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/ClientGSIContext.java: ## @@ -66,15 +75,24 @@ public void

[GitHub] [hadoop] simbadzina commented on a diff in pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-09-06 Thread GitBox
simbadzina commented on code in PR #4311: URL: https://github.com/apache/hadoop/pull/4311#discussion_r964308328 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/FederatedNamespaceIds.java: ## @@ -0,0 +1,113 @@ +/** + *

[GitHub] [hadoop] simbadzina commented on a diff in pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-09-06 Thread GitBox
simbadzina commented on code in PR #4311: URL: https://github.com/apache/hadoop/pull/4311#discussion_r964306464 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/FederatedNamespaceIds.java: ## @@ -0,0 +1,113 @@ +/** + *

[GitHub] [hadoop] ZanderXu commented on pull request #4560: HDFS-16659. JournalNode should throw NewerTxnIdException when SinceTxId is bigger than HighestWrittenTxId

2022-09-06 Thread GitBox
ZanderXu commented on PR #4560: URL: https://github.com/apache/hadoop/pull/4560#issuecomment-1238805756 @xkrogen Sir, thank you for your patient answers and reviews, as well as nice suggestions. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] slfan1989 opened a new pull request, #4863: YARN-11297. [Federation]Improve Yarn Router Reservation Submission Code.

2022-09-06 Thread GitBox
slfan1989 opened a new pull request, #4863: URL: https://github.com/apache/hadoop/pull/4863 JIRA: YARN-11297. [Federation]Improve Yarn Router Reservation Submission Code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4858: YARN-11296. [Federation] Fix SQLFederationStateStore#Sql script bug.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4858: URL: https://github.com/apache/hadoop/pull/4858#discussion_r964259520 ## hadoop-yarn-project/hadoop-yarn/bin/FederationStateStore/MySQL/FederationStateStoreTables.sql: ## @@ -36,7 +36,7 @@ CREATE TABLE membership( state varchar(32)

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964257610 ##

[GitHub] [hadoop] goiri commented on a diff in pull request #4858: YARN-11296. [Federation] Fix SQLFederationStateStore#Sql script bug.

2022-09-06 Thread GitBox
goiri commented on code in PR #4858: URL: https://github.com/apache/hadoop/pull/4858#discussion_r964257406 ## hadoop-yarn-project/hadoop-yarn/bin/FederationStateStore/MySQL/FederationStateStoreTables.sql: ## @@ -36,7 +36,7 @@ CREATE TABLE membership( state varchar(32) NOT

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964256887 ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964252561 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java:

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964252561 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/FederationClientInterceptor.java:

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964250673 ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964250594 ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964250393 ##

[GitHub] [hadoop] hadoop-yetus commented on pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4846: URL: https://github.com/apache/hadoop/pull/4846#issuecomment-1238739439 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601040#comment-17601040 ] ASF GitHub Bot commented on HADOOP-18439: - hadoop-yetus commented on PR #4862: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4862: HADOOP-18439. Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4862: URL: https://github.com/apache/hadoop/pull/4862#issuecomment-1238724842 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-09-06 Thread Larry McCay (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry McCay updated HADOOP-18388: - Labels: Reviewed pull-request-available (was: pull-request-available) > Allow dynamic

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601039#comment-17601039 ] ASF GitHub Bot commented on HADOOP-18388: - lmccay commented on PR #4798: URL:

[GitHub] [hadoop] lmccay commented on pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-09-06 Thread GitBox
lmccay commented on PR #4798: URL: https://github.com/apache/hadoop/pull/4798#issuecomment-1238722372 I've merged this to trunk, @ayushtkn - thank you for your contribution! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601038#comment-17601038 ] ASF GitHub Bot commented on HADOOP-18388: - lmccay merged PR #4798: URL:

[GitHub] [hadoop] lmccay merged pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-09-06 Thread GitBox
lmccay merged PR #4798: URL: https://github.com/apache/hadoop/pull/4798 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601037#comment-17601037 ] ASF GitHub Bot commented on HADOOP-18388: - lmccay commented on code in PR #4798: URL:

[GitHub] [hadoop] lmccay commented on a diff in pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-09-06 Thread GitBox
lmccay commented on code in PR #4798: URL: https://github.com/apache/hadoop/pull/4798#discussion_r964231336 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/LdapGroupsMapping.java: ## @@ -437,8 +443,14 @@ Set lookupGroup(SearchResult result,

[GitHub] [hadoop] simbadzina commented on a diff in pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-09-06 Thread GitBox
simbadzina commented on code in PR #4311: URL: https://github.com/apache/hadoop/pull/4311#discussion_r964156460 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterStateIdContext.java: ## @@ -0,0 +1,94 @@ +/** + * Licensed

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600973#comment-17600973 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1238630799 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] simbadzina commented on a diff in pull request #4311: HDFS-13522: IPC changes to support observer reads through routers.

2022-09-06 Thread GitBox
simbadzina commented on code in PR #4311: URL: https://github.com/apache/hadoop/pull/4311#discussion_r964131419 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/FederatedNamespaceIds.java: ## @@ -0,0 +1,113 @@ +/** + *

[GitHub] [hadoop] goiri commented on a diff in pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
goiri commented on code in PR #4846: URL: https://github.com/apache/hadoop/pull/4846#discussion_r964122414 ##

[jira] [Commented] (HADOOP-18435) Remove usage of fs.s3a.executor.capacity

2022-09-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600957#comment-17600957 ] Mukund Thakur commented on HADOOP-18435: Yes it will be used in future for Vectored IO stuff.

[jira] [Updated] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18439: Labels: pull-request-available (was: ) > Fix VectoredIO for LocalFileSystem when

[jira] [Commented] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600945#comment-17600945 ] ASF GitHub Bot commented on HADOOP-18439: - mukund-thakur opened a new pull request, #4862: URL:

[GitHub] [hadoop] mukund-thakur opened a new pull request, #4862: HADOOP-18439. Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread GitBox
mukund-thakur opened a new pull request, #4862: URL: https://github.com/apache/hadoop/pull/4862 part of HADOOP-18103. While merging the ranges in CheckSumFs, they are rounded up based on the value of checksum bytes size which leads to some ranges crossing the EOF thus they

[jira] [Updated] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18439: --- Summary: Fix VectoredIO for LocalFileSystem when checksum is enabled. (was: Fix

[jira] [Updated] (HADOOP-18439) Fix VectoredIO for LocalFileSystem for small files.

2022-09-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18439: --- Description: While merging the ranges in CheckSumFs, they are rounded up based on the

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600927#comment-17600927 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1238488397 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600925#comment-17600925 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1238486806 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] xkrogen commented on pull request #4560: HDFS-16659. JournalNode should throw NewerTxnIdException when SinceTxId is bigger than HighestWrittenTxId

2022-09-06 Thread GitBox
xkrogen commented on PR #4560: URL: https://github.com/apache/hadoop/pull/4560#issuecomment-1238439633 Merged to trunk. Thanks for the contribution @ZanderXu ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2022-09-06 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HADOOP-18444: -- Description: Trash.moveToAppropriateTrash is used by _hadoop cli -rm_ and hive, to move files to

[GitHub] [hadoop] xkrogen merged pull request #4560: HDFS-16659. JournalNode should throw NewerTxnIdException when SinceTxId is bigger than HighestWrittenTxId

2022-09-06 Thread GitBox
xkrogen merged PR #4560: URL: https://github.com/apache/hadoop/pull/4560 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2022-09-06 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HADOOP-18444: -- Description: Trash.moveToAppropriateTrash is used by _hadoop cli -rm_ and hive, to move files to

[jira] [Assigned] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2022-09-06 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin reassigned HADOOP-18444: - Assignee: Xing Lin > Add Support for localized trash for ViewFileSystem in >

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600902#comment-17600902 ] ASF GitHub Bot commented on HADOOP-18388: - hadoop-yetus commented on PR #4798: URL:

[jira] [Updated] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2022-09-06 Thread Xing Lin (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Lin updated HADOOP-18444: -- Description: Trash.moveToAppropriateTrash is used by _hadoop cli -rm_ and hive, to move files to

[GitHub] [hadoop] hadoop-yetus commented on pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4798: URL: https://github.com/apache/hadoop/pull/4798#issuecomment-1238436853 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2022-09-06 Thread Xing Lin (Jira)
Xing Lin created HADOOP-18444: - Summary: Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash Key: HADOOP-18444 URL: https://issues.apache.org/jira/browse/HADOOP-18444

[GitHub] [hadoop] hadoop-yetus commented on pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4846: URL: https://github.com/apache/hadoop/pull/4846#issuecomment-1238405786 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4744: HDFS-16689. Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4744: URL: https://github.com/apache/hadoop/pull/4744#issuecomment-1238381684 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4744: HDFS-16689. Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4744: URL: https://github.com/apache/hadoop/pull/4744#issuecomment-1238374829 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18443) Upgrade snakeyaml to 1.31 to mitigate CVE-2022-25857

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600859#comment-17600859 ] ASF GitHub Bot commented on HADOOP-18443: - hadoop-yetus commented on PR #4856: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4856: HADOOP-18443. Upgrade snakeyaml to 1.31 to mitigate CVE-2022-25857

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4856: URL: https://github.com/apache/hadoop/pull/4856#issuecomment-1238359100 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
slfan1989 commented on PR #4846: URL: https://github.com/apache/hadoop/pull/4846#issuecomment-1238308788 @goiri Please help to review the code again, thank you very much! This PR changes the execution script of the stored procedure, I will check the script against the major version

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600822#comment-17600822 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1238284766 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-18442) Remove the hadoop-openstack module

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600806#comment-17600806 ] ASF GitHub Bot commented on HADOOP-18442: - hadoop-yetus commented on PR #4855: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4855: HADOOP-18442. Remove openstack support

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4855: URL: https://github.com/apache/hadoop/pull/4855#issuecomment-1238256557 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4846: URL: https://github.com/apache/hadoop/pull/4846#issuecomment-1238215896 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4860: fix an error

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4860: URL: https://github.com/apache/hadoop/pull/4860#issuecomment-1238204686 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4859: fix logic bug

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4859: URL: https://github.com/apache/hadoop/pull/4859#issuecomment-1238195434 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] einavh opened a new pull request, #4861: Branch 3.2 - hadoop per bucket endpoint configuration is ignored

2022-09-06 Thread GitBox
einavh opened a new pull request, #4861: URL: https://github.com/apache/hadoop/pull/4861 I'm using EMR emr-6.5.0 cluster in us-east-1 with ec2 instances. cluster is running spark application using pyspark 3.2.1 EMR is using Hadoop distribution:Amazon 3.2.1 my spark application

[GitHub] [hadoop] pingguoCooler closed pull request #4837: Preparing for 2.10 upgrade development

2022-09-06 Thread GitBox
pingguoCooler closed pull request #4837: Preparing for 2.10 upgrade development URL: https://github.com/apache/hadoop/pull/4837 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] RichardDestinyRC opened a new pull request, #4860: fix an error

2022-09-06 Thread GitBox
RichardDestinyRC opened a new pull request, #4860: URL: https://github.com/apache/hadoop/pull/4860 how to commit the code? ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600764#comment-17600764 ] ASF GitHub Bot commented on HADOOP-18388: - hadoop-yetus commented on PR #4798: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4798: URL: https://github.com/apache/hadoop/pull/4798#issuecomment-1238126857 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] wukong1688 opened a new pull request, #4859: update readme

2022-09-06 Thread GitBox
wukong1688 opened a new pull request, #4859: URL: https://github.com/apache/hadoop/pull/4859 update readme ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA

[GitHub] [hadoop] ZanderXu commented on a diff in pull request #4744: HDFS-16689. Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-09-06 Thread GitBox
ZanderXu commented on code in PR #4744: URL: https://github.com/apache/hadoop/pull/4744#discussion_r963522811 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestHAWithInProgressTail.java: ## @@ -0,0 +1,142 @@ +/** + * Licensed to the

[jira] [Commented] (HADOOP-17873) ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600703#comment-17600703 ] ASF GitHub Bot commented on HADOOP-17873: - steveloughran merged PR #3699: URL:

[GitHub] [hadoop] steveloughran merged pull request #3699: HADOOP-17873. ABFS: Fix transient failures in ITestAbfsStreamStatistics and ITestAbfsRestOperationException

2022-09-06 Thread GitBox
steveloughran merged PR #3699: URL: https://github.com/apache/hadoop/pull/3699 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18186) s3a prefetching to use SemaphoredDelegatingExecutor for submitting work

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600702#comment-17600702 ] ASF GitHub Bot commented on HADOOP-18186: - mehakmeet commented on code in PR #4796: URL:

[GitHub] [hadoop] mehakmeet commented on a diff in pull request #4796: HADOOP-18186. s3a prefetching to use SemaphoredDelegatingExecutor for submitting work

2022-09-06 Thread GitBox
mehakmeet commented on code in PR #4796: URL: https://github.com/apache/hadoop/pull/4796#discussion_r963505787 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3APrefetchingInputStream.java: ## @@ -130,6 +131,7 @@ public void testReadLargeFileFully()

[GitHub] [hadoop] hadoop-yetus commented on pull request #4858: YARN-11296. [Federation] Fix SQLFederationStateStore#Sql script bug.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4858: URL: https://github.com/apache/hadoop/pull/4858#issuecomment-1237921393 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4784: HDFS-16737. Fix number of threads in FsDatasetAsyncDiskService#addExecutorForVolume

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4784: URL: https://github.com/apache/hadoop/pull/4784#issuecomment-1237915530 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4660: HDFS-16703. Enable RPC Timeout for some protocols of NameNode.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4660: URL: https://github.com/apache/hadoop/pull/4660#issuecomment-1237912143 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-11219) [Umbrella] Upgrade to netty 4

2022-09-06 Thread groot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600660#comment-17600660 ] groot commented on HADOOP-11219: [~aajisaka] [~weichiu] - Apart from the two modules mentioned in

[GitHub] [hadoop] hadoop-yetus commented on pull request #4846: YARN-11290. Improve Query Condition of FederationStateStore#getApplicationsHomeSubCluster.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4846: URL: https://github.com/apache/hadoop/pull/4846#issuecomment-1237793763 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2022-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600654#comment-17600654 ] ASF GitHub Bot commented on HADOOP-15327: - ashutoshcipher commented on PR #3259: URL:

[GitHub] [hadoop] ashutoshcipher commented on pull request #3259: HADOOP-15327. Upgrade MR ShuffleHandler to use Netty4

2022-09-06 Thread GitBox
ashutoshcipher commented on PR #3259: URL: https://github.com/apache/hadoop/pull/3259#issuecomment-1237792070 Thanks @szilard-nemeth for working on this. Looks good to me. Looking forward for the final patch. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4858: YARN-11296. [Federation] Fix SQLFederationStateStore#Sql script bug.

2022-09-06 Thread GitBox
hadoop-yetus commented on PR #4858: URL: https://github.com/apache/hadoop/pull/4858#issuecomment-1237763399 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Assigned] (HADOOP-18197) Update protobuf 3.7.1 to a version without CVE-2021-22569

2022-09-06 Thread groot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] groot reassigned HADOOP-18197: -- Assignee: groot > Update protobuf 3.7.1 to a version without CVE-2021-22569 >

[GitHub] [hadoop] slfan1989 opened a new pull request, #4858: YARN-11296. Fix SQLFederationStateStore#Sql script bug.

2022-09-06 Thread GitBox
slfan1989 opened a new pull request, #4858: URL: https://github.com/apache/hadoop/pull/4858 JIRA: YARN-11296. Fix SQLFederationStateStore#Sql script bug. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL