[GitHub] [hadoop] slfan1989 opened a new pull request, #5057: YARN-11359. [Federation] Routing admin invocations transparently to multiple RMs.

2022-10-20 Thread GitBox
slfan1989 opened a new pull request, #5057: URL: https://github.com/apache/hadoop/pull/5057 JIRA: YARN-11359. [Federation] Routing admin invocations transparently to multiple RMs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] slfan1989 opened a new pull request, #5056: YARN-11358. [Federation] Add Strict Mode Configuration Parameters.

2022-10-20 Thread GitBox
slfan1989 opened a new pull request, #5056: URL: https://github.com/apache/hadoop/pull/5056 JIRA: YARN-11358. [Federation] Add Strict Mode Configuration Parameters. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4982: YARN-11332. [Federation] Improve FederationClientInterceptor#ThreadPool thread pool configuration.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4982: URL: https://github.com/apache/hadoop/pull/4982#issuecomment-1286453733 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5030: URL: https://github.com/apache/hadoop/pull/5030#issuecomment-1286438510 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5055: YARN-11357. Fix FederationClientInterceptor#submitApplication Can't Update SubClusterId

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5055: URL: https://github.com/apache/hadoop/pull/5055#issuecomment-1286427217 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621471#comment-17621471 ] ASF GitHub Bot commented on HADOOP-18399: - hadoop-yetus commented on PR #5054: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1286420083 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18487) protobuf-2.5.0 dependencies => provided

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621455#comment-17621455 ] ASF GitHub Bot commented on HADOOP-18487: - hadoop-yetus commented on PR #4996: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4996: HADOOP-18487. protobuf 2.5.0 marked as provided.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4996: URL: https://github.com/apache/hadoop/pull/4996#issuecomment-1286385295 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 opened a new pull request, #5055: YARN-11357. Fix FederationClientInterceptor#submitApplication Can't Update SubClusterId

2022-10-20 Thread GitBox
slfan1989 opened a new pull request, #5055: URL: https://github.com/apache/hadoop/pull/5055 JIRA: YARN-11357. Fix FederationClientInterceptor#submitApplication Can't Update SubClusterId. In [YARN-11342](https://issues.apache.org/jira/browse/YARN-11342), I refactored the

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001269099 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001269099 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[jira] [Commented] (HADOOP-17705) S3A to add option fs.s3a.endpoint.region to set AWS region

2022-10-20 Thread Greg Senia (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621413#comment-17621413 ] Greg Senia commented on HADOOP-17705: - Also fixes it on Hadoop 2.x versions if the SDK is updated

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621411#comment-17621411 ] ASF GitHub Bot commented on HADOOP-18399: - virajjasani commented on PR #5054: URL:

[GitHub] [hadoop] virajjasani commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2022-10-20 Thread GitBox
virajjasani commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1286286255 ``` [INFO] --- maven-surefire-plugin:3.0.0-M1:test (default-test) @ hadoop-aws --- [INFO] [INFO] --- [INFO] T E S T S

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001214547 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[jira] [Updated] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18399: Labels: pull-request-available (was: ) > SingleFilePerBlockCache to use

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621407#comment-17621407 ] ASF GitHub Bot commented on HADOOP-18399: - virajjasani commented on PR #5054: URL:

[GitHub] [hadoop] virajjasani commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2022-10-20 Thread GitBox
virajjasani commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1286270467 Tested against `us-west-2` with: `mvn -Dparallel-tests -DtestsThreadCount=8 -Dscale clean verify` and `mvn -Dparallel-tests -DtestsThreadCount=8 -Dprefetch -Dscale

[GitHub] [hadoop] hadoop-yetus commented on pull request #5017: YARN-11330. use secure XML parsers (#4981)

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5017: URL: https://github.com/apache/hadoop/pull/5017#issuecomment-1286243493 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001179187 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001179567 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001179187 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[GitHub] [hadoop] slfan1989 commented on pull request #5032: YARN-11295. [Federation] Router Support DelegationToken in MemoryStore mode.

2022-10-20 Thread GitBox
slfan1989 commented on PR #5032: URL: https://github.com/apache/hadoop/pull/5032#issuecomment-1286226835 @goiri Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HADOOP-17705) S3A to add option fs.s3a.endpoint.region to set AWS region

2022-10-20 Thread Greg Senia (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621385#comment-17621385 ] Greg Senia commented on HADOOP-17705: - [~ste...@apache.org] apparently this was the real fix to the

[jira] [Commented] (HADOOP-18233) Possible race condition with TemporaryAWSCredentialsProvider

2022-10-20 Thread Jimmy Wong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621383#comment-17621383 ] Jimmy Wong commented on HADOOP-18233: - Yep, setting "fs.s3a.bucket.probe" to "2" also resolves the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4980: MAPREDUCE-7411: use secure XML parsers

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4980: URL: https://github.com/apache/hadoop/pull/4980#issuecomment-1286203551 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4929: YARN-11229. [Federation] Add checkUserAccessToQueue REST APIs for Router.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4929: URL: https://github.com/apache/hadoop/pull/4929#issuecomment-1286100860 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Assigned] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin

2022-10-20 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-18399: - Assignee: Viraj Jasani > SingleFilePerBlockCache to use LocalDirAllocator for file

[GitHub] [hadoop] goiri merged pull request #5032: YARN-11295. [Federation] Router Support DelegationToken in MemoryStore mode.

2022-10-20 Thread GitBox
goiri merged PR #5032: URL: https://github.com/apache/hadoop/pull/5032 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] goiri commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
goiri commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1001069884 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[GitHub] [hadoop] hadoop-yetus commented on pull request #4982: YARN-11332. [Federation] Improve FederationClientInterceptor#ThreadPool thread pool configuration.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4982: URL: https://github.com/apache/hadoop/pull/4982#issuecomment-1286083147 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5030: URL: https://github.com/apache/hadoop/pull/5030#issuecomment-1286042680 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18233) Possible race condition with TemporaryAWSCredentialsProvider

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621303#comment-17621303 ] Steve Loughran commented on HADOOP-18233: - maybe if the bucket probe is 0. we should still ask

[jira] [Commented] (HADOOP-18233) Possible race condition with TemporaryAWSCredentialsProvider

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621299#comment-17621299 ] Steve Loughran commented on HADOOP-18233: - note that we did change the probe to 0 in

[jira] [Commented] (HADOOP-17612) Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621297#comment-17621297 ] ASF GitHub Bot commented on HADOOP-17612: - hadoop-yetus commented on PR #5047: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5047: HADOOP-17612. Upgrade Zookeeper to 3.6.3 and Curator to 5.2.0 (#3241)

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5047: URL: https://github.com/apache/hadoop/pull/5047#issuecomment-1285938999 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18233) Possible race condition with TemporaryAWSCredentialsProvider

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621295#comment-17621295 ] Steve Loughran commented on HADOOP-18233: - ok, so the race condition is that one thread can

[jira] [Reopened] (HADOOP-18233) Possible race condition with TemporaryAWSCredentialsProvider

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-18233: - > Possible race condition with TemporaryAWSCredentialsProvider >

[jira] [Resolved] (HADOOP-18500) Upgrade maven-shade-plugin to 3.3.0

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18500. - Fix Version/s: 3.4.0 Resolution: Fixed > Upgrade maven-shade-plugin to 3.3.0 >

[jira] [Commented] (HADOOP-18500) Upgrade maven-shade-plugin to 3.3.0

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621286#comment-17621286 ] ASF GitHub Bot commented on HADOOP-18500: - steveloughran commented on PR #5045: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5045: HADOOP-18500: Upgrade maven-shade-plugin to 3.3.0

2022-10-20 Thread GitBox
steveloughran commented on PR #5045: URL: https://github.com/apache/hadoop/pull/5045#issuecomment-1285928398 +1; put it in trunk to see if causes problems for any other patch going through yetus; if all is good we can put into 3.3 too. -- This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-18500) Upgrade maven-shade-plugin to 3.3.0

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621285#comment-17621285 ] ASF GitHub Bot commented on HADOOP-18500: - steveloughran merged PR #5045: URL:

[GitHub] [hadoop] steveloughran merged pull request #5045: HADOOP-18500: Upgrade maven-shade-plugin to 3.3.0

2022-10-20 Thread GitBox
steveloughran merged PR #5045: URL: https://github.com/apache/hadoop/pull/5045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-18498) [ABFS]: Error introduced when SAS Token containing '?' prefix is passed

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18498: Component/s: fs/azure > [ABFS]: Error introduced when SAS Token containing '?' prefix is

[GitHub] [hadoop-thirdparty] pjfanning commented on a diff in pull request #21: [HADOOP-18342] shaded avro jar

2022-10-20 Thread GitBox
pjfanning commented on code in PR #21: URL: https://github.com/apache/hadoop-thirdparty/pull/21#discussion_r1000937480 ## hadoop-shaded-avro/pom.xml: ## @@ -0,0 +1,100 @@ + + +http://maven.apache.org/POM/4.0.0; + xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; +

[GitHub] [hadoop-thirdparty] pjfanning commented on pull request #21: [HADOOP-18342] shaded avro jar

2022-10-20 Thread GitBox
pjfanning commented on PR #21: URL: https://github.com/apache/hadoop-thirdparty/pull/21#issuecomment-1285924920 > do see #19 and discussion about whether artifacts need names. it may be good to use a version number here... I can rename the module and jar to hadoop-shaded-avro_1_11 if

[GitHub] [hadoop] minni31 commented on pull request #3760: YARN-11037. Add configurable logic to split resource request to least…

2022-10-20 Thread GitBox
minni31 commented on PR #3760: URL: https://github.com/apache/hadoop/pull/3760#issuecomment-1285924514 @bibinchundatt Can you please review this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4835: HDFS-16740. Mini cluster test flakiness

2022-10-20 Thread GitBox
steveloughran commented on code in PR #4835: URL: https://github.com/apache/hadoop/pull/4835#discussion_r1000928173 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestRollingUpgrade.java: ## @@ -83,37 +83,18 @@ public static void runCmd(DFSAdmin

[GitHub] [hadoop-thirdparty] steveloughran commented on pull request #21: [HADOOP-18342] shaded avro jar

2022-10-20 Thread GitBox
steveloughran commented on PR #21: URL: https://github.com/apache/hadoop-thirdparty/pull/21#issuecomment-1285907443 do see #19 and discussion about whether artifacts need names. it may be good to use a version number here... -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-thirdparty] steveloughran commented on pull request #19: HADOOP-18197. Upgrade protobuf to 3.21.7

2022-10-20 Thread GitBox
steveloughran commented on PR #19: URL: https://github.com/apache/hadoop-thirdparty/pull/19#issuecomment-1285906735 add for @pjfanning to get involved; whole question about whether to use a version number in #21. applies. * version in jar name is a PITA when upgrading/re-releasing,

[GitHub] [hadoop] hadoop-yetus commented on pull request #5050: HDFS-16809. EC striped block is not sufficient when doing in maintenance.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5050: URL: https://github.com/apache/hadoop/pull/5050#issuecomment-1285904505 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop-thirdparty] steveloughran commented on a diff in pull request #21: [HADOOP-18342] shaded avro jar

2022-10-20 Thread GitBox
steveloughran commented on code in PR #21: URL: https://github.com/apache/hadoop-thirdparty/pull/21#discussion_r1000914786 ## hadoop-shaded-avro/pom.xml: ## @@ -0,0 +1,100 @@ + + +http://maven.apache.org/POM/4.0.0; + xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] [hadoop-thirdparty] steveloughran commented on pull request #21: [HADOOP-18342] shaded avro jar

2022-10-20 Thread GitBox
steveloughran commented on PR #21: URL: https://github.com/apache/hadoop-thirdparty/pull/21#issuecomment-1285900443 lgtm; needs a newline at the end of the new pom. +1 pending that -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HADOOP-18471) An unhandled ArrayIndexOutOfBoundsException in DefaultStringifier.storeArray() if provided with an empty input

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621263#comment-17621263 ] ASF GitHub Bot commented on HADOOP-18471: - steveloughran commented on PR #4957: URL:

[GitHub] [hadoop] steveloughran commented on pull request #4957: HADOOP-18471. Fixed ArrayIndexOutOfBoundsException in class DefaultStringifier

2022-10-20 Thread GitBox
steveloughran commented on PR #4957: URL: https://github.com/apache/hadoop/pull/4957#issuecomment-1285897424 thanks, in trunk and branch-3.3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Assigned] (HADOOP-18471) An unhandled ArrayIndexOutOfBoundsException in DefaultStringifier.storeArray() if provided with an empty input

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18471: --- Assignee: FuzzingTeam > An unhandled ArrayIndexOutOfBoundsException in >

[jira] [Resolved] (HADOOP-18471) An unhandled ArrayIndexOutOfBoundsException in DefaultStringifier.storeArray() if provided with an empty input

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18471. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed merged into

[GitHub] [hadoop] pjfanning commented on pull request #4980: MAPREDUCE-7411: use secure XML parsers

2022-10-20 Thread GitBox
pjfanning commented on PR #4980: URL: https://github.com/apache/hadoop/pull/4980#issuecomment-1285893112 @steveloughran rebased and build restarted -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HADOOP-18471) An unhandled ArrayIndexOutOfBoundsException in DefaultStringifier.storeArray() if provided with an empty input

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621258#comment-17621258 ] ASF GitHub Bot commented on HADOOP-18471: - steveloughran merged PR #4957: URL:

[GitHub] [hadoop] steveloughran merged pull request #4957: HADOOP-18471. Fixed ArrayIndexOutOfBoundsException in class DefaultStringifier

2022-10-20 Thread GitBox
steveloughran merged PR #4957: URL: https://github.com/apache/hadoop/pull/4957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18471) An unhandled ArrayIndexOutOfBoundsException in DefaultStringifier.storeArray() if provided with an empty input

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621257#comment-17621257 ] ASF GitHub Bot commented on HADOOP-18471: - steveloughran commented on code in PR #4957: URL:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4957: HADOOP-18471. Fixed ArrayIndexOutOfBoundsException in class DefaultStringifier

2022-10-20 Thread GitBox
steveloughran commented on code in PR #4957: URL: https://github.com/apache/hadoop/pull/4957#discussion_r1000905429 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/DefaultStringifier.java: ## @@ -158,6 +158,9 @@ public static K load(Configuration

[jira] [Commented] (HADOOP-17767) ABFS: Improve test scripts

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621252#comment-17621252 ] ASF GitHub Bot commented on HADOOP-17767: - steveloughran commented on PR #3124: URL:

[jira] [Commented] (HADOOP-17767) ABFS: Improve test scripts

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621251#comment-17621251 ] ASF GitHub Bot commented on HADOOP-17767: - steveloughran merged PR #3124: URL:

[GitHub] [hadoop] steveloughran commented on pull request #3124: HADOOP-17767. ABFS: Updates test scripts

2022-10-20 Thread GitBox
steveloughran commented on PR #3124: URL: https://github.com/apache/hadoop/pull/3124#issuecomment-1285884963 @snvijaya merged to trunk; cherrypick in to branch-3.3, test it and push up a new pr and i will merge that. thanks -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] steveloughran merged pull request #3124: HADOOP-17767. ABFS: Updates test scripts

2022-10-20 Thread GitBox
steveloughran merged PR #3124: URL: https://github.com/apache/hadoop/pull/3124 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on pull request #4980: MAPREDUCE-7411: use secure XML parsers

2022-10-20 Thread GitBox
steveloughran commented on PR #4980: URL: https://github.com/apache/hadoop/pull/4980#issuecomment-1285878695 @pjfanning can you rebase and push up to kick jenkins off again? thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] slfan1989 commented on pull request #5005: YARN-11342. [Federation] Refactor getNewApplication, submitApplication Use FederationActionRetry.

2022-10-20 Thread GitBox
slfan1989 commented on PR #5005: URL: https://github.com/apache/hadoop/pull/5005#issuecomment-1285877687 @goiri Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4929: YARN-11229. [Federation] Add checkUserAccessToQueue REST APIs for Router.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #4929: URL: https://github.com/apache/hadoop/pull/4929#discussion_r1000889253 ##

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
slfan1989 commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1000883075 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[GitHub] [hadoop] steveloughran merged pull request #5016: HDFS-16795. Use secure XML parsers (#4979)

2022-10-20 Thread GitBox
steveloughran merged PR #5016: URL: https://github.com/apache/hadoop/pull/5016 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (HADOOP-18156) Address JavaDoc warnings in classes like MarkerTool, S3ObjectAttributes, etc.

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18156. - Fix Version/s: 3.3.9 Resolution: Fixed > Address JavaDoc warnings in classes

[jira] [Commented] (HADOOP-18156) Address JavaDoc warnings in classes like MarkerTool, S3ObjectAttributes, etc.

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621239#comment-17621239 ] ASF GitHub Bot commented on HADOOP-18156: - steveloughran merged PR #5038: URL:

[GitHub] [hadoop] steveloughran merged pull request #5038: HADOOP-18156. Address JavaDoc warnings in classes like MarkerTool, S3ObjectAttributes, etc (#4965)

2022-10-20 Thread GitBox
steveloughran merged PR #5038: URL: https://github.com/apache/hadoop/pull/5038 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18499) S3A to support setting proxy protocol

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621238#comment-17621238 ] ASF GitHub Bot commented on HADOOP-18499: - steveloughran commented on code in PR #5051: URL:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5051: HADOOP-18499. S3A to support setting proxy protocol

2022-10-20 Thread GitBox
steveloughran commented on code in PR #5051: URL: https://github.com/apache/hadoop/pull/5051#discussion_r1000877935 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java: ## @@ -212,6 +212,8 @@ private Constants() { public static final String

[jira] [Commented] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621236#comment-17621236 ] ASF GitHub Bot commented on HADOOP-15983: - steveloughran commented on PR #5048: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5048: HADOOP-15983. Use jersey-json that is built to use jackson2 (branch 3.3)

2022-10-20 Thread GitBox
steveloughran commented on PR #5048: URL: https://github.com/apache/hadoop/pull/5048#issuecomment-1285856871 thanks; pushing through again for a 3.3.5 release in #5053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] bteke commented on a diff in pull request #5052: YARN-11356. Upgrade DataTables to 1.11.5 to fix CVEs

2022-10-20 Thread GitBox
bteke commented on code in PR #5052: URL: https://github.com/apache/hadoop/pull/5052#discussion_r1000875531 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-1.11.5/css/jquery.dataTables.css: ## @@ -1,21 +1,3 @@ -/** Review Comment:

[jira] [Commented] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621233#comment-17621233 ] ASF GitHub Bot commented on HADOOP-15983: - steveloughran opened a new pull request, #5053: URL:

[GitHub] [hadoop] steveloughran opened a new pull request, #5053: HADOOP-15983. Use jersey-json that is built to use jackson2 ((#3988)

2022-10-20 Thread GitBox
steveloughran opened a new pull request, #5053: URL: https://github.com/apache/hadoop/pull/5053 #3988 on branch-3.3.5 Moves from com.sun.jersey 1.19 to the artifact com.github.pjfanning:jersey-json:1.20 This allows jackson 1 to be removed from the classpath.

[jira] [Commented] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621230#comment-17621230 ] ASF GitHub Bot commented on HADOOP-15983: - steveloughran merged PR #5048: URL:

[GitHub] [hadoop] steveloughran merged pull request #5048: HADOOP-15983. Use jersey-json that is built to use jackson2 (branch 3.3)

2022-10-20 Thread GitBox
steveloughran merged PR #5048: URL: https://github.com/apache/hadoop/pull/5048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] goiri merged pull request #5005: YARN-11342. [Federation] Refactor getNewApplication, submitApplication Use FederationActionRetry.

2022-10-20 Thread GitBox
goiri merged PR #5005: URL: https://github.com/apache/hadoop/pull/5005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] goiri commented on a diff in pull request #5030: YARN-11345. [Federation] Refactoring Yarn Router's Application Web Page.

2022-10-20 Thread GitBox
goiri commented on code in PR #5030: URL: https://github.com/apache/hadoop/pull/5030#discussion_r1000850995 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/AppsBlock.java: ## @@ -81,53

[jira] [Commented] (HADOOP-15983) Use jersey-json that is built to use jackson2

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621204#comment-17621204 ] ASF GitHub Bot commented on HADOOP-15983: - hadoop-yetus commented on PR #5048: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5048: HADOOP-15983. Use jersey-json that is built to use jackson2 (branch 3.3)

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #5048: URL: https://github.com/apache/hadoop/pull/5048#issuecomment-1285788496 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18197) Update protobuf 3.7.1 to a version without CVE-2021-22569

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621198#comment-17621198 ] ASF GitHub Bot commented on HADOOP-18197: - hadoop-yetus commented on PR #4418: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4418: HADOOP-18197. Upgrade protobuf to 3.21.7 (through upgraded hadoop-shaded-protobuf jar)

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4418: URL: https://github.com/apache/hadoop/pull/4418#issuecomment-1285780046 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4929: YARN-11229. [Federation] Add checkUserAccessToQueue REST APIs for Router.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4929: URL: https://github.com/apache/hadoop/pull/4929#issuecomment-1285674115 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4929: YARN-11229. [Federation] Add checkUserAccessToQueue REST APIs for Router.

2022-10-20 Thread GitBox
hadoop-yetus commented on PR #4929: URL: https://github.com/apache/hadoop/pull/4929#issuecomment-1285672095 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18136) Verify FileUtils.unTar() handling of missing .tar files: Fixes CVE-2022-25168

2022-10-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18136: Description: add a test to verify FileUtils.unTar() of a non .gz fails meaningfully if

[GitHub] [hadoop] tasanuma commented on pull request #5050: HDFS-16809. EC striped block is not sufficient when doing in maintenance.

2022-10-20 Thread GitBox
tasanuma commented on PR #5050: URL: https://github.com/apache/hadoop/pull/5050#issuecomment-1285472477 @dingshun3016 Thanks for reporting the issue and submitting the PR. Is it possible to add a unit test? -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-15915) Report problems w/ local S3A buffer directory meaningfully

2022-10-20 Thread Zbigniew Kostrzewa (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621073#comment-17621073 ] Zbigniew Kostrzewa commented on HADOOP-15915: - I've recently stumbled upon this with

[GitHub] [hadoop] K0K0V0K commented on a diff in pull request #5052: YARN-11356. Upgrade DataTables to 1.11.5 to fix CVEs

2022-10-20 Thread GitBox
K0K0V0K commented on code in PR #5052: URL: https://github.com/apache/hadoop/pull/5052#discussion_r1000546604 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-1.11.5/css/jquery.dataTables.css: ## @@ -1,21 +1,3 @@ -/** Review Comment:

[GitHub] [hadoop] K0K0V0K commented on a diff in pull request #5052: YARN-11356. Upgrade DataTables to 1.11.5 to fix CVEs

2022-10-20 Thread GitBox
K0K0V0K commented on code in PR #5052: URL: https://github.com/apache/hadoop/pull/5052#discussion_r1000546604 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/dt-1.11.5/css/jquery.dataTables.css: ## @@ -1,21 +1,3 @@ -/** Review Comment:

[jira] [Commented] (HADOOP-9946) NumAllSinks metrics shows lower value than NumActiveSinks

2022-10-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-9946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621058#comment-17621058 ] ASF GitHub Bot commented on HADOOP-9946: ashutoshcipher commented on PR #5002: URL:

[GitHub] [hadoop] ashutoshcipher commented on pull request #5002: HADOOP-9946. NumAllSinks metrics shows lower value than NumActiveSinks

2022-10-20 Thread GitBox
ashutoshcipher commented on PR #5002: URL: https://github.com/apache/hadoop/pull/5002#issuecomment-1285435569 @ZanderXu - Can we commit/merge this, as we dont have any other comments? Thanks -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] ashutoshcipher commented on pull request #5044: HDFS-3570. Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2022-10-20 Thread GitBox
ashutoshcipher commented on PR #5044: URL: https://github.com/apache/hadoop/pull/5044#issuecomment-1285423482 @aajisaka @ZanderXu - Please help in reviewing . Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

  1   2   >