[GitHub] [hadoop] virajjasani commented on a diff in pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
virajjasani commented on code in PR #5497: URL: https://github.com/apache/hadoop/pull/5497#discussion_r1148317954 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/store/driver/TestStateStoreDriverBase.java: ## @@ -574,6 +580,38 @@ pri

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
ayushtkn commented on code in PR #5497: URL: https://github.com/apache/hadoop/pull/5497#discussion_r1148316504 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/store/driver/TestStateStoreDriverBase.java: ## @@ -574,6 +580,38 @@ privat

[jira] [Updated] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-18676: -- Fix Version/s: (was: 3.4.0) > Include jettison as direct dependency of hadoop-common > --

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704890#comment-17704890 ] Ayush Saxena commented on HADOOP-18676: --- have reverted this to unblock the builds

[jira] [Reopened] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona reopened HADOOP-18676: we need to revert and recreate another PR with hadoop-client dependency handlings > Include

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704886#comment-17704886 ] ASF GitHub Bot commented on HADOOP-18676: - akatona84 commented on PR #5507: URL

[GitHub] [hadoop] akatona84 commented on pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
akatona84 commented on PR #5507: URL: https://github.com/apache/hadoop/pull/5507#issuecomment-1483738206 Yes... it was a mistake to revert the exclusions from hadoop-client. sorry -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704884#comment-17704884 ] ASF GitHub Bot commented on HADOOP-18676: - akatona84 opened a new pull request,

[GitHub] [hadoop] akatona84 opened a new pull request, #5512: Revert "HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib"

2023-03-24 Thread via GitHub
akatona84 opened a new pull request, #5512: URL: https://github.com/apache/hadoop/pull/5512 Reverts apache/hadoop#5507 Exclusions must be added to hadoop-client -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [hadoop] hadoop-yetus commented on pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5497: URL: https://github.com/apache/hadoop/pull/5497#issuecomment-1483735805 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5496: YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation.

2023-03-24 Thread via GitHub
slfan1989 commented on code in PR #5496: URL: https://github.com/apache/hadoop/pull/5496#discussion_r1148266791 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/rmadmin/TestableFederationRMAdminInterceptor

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5496: YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation.

2023-03-24 Thread via GitHub
slfan1989 commented on code in PR #5496: URL: https://github.com/apache/hadoop/pull/5496#discussion_r1148266754 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/rmadmin/TestableFederationRMAdminInterceptor

[GitHub] [hadoop] virajjasani commented on pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
virajjasani commented on PR #5497: URL: https://github.com/apache/hadoop/pull/5497#issuecomment-1483679610 Btw the build is broken after commit https://github.com/apache/hadoop/commit/72b01227062fcd5214c3561c4b81842ac1802bdd just in case we get -1 for mvninstall from Jenkins QA -- This

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704853#comment-17704853 ] ASF GitHub Bot commented on HADOOP-18399: - virajjasani commented on PR #5054: U

[GitHub] [hadoop] virajjasani commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-03-24 Thread via GitHub
virajjasani commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1483678940 mvninstall and shadedclient errors above are related to this latest commit https://github.com/apache/hadoop/commit/72b01227062fcd5214c3561c4b81842ac1802bdd -- This is an automated me

[GitHub] [hadoop] virajjasani commented on pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
virajjasani commented on PR #5507: URL: https://github.com/apache/hadoop/pull/5507#issuecomment-1483678566 I just checked locally and the build is failing with this commit, with same error -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704852#comment-17704852 ] ASF GitHub Bot commented on HADOOP-18676: - virajjasani commented on PR #5507: U

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704851#comment-17704851 ] ASF GitHub Bot commented on HADOOP-18676: - virajjasani commented on PR #5507: U

[GitHub] [hadoop] virajjasani commented on pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
virajjasani commented on PR #5507: URL: https://github.com/apache/hadoop/pull/5507#issuecomment-1483675293 The build failure on trunk seems related to this change? e.g. https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5054/21/artifact/out/branch-mvninstall-root.txt ```

[GitHub] [hadoop] virajjasani commented on pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
virajjasani commented on PR #5497: URL: https://github.com/apache/hadoop/pull/5497#issuecomment-1483673321 Done, thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[GitHub] [hadoop] goiri commented on a diff in pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
goiri commented on code in PR #5497: URL: https://github.com/apache/hadoop/pull/5497#discussion_r1148236769 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/store/driver/TestStateStoreDriverBase.java: ## @@ -574,6 +580,38 @@ private s

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704847#comment-17704847 ] ASF GitHub Bot commented on HADOOP-18399: - hadoop-yetus commented on PR #5054:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1483665148 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] goiri commented on a diff in pull request #5496: YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation.

2023-03-24 Thread via GitHub
goiri commented on code in PR #5496: URL: https://github.com/apache/hadoop/pull/5496#discussion_r1148220112 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/rmadmin/TestableFederationRMAdminInterceptor.jav

[GitHub] [hadoop] goiri commented on a diff in pull request #5496: YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation.

2023-03-24 Thread via GitHub
goiri commented on code in PR #5496: URL: https://github.com/apache/hadoop/pull/5496#discussion_r1148216905 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/test/java/org/apache/hadoop/yarn/server/router/rmadmin/TestableFederationRMAdminInterceptor.jav

[jira] [Updated] (HADOOP-18207) Introduce hadoop-logging module

2023-03-24 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18207: -- Status: Patch Available (was: In Progress) > Introduce hadoop-logging module > -

[jira] [Commented] (HADOOP-16206) Migrate from Log4j1 to Log4j2

2023-03-24 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704839#comment-17704839 ] Viraj Jasani commented on HADOOP-16206: --- Sub-task HADOOP-18207 introducing hadoop

[jira] [Commented] (HADOOP-18207) Introduce hadoop-logging module

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704838#comment-17704838 ] ASF GitHub Bot commented on HADOOP-18207: - virajjasani commented on PR #5503: U

[GitHub] [hadoop] virajjasani commented on pull request #5503: HADOOP-18207. Introduce hadoop-logging module

2023-03-24 Thread via GitHub
virajjasani commented on PR #5503: URL: https://github.com/apache/hadoop/pull/5503#issuecomment-1483577856 The test failures are not relevant, they are also found on https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/1175/testReport/ and https://ci-hadoop.apache.org/job/h

[jira] [Commented] (HADOOP-18207) Introduce hadoop-logging module

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704836#comment-17704836 ] ASF GitHub Bot commented on HADOOP-18207: - hadoop-yetus commented on PR #5503:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5503: HADOOP-18207. Introduce hadoop-logging module

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5503: URL: https://github.com/apache/hadoop/pull/5503#issuecomment-1483544987 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18207) Introduce hadoop-logging module

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704832#comment-17704832 ] ASF GitHub Bot commented on HADOOP-18207: - hadoop-yetus commented on PR #5503:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5503: HADOOP-18207. Introduce hadoop-logging module

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5503: URL: https://github.com/apache/hadoop/pull/5503#issuecomment-1483523552 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704804#comment-17704804 ] ASF GitHub Bot commented on HADOOP-18399: - hadoop-yetus commented on PR #5054:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1483388652 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5511: HADOOP-18680: Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5511: URL: https://github.com/apache/hadoop/pull/5511#issuecomment-1483181089 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18680) Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704738#comment-17704738 ] ASF GitHub Bot commented on HADOOP-18680: - hadoop-yetus commented on PR #5511:

[jira] [Commented] (HADOOP-18207) Introduce hadoop-logging module

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704733#comment-17704733 ] ASF GitHub Bot commented on HADOOP-18207: - virajjasani commented on PR #5503: U

[GitHub] [hadoop] virajjasani commented on pull request #5503: HADOOP-18207. Introduce hadoop-logging module

2023-03-24 Thread via GitHub
virajjasani commented on PR #5503: URL: https://github.com/apache/hadoop/pull/5503#issuecomment-1483178044 I have also built tarball, deployed to a k8s cluster, started NN, DN, JN, Zkfc, RM, NM, HS daemons and the logs look good so far. -- This is an automated message from the Apache Git

[GitHub] [hadoop] virajjasani commented on pull request #5497: HDFS-16959. RBF: State store cache loading metrics

2023-03-24 Thread via GitHub
virajjasani commented on PR #5497: URL: https://github.com/apache/hadoop/pull/5497#issuecomment-1483149115 @goiri @ayushtkn Thanks a lot for your reviews! Does this look good to go? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [hadoop] umamaheswararao commented on pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-24 Thread via GitHub
umamaheswararao commented on PR #5364: URL: https://github.com/apache/hadoop/pull/5364#issuecomment-1483136719 This patch looks good to me. If @steveloughran agree that his comments address, we can proceed to commit. Thanks -- This is an automated message from the Apache Git Service. To r

[GitHub] [hadoop] umamaheswararao commented on a diff in pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-24 Thread via GitHub
umamaheswararao commented on code in PR #5364: URL: https://github.com/apache/hadoop/pull/5364#discussion_r1146899680 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpSync.java: ## @@ -286,6 +299,36 @@ private boolean getAllDiffs() throws IOException {

[jira] [Commented] (HADOOP-18680) Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704698#comment-17704698 ] ASF GitHub Bot commented on HADOOP-18680: - hadoop-yetus commented on PR #5511:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5511: HADOOP-18680: Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5511: URL: https://github.com/apache/hadoop/pull/5511#issuecomment-1483086346 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apache.org/job

[jira] [Commented] (HADOOP-18680) Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704696#comment-17704696 ] ASF GitHub Bot commented on HADOOP-18680: - cnauroth commented on PR #5511: URL:

[GitHub] [hadoop] cnauroth commented on pull request #5511: HADOOP-18680: Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread via GitHub
cnauroth commented on PR #5511: URL: https://github.com/apache/hadoop/pull/5511#issuecomment-1483083732 @vinayakumarb , may I get your code review, since you had worked on the aarch64 Dockerfile? -- This is an automated message from the Apache Git Service. To respond to the message, pleas

[jira] [Updated] (HADOOP-18680) Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18680: Labels: pull-request-available (was: ) > Insufficient heap during full test runs in Dock

[jira] [Commented] (HADOOP-18680) Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704695#comment-17704695 ] ASF GitHub Bot commented on HADOOP-18680: - cnauroth opened a new pull request,

[GitHub] [hadoop] cnauroth opened a new pull request, #5511: HADOOP-18680: Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread via GitHub
cnauroth opened a new pull request, #5511: URL: https://github.com/apache/hadoop/pull/5511 ### Description of PR During verification of releases on the 3.3 line, I often run out of heap during full test runs inside the Docker container. Let's increase the default in `MAVEN_OPTS` to m

[jira] [Created] (HADOOP-18680) Insufficient heap during full test runs in Docker container on branch-3.3.

2023-03-24 Thread Chris Nauroth (Jira)
Chris Nauroth created HADOOP-18680: -- Summary: Insufficient heap during full test runs in Docker container on branch-3.3. Key: HADOOP-18680 URL: https://issues.apache.org/jira/browse/HADOOP-18680 Proj

[GitHub] [hadoop] hadoop-yetus commented on pull request #5510: HDFS-16964. Improve processing of excess redundancy after failover.

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5510: URL: https://github.com/apache/hadoop/pull/5510#issuecomment-1483058535 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5496: YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation.

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5496: URL: https://github.com/apache/hadoop/pull/5496#issuecomment-1483037564 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5465: YARN-11427. + YARN-11404. Pull up the versioned imports in pom of hadoop-mapreduce-client-app to hadoop-project pom

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5465: URL: https://github.com/apache/hadoop/pull/5465#issuecomment-1483007195 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated HADOOP-18676: --- Fix Version/s: 3.4.0 > Include jettison as direct dependency of hadoop-common > ---

[jira] [Updated] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated HADOOP-18676: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Avail

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704666#comment-17704666 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704667#comment-17704667 ] ASF GitHub Bot commented on HADOOP-18676: - brumi1024 merged PR #5507: URL: http

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704664#comment-17704664 ] ASF GitHub Bot commented on HADOOP-18676: - brumi1024 commented on PR #5507: URL

[GitHub] [hadoop] brumi1024 merged pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
brumi1024 merged PR #5507: URL: https://github.com/apache/hadoop/pull/5507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1483000164 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] brumi1024 commented on pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
brumi1024 commented on PR #5507: URL: https://github.com/apache/hadoop/pull/5507#issuecomment-1482999871 Thanks, and thanks for the review! Thanks @akatona84 for the patch! Merging to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704663#comment-17704663 ] ASF GitHub Bot commented on HADOOP-18676: - pjfanning commented on PR #5507: URL

[GitHub] [hadoop] pjfanning commented on pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
pjfanning commented on PR #5507: URL: https://github.com/apache/hadoop/pull/5507#issuecomment-1482997337 @brumi1024 this PR looks fine to me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704653#comment-17704653 ] Steve Loughran commented on HADOOP-18679: - need to think about throttling here,

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704648#comment-17704648 ] Steve Loughran commented on HADOOP-18679: - h2. Possible API: delete queue a

[jira] [Created] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-24 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18679: --- Summary: Add API for bulk/paged object deletion Key: HADOOP-18679 URL: https://issues.apache.org/jira/browse/HADOOP-18679 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-16800) ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency?

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16800. - Resolution: Won't Fix > ITestDynamoDBMetadataStore.testTableVersioning failure -DDB del

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704644#comment-17704644 ] ASF GitHub Bot commented on HADOOP-18676: - brumi1024 commented on PR #5507: URL

[GitHub] [hadoop] brumi1024 commented on pull request #5507: HADOOP-18676. Fixing jettison vulnerability of hadoop-common lib

2023-03-24 Thread via GitHub
brumi1024 commented on PR #5507: URL: https://github.com/apache/hadoop/pull/5507#issuecomment-1482897517 @pjfanning is anything outstanding with this ticket? If not can we merge this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus commented on pull request #5496: YARN-11376. [Federation] Support updateNodeResource、refreshNodesResources API's for Federation.

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5496: URL: https://github.com/apache/hadoop/pull/5496#issuecomment-1482859842 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704611#comment-17704611 ] ASF GitHub Bot commented on HADOOP-18012: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
steveloughran commented on code in PR #5488: URL: https://github.com/apache/hadoop/pull/5488#discussion_r1147588525 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java: ## @@ -55,6 +55,10 @@ import java.util.concurrent.TimeUnit

[GitHub] [hadoop] szetszwo commented on a diff in pull request #5505: HDFS-16963. Remove the unnecessary use of Optional from DistributedFileSystem

2023-03-24 Thread via GitHub
szetszwo commented on code in PR #5505: URL: https://github.com/apache/hadoop/pull/5505#discussion_r1147590981 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java: ## @@ -3876,10 +3873,9 @@ public boolean hasPathCapability(fi

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704591#comment-17704591 ] Andras Katona commented on HADOOP-18676: It's been there since jettison came in

[jira] [Updated] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona updated HADOOP-18676: --- Description: When hadoop common is pulled in outside of hadoop project, the wrong version o

[jira] [Updated] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona updated HADOOP-18676: --- Description: When hadoop common is pulled in outside of hadoop project, the wrong version o

[GitHub] [hadoop] Hexiaoqiao commented on a diff in pull request #5510: HDFS-16964. Improve processing of excess redundancy after failover.

2023-03-24 Thread via GitHub
Hexiaoqiao commented on code in PR #5510: URL: https://github.com/apache/hadoop/pull/5510#discussion_r1147515572 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java: ## @@ -4020,12 +4014,22 @@ public void setReplicatio

[jira] [Resolved] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt resolved HADOOP-18678. - Resolution: Fixed That seem to have resolved it. Thanks! > Broken links for arm build

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704582#comment-17704582 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1482678183 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704580#comment-17704580 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704579#comment-17704579 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1482672138 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1482671660 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704574#comment-17704574 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1482637219 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704569#comment-17704569 ] Steve Loughran commented on HADOOP-18678: - files have changed though it'll prob

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704562#comment-17704562 ] Steve Loughran commented on HADOOP-18676: - what versions does this affect? > I

[GitHub] [hadoop] zhangshuyan0 opened a new pull request, #5510: HDFS-16964. Improve processing of excess redundancy after failover.

2023-03-24 Thread via GitHub
zhangshuyan0 opened a new pull request, #5510: URL: https://github.com/apache/hadoop/pull/5510 ### Description of PR After failover, the block with excess redundancy cannot be processed until all replicas are not stale, because the stale ones may have been deleted. That is to say

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704558#comment-17704558 ] ASF GitHub Bot commented on HADOOP-18012: - sreeb-msft commented on code in PR #

[GitHub] [hadoop] sreeb-msft commented on a diff in pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
sreeb-msft commented on code in PR #5488: URL: https://github.com/apache/hadoop/pull/5488#discussion_r1147377604 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -578,26 +611,49 @@ public AbfsClientRenameResult renamePath(

[GitHub] [hadoop] hadoop-yetus commented on pull request #5505: HDFS-16963. Remove the unnecessary use of Optional from DistributedFileSystem

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5505: URL: https://github.com/apache/hadoop/pull/5505#issuecomment-1482556118 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704552#comment-17704552 ] ASF GitHub Bot commented on HADOOP-18012: - saxenapranav commented on code in PR

[GitHub] [hadoop] saxenapranav commented on a diff in pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
saxenapranav commented on code in PR #5488: URL: https://github.com/apache/hadoop/pull/5488#discussion_r1147353317 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java: ## @@ -55,6 +55,10 @@ import java.util.concurrent.TimeUnit;

[jira] [Assigned] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18678: --- Assignee: Steve Loughran > Broken links for arm build of hadoop 3.3.5 > --

[jira] [Commented] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704545#comment-17704545 ] Steve Loughran commented on HADOOP-18678: - let me rename the files > Broken li

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704542#comment-17704542 ] ASF GitHub Bot commented on HADOOP-18012: - sreeb-msft commented on PR #5488: UR

[GitHub] [hadoop] sreeb-msft commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-24 Thread via GitHub
sreeb-msft commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1482507227 @steveloughran @saxenapranav @anmolanmol1234 Have addressed the comments. Will be great if you all can take a look! Thanks. -- This is an automated message from the Apache Git Servic

[GitHub] [hadoop] hadoop-yetus commented on pull request #5505: HDFS-16963. Remove the unnecessary use of Optional from DistributedFileSystem

2023-03-24 Thread via GitHub
hadoop-yetus commented on PR #5505: URL: https://github.com/apache/hadoop/pull/5505#issuecomment-1482506885 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18675) CachedSASToken noisy log errors when SAS token has YYYY-MM-DD expiration

2023-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704537#comment-17704537 ] ASF GitHub Bot commented on HADOOP-18675: - saxenapranav commented on code in PR

  1   2   >