[GitHub] [hadoop] xinglin commented on pull request #4872: HDFS-16764. ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2022-10-08 Thread GitBox
xinglin commented on PR #4872: URL: https://github.com/apache/hadoop/pull/4872#issuecomment-1272459124 Hi @ZanderXu, I understand what you tried to do now. The first `checkOperation(OperationCategory.WRITE)` call will throw a `RetryOnActiveException` on an observerNN. Are

[GitHub] [hadoop] xinglin commented on a diff in pull request #4872: HDFS-16764. ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2022-10-08 Thread GitBox
xinglin commented on code in PR #4872: URL: https://github.com/apache/hadoop/pull/4872#discussion_r990733465 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRpcServer.java: ## @@ -158,6 +164,49 @@ public void

[GitHub] [hadoop] ZanderXu commented on a diff in pull request #4750: HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS

2022-10-08 Thread GitBox
ZanderXu commented on code in PR #4750: URL: https://github.com/apache/hadoop/pull/4750#discussion_r990721289 ## hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java: ## @@ -73,39 +102,15 @@ import

[GitHub] [hadoop] ZanderXu commented on pull request #4872: HDFS-16764. ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2022-10-08 Thread GitBox
ZanderXu commented on PR #4872: URL: https://github.com/apache/hadoop/pull/4872#issuecomment-1272433724 > Hi @ZanderXu, > > I am not clear what exactly you are trying to achieve here. Are you trying to enable observerNodes to handle addBlock RPC from clients? I believe addBlock is

[GitHub] [hadoop] xinglin commented on pull request #4872: HDFS-16764. ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2022-10-08 Thread GitBox
xinglin commented on PR #4872: URL: https://github.com/apache/hadoop/pull/4872#issuecomment-1272415229 Hi @ZanderXu, I am not clear what exactly you are trying to achieve here. Are you trying to enable observerNodes to handle addBlock RPC from clients? I believe addBlock is an

[GitHub] [hadoop] hadoop-yetus commented on pull request #4987: HDFS-16798. SerialNumberMap should decrease the current if the old already exist

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4987: URL: https://github.com/apache/hadoop/pull/4987#issuecomment-1272383474 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4968: HDFS-16792. Add -newEditsOnly option to name node initializeSharedEdits command to format unformatted journal nodes for master replaceme

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4968: URL: https://github.com/apache/hadoop/pull/4968#issuecomment-1272366371 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ZanderXu commented on pull request #4987: HDFS-16798. SerialNumberMap should decrease the current if the old already exist

2022-10-08 Thread GitBox
ZanderXu commented on PR #4987: URL: https://github.com/apache/hadoop/pull/4987#issuecomment-1272346518 > Congratulations on your promotion to committer, very good! @slfan1989 Thanks, bro. You will get a promotion soon. -- This is an automated message from the Apache Git Service.

[jira] [Commented] (HADOOP-18360) Update commons-csv from 1.0 to 1.9.0.

2022-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614499#comment-17614499 ] ASF GitHub Bot commented on HADOOP-18360: - slfan1989 commented on PR #4928: URL:

[GitHub] [hadoop] slfan1989 commented on pull request #4928: HADOOP-18360. Update commons-csv from 1.0 to 1.9.0.

2022-10-08 Thread GitBox
slfan1989 commented on PR #4928: URL: https://github.com/apache/hadoop/pull/4928#issuecomment-1272339219 @ayushtkn Can you help review this pr? I think an upgrade is still necessary. For the deprecated method, I also made a replacement. -- This is an automated message from the Apache Git

[GitHub] [hadoop] slfan1989 commented on pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2022-10-08 Thread GitBox
slfan1989 commented on PR #4687: URL: https://github.com/apache/hadoop/pull/4687#issuecomment-1272338733 @9uapaw Thank you very much for your suggestion, I will modify the code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] slfan1989 commented on pull request #4982: YARN-11332. [Federation] Improve FederationClientInterceptor#ThreadPool thread pool configuration.

2022-10-08 Thread GitBox
slfan1989 commented on PR #4982: URL: https://github.com/apache/hadoop/pull/4982#issuecomment-1272337601 @goiri Can you help review the code again? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] slfan1989 commented on pull request #4987: HDFS-16798. SerialNumberMap should decrease the current if the old already exist

2022-10-08 Thread GitBox
slfan1989 commented on PR #4987: URL: https://github.com/apache/hadoop/pull/4987#issuecomment-1272331099 @ZanderXu Congratulations on your promotion to committer, very good! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] hadoop-yetus commented on pull request #4941: YARN-10680: logging of uncaught exceptions throughout SLS

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4941: URL: https://github.com/apache/hadoop/pull/4941#issuecomment-1272329041 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] 9uapaw commented on pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2022-10-08 Thread GitBox
9uapaw commented on PR #4687: URL: https://github.com/apache/hadoop/pull/4687#issuecomment-1272312993 Hi @slfan1989, thanks for the patch! I think this should be hidden behind a config flag, and should be opt-in (false by default). Metrics aggregation often causes performance degradation.

[GitHub] [hadoop] susheel-gupta commented on a diff in pull request #4941: YARN-10680: logging of uncaught exceptions throughout SLS

2022-10-08 Thread GitBox
susheel-gupta commented on code in PR #4941: URL: https://github.com/apache/hadoop/pull/4941#discussion_r990636469 ## hadoop-tools/hadoop-sls/src/main/java/org/apache/hadoop/yarn/sls/scheduler/SLSCapacityScheduler.java: ## @@ -105,7 +108,11 @@ public boolean tryCommit(Resource

[GitHub] [hadoop] hadoop-yetus commented on pull request #4655: YARN-11216. Avoid unnecessary reconstruction of ConfigurationProperties

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4655: URL: https://github.com/apache/hadoop/pull/4655#issuecomment-1272305412 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ZanderXu opened a new pull request, #4987: HDFS-16798. SerialNumberMap should decrease the current if the old already exist

2022-10-08 Thread GitBox
ZanderXu opened a new pull request, #4987: URL: https://github.com/apache/hadoop/pull/4987 ### Description of PR During looking into some code related XATTR, I found there is a bug in SerialNumberMap, as bellow: ``` public int get(T t) { if (t == null) { return 0;

[GitHub] [hadoop] ashutoshcipher commented on pull request #4750: HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS

2022-10-08 Thread GitBox
ashutoshcipher commented on PR #4750: URL: https://github.com/apache/hadoop/pull/4750#issuecomment-1272297083 Hi @ZanderXu - Can you please help in reviewing ? Thank you so much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] ashutoshcipher commented on pull request #4750: HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS

2022-10-08 Thread GitBox
ashutoshcipher commented on PR #4750: URL: https://github.com/apache/hadoop/pull/4750#issuecomment-1272296766 > hadoop.fs.http.client.TestHttpFSWithHttpFSFileSystem Is passing in local. Will trigger jenkins once again after getting current code being reviewed -- This is an

[GitHub] [hadoop] hadoop-yetus commented on pull request #4967: HDFS-16791 WIP - client protocol and Filesystem apis implemented and …

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4967: URL: https://github.com/apache/hadoop/pull/4967#issuecomment-1272286436 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] K0K0V0K commented on pull request #4949: YARN-8262. Added meaningful error codes to get_executable in container-executor

2022-10-08 Thread GitBox
K0K0V0K commented on PR #4949: URL: https://github.com/apache/hadoop/pull/4949#issuecomment-1272264656 I think there should be at least one test in the TestLinuxContainerExecutor, what will check in case of an error the app will return with a not -1 error code. -- This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #4967: HDFS-16791 WIP - client protocol and Filesystem apis implemented and …

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4967: URL: https://github.com/apache/hadoop/pull/4967#issuecomment-1272263575 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4687: URL: https://github.com/apache/hadoop/pull/4687#issuecomment-1272244531 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4976: YARN-11328. Refactoring part of the code of SQLFederationStateStore.

2022-10-08 Thread GitBox
hadoop-yetus commented on PR #4976: URL: https://github.com/apache/hadoop/pull/4976#issuecomment-1272242696 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |