[GitHub] [hadoop] hadoop-yetus commented on pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#issuecomment-900829282 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu commented on a change in pull request #3302: HDFS-16173.Improve CopyCommands#Put#executor queue configurability.

2021-08-17 Thread GitBox
jianghuazhu commented on a change in pull request #3302: URL: https://github.com/apache/hadoop/pull/3302#discussion_r690875212 ## File path: hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md ## @@ -542,6 +542,8 @@ Options: * `-l` : Allow DataNode to

[jira] [Created] (HADOOP-17854) Run junit in Jenkins only if surefire reports exist

2021-08-17 Thread Gautham Banasandra (Jira)
Gautham Banasandra created HADOOP-17854: --- Summary: Run junit in Jenkins only if surefire reports exist Key: HADOOP-17854 URL: https://issues.apache.org/jira/browse/HADOOP-17854 Project: Hadoop

[GitHub] [hadoop] jojochuang commented on a change in pull request #3302: HDFS-16173.Improve CopyCommands#Put#executor queue configurability.

2021-08-17 Thread GitBox
jojochuang commented on a change in pull request #3302: URL: https://github.com/apache/hadoop/pull/3302#discussion_r690872102 ## File path: hadoop-common-project/hadoop-common/src/site/markdown/FileSystemShell.md ## @@ -542,6 +542,8 @@ Options: * `-l` : Allow DataNode to

[GitHub] [hadoop] jojochuang commented on a change in pull request #3302: HDFS-16173.Improve CopyCommands#Put#executor queue configurability.

2021-08-17 Thread GitBox
jojochuang commented on a change in pull request #3302: URL: https://github.com/apache/hadoop/pull/3302#discussion_r690871929 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommands.java ## @@ -256,6 +258,8 @@ protected void

[GitHub] [hadoop] jianghuazhu commented on pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#issuecomment-900751597 Thanks @jojochuang for the comment. I will make some changes later. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] ferhui commented on pull request #3302: HDFS-16173.Improve CopyCommands#Put#executor queue configurability.

2021-08-17 Thread GitBox
ferhui commented on pull request #3302: URL: https://github.com/apache/hadoop/pull/3302#issuecomment-900750019 @jianghuazhu Thanks for contribution! @virajjasani Thanks for review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] jojochuang commented on a change in pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
jojochuang commented on a change in pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#discussion_r690806472 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java ## @@ -494,6 +494,10 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #2894: HDFS-15966. Empty the statistical parameters when emptying the redundant queue

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #2894: URL: https://github.com/apache/hadoop/pull/2894#issuecomment-900650739 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17618) ABFS: Partially obfuscate SAS object IDs in Logs

2021-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17618?focusedWorklogId=638874=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-638874 ] ASF GitHub Bot logged work on HADOOP-17618: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2845: HADOOP-17618. ABFS: Partially obfuscate SAS object IDs in Logs

2021-08-17 Thread GitBox
hadoop-yetus removed a comment on pull request #2845: URL: https://github.com/apache/hadoop/pull/2845#issuecomment-811242106 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] steveloughran commented on pull request #3281: HADOOP-17863. Improve logging on ABFS network errors

2021-08-17 Thread GitBox
steveloughran commented on pull request #3281: URL: https://github.com/apache/hadoop/pull/3281#issuecomment-900608265 @mukund-thakur @mehakmeet @snvijaya comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Work logged] (HADOOP-17825) Add BuiltInGzipCompressor

2021-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17825?focusedWorklogId=638871=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-638871 ] ASF GitHub Bot logged work on HADOOP-17825: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3250: HADOOP-17825. Add BuiltInGzipCompressor

2021-08-17 Thread GitBox
hadoop-yetus removed a comment on pull request #3250: URL: https://github.com/apache/hadoop/pull/3250#issuecomment-898777110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] hadoop-yetus commented on pull request #2841: HDFS-15939.Solve the problem that DataXceiverServer#run() does not record SocketTimeout exception.

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #2841: URL: https://github.com/apache/hadoop/pull/2841#issuecomment-900530473 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3309: Hadoop 17853. ABFS: Enable optional store connectivity over azure specific protocol for data egress

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #3309: URL: https://github.com/apache/hadoop/pull/3309#issuecomment-900518331 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] snvijaya commented on pull request #3309: Hadoop 17853. ABFS: Enable optional store connectivity over azure specific protocol for data egress

2021-08-17 Thread GitBox
snvijaya commented on pull request #3309: URL: https://github.com/apache/hadoop/pull/3309#issuecomment-900509712 Test results: HNS-OAuth [INFO] Results: [INFO] [WARNING] Tests run: 110, Failures: 0, Errors: 0, Skipped: 1 [INFO] Results: [INFO]

[GitHub] [hadoop] goiri merged pull request #3303: HDFS-16174. Refactor TempFile and TempDir in libhdfs++

2021-08-17 Thread GitBox
goiri merged pull request #3303: URL: https://github.com/apache/hadoop/pull/3303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] snvijaya opened a new pull request #3309: Hadoop 17853. ABFS: Enable optional store connectivity over azure specific protocol for data egress

2021-08-17 Thread GitBox
snvijaya opened a new pull request #3309: URL: https://github.com/apache/hadoop/pull/3309 This commit provides an option to enable store access on read path over an Azure specific protocol. To enable the feature, config "fs.azure.fastpath.enable"needs to be turned on. This will only work

[GitHub] [hadoop] jianghuazhu commented on pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#issuecomment-900448160 Thanks @jojochuang for the comment. I have submitted some new codes, could you please review them? Thank you very much. -- This is an automated message from the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3284: HDFS-16157. Support configuring DNS record to get list of journal nodes.

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #3284: URL: https://github.com/apache/hadoop/pull/3284#issuecomment-900425151 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17853) ABFS: Enable optional store connectivity over azure specific protocol for data egress

2021-08-17 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-17853: -- Summary: ABFS: Enable optional store connectivity over azure specific protocol for data egress Key: HADOOP-17853 URL:

[jira] [Created] (HADOOP-17852) ABFS: Test with 100MB buffer size in ITestAbfsReadWriteAndSeek times out

2021-08-17 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-17852: -- Summary: ABFS: Test with 100MB buffer size in ITestAbfsReadWriteAndSeek times out Key: HADOOP-17852 URL: https://issues.apache.org/jira/browse/HADOOP-17852

[GitHub] [hadoop] hadoop-yetus commented on pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#issuecomment-900385813 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#issuecomment-900374339 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu edited a comment on pull request #2841: HDFS-15939.Solve the problem that DataXceiverServer#run() does not record SocketTimeout exception.

2021-08-17 Thread GitBox
jianghuazhu edited a comment on pull request #2841: URL: https://github.com/apache/hadoop/pull/2841#issuecomment-900280620 Sorry, I ignored this question for a while. I will continue to work. @liuml07 , thanks for your comment. I very much agree with your suggestion, so I made two

[GitHub] [hadoop] jianghuazhu edited a comment on pull request #2841: HDFS-15939.Solve the problem that DataXceiverServer#run() does not record SocketTimeout exception.

2021-08-17 Thread GitBox
jianghuazhu edited a comment on pull request #2841: URL: https://github.com/apache/hadoop/pull/2841#issuecomment-900280620 Sorry, I ignored this question for a while. I will continue to work. @liuml07 , thanks for your comment. I very much agree with your opinion, so I made two

[GitHub] [hadoop] jianghuazhu commented on pull request #2841: HDFS-15939.Solve the problem that DataXceiverServer#run() does not record SocketTimeout exception.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #2841: URL: https://github.com/apache/hadoop/pull/2841#issuecomment-900280620 Sorry, I ignored this question for a while. I will continue to work. @liuml07 , thanks for your comment. I very much agree with your opinion, so I made two improvements:

[jira] [Work logged] (HADOOP-17767) ABFS: Improve test scripts

2021-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17767?focusedWorklogId=638620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-638620 ] ASF GitHub Bot logged work on HADOOP-17767: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3124: HADOOP-17767. ABFS: Updates test scripts

2021-08-17 Thread GitBox
hadoop-yetus commented on pull request #3124: URL: https://github.com/apache/hadoop/pull/3124#issuecomment-900223501 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on pull request #3288: HDFS-16158. Discover datanodes with unbalanced volume usage by the st…

2021-08-17 Thread GitBox
tomscut commented on pull request #3288: URL: https://github.com/apache/hadoop/pull/3288#issuecomment-900221653 Thanks @jojochuang for your review, I will fix these problems ASAP. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] jojochuang commented on a change in pull request #3288: HDFS-16158. Discover datanodes with unbalanced volume usage by the st…

2021-08-17 Thread GitBox
jojochuang commented on a change in pull request #3288: URL: https://github.com/apache/hadoop/pull/3288#discussion_r690277334 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java ## @@ -3184,6

[GitHub] [hadoop] jianghuazhu commented on pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#issuecomment-900204198 OK. Thanks @jojochuang for the comment. I will continue to work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Work logged] (HADOOP-17767) ABFS: Improve test scripts

2021-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17767?focusedWorklogId=638601=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-638601 ] ASF GitHub Bot logged work on HADOOP-17767: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snvijaya commented on pull request #3124: HADOOP-17767. ABFS: Updates test scripts

2021-08-17 Thread GitBox
snvijaya commented on pull request #3124: URL: https://github.com/apache/hadoop/pull/3124#issuecomment-900179180 --- AGGREGATED TEST RESULT HNS-OAuth - Test results - [INFO] Results: [INFO] [WARNING]

[GitHub] [hadoop] jojochuang commented on a change in pull request #3307: HDFS-16175.Improve the configurable value of Server #PURGE_INTERVAL_NANOS.

2021-08-17 Thread GitBox
jojochuang commented on a change in pull request #3307: URL: https://github.com/apache/hadoop/pull/3307#discussion_r690232653 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeysPublic.java ## @@ -494,6 +494,10 @@

[GitHub] [hadoop] PrabhuJoseph commented on pull request #3287: YARN-10873: Account for scheduled AM containers before deactivating node

2021-08-17 Thread GitBox
PrabhuJoseph commented on pull request #3287: URL: https://github.com/apache/hadoop/pull/3287#issuecomment-900114034 Thanks @srinivasst for the patch and @surnaik for the review. Have committed the patch to trunk. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] PrabhuJoseph merged pull request #3287: YARN-10873: Account for scheduled AM containers before deactivating node

2021-08-17 Thread GitBox
PrabhuJoseph merged pull request #3287: URL: https://github.com/apache/hadoop/pull/3287 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] jojochuang commented on pull request #3295: HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments.

2021-08-17 Thread GitBox
jojochuang commented on pull request #3295: URL: https://github.com/apache/hadoop/pull/3295#issuecomment-900112457 merged. thanks all! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] jojochuang merged pull request #3295: HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments.

2021-08-17 Thread GitBox
jojochuang merged pull request #3295: URL: https://github.com/apache/hadoop/pull/3295 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17844) Upgrade JSON smart to 2.4.7

2021-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17844?focusedWorklogId=638559=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-638559 ] ASF GitHub Bot logged work on HADOOP-17844: --- Author: ASF GitHub Bot

[GitHub] [hadoop] prasad-acit commented on pull request #3299: HADOOP-17844. Upgrade JSON smart to 2.4.7

2021-08-17 Thread GitBox
prasad-acit commented on pull request #3299: URL: https://github.com/apache/hadoop/pull/3299#issuecomment-900076323 Thank you @aajisaka for review & processing it further. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] jianghuazhu commented on pull request #3302: HDFS-16173.Improve CopyCommands#Put#executor queue configurability.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #3302: URL: https://github.com/apache/hadoop/pull/3302#issuecomment-900063826 Thanks @virajjasani for the comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] jianghuazhu commented on pull request #3295: HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #3295: URL: https://github.com/apache/hadoop/pull/3295#issuecomment-900061720 Thanks @virajjasani for the comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HADOOP-17668) Use profile hbase-2.0 by default and update hbase version

2021-08-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400177#comment-17400177 ] Viraj Jasani commented on HADOOP-17668: --- FYI [~zhangduo] [~stack] > Use profile hbase-2.0 by

[jira] [Assigned] (HADOOP-17668) Use profile hbase-2.0 by default and update hbase version

2021-08-17 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-17668: - Assignee: (was: Viraj Jasani) > Use profile hbase-2.0 by default and update hbase

[GitHub] [hadoop] jianghuazhu commented on pull request #3295: HDFS-16162.Improve DFSUtil#checkProtectedDescendants() related parameter comments.

2021-08-17 Thread GitBox
jianghuazhu commented on pull request #3295: URL: https://github.com/apache/hadoop/pull/3295#issuecomment-900025678 @ayushtkn , thanks for your comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL