[GitHub] [hadoop] Hexiaoqiao commented on a change in pull request #3140: HDFS-16088. Standby NameNode process getLiveDatanodeStorageReport req…

2021-07-05 Thread GitBox
Hexiaoqiao commented on a change in pull request #3140: URL: https://github.com/apache/hadoop/pull/3140#discussion_r664253973 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithHANameNodes.java ## @@ -236,4

[jira] [Comment Edited] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

2021-07-05 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375234#comment-17375234 ] Anoop Sam John edited comment on HADOOP-17770 at 7/6/21, 5:38 AM: -- Ran

[jira] [Commented] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

2021-07-05 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375234#comment-17375234 ] Anoop Sam John commented on HADOOP-17770: - Ran below perf test with an HBase usage Have a 3 RS

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

2021-07-05 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: AvgLatency_50% cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

2021-07-05 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: Throughput_50% cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

2021-07-05 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: AvgLatency_0 cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-15566) Support OpenTelemetry

2021-07-05 Thread Kiran Kumar Maturi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kiran Kumar Maturi updated HADOOP-15566: Attachment: HADOOP-15566-WIP.1.patch > Support OpenTelemetry >

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

2021-07-05 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: Throughput_0 cache hit.png > WASB : Support disabling buffered reads in

[GitHub] [hadoop] mukund-thakur commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-07-05 Thread GitBox
mukund-thakur commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-874472280 > I propose we add a dir for job stats into which success/failure JSON goes (we will add a success/failure bit and a stack trace serialization on failures)...saving to

[jira] [Work logged] (HADOOP-17788) Replace IOUtils#closeQuietly usages

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17788?focusedWorklogId=618878=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618878 ] ASF GitHub Bot logged work on HADOOP-17788: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3171: HADOOP-17788. Replace IOUtils#closeQuietly usages by Hadoop's own utility

2021-07-05 Thread GitBox
hadoop-yetus commented on pull request #3171: URL: https://github.com/apache/hadoop/pull/3171#issuecomment-874468390 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on pull request #3140: HDFS-16088. Standby NameNode process getLiveDatanodeStorageReport req…

2021-07-05 Thread GitBox
tomscut commented on pull request #3140: URL: https://github.com/apache/hadoop/pull/3140#issuecomment-874419344 Hi @tasanuma @jojochuang @aajisaka @ayushtkn , could you also help to review the code if you have time? Thanks a lot. We can refer to the discussion in JIRA

[GitHub] [hadoop] tomscut commented on pull request #3174: HDFS-16110. Remove unused method reportChecksumFailure in DFSClient

2021-07-05 Thread GitBox
tomscut commented on pull request #3174: URL: https://github.com/apache/hadoop/pull/3174#issuecomment-874418161 Thanks @jojochuang for the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] jojochuang merged pull request #3174: HDFS-16110. Remove unused method reportChecksumFailure in DFSClient

2021-07-05 Thread GitBox
jojochuang merged pull request #3174: URL: https://github.com/apache/hadoop/pull/3174 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3140: HDFS-16088. Standby NameNode process getLiveDatanodeStorageReport req…

2021-07-05 Thread GitBox
tomscut commented on pull request #3140: URL: https://github.com/apache/hadoop/pull/3140#issuecomment-874412101 Thanks @ferhui for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=618834=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618834 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub Bot

[GitHub] [hadoop] liangxs commented on pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread GitBox
liangxs commented on pull request #3080: URL: https://github.com/apache/hadoop/pull/3080#issuecomment-874400802 @ferhui @aajisaka Thanks very much for your reviews! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375092#comment-17375092 ] Hui Fei commented on HADOOP-17749: -- Could not access gitbox, cherrypick to branch-3.2 branch-3.3 later

[jira] [Work logged] (HADOOP-17776) The java agent args should be passed as the VM arguments

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17776?focusedWorklogId=618831=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618831 ] ASF GitHub Bot logged work on HADOOP-17776: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jiwq edited a comment on pull request #3147: HADOOP-17776. The java agent args should be passed as the VM arguments

2021-07-05 Thread GitBox
jiwq edited a comment on pull request #3147: URL: https://github.com/apache/hadoop/pull/3147#issuecomment-874394094 @aajisaka Thanks for your review. I agree with your opinion and I can try to refactor the `maven-surefire-plugin.argLine` in a separate jira. -- This is an automated

[jira] [Work logged] (HADOOP-17776) The java agent args should be passed as the VM arguments

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17776?focusedWorklogId=618830=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618830 ] ASF GitHub Bot logged work on HADOOP-17776: --- Author: ASF GitHub Bot

[jira] [Reopened] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HADOOP-17749: -- > Remove lock contention in SelectorPool of SocketIOWithTimeout >

[GitHub] [hadoop] jiwq commented on pull request #3147: HADOOP-17776. The java agent args should be passed as the VM arguments

2021-07-05 Thread GitBox
jiwq commented on pull request #3147: URL: https://github.com/apache/hadoop/pull/3147#issuecomment-874394094 @aajisaka Thanks for your review. I agree with your opinion and I can try refactor the `maven-surefire-plugin.argLine` in a separate jira. -- This is an automated message from

[GitHub] [hadoop] tomscut commented on pull request #3174: HDFS-16110. Remove unused method reportChecksumFailure in DFSClient

2021-07-05 Thread GitBox
tomscut commented on pull request #3174: URL: https://github.com/apache/hadoop/pull/3174#issuecomment-874394011 Thanks @tasanuma for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Assigned] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HADOOP-17749: Assignee: Xuesen Liang > Remove lock contention in SelectorPool of SocketIOWithTimeout >

[jira] [Resolved] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HADOOP-17749. -- Fix Version/s: 3.4.0 Resolution: Fixed > Remove lock contention in SelectorPool of

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=618828=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618828 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui merged pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread GitBox
ferhui merged pull request #3080: URL: https://github.com/apache/hadoop/pull/3080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=618827=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618827 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-07-05 Thread GitBox
ferhui commented on pull request #3080: URL: https://github.com/apache/hadoop/pull/3080#issuecomment-874391947 @liangxs Thanks for contribution. @aajisaka Thanks for review! Merged to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] hadoop-yetus commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-07-05 Thread GitBox
hadoop-yetus commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-874362787 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17791) TestActivitiesManager is flaky

2021-07-05 Thread Szilard Nemeth (Jira)
Szilard Nemeth created HADOOP-17791: --- Summary: TestActivitiesManager is flaky Key: HADOOP-17791 URL: https://issues.apache.org/jira/browse/HADOOP-17791 Project: Hadoop Common Issue Type:

[GitHub] [hadoop] steveloughran closed pull request #2349: MAPREDUCE-7282. Move away from V2 commit algorithm

2021-07-05 Thread GitBox
steveloughran closed pull request #2349: URL: https://github.com/apache/hadoop/pull/2349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-07-05 Thread GitBox
steveloughran commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-874312227 I propose we add a dir for job stats into which success/failure JSON goes (we will add a success/failure bit and a stack trace serialization on failures)...saving to this

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-861004924 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618790=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618790 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618789=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618789 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618788=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618788 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #1690: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
steveloughran closed pull request #1690: URL: https://github.com/apache/hadoop/pull/1690 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on pull request #1690: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
steveloughran commented on pull request #1690: URL: https://github.com/apache/hadoop/pull/1690#issuecomment-874310490 closing as it is superceded by #1727. Let's see if we can get it wrapped up in there -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1690: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #1690: URL: https://github.com/apache/hadoop/pull/1690#issuecomment-667156807 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618787=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618787 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618786=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618786 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #1727: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
steveloughran commented on pull request #1727: URL: https://github.com/apache/hadoop/pull/1727#issuecomment-874310092 @goiri looks like some other pom change has broken the merge. Rebase and we can look at it again -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1727: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #1727: URL: https://github.com/apache/hadoop/pull/1727#issuecomment-557717462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618785=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618785 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618784=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618784 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1727: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #1727: URL: https://github.com/apache/hadoop/pull/1727#issuecomment-667180788 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1727: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #1727: URL: https://github.com/apache/hadoop/pull/1727#issuecomment-557384227 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-16680) Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16680?focusedWorklogId=618783=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618783 ] ASF GitHub Bot logged work on HADOOP-16680: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #1690: HADOOP-16680. Add MicrosoftGraphGroupsMapping GroupMappingServiceProvider

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #1690: URL: https://github.com/apache/hadoop/pull/1690#issuecomment-548993831 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | 0 | reexec | 33 |

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=618781=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618781 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2638: HADOOP-17402. Add GCS config to the core-site

2021-07-05 Thread GitBox
steveloughran commented on pull request #2638: URL: https://github.com/apache/hadoop/pull/2638#issuecomment-874308502 Merged to trunk. @ravwojdyla : if you cherrypick this to branch-3.3 and submit a new PR there, I'll merge as soon as yetus is happy. Leaving the JIRA open for now

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=618780=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618780 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #2638: HADOOP-17402. Add GCS config to the core-site

2021-07-05 Thread GitBox
steveloughran merged pull request #2638: URL: https://github.com/apache/hadoop/pull/2638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=618777=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618777 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=618779=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618779 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=618778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618778 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2638: HADOOP-17402. Add GCS config to the core-site

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #2638: URL: https://github.com/apache/hadoop/pull/2638#issuecomment-770508993 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2638: HADOOP-17402. Add GCS config to the core-site

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #2638: URL: https://github.com/apache/hadoop/pull/2638#issuecomment-764861125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] steveloughran commented on a change in pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

2021-07-05 Thread GitBox
steveloughran commented on a change in pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#discussion_r664110702 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractCopyFromLocalTest.java ## @@ -0,0

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=618776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618776 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#issuecomment-868703568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-16752) ABFS: test failure testLastModifiedTime()

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16752?focusedWorklogId=618775=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618775 ] ASF GitHub Bot logged work on HADOOP-16752: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16752) ABFS: test failure testLastModifiedTime()

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16752?focusedWorklogId=618774=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618774 ] ASF GitHub Bot logged work on HADOOP-16752: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3045: HADOOP-16752. assertion failure in ITestAzureBlobFileSystemFileStatus

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #3045: URL: https://github.com/apache/hadoop/pull/3045#issuecomment-846952997 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] steveloughran commented on pull request #3045: HADOOP-16752. assertion failure in ITestAzureBlobFileSystemFileStatus

2021-07-05 Thread GitBox
steveloughran commented on pull request #3045: URL: https://github.com/apache/hadoop/pull/3045#issuecomment-874304825 Looking at it some more. It's getting modtime from the store, create time from the clock. 1. Tests under load can have an endtime > modtime 2. clock skew could

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=618771=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618771 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

2021-07-05 Thread GitBox
steveloughran commented on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-874303444 Note: we could also backport to 3.2.x if you want to cherrypick the 3.3 changes and retest...then provide a new PR. -- This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-17765) ABFS: Use Unique File Paths in Tests

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17765?focusedWorklogId=618769=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618769 ] ASF GitHub Bot logged work on HADOOP-17765: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3122: HADOOP-17765. ABFS: Use Unique File Paths in Tests

2021-07-05 Thread GitBox
steveloughran commented on a change in pull request #3122: URL: https://github.com/apache/hadoop/pull/3122#discussion_r664106486 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/ITestAzureBlobFileSystemBackCompat.java ## @@ -50,13 +52,17 @@

[jira] [Work logged] (HADOOP-17779) Lock File System Creator Semaphore Uninterruptibly

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17779?focusedWorklogId=618768=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618768 ] ASF GitHub Bot logged work on HADOOP-17779: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3158: HADOOP-17779: Lock File System Creator Semaphore Uninterruptibly

2021-07-05 Thread GitBox
steveloughran commented on pull request #3158: URL: https://github.com/apache/hadoop/pull/3158#issuecomment-874300831 why do we need to make it uninterruptible? Is there a risk of problems if one thread is waiting for the semaphore and the process is exited? -- This is an

[jira] [Work logged] (HADOOP-17779) Lock File System Creator Semaphore Uninterruptibly

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17779?focusedWorklogId=618767=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618767 ] ASF GitHub Bot logged work on HADOOP-17779: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3158: HADOOP-17779: Lock File System Creator Semaphore Uninterruptibly

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #3158: URL: https://github.com/apache/hadoop/pull/3158#issuecomment-871086628 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17788) Replace IOUtils#closeQuietly usages

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17788?focusedWorklogId=618766=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618766 ] ASF GitHub Bot logged work on HADOOP-17788: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3171: HADOOP-17788. Replace IOUtils#closeQuietly usages by Hadoop's own utility

2021-07-05 Thread GitBox
steveloughran commented on pull request #3171: URL: https://github.com/apache/hadoop/pull/3171#issuecomment-874299709 @aajisaka > To fix deprecation warning, I perfer using try-with-resources rather than replacing with our internal replacement. Mixed feelings there. I went

[jira] [Commented] (HADOOP-17790) ABFS: Modifications to TracingContext

2021-07-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374974#comment-17374974 ] Steve Loughran commented on HADOOP-17790: - I'd really like this to pick up and integrate with

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=618763=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618763 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-872117658 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=618762=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618762 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=618761=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618761 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-872998551 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-07-05 Thread GitBox
hadoop-yetus removed a comment on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-870058533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (HADOOP-17631) Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when restrictSystemProps=true

2021-07-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17631: Description: When configuration reads in resources with a restricted parser, it skips

[jira] [Work logged] (HADOOP-17682) ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17682?focusedWorklogId=618742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618742 ] ASF GitHub Bot logged work on HADOOP-17682: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2975: HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters

2021-07-05 Thread GitBox
hadoop-yetus commented on pull request #2975: URL: https://github.com/apache/hadoop/pull/2975#issuecomment-874257716 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17790) ABFS: Modifications to TracingContext

2021-07-05 Thread Sumangala Patki (Jira)
Sumangala Patki created HADOOP-17790: Summary: ABFS: Modifications to TracingContext Key: HADOOP-17790 URL: https://issues.apache.org/jira/browse/HADOOP-17790 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17250. Resolution: Fixed > ABFS: Random read perf improvement >

[jira] [Updated] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-17250: --- Description: Random read if marginally read ahead was seen to improve perf for a TPCH

[jira] [Updated] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-17250: --- Fix Version/s: 3.3.2 > ABFS: Random read perf improvement >

[jira] [Assigned] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-17250: -- Assignee: Mukund Thakur (was: Mukund Thakur) > ABFS: Random read perf improvement

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2021-07-05 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-874062488 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17765) ABFS: Use Unique File Paths in Tests

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17765?focusedWorklogId=618606=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618606 ] ASF GitHub Bot logged work on HADOOP-17765: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3153: HADOOP-17765. ABFS: Use Unique File Paths in Tests

2021-07-05 Thread GitBox
hadoop-yetus commented on pull request #3153: URL: https://github.com/apache/hadoop/pull/3153#issuecomment-874022678 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?focusedWorklogId=618601=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618601 ] ASF GitHub Bot logged work on HADOOP-17250: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3110: HADOOP-17250 Lot of short reads can be merged with readahead.

2021-07-05 Thread GitBox
hadoop-yetus commented on pull request #3110: URL: https://github.com/apache/hadoop/pull/3110#issuecomment-874011511 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?focusedWorklogId=618600=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-618600 ] ASF GitHub Bot logged work on HADOOP-17250: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur merged pull request #3110: HADOOP-17250 Lot of short reads can be merged with readahead.

2021-07-05 Thread GitBox
mukund-thakur merged pull request #3110: URL: https://github.com/apache/hadoop/pull/3110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-13144) Enhancing IPC client throughput via multiple connections per user

2021-07-05 Thread Hong Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17374737#comment-17374737 ] Hong Chen commented on HADOOP-13144: [~brahmareddy] [~elgoiri] hi, could u provide a 3.3.0 patch

  1   2   >