[GitHub] [hadoop] steveloughran merged pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-08 Thread GitBox
steveloughran merged pull request #2264: URL: https://github.com/apache/hadoop/pull/2264 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] steveloughran commented on pull request #2264: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-08 Thread GitBox
steveloughran commented on pull request #2264: URL: https://github.com/apache/hadoop/pull/2264#issuecomment-688736659 +1, merged to trunk, do a retest on branch-3.3 and I'll merge there too This is an automated message from

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=479960=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479960 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] BilwaST commented on pull request #2239: YARN-10403. Add success/failure message to RMAdmin CLI queue refresh

2020-09-08 Thread GitBox
BilwaST commented on pull request #2239: URL: https://github.com/apache/hadoop/pull/2239#issuecomment-688719152 Thanks @brucesw for updating. +1(Non binding) This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] 1996fanrui commented on pull request #2241: HADOOP-17222. Create socket address combined with cache

2020-09-08 Thread GitBox
1996fanrui commented on pull request #2241: URL: https://github.com/apache/hadoop/pull/2241#issuecomment-688674895 > I'm now on vacation. I will merge it this week. ok, thank you very much. This is an automated

[jira] [Work logged] (HADOOP-17222) Create socket address combined with cache to speed up hdfs client choose DataNode

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17222?focusedWorklogId=479887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479887 ] ASF GitHub Bot logged work on HADOOP-17222: --- Author: ASF GitHub Bot

[GitHub] [hadoop] jianghuazhu opened a new pull request #2281: HDFS-15516.Add info for create flags in NameNode audit logs.

2020-09-08 Thread GitBox
jianghuazhu opened a new pull request #2281: URL: https://github.com/apache/hadoop/pull/2281 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number.

[GitHub] [hadoop] steveloughran commented on pull request #2272: HADOOP-17158. Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread GitBox
steveloughran commented on pull request #2272: URL: https://github.com/apache/hadoop/pull/2272#issuecomment-688734784 merged to trunk; if you want it in branch-3.3 do a cherrypick, retest and let me know it worked This is

[jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=479958=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479958 ] ASF GitHub Bot logged work on HADOOP-17158: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17158. - Fix Version/s: 3.4.0 Resolution: Fixed fixed in trunk; happy to cherrypick to

[GitHub] [hadoop] steveloughran merged pull request #2272: HADOOP-17158. Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread GitBox
steveloughran merged pull request #2272: URL: https://github.com/apache/hadoop/pull/2272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Work logged] (HADOOP-17158) Test timeout for ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17158?focusedWorklogId=479959=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479959 ] ASF GitHub Bot logged work on HADOOP-17158: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

2020-09-08 Thread GitBox
steveloughran commented on a change in pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#discussion_r484767016 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Listing.java ## @@ -764,82 +759,122 @@ public int getBatchSize() {

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=479951=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479951 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=479961=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479961 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

2020-09-08 Thread GitBox
hadoop-yetus removed a comment on pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#issuecomment-688314591 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=480001=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480001 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[GitHub] [hadoop] lamber-ken opened a new pull request #2284: HDFS-15561. Fix NullPointException when start dfsrouter

2020-09-08 Thread GitBox
lamber-ken opened a new pull request #2284: URL: https://github.com/apache/hadoop/pull/2284 ## NOTICE `dfs.federation.router.monitor.localnamenode.enable` is true by default, but it always add it to namenode heartbeat service, so the log file is full of exception information.

[GitHub] [hadoop] steveloughran commented on pull request #2283: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-08 Thread GitBox
steveloughran commented on pull request #2283: URL: https://github.com/apache/hadoop/pull/2283#issuecomment-688833532 merged; closing. Thanks! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] steveloughran closed pull request #2283: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-08 Thread GitBox
steveloughran closed pull request #2283: URL: https://github.com/apache/hadoop/pull/2283 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17229: Fix Version/s: (was: 3.4.0) 3.3.1 > Test failure as failed

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192185#comment-17192185 ] Masatake Iwasaki commented on HADOOP-16918: --- nimbus-jose-jwt was upgraded from 4.41.1 to 7.9

[GitHub] [hadoop] mehakmeet opened a new pull request #2282: HADOOP-17113, Hadoop-17158. Adding ReadAhead Counters and fixing ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread GitBox
mehakmeet opened a new pull request #2282: URL: https://github.com/apache/hadoop/pull/2282 Backport for both HADOOP-17113(#2154) and HADOOP-17158(#2272) Tested by: mvn -T 1C -Dparallel-tests=abfs clean verify Region: East US ``` [INFO] Results: [INFO] [INFO] Tests run:

[jira] [Commented] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192171#comment-17192171 ] Steve Loughran commented on HADOOP-17244: - This is only an issue on branches with HADOOP-16430

[GitHub] [hadoop] mukund-thakur commented on pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

2020-09-08 Thread GitBox
mukund-thakur commented on pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#issuecomment-688823862 > checkstyle complaining with fixable issues > > ``` > ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Listing.java:370:

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=480084=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480084 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

2020-09-08 Thread GitBox
steveloughran commented on a change in pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#discussion_r484868210 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/S3Guard.java ## @@ -362,14 +340,16 @@ public static

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=480090=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480090 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192080#comment-17192080 ] Steve Loughran commented on HADOOP-17244: - .. this fix needs to go in to all releases of Hadoop

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=479991=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-479991 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#issuecomment-688762761 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Commented] (HADOOP-17217) S3A FileSystem does not correctly delete directories with fake entries

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192123#comment-17192123 ] Steve Loughran commented on HADOOP-17217: - Should be fixed in HADOOP-13230, provided you don't

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=480053=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480053 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] BilwaST removed a comment on pull request #2239: YARN-10403. Add success/failure message to RMAdmin CLI queue refresh

2020-09-08 Thread GitBox
BilwaST removed a comment on pull request #2239: URL: https://github.com/apache/hadoop/pull/2239#issuecomment-688719152 Thanks @brucesw for updating. +1(Non binding) This is an automated message from the Apache Git Service.

[jira] [Commented] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192179#comment-17192179 ] Steve Loughran commented on HADOOP-17229: - merged to trunk and 3.3 > Test failure as failed

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=480093=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480093 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=480092=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480092 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2282: HADOOP-17113, HADOOP-17158. Adding ReadAhead Counters and fixing ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread GitBox
steveloughran commented on pull request #2282: URL: https://github.com/apache/hadoop/pull/2282#issuecomment-688851051 merged to branch-3.3. Thanks! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] steveloughran closed pull request #2282: HADOOP-17113, HADOOP-17158. Adding ReadAhead Counters and fixing ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread GitBox
steveloughran closed pull request #2282: URL: https://github.com/apache/hadoop/pull/2282 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192196#comment-17192196 ] Masatake Iwasaki commented on HADOOP-16918: --- difference of netty version between branch-2.10

[GitHub] [hadoop] hadoop-yetus commented on pull request #2281: HDFS-15516.Add info for create flags in NameNode audit logs.

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2281: URL: https://github.com/apache/hadoop/pull/2281#issuecomment-688789950 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m

[GitHub] [hadoop] BilwaST commented on pull request #2239: YARN-10403. Add success/failure message to RMAdmin CLI queue refresh

2020-09-08 Thread GitBox
BilwaST commented on pull request #2239: URL: https://github.com/apache/hadoop/pull/2239#issuecomment-688807826 Hi @brucesw RMAdminCLI#run method already is printing error msg like below . You can add success message in run method itself which will be common for all commands. What do

[GitHub] [hadoop] hadoop-yetus commented on pull request #2282: HADOOP-17113, HADOOP-17158. Adding ReadAhead Counters and fixing ITestAbfsInputStreamStatistics#testReadAheadCounters

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2282: URL: https://github.com/apache/hadoop/pull/2282#issuecomment-688828740 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 31m

[jira] [Resolved] (HADOOP-17189) add way for s3a to recognise buckets with "." in name and switch to path access

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17189. - Fix Version/s: 3.4.0 Resolution: Won't Fix WONTFIXing this, as buckets with .

[jira] [Updated] (HADOOP-17113) Adding ReadAhead Counters in ABFS

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17113: Labels: pull-request-available (was: ) > Adding ReadAhead Counters in ABFS >

[jira] [Work logged] (HADOOP-17113) Adding ReadAhead Counters in ABFS

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17113?focusedWorklogId=480016=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480016 ] ASF GitHub Bot logged work on HADOOP-17113: --- Author: ASF GitHub Bot

[jira] [Created] (HADOOP-17250) ABFS: Allow random read sizes to be of buffer size

2020-09-08 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-17250: -- Summary: ABFS: Allow random read sizes to be of buffer size Key: HADOOP-17250 URL: https://issues.apache.org/jira/browse/HADOOP-17250 Project: Hadoop

[GitHub] [hadoop] mehakmeet opened a new pull request #2283: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-08 Thread GitBox
mehakmeet opened a new pull request #2283: URL: https://github.com/apache/hadoop/pull/2283 Backport for HADOOP-17229(#2264) Tested by: mvn -T 1C -Dparallel-tests=abfs clean verify ``` [INFO] Results: [INFO] [INFO] Tests run: 87, Failures: 0, Errors: 0, Skipped: 0 ```

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

2020-09-08 Thread GitBox
hadoop-yetus removed a comment on pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#issuecomment-682588174 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec

[GitHub] [hadoop] steveloughran commented on pull request #2257: HADOOP-17023 Tune S3AFileSystem.listStatus() api.

2020-09-08 Thread GitBox
steveloughran commented on pull request #2257: URL: https://github.com/apache/hadoop/pull/2257#issuecomment-688822205 checkstyle complaining with fixable issues ``` ./hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Listing.java:370:

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=480079=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480079 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17023) Tune listStatus() api of s3a.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17023?focusedWorklogId=480080=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480080 ] ASF GitHub Bot logged work on HADOOP-17023: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=480106=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480106 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17113) Adding ReadAhead Counters in ABFS

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17113?focusedWorklogId=480103=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480103 ] ASF GitHub Bot logged work on HADOOP-17113: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17113) Adding ReadAhead Counters in ABFS

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17113?focusedWorklogId=480105=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480105 ] ASF GitHub Bot logged work on HADOOP-17113: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-08 Thread GitBox
steveloughran commented on pull request #2280: URL: https://github.com/apache/hadoop/pull/2280#issuecomment-688851531 broke the local fs tests ``` [ERROR] Failures: [ERROR]

[jira] [Work logged] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?focusedWorklogId=480119=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480119 ] ASF GitHub Bot logged work on HADOOP-17229: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2283: HADOOP-17229. No updation of bytes received counter value after response failure occurs in ABFS

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2283: URL: https://github.com/apache/hadoop/pull/2283#issuecomment-688857463 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 30m

[jira] [Resolved] (HADOOP-17229) Test failure as failed request body counted in byte received metric - ITestAbfsNetworkStatistics#testAbfsHttpResponseStatistics

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17229. - Fix Version/s: 3.4.0 Resolution: Fixed > Test failure as failed request body

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192177#comment-17192177 ] Masatake Iwasaki commented on HADOOP-16918: --- Jetty was upgraded from 6.1.26 to

[jira] [Work logged] (HADOOP-17113) Adding ReadAhead Counters in ABFS

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17113?focusedWorklogId=480089=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480089 ] ASF GitHub Bot logged work on HADOOP-17113: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-16942) S3A creating folder level delete markers

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192199#comment-17192199 ] Steve Loughran commented on HADOOP-16942: - one more point, you said: EMR version - 6.0.0

[jira] [Commented] (HADOOP-16843) S3A DT marshalling to include nested error text in wrapped message

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192211#comment-17192211 ] Steve Loughran commented on HADOOP-16843: - Might be of interest for [~gabor.bota] > S3A DT

[GitHub] [hadoop] iwasakims opened a new pull request #2285: HADOOP-17251. Upgrade netty-all to 4.1.50.Final on branch-2.10.

2020-09-08 Thread GitBox
iwasakims opened a new pull request #2285: URL: https://github.com/apache/hadoop/pull/2285 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Work logged] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17251?focusedWorklogId=480153=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480153 ] ASF GitHub Bot logged work on HADOOP-17251: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17241) s3a: bucket names which aren't parseable hostnames unsupported

2020-09-08 Thread peter weissbrod (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192236#comment-17192236 ] peter weissbrod commented on HADOOP-17241: -- Further information: I've started to experience

[jira] [Work logged] (HADOOP-17242) S3A (async) ObjectListingIterator to block in hasNext() for results

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17242?focusedWorklogId=480152=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480152 ] ASF GitHub Bot logged work on HADOOP-17242: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2273: HADOOP-17242. S3A ObjectListingIterator to block in hasNext() for results

2020-09-08 Thread GitBox
steveloughran commented on pull request #2273: URL: https://github.com/apache/hadoop/pull/2273#issuecomment-688895798 on this again. Need to think about what happens after hasNext raises an exception. IMO we should cache it and rethrow on all subsequent hasNext/next. Without that if you

[jira] [Updated] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17251: -- Status: Patch Available (was: Open) > Upgrade netty-all to 4.1.50.Final on

[jira] [Updated] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17251: -- Description: netty-all seems to be easily updated to fix HADOOP-16918. > Upgrade

[jira] [Updated] (HADOOP-14910) Upgrade netty-all jar to latest 4.0.x.Final

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-14910: -- Fix Version/s: 2.10.1 > Upgrade netty-all jar to latest 4.0.x.Final >

[jira] [Commented] (HADOOP-14910) Upgrade netty-all jar to latest 4.0.x.Final

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1719#comment-1719 ] Masatake Iwasaki commented on HADOOP-14910: --- cherry-picked to branch-2.10. > Upgrade

[jira] [Created] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17251: - Summary: Upgrade netty-all to 4.1.50.Final on branch-2.10 Key: HADOOP-17251 URL: https://issues.apache.org/jira/browse/HADOOP-17251 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #2278: HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2278: URL: https://github.com/apache/hadoop/pull/2278#issuecomment-688943301 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 32m

[jira] [Work logged] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17251?focusedWorklogId=480174=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480174 ] ASF GitHub Bot logged work on HADOOP-17251: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2285: HADOOP-17251. Upgrade netty-all to 4.1.50.Final on branch-2.10.

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2285: URL: https://github.com/apache/hadoop/pull/2285#issuecomment-688920889 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 11m

[GitHub] [hadoop] iwasakims commented on pull request #2285: HADOOP-17251. Upgrade netty-all to 4.1.50.Final on branch-2.10.

2020-09-08 Thread GitBox
iwasakims commented on pull request #2285: URL: https://github.com/apache/hadoop/pull/2285#issuecomment-688930231 TestWebHDFS passed with the patch on my local. This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17251?focusedWorklogId=480189=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480189 ] ASF GitHub Bot logged work on HADOOP-17251: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #2284: HDFS-15561. Fix NullPointException when start dfsrouter

2020-09-08 Thread GitBox
goiri commented on a change in pull request #2284: URL: https://github.com/apache/hadoop/pull/2284#discussion_r485034706 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/Router.java ## @@ -553,11 +553,18 @@ public

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192238#comment-17192238 ] Masatake Iwasaki commented on HADOOP-16918: --- I filed HADOOP-17251 to upgrade netty-all to

[GitHub] [hadoop] hadoop-yetus commented on pull request #2284: HDFS-15561. Fix NullPointException when start dfsrouter

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2284: URL: https://github.com/apache/hadoop/pull/2284#issuecomment-688878940 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=480203=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480203 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17181) ITestS3AContractUnbuffer failure -stream.read didn't return all data

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192297#comment-17192297 ] Steve Loughran commented on HADOOP-17181: - ..and again. Maybe it's network load @ home or

[jira] [Updated] (HADOOP-17251) Upgrade netty-all to 4.1.50.Final on branch-2.10

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17251: Labels: pull-request-available (was: ) > Upgrade netty-all to 4.1.50.Final on

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192241#comment-17192241 ] Masatake Iwasaki commented on HADOOP-16918: --- I would like to put zookeeper and hbase-common

[GitHub] [hadoop] hadoop-yetus commented on pull request #2281: HDFS-15516.Add info for create flags in NameNode audit logs.

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2281: URL: https://github.com/apache/hadoop/pull/2281#issuecomment-688967698 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Updated] (HADOOP-17250) ABFS: Allow random read sizes to be of buffer size

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17250: Affects Version/s: (was: 3.1.4) 3.3.0 > ABFS: Allow random

[jira] [Commented] (HADOOP-17250) ABFS: Allow random read sizes to be of buffer size

2020-09-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192286#comment-17192286 ] Steve Loughran commented on HADOOP-17250: - back-to-back readFully() are pretty common. Look @

[GitHub] [hadoop] hadoop-yetus commented on pull request #2280: HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2280: URL: https://github.com/apache/hadoop/pull/2280#issuecomment-689012950 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17244) HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17244?focusedWorklogId=480285=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480285 ] ASF GitHub Bot logged work on HADOOP-17244: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao commented on a change in pull request #2240: HADOOP-17165. Implement service-user feature in DecayRPCScheduler.

2020-09-08 Thread GitBox
sunchao commented on a change in pull request #2240: URL: https://github.com/apache/hadoop/pull/2240#discussion_r485068150 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/DecayRpcScheduler.java ## @@ -178,6 +188,7 @@ private static

[jira] [Work logged] (HADOOP-17165) Implement service-user feature in DecayRPCScheduler

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17165?focusedWorklogId=480287=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480287 ] ASF GitHub Bot logged work on HADOOP-17165: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192377#comment-17192377 ] Wei-Chiu Chuang commented on HADOOP-16918: -- I should probably run this dependency checker

[GitHub] [hadoop] hadoop-yetus commented on pull request #2185: HADOOP-15891. provide Regex Based Mount Point In Inode Tree

2020-09-08 Thread GitBox
hadoop-yetus commented on pull request #2185: URL: https://github.com/apache/hadoop/pull/2185#issuecomment-689082045 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-17249) Upgrade jackson-databind to 2.10 on branch-2.10

2020-09-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192311#comment-17192311 ] Jim Brennan commented on HADOOP-17249: -- [~iwasakims] there were some concerns about breaking

[GitHub] [hadoop] Gaurangi94 commented on a change in pull request #2028: MAPREDUCE-7279. Adds RM host name to history server web page

2020-09-08 Thread GitBox
Gaurangi94 commented on a change in pull request #2028: URL: https://github.com/apache/hadoop/pull/2028#discussion_r485081448 ## File path:

[jira] [Commented] (HADOOP-16918) Dependency update for Hadoop 2.10

2020-09-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192376#comment-17192376 ] Wei-Chiu Chuang commented on HADOOP-16918: -- We can probably update zookeeper from 3.4.9 to

[jira] [Work logged] (HADOOP-15891) Provide Regex Based Mount Point In Inode Tree

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15891?focusedWorklogId=480379=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480379 ] ASF GitHub Bot logged work on HADOOP-15891: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-15702) ABFS: Increase timeout of ITestAbfsReadWriteAndSeek

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15702?focusedWorklogId=480264=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-480264 ] ASF GitHub Bot logged work on HADOOP-15702: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-15702) ABFS: Increase timeout of ITestAbfsReadWriteAndSeek

2020-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-15702: Labels: abfsinactive pull-request-available (was: abfsinactive) > ABFS: Increase

  1   2   >