[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535922=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535922 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759981461 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on pull request #2475: HDFS-15672. TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk.

2021-01-13 Thread GitBox
aajisaka commented on pull request #2475: URL: https://github.com/apache/hadoop/pull/2475#issuecomment-759978624 Thank you @iwasakims for your fix! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] aajisaka merged pull request #2475: HDFS-15672. TestBalancerWithMultipleNameNodes#testBalancingBlockpoolsWithBlockPoolPolicy fails on trunk.

2021-01-13 Thread GitBox
aajisaka merged pull request #2475: URL: https://github.com/apache/hadoop/pull/2475 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka opened a new pull request #2620: HDFS-15717. Improve fsck logging. (#2529) Contributed by Kihwal Lee a…

2021-01-13 Thread GitBox
aajisaka opened a new pull request #2620: URL: https://github.com/apache/hadoop/pull/2620 …nd Ahmed Hussein (cherry picked from commit be35fa186cc0c5c1f90028a9383851d47791bf04) Backport for branch-2.10. * Fixed conflicts. * Removed lambda for JDK7. I don't

[jira] [Commented] (HADOOP-16947) Stale record should be remove when MutableRollingAverages generating aggregate data.

2021-01-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264642#comment-17264642 ] Xiaoqiao He commented on HADOOP-16947: -- LGTM. +1 for [^HADOOP-16947-012.patch]. [~elgoiri] do you

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535894=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535894 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759940478 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535887 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759930746 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535881=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535881 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
GauthamBanasandra commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759929741 This is quite strange. Even though I downgraded the Boost version to 1.71.0, CMake is still complaining that it can't find 1.72.0 - ``` [WARNING] Could NOT find

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535877=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535877 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759925019 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=535854=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535854 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-759903989 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] aajisaka closed pull request #2603: Merge pull request #1 from apache/trunk

2021-01-13 Thread GitBox
aajisaka closed pull request #2603: URL: https://github.com/apache/hadoop/pull/2603 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka commented on pull request #2603: Merge pull request #1 from apache/trunk

2021-01-13 Thread GitBox
aajisaka commented on pull request #2603: URL: https://github.com/apache/hadoop/pull/2603#issuecomment-759888545 Closing this as invalid. Please check https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute when creating a pull request.

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535845=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535845 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759887832 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-17079) Optimize UGI#getGroups by adding UGI#getGroupsSet

2021-01-13 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264548#comment-17264548 ] Ahmed Hussein commented on HADOOP-17079: [~xyao], thanks for the optimization.

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=535811=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535811 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2584: HADOOP-16202. Enhance openFile()

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-759834285 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535788=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535788 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
goiri commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759796809 I think the HDFS native client is not liking the version of libboost that focal is bringing. We can either update that in cmake or try to install the specific libboost.

[jira] [Created] (HADOOP-17467) netgroup-user mapping breaks by a race in NetgroupCache

2021-01-13 Thread Ahmed Hussein (Jira)
Ahmed Hussein created HADOOP-17467: -- Summary: netgroup-user mapping breaks by a race in NetgroupCache Key: HADOOP-17467 URL: https://issues.apache.org/jira/browse/HADOOP-17467 Project: Hadoop Common

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535728=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535728 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535727=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535727 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya edited a comment on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-01-13 Thread GitBox
viirya edited a comment on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759756129 About the latest test failure, I cannot reproduce them locally: ``` hadoop.streaming.TestStreamingBadRecords

[GitHub] [hadoop] viirya commented on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-01-13 Thread GitBox
viirya commented on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759756129 About the latest test failure, I cannot reproduce them locally: ``` hadoop.streaming.TestStreamingBadRecords hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535712=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535712 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759747312 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=535674=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535674 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-759711312 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535611=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535611 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759639249 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535606=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535606 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-759632552 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=535603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535603 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran edited a comment on pull request #2584: HADOOP-16202. Enhance openFile()

2021-01-13 Thread GitBox
steveloughran edited a comment on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-759582014 I'm thinking we should be more ambitious in read policy than just "fadvise", because we can then use it as a declaration for the input streams to tune all their

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535602=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535602 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
goiri commented on a change in pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#discussion_r556732082 ## File path: dev-support/docker/Dockerfile ## @@ -91,38 +95,20 @@ ENV MAVEN_HOME /usr # JAVA_HOME must be set in Maven >= 3.5.0 (MNG-6003) ENV JAVA_HOME

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535600=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535600 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
GauthamBanasandra commented on a change in pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#discussion_r556729109 ## File path: dev-support/docker/Dockerfile ## @@ -91,38 +95,20 @@ ENV MAVEN_HOME /usr # JAVA_HOME must be set in Maven >= 3.5.0 (MNG-6003)

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535597=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535597 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
GauthamBanasandra commented on a change in pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#discussion_r556729109 ## File path: dev-support/docker/Dockerfile ## @@ -91,38 +95,20 @@ ENV MAVEN_HOME /usr # JAVA_HOME must be set in Maven >= 3.5.0 (MNG-6003)

[GitHub] [hadoop] eric-badger commented on pull request #2513: YARN-10494 CLI tool for docker-to-squashfs conversion (pure Java).

2021-01-13 Thread GitBox
eric-badger commented on pull request #2513: URL: https://github.com/apache/hadoop/pull/2513#issuecomment-759620694 > I think that's Apache HttpClient (could try disabling org.apache.http.wire debug logging). It shouldn't be coming from this code. Looks like you're right. I set

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535592=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535592 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] GauthamBanasandra commented on a change in pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
GauthamBanasandra commented on a change in pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#discussion_r556724055 ## File path: dev-support/docker/Dockerfile ## @@ -51,11 +51,14 @@ RUN apt-get -q update \ gcc \ git \ gnupg-agent \

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535588=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535588 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
goiri commented on a change in pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#discussion_r556720631 ## File path: dev-support/docker/Dockerfile ## @@ -51,11 +51,14 @@ RUN apt-get -q update \ gcc \ git \ gnupg-agent \ +

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=535586=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535586 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=535587=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535587 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran edited a comment on pull request #2584: HADOOP-16202. Enhance openFile()

2021-01-13 Thread GitBox
steveloughran edited a comment on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-759582014 I'm thinking we should be more ambitious in read policy than just "fadvise", because we can then use it as a declaration for the input streams to tune all their

[GitHub] [hadoop] steveloughran edited a comment on pull request #2584: HADOOP-16202. Enhance openFile()

2021-01-13 Thread GitBox
steveloughran edited a comment on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-759582014 I'm thinking we should be more ambitious in read policy than just "fadvise", because we can then use it as a declaration for the input streams to tune all their

[jira] [Resolved] (HADOOP-14159) Add some Java-8 friendly way to work with RemoteIterable, especially listings

2021-01-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14159. - Fix Version/s: 3.3.1 Resolution: Duplicate done inside HADOOP-17450 > Add

[jira] [Resolved] (HADOOP-14000) S3guard metadata stores to support millions of entries

2021-01-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14000. - Resolution: Won't Fix > S3guard metadata stores to support millions of entries >

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=535551=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535551 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2584: HADOOP-16202. Enhance openFile()

2021-01-13 Thread GitBox
steveloughran commented on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-759582014 I'm thinking we should be more ambitious in read policy than just "fadvise", because we can then use it as a declaration for the input streams to tune all their params,

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535532=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535532 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535531=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535531 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran edited a comment on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-01-13 Thread GitBox
steveloughran edited a comment on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759570281 > Currently I only move lz4 and snappy codes to hadoop-compression which are two codecs we have added the dependencies. that's great -that means all should be

[GitHub] [hadoop] steveloughran commented on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-01-13 Thread GitBox
steveloughran commented on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759570281 > Currently I only move lz4 and snappy codes to hadoop-compression which are two codecs we have added the dependencies.

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=535529=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535529 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-759568895 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535528=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535528 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
hadoop-yetus removed a comment on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-758909017 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535527=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535527 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-759567506 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=535526=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535526 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread GitBox
steveloughran commented on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-759567381 It's in the commit log, but I'll add it as an explicit comment: I've added getXAttr() for directories too. The code initially does a HEAD path and if that returns 404 do a

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=535521=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535521 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread GitBox
hadoop-yetus removed a comment on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-758775336 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=535509=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535509 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread GitBox
steveloughran commented on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-759555115 build failed. Looks spurious. But I'm going to rebase anyway This is an automated message from the Apache

[jira] [Work logged] (HADOOP-17414) Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17414?focusedWorklogId=535508=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535508 ] ASF GitHub Bot logged work on HADOOP-17414: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2530: HADOOP-17414. Magic committer files don't have the count of bytes written collected by spark

2021-01-13 Thread GitBox
hadoop-yetus removed a comment on pull request #2530: URL: https://github.com/apache/hadoop/pull/2530#issuecomment-758710185 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535489=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535489 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
steveloughran commented on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-759535947 build will fail until I commit a change that I had locally but not pushed up. hold on This is an

[jira] [Updated] (HADOOP-17451) Intermittent failure of S3A tests which make assertions on statistics/IOStatistics

2021-01-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17451: Summary: Intermittent failure of S3A tests which make assertions on

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535484=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535484 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
steveloughran commented on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-759531207 Test s3 london with `-Dparallel-tests -DtestsThreadCount=6 -Dscale -Dmarkers=keep -Ds3guard -Ddynamo -Dscale` all good apart from that unbuffer intermittent

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535482 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
steveloughran commented on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-759528894 Local test runs of the last two patch * after HADOOP-17271: only the expected failures surfaced * add HADOOP-17451 and those go away

[GitHub] [hadoop] touchida commented on pull request #2598: HDFS-15762. TestMultipleNNPortQOP#testMultipleNNPortOverwriteDownStream fails intermittently

2021-01-13 Thread GitBox
touchida commented on pull request #2598: URL: https://github.com/apache/hadoop/pull/2598#issuecomment-759515839 @amahussein @aajisaka Thanks for your careful reviews and commit! This is an automated message from the Apache

[jira] [Work logged] (HADOOP-16830) Add Public IOStatistics API

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=535449=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535449 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2616: Backport HADOOP-16830 to branch-3.3

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2616: URL: https://github.com/apache/hadoop/pull/2616#issuecomment-759502895 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 25m

[GitHub] [hadoop] GauthamBanasandra commented on pull request #2613: HADOOP-17465. Upgrade to Focal

2021-01-13 Thread GitBox
GauthamBanasandra commented on pull request #2613: URL: https://github.com/apache/hadoop/pull/2613#issuecomment-759496084 @ayushtkn could you please review my PR? This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17465) Update Dockerfile to use Focal

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17465?focusedWorklogId=535432=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535432 ] ASF GitHub Bot logged work on HADOOP-17465: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2509: HADOOP-17404. ABFS: Small write - Merge append and flush

2021-01-13 Thread GitBox
steveloughran commented on pull request #2509: URL: https://github.com/apache/hadoop/pull/2509#issuecomment-759470820 Any plans to merge to branch-3.3? This is complicating my own backporting work. If you do want it in -3.3, create a PR against it with this and the predecessor

[jira] [Work logged] (HADOOP-17404) ABFS: Piggyback flush on Append calls for short writes

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17404?focusedWorklogId=535412=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535412 ] ASF GitHub Bot logged work on HADOOP-17404: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2619: YARN-10500. TestDelegationTokenRenewer fails intermittently.

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2619: URL: https://github.com/apache/hadoop/pull/2619#issuecomment-759468773 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] steveloughran commented on a change in pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-13 Thread GitBox
steveloughran commented on a change in pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#discussion_r556477782 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/ListStatusRemoteIterator.java ## @@ -0,0 +1,149 @@

[jira] [Work logged] (HADOOP-17296) ABFS: Allow Random Reads to be of Buffer Size

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17296?focusedWorklogId=535354=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535354 ] ASF GitHub Bot logged work on HADOOP-17296: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2618: Backport: ABFS. HADOOP-17296 to 17404

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2618: URL: https://github.com/apache/hadoop/pull/2618#issuecomment-759418907 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 29m

[jira] [Work logged] (HADOOP-17464) Create hadoop-compression module

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17464?focusedWorklogId=535349=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535349 ] ASF GitHub Bot logged work on HADOOP-17464: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2611: HADOOP-17464. Create hadoop-compression module

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2611: URL: https://github.com/apache/hadoop/pull/2611#issuecomment-759415506 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17191) ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results

2021-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17191?focusedWorklogId=535333=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-535333 ] ASF GitHub Bot logged work on HADOOP-17191: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2597: HADOOP-17191. ABFS: Run the tests with various combinations of configurations and publish a consolidated results

2021-01-13 Thread GitBox
hadoop-yetus commented on pull request #2597: URL: https://github.com/apache/hadoop/pull/2597#issuecomment-759410406 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2548: DRAFT PR: Implementing ListStatusRemoteIterator

2021-01-13 Thread GitBox
hadoop-yetus removed a comment on pull request #2548: URL: https://github.com/apache/hadoop/pull/2548#issuecomment-757641569 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

  1   2   >