[jira] [Commented] (HADOOP-16381) The JSON License is included in binary tarball via azure-documentdb:1.16.2

2019-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882654#comment-16882654 ] Hudson commented on HADOOP-16381: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16887 (See

[jira] [Updated] (HADOOP-16381) The JSON License is included in binary tarball via azure-documentdb:1.16.2

2019-07-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16381: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0

[jira] [Commented] (HADOOP-16381) The JSON License is included in binary tarball via azure-documentdb:1.16.2

2019-07-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882651#comment-16882651 ] Akira Ajisaka commented on HADOOP-16381: +1, committing this. > The JSON License is included

[jira] [Updated] (HADOOP-16401) ABFS: port Azure doc to 3.2 branch

2019-07-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16401: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1

[GitHub] [hadoop] mukul1987 opened a new pull request #1076: HDDS-1782. Add an option to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul Kumar Singh.

2019-07-10 Thread GitBox
mukul1987 opened a new pull request #1076: HDDS-1782. Add an option to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/1076 This is an

[jira] [Commented] (HADOOP-16384) ITestS3AContractRootDir failing.

2019-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882556#comment-16882556 ] Hadoop QA commented on HADOOP-16384: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
hadoop-yetus commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510285103 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16417) abfs can't access storage account without password

2019-07-10 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882533#comment-16882533 ] Da Zhou commented on HADOOP-16417: -- I am not sure if ABFS support anonymous connections, [~snvijaya],

[GitHub] [hadoop] steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510263195 Status of latest patch * run the local and s3guard tests * disabled FS caching to stop the partition test failing

[jira] [Commented] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882494#comment-16882494 ] Hadoop QA commented on HADOOP-16418: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] justinuang closed pull request #645: HADOOP-16132 Support multipart download in S3AFileSystem

2019-07-10 Thread GitBox
justinuang closed pull request #645: HADOOP-16132 Support multipart download in S3AFileSystem URL: https://github.com/apache/hadoop/pull/645 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] justinuang commented on issue #645: HADOOP-16132 Support multipart download in S3AFileSystem

2019-07-10 Thread GitBox
justinuang commented on issue #645: HADOOP-16132 Support multipart download in S3AFileSystem URL: https://github.com/apache/hadoop/pull/645#issuecomment-510240463 Sorry, I am not anymore. We can close it. On Wed, Jul 10, 2019 at 5:09 PM bolkedebruin wrote: > @justinuang

[GitHub] [hadoop] bolkedebruin commented on issue #645: HADOOP-16132 Support multipart download in S3AFileSystem

2019-07-10 Thread GitBox
bolkedebruin commented on issue #645: HADOOP-16132 Support multipart download in S3AFileSystem URL: https://github.com/apache/hadoop/pull/645#issuecomment-510229523 @justinuang are you still working on this? This is an

[jira] [Commented] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882448#comment-16882448 ] Erik Krogen commented on HADOOP-16418: -- Fix those last 2 checkstyle warnings in v004 > Fix

[jira] [Updated] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16418: - Attachment: HADOOP-16418.004.patch > Fix checkstyle and findbugs warnings in

[jira] [Commented] (HADOOP-16401) ABFS: port Azure doc to 3.2 branch

2019-07-10 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882445#comment-16882445 ] Da Zhou commented on HADOOP-16401: -- [~ste...@apache.org], got it. +1 to this patch. > ABFS: port

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882410#comment-16882410 ] Hadoop QA commented on HADOOP-15729: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16393. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 3.3.0 >

[jira] [Commented] (HADOOP-16393) S3Guard init command uses global settings, not those of target bucket

2019-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882407#comment-16882407 ] Hudson commented on HADOOP-16393: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16885 (See

[jira] [Commented] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882406#comment-16882406 ] Hadoop QA commented on HADOOP-16418: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] steveloughran commented on issue #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket

2019-07-10 Thread GitBox
steveloughran commented on issue #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket URL: https://github.com/apache/hadoop/pull/1012#issuecomment-510205472 thanks, merged This is an

[GitHub] [hadoop] steveloughran closed pull request #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket

2019-07-10 Thread GitBox
steveloughran closed pull request #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket URL: https://github.com/apache/hadoop/pull/1012 This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882398#comment-16882398 ] Sean Mackrory commented on HADOOP-15729: Oh it was an obsolete import. Pull request created:

[GitHub] [hadoop] mackrorysd opened a new pull request #1075: HADOOP-15729. [s3a] Allow core threads to time out.

2019-07-10 Thread GitBox
mackrorysd opened a new pull request #1075: HADOOP-15729. [s3a] Allow core threads to time out. URL: https://github.com/apache/hadoop/pull/1075 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] ajayydv opened a new pull request #1074: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar.

2019-07-10 Thread GitBox
ajayydv opened a new pull request #1074: HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/1074 This is an automated message from the

[jira] [Resolved] (HADOOP-16420) S3A returns 400 "bad request" on a single path within an S3 bucket

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16420. - Resolution: Cannot Reproduce > S3A returns 400 "bad request" on a single path within

[jira] [Commented] (HADOOP-16420) S3A returns 400 "bad request" on a single path within an S3 bucket

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882348#comment-16882348 ] Steve Loughran commented on HADOOP-16420: - trying to change the encryption setting didn't help.

[jira] [Commented] (HADOOP-16420) S3A returns 400 "bad request" on a single path within an S3 bucket

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882345#comment-16882345 ] Steve Loughran commented on HADOOP-16420: - And a debug log of a stat command. Strange Also

[jira] [Updated] (HADOOP-16420) S3A returns 400 "bad request" on a single path within an S3 bucket

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16420: Attachment: out.txt > S3A returns 400 "bad request" on a single path within an S3 bucket

[jira] [Created] (HADOOP-16420) S3A returns 400 "bad request" on a single path within an S3 bucket

2019-07-10 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16420: --- Summary: S3A returns 400 "bad request" on a single path within an S3 bucket Key: HADOOP-16420 URL: https://issues.apache.org/jira/browse/HADOOP-16420 Project:

[jira] [Commented] (HADOOP-16420) S3A returns 400 "bad request" on a single path within an S3 bucket

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882342#comment-16882342 ] Steve Loughran commented on HADOOP-16420: - Stack {code} [ERROR]

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Attachment: (was: HADOOP-15729.002.patch) > [s3a] stop treat fs.s3a.max.threads as the

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Attachment: HADOOP-15729.002.patch > [s3a] stop treat fs.s3a.max.threads as the long-term

[GitHub] [hadoop] steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510176835 thanks for the tests. Reviewing the failures {code}

[jira] [Commented] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882330#comment-16882330 ] Erik Krogen commented on HADOOP-16418: -- I added the suppression for the JavadocStyle check before

[jira] [Updated] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16418: - Attachment: HADOOP-16418.003.patch > Fix checkstyle and findbugs warnings in

[jira] [Updated] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16418: - Attachment: (was: HADOOP-16418.003.patch) > Fix checkstyle and findbugs warnings in

[jira] [Updated] (HADOOP-16418) Fix checkstyle and findbugs warnings in hadoop-dynamometer

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16418: - Attachment: HADOOP-16418.003.patch > Fix checkstyle and findbugs warnings in

[GitHub] [hadoop] anuengineer merged pull request #973: HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar.

2019-07-10 Thread GitBox
anuengineer merged pull request #973: HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/973 This is an automated message from

[GitHub] [hadoop] steveloughran commented on issue #1037: HADOOP-15847 limit the r/w capacity

2019-07-10 Thread GitBox
steveloughran commented on issue #1037: HADOOP-15847 limit the r/w capacity URL: https://github.com/apache/hadoop/pull/1037#issuecomment-510147345 I've committed it locally -before I push it to the ASF repo, I want to list you as the author field on the commit. What name/email addr do you

[GitHub] [hadoop] arp7 merged pull request #1068: HDDS-1778. Fix existing blockade tests.

2019-07-10 Thread GitBox
arp7 merged pull request #1068: HDDS-1778. Fix existing blockade tests. URL: https://github.com/apache/hadoop/pull/1068 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302163297 ## File path: hadoop-tools/hadoop-aws/src/test/resources/log4j.properties ## @@ -57,6

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302162922 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302160584 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302158164 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md ##

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302156330 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302155360 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302153058 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302152332 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302151422 ## File path:

[GitHub] [hadoop] mackrorysd commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-07-10 Thread GitBox
mackrorysd commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-510126748 Ok, sounds reasonable enough. +1 from me.

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302150639 ## File path: hadoop-tools/hadoop-aws/pom.xml ## @@ -215,15 +219,21 @@

[GitHub] [hadoop] mackrorysd commented on issue #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket

2019-07-10 Thread GitBox
mackrorysd commented on issue #1012: HADOOP-16393. S3Guard init command uses global settings, not those of target bucket URL: https://github.com/apache/hadoop/pull/1012#issuecomment-510126336 +1 - LGTM This is an automated

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302149768 ## File path: hadoop-tools/hadoop-aws/pom.xml ## @@ -186,7 +186,11 @@

[jira] [Comment Edited] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-07-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882209#comment-16882209 ] Anu Engineer edited comment on HADOOP-13363 at 7/10/19 4:04 PM:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302148149 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302147780 ## File path:

[jira] [Commented] (HADOOP-13363) Upgrade protobuf from 2.5.0 to something newer

2019-07-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882209#comment-16882209 ] Anu Engineer commented on HADOOP-13363: --- {quote}Who watching this JIRA thinks "it is time" to

[GitHub] [hadoop] steveloughran commented on issue #1037: HADOOP-15847 limit the r/w capacity

2019-07-10 Thread GitBox
steveloughran commented on issue #1037: HADOOP-15847 limit the r/w capacity URL: https://github.com/apache/hadoop/pull/1037#issuecomment-510108406 Patch LGTM +1 when I commit I'll also cut the line "Tip: for agility, use DynamoDB autoscaling" as its obsolete now

[GitHub] [hadoop] steveloughran commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists

2019-07-10 Thread GitBox
steveloughran commented on issue #992: HADOOP-16357 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-510107381 we're changing the default mode to == that of FileOutputCommitter, namely "it's ok if the

[jira] [Assigned] (HADOOP-16404) ABFS default blocksize change(256MB from 512MB)

2019-07-10 Thread Arun Singh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Singh reassigned HADOOP-16404: --- Assignee: Arun Singh > ABFS default blocksize change(256MB from 512MB) >

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Status: Patch Available (was: Open) Resubmitting as checkstyle output has expired. >

[jira] [Updated] (HADOOP-15729) [s3a] stop treat fs.s3a.max.threads as the long-term minimum

2019-07-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15729: --- Status: Open (was: Patch Available) > [s3a] stop treat fs.s3a.max.threads as the

[GitHub] [hadoop] bgaborg commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510098818 test results against ireland with dynamo:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302093454 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302068921 ## File path: hadoop-tools/hadoop-aws/pom.xml ## @@ -186,7 +186,11 @@

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302099673 ## File path: hadoop-tools/hadoop-aws/src/test/resources/log4j.properties ## @@ -57,6 +57,8 @@

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302110128 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302064355 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302071233 ## File path: hadoop-tools/hadoop-aws/pom.xml ## @@ -215,15 +219,21 @@

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302074925 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/WriteOperationHelper.java

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302096415 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302066096 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302069432 ## File path: hadoop-tools/hadoop-aws/pom.xml ## @@ -186,7 +186,11 @@

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302096634 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302088282 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302098848 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302090898 ## File path:

[GitHub] [hadoop] bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
bgaborg commented on a change in pull request #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#discussion_r302085607 ## File path:

[GitHub] [hadoop] ajayydv commented on issue #973: HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar.

2019-07-10 Thread GitBox
ajayydv commented on issue #973: HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. URL: https://github.com/apache/hadoop/pull/973#issuecomment-510092818 failed junit tests look unrelated, TestWatchForCommit &

[GitHub] [hadoop] lokeshj1703 commented on a change in pull request #1072: HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh.

2019-07-10 Thread GitBox
lokeshj1703 commented on a change in pull request #1072: HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/1072#discussion_r302098470 ## File path:

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

2019-07-10 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882108#comment-16882108 ] Adam Antal commented on HADOOP-15691: - Hi [~ste...@apache.org], is there any update on this? Would

[GitHub] [hadoop] elek merged pull request #1065: HDDS-1525. Mapreduce failure when using Hadoop 2.7.5

2019-07-10 Thread GitBox
elek merged pull request #1065: HDDS-1525. Mapreduce failure when using Hadoop 2.7.5 URL: https://github.com/apache/hadoop/pull/1065 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] elek commented on issue #1065: HDDS-1525. Mapreduce failure when using Hadoop 2.7.5

2019-07-10 Thread GitBox
elek commented on issue #1065: HDDS-1525. Mapreduce failure when using Hadoop 2.7.5 URL: https://github.com/apache/hadoop/pull/1065#issuecomment-510063256 Thanks the review @xiaoyuyao (and the initial fix for the problem). I rebased the version, will commit it soon. Tested

[GitHub] [hadoop] hadoop-yetus commented on issue #1068: HDDS-1778. Fix existing blockade tests.

2019-07-10 Thread GitBox
hadoop-yetus commented on issue #1068: HDDS-1778. Fix existing blockade tests. URL: https://github.com/apache/hadoop/pull/1068#issuecomment-510061876 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:|

[GitHub] [hadoop] bshashikant opened a new pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky.

2019-07-10 Thread GitBox
bshashikant opened a new pull request #1073: HDDS-1780. TestFailureHandlingByClient tests are flaky. URL: https://github.com/apache/hadoop/pull/1073 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] bshashikant commented on issue #1072: HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh.

2019-07-10 Thread GitBox
bshashikant commented on issue #1072: HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/1072#issuecomment-510045856 Looks good. Pending test results.

[GitHub] [hadoop] mukul1987 opened a new pull request #1072: HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh.

2019-07-10 Thread GitBox
mukul1987 opened a new pull request #1072: HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh. URL: https://github.com/apache/hadoop/pull/1072 The last applied term index wasn't updated as the method is called by multiple

[GitHub] [hadoop] steveloughran edited a comment on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran edited a comment on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510040326 Got a failure when testing this patch on top of an internal branch. ``` [ERROR]

[GitHub] [hadoop] steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3

2019-07-10 Thread GitBox
steveloughran commented on issue #1003: HADOOP-16384: Avoid inconsistencies between DDB and S3 URL: https://github.com/apache/hadoop/pull/1003#issuecomment-510040326 Got a failure when testing this patch on top of an internal branch. ``` [ERROR]

[GitHub] [hadoop] elek commented on issue #1070: HDDS-1725. pv-test example to test csi is not working

2019-07-10 Thread GitBox
elek commented on issue #1070: HDDS-1725. pv-test example to test csi is not working URL: https://github.com/apache/hadoop/pull/1070#issuecomment-510039418 The mentioned problems are fixed. ozone-csi is created before HDDS-1646 (persistence support). Instead of having ozone-csi I

[jira] [Commented] (HADOOP-16415) Speed up S3A test runs

2019-07-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881996#comment-16881996 ] Steve Loughran commented on HADOOP-16415: - All the tests of S3A committers are slow because

[GitHub] [hadoop] bshashikant opened a new pull request #1071: HDDS-1779. TestWatchForCommit tests are flaky.

2019-07-10 Thread GitBox
bshashikant opened a new pull request #1071: HDDS-1779. TestWatchForCommit tests are flaky. URL: https://github.com/apache/hadoop/pull/1071 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] elek opened a new pull request #1070: HDDS-1725. pv-test example to test csi is not working

2019-07-10 Thread GitBox
elek opened a new pull request #1070: HDDS-1725. pv-test example to test csi is not working URL: https://github.com/apache/hadoop/pull/1070 [~rmaruthiyodan] reported two problems regarding to the pv-test example in csi examples folder. pv-test folder contains an example nginx

[GitHub] [hadoop] elek closed pull request #1059: HDDS-1764. Fix hidden errors in acceptance tests

2019-07-10 Thread GitBox
elek closed pull request #1059: HDDS-1764. Fix hidden errors in acceptance tests URL: https://github.com/apache/hadoop/pull/1059 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] bshashikant closed pull request #1069: HDDS-1779. TestWatchForCommit tests are flaky.

2019-07-10 Thread GitBox
bshashikant closed pull request #1069: HDDS-1779. TestWatchForCommit tests are flaky. URL: https://github.com/apache/hadoop/pull/1069 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] bshashikant opened a new pull request #1069: HDDS-1779. TestWatchForCommit tests are flaky.

2019-07-10 Thread GitBox
bshashikant opened a new pull request #1069: HDDS-1779. TestWatchForCommit tests are flaky. URL: https://github.com/apache/hadoop/pull/1069 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] elek commented on issue #1059: HDDS-1764. Fix hidden errors in acceptance tests

2019-07-10 Thread GitBox
elek commented on issue #1059: HDDS-1764. Fix hidden errors in acceptance tests URL: https://github.com/apache/hadoop/pull/1059#issuecomment-510025594 Thanks the review @xiaoyuyao I rebased it and will merge it soon. I cross-checked it with your PR (#1066) and found that I didn't

[GitHub] [hadoop] ChenSammi commented on issue #931: HDDS-1586. Allow Ozone RPC client to read with topology awareness.

2019-07-10 Thread GitBox
ChenSammi commented on issue #931: HDDS-1586. Allow Ozone RPC client to read with topology awareness. URL: https://github.com/apache/hadoop/pull/931#issuecomment-510022820 Thanks @xiaoyuyao for reviewing the code. This is

[GitHub] [hadoop] ChenSammi commented on a change in pull request #931: HDDS-1586. Allow Ozone RPC client to read with topology awareness.

2019-07-10 Thread GitBox
ChenSammi commented on a change in pull request #931: HDDS-1586. Allow Ozone RPC client to read with topology awareness. URL: https://github.com/apache/hadoop/pull/931#discussion_r302015013 ## File path:

  1   2   >