[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362310#comment-16362310 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362309#comment-16362309 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-15187) Remove ADL mock test dependency on REST call invoked from Java SDK

2018-02-13 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362210#comment-16362210 ] Vishwajeet Dusane commented on HADOOP-15187: Thanks [~ste...@apache.org] > Remove ADL mock

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-13 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362207#comment-16362207 ] Andras Bokor commented on HADOOP-10571: --- Thanks for the comments [~ajisakaa]! Please find my

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362307#comment-16362307 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread Omkar Aradhya K S (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362074#comment-16362074 ] Omkar Aradhya K S commented on HADOOP-13972: Hi [~jzhuge] do you have any further

[jira] [Commented] (HADOOP-15213) JniBasedUnixGroupsNetgroupMapping.java and ShellBasedUnixGroupsNetgroupMapping.java use netgroup.substring(1)

2018-02-13 Thread Dhirendra Khanka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362125#comment-16362125 ] Dhirendra Khanka commented on HADOOP-15213: --- {quote}added a comment - 5 days ago In

[jira] [Created] (HADOOP-15224) builld up md5 checksum as blocks are built in S3ABlockOutputStream; validate upload

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15224: --- Summary: builld up md5 checksum as blocks are built in S3ABlockOutputStream; validate upload Key: HADOOP-15224 URL: https://issues.apache.org/jira/browse/HADOOP-15224

[jira] [Updated] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-13 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-10571: -- Attachment: HADOOP-10571.07.patch > Use Log.*(Object, Throwable) overload to log exceptions >

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362312#comment-16362312 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362313#comment-16362313 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on a diff in the

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362140#comment-16362140 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Comment Edited] (HADOOP-15213) JniBasedUnixGroupsNetgroupMapping.java and ShellBasedUnixGroupsNetgroupMapping.java use netgroup.substring(1)

2018-02-13 Thread Dhirendra Khanka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362125#comment-16362125 ] Dhirendra Khanka edited comment on HADOOP-15213 at 2/13/18 12:03 PM: -

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362316#comment-16362316 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on the issue:

[jira] [Commented] (HADOOP-11717) Add Redirecting WebSSO behavior with JWT Token in Hadoop Auth

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362347#comment-16362347 ] Brahma Reddy Battula commented on HADOOP-11717: --- Nice work Guys!! We should upgrade 

[jira] [Commented] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362353#comment-16362353 ] Brahma Reddy Battula commented on HADOOP-14799: --- This needs to be cherry-picked to

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362053#comment-16362053 ] Akira Ajisaka commented on HADOOP-10571: Thanks [~boky01] for continuing the work! Overall looks

[jira] [Resolved] (HADOOP-15213) JniBasedUnixGroupsNetgroupMapping.java and ShellBasedUnixGroupsNetgroupMapping.java use netgroup.substring(1)

2018-02-13 Thread Dhirendra Khanka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhirendra Khanka resolved HADOOP-15213. --- Resolution: Not A Problem > JniBasedUnixGroupsNetgroupMapping.java and >

[jira] [Commented] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362104#comment-16362104 ] genericqa commented on HADOOP-15223: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362135#comment-16362135 ] ASF GitHub Bot commented on HADOOP-13972: - GitHub user ssonker opened a pull request:

[jira] [Updated] (HADOOP-14291) S3a "Bad Request" message to include diagnostics

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14291: Parent Issue: HADOOP-15220 (was: HADOOP-14531) > S3a "Bad Request" message to include

[jira] [Updated] (HADOOP-15057) s3guard bucket-info command to include default bucket encryption info

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15057: Parent Issue: HADOOP-15220 (was: HADOOP-14831) > s3guard bucket-info command to include

[jira] [Comment Edited] (HADOOP-11717) Add Redirecting WebSSO behavior with JWT Token in Hadoop Auth

2018-02-13 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362594#comment-16362594 ] Larry McCay edited comment on HADOOP-11717 at 2/13/18 4:31 PM: ---

[jira] [Commented] (HADOOP-14531) Improve S3A error handling & reporting

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362429#comment-16362429 ] Steve Loughran commented on HADOOP-14531: - I'll loo at what needs to be moved out of here and

[jira] [Commented] (HADOOP-14291) S3a "Bad Request" message to include diagnostics

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362439#comment-16362439 ] Steve Loughran commented on HADOOP-14291: - I've got a separate app to do the diagnostics:

[jira] [Updated] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15076: Priority: Blocker (was: Major) > Enhance s3a troubleshooting docs, add perf section >

[jira] [Commented] (HADOOP-14530) Translate ARN exception to something other than FNFE

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362460#comment-16362460 ] Steve Loughran commented on HADOOP-14530: - It's actually coming back as AWSS3IOException; we

[jira] [Updated] (HADOOP-14530) Translate ARN exception to something other than FNFE

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14530: Parent Issue: HADOOP-15220 (was: HADOOP-14325) > Translate ARN exception to something

[jira] [Resolved] (HADOOP-13271) Intermittent failure of TestS3AContractRootDir.testListEmptyRootDirectory

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13271. - Resolution: Cannot Reproduce Fix Version/s: 3.1.0 > Intermittent failure of

[jira] [Updated] (HADOOP-14825) Über-JIRA: S3Guard Phase II -Hadoop 3.1 features

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14825: Summary: Über-JIRA: S3Guard Phase II -Hadoop 3.1 features (was: Über-JIRA: S3Guard Phase

[jira] [Updated] (HADOOP-14825) Über-JIRA: S3Guard Phase II: Hadoop 3.1 features

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14825: Summary: Über-JIRA: S3Guard Phase II: Hadoop 3.1 features (was: Über-JIRA: S3Guard Phase

[jira] [Created] (HADOOP-15226) Über-JIRA: S3Guard Phase III: Hadoop 3.2 features

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15226: --- Summary: Über-JIRA: S3Guard Phase III: Hadoop 3.2 features Key: HADOOP-15226 URL: https://issues.apache.org/jira/browse/HADOOP-15226 Project: Hadoop Common

[jira] [Created] (HADOOP-15225) mvn javadoc:test-javadoc goal throws cannot find symbol

2018-02-13 Thread Andras Bokor (JIRA)
Andras Bokor created HADOOP-15225: - Summary: mvn javadoc:test-javadoc goal throws cannot find symbol Key: HADOOP-15225 URL: https://issues.apache.org/jira/browse/HADOOP-15225 Project: Hadoop Common

[jira] [Resolved] (HADOOP-13973) S3A GET/HEAD requests failing: java.lang.IllegalStateException: Connection is not open/Connection pool shut down

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13973. - Resolution: Cannot Reproduce Fix Version/s: 3.1.0 Haven't seen this ourselves,

[jira] [Assigned] (HADOOP-15183) S3Guard store becomes inconsistent after partial failure of rename

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15183: --- Assignee: Steve Loughran > S3Guard store becomes inconsistent after partial

[jira] [Commented] (HADOOP-11717) Add Redirecting WebSSO behavior with JWT Token in Hadoop Auth

2018-02-13 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362594#comment-16362594 ] Larry McCay commented on HADOOP-11717: -- [~brahmareddy] - Thanks - why hasn't HADOOP-14799 been 

[jira] [Resolved] (HADOOP-14531) Improve S3A error handling & reporting

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14531. - Resolution: Fixed Fix Version/s: 3.1.0 > Improve S3A error handling & reporting

[jira] [Updated] (HADOOP-14621) S3A client raising ConnectionPoolTimeoutException

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14621: Parent Issue: HADOOP-14831 (was: HADOOP-14531) > S3A client raising

[jira] [Resolved] (HADOOP-13713) ITestS3AContractRootDir.testRmEmptyRootDirNonRecursive failing intermittently

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13713. - Resolution: Cannot Reproduce Target Version/s: 3.1.0 >

[jira] [Updated] (HADOOP-14621) S3A client raising ConnectionPoolTimeoutException

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14621: Priority: Major (was: Minor) > S3A client raising ConnectionPoolTimeoutException >

[jira] [Commented] (HADOOP-14178) Move Mockito up to version 2.x

2018-02-13 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362385#comment-16362385 ] Andras Bokor commented on HADOOP-14178: --- [~ajisakaa], I went through on the patch again

[jira] [Updated] (HADOOP-13334) AmazonClient 30x exceptions to include redirect URL in message

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13334: Parent Issue: HADOOP-15220 (was: HADOOP-14531) > AmazonClient 30x exceptions to include

[jira] [Commented] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362458#comment-16362458 ] Steve Loughran commented on HADOOP-15076: - Include stacks from HADOOP-14621 and HADOOP-14530 >

[jira] [Commented] (HADOOP-15076) Enhance s3a troubleshooting docs, add perf section

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362465#comment-16362465 ] Steve Loughran commented on HADOOP-15076: - messages in HADOOP-14531 should be covered, even if

[jira] [Updated] (HADOOP-13761) S3Guard: implement retries for DDB failures and throttling; translate exceptions

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13761: Parent Issue: HADOOP-14825 (was: HADOOP-14531) > S3Guard: implement retries for DDB

[jira] [Commented] (HADOOP-14776) clean up ITestS3AFileSystemContract

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362591#comment-16362591 ] genericqa commented on HADOOP-14776: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

2018-02-13 Thread Aki Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362627#comment-16362627 ] Aki Tanaka commented on HADOOP-15206: - Thank you, I updated the patch.   Implemented the following

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Attachment: HADOOP-15176-003.patch > Enhance IAM assumed role support in S3A client >

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Priority: Blocker (was: Major) > Enhance IAM assumed role support in S3A client >

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362682#comment-16362682 ] Akira Ajisaka commented on HADOOP-10571: Thanks! Now I'm +1 pending Jenkins and Steve's next

[jira] [Updated] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

2018-02-13 Thread Aki Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aki Tanaka updated HADOOP-15206: Attachment: HADOOP-15206.005.patch > BZip2 drops and duplicates records when input split size is

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Status: Open (was: Patch Available) > Enhance IAM assumed role support in S3A client >

[jira] [Updated] (HADOOP-14800) eliminate double stack trace on some s3guard CLI failures

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14800: Parent Issue: HADOOP-14825 (was: HADOOP-15226) > eliminate double stack trace on some

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362675#comment-16362675 ] Steve Loughran commented on HADOOP-14927: - Have you got the patch for this? Or can we close it

[jira] [Updated] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14468: Parent Issue: HADOOP-15226 (was: HADOOP-14825) > S3Guard: make short-circuit

[jira] [Updated] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14468: Target Version/s: 3.2.0 > S3Guard: make short-circuit getFileStatus() configurable >

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362702#comment-16362702 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Commented] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362721#comment-16362721 ] Steve Loughran commented on HADOOP-14507: - Patch 007, working on trunk properly. Test: S3A

[jira] [Updated] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-02-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HADOOP-12897: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

[jira] [Resolved] (HADOOP-13308) S3A delete and rename may fail to preserve parent directory.

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13308. - Resolution: Won't Fix > S3A delete and rename may fail to preserve parent directory. >

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Status: Patch Available (was: Open) > extend per-bucket secret key config with explicit

[jira] [Updated] (HADOOP-14831) Über-jira: S3a phase IV: Hadoop 3.1 features

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14831: Priority: Blocker (was: Major) Issue Type: Improvement (was: Bug) > Über-jira:

[jira] [Updated] (HADOOP-13637) improve setting of max connections in AWS client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13637: Target Version/s: (was: 3.1.0) > improve setting of max connections in AWS client >

[jira] [Commented] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362598#comment-16362598 ] Larry McCay commented on HADOOP-14799: -- Is there a reason that this wasn't backported to the 2.x

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362664#comment-16362664 ] Steve Loughran commented on HADOOP-15176: - Testing: S3 ireland. This is ready for review now >

[jira] [Commented] (HADOOP-14178) Move Mockito up to version 2.x

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362679#comment-16362679 ] Akira Ajisaka commented on HADOOP-14178: Thanks! 008 patch addressed your comment. > Move

[jira] [Updated] (HADOOP-14178) Move Mockito up to version 2.x

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14178: --- Attachment: HADOOP-14178.008.patch > Move Mockito up to version 2.x >

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: HADOOP-14507-007.patch > extend per-bucket secret key config with explicit

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362850#comment-16362850 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362612#comment-16362612 ] genericqa commented on HADOOP-10571: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14077) Improve the patch of HADOOP-13119

2018-02-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362666#comment-16362666 ] Eric Yang commented on HADOOP-14077: [~yuanbo] Hadoop Security team has brought to my attention that

[jira] [Assigned] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13936: --- Assignee: Steve Loughran > S3Guard: DynamoDB can go out of sync with

[jira] [Updated] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13936: Priority: Blocker (was: Minor) > S3Guard: DynamoDB can go out of sync with

[jira] [Updated] (HADOOP-15183) S3Guard store becomes inconsistent after partial failure of rename

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15183: Priority: Blocker (was: Major) > S3Guard store becomes inconsistent after partial

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362708#comment-16362708 ] ASF GitHub Bot commented on HADOOP-13972: - Github user ssonker commented on the issue:

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: HADOOP-14507-007.patch > extend per-bucket secret key config with explicit

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362660#comment-16362660 ] Steve Loughran commented on HADOOP-15176: - * skip tests of rename in assumed role which fail

[jira] [Updated] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15176: Status: Patch Available (was: Open) > Enhance IAM assumed role support in S3A client >

[jira] [Reopened] (HADOOP-14077) Improve the patch of HADOOP-13119

2018-02-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened HADOOP-14077: > Improve the patch of HADOOP-13119 > - > > Key:

[jira] [Commented] (HADOOP-14825) Über-JIRA: S3Guard Phase II: Hadoop 3.1 features

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362673#comment-16362673 ] Steve Loughran commented on HADOOP-14825: - I've just created a phase III JIRA for Hadoop 3.2,

[jira] [Commented] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

2018-02-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362712#comment-16362712 ] Akira Ajisaka commented on HADOOP-15223: Thanks [~zhenyi] for the patch! Some comments: 1. Would

[jira] [Commented] (HADOOP-13972) ADLS to support per-store configuration

2018-02-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362745#comment-16362745 ] ASF GitHub Bot commented on HADOOP-13972: - Github user steveloughran commented on the issue:

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: (was: HADOOP-14507-007.patch) > extend per-bucket secret key config with

[jira] [Commented] (HADOOP-14620) S3A authentication failure for regions other than us-east-1

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362845#comment-16362845 ] Steve Loughran commented on HADOOP-14620: - I've now got a diagnostics tool to help diagnose

[jira] [Resolved] (HADOOP-14620) S3A authentication failure for regions other than us-east-1

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14620. - Resolution: Works for Me Fix Version/s: 3.1.0 > S3A authentication failure for

[jira] [Commented] (HADOOP-15176) Enhance IAM assumed role support in S3A client

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362855#comment-16362855 ] genericqa commented on HADOOP-15176: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362907#comment-16362907 ] Ray Chiang commented on HADOOP-14799: - [~lmccay], this was originally done as one of a batch of

[jira] [Commented] (HADOOP-15227) add mapreduce.outputcommitter.factory.scheme.s3a to core-default

2018-02-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363017#comment-16363017 ] Jason Lowe commented on HADOOP-15227: - Does this go in core-default or mapred-default? The property

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-02-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362864#comment-16362864 ] Hudson commented on HADOOP-12897: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13652 (See

[jira] [Commented] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2018-02-13 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362918#comment-16362918 ] genericqa commented on HADOOP-14507: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-14077) Improve the patch of HADOOP-13119

2018-02-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved HADOOP-14077. Resolution: Fixed This has already been part of a release. Please leave it resolved. >

[jira] [Updated] (HADOOP-14334) S3 SSEC tests to downgrade when running against a mandatory encryption object store

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14334: Parent Issue: HADOOP-15220 (was: HADOOP-14325) > S3 SSEC tests to downgrade when

[jira] [Commented] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362879#comment-16362879 ] Brahma Reddy Battula commented on HADOOP-14799: --- Pushed to branch-2,branch-2.9 and

[jira] [Commented] (HADOOP-14903) Add json-smart explicitly to pom.xml

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362895#comment-16362895 ] Brahma Reddy Battula commented on HADOOP-14903: --- As  -HADOOP-14799-  committed to

[jira] [Created] (HADOOP-15227) add mapreduce.outputcommitter.factory.scheme.s3a to core-default

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15227: --- Summary: add mapreduce.outputcommitter.factory.scheme.s3a to core-default Key: HADOOP-15227 URL: https://issues.apache.org/jira/browse/HADOOP-15227 Project:

[jira] [Commented] (HADOOP-15228) S3A Retry policy to retry on NoResponseException

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363028#comment-16363028 ] Steve Loughran commented on HADOOP-15228: - {code} 2017-02-07 10:01:07,950 INFO

[jira] [Created] (HADOOP-15228) S3A Retry policy to retry on NoResponseException

2018-02-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15228: --- Summary: S3A Retry policy to retry on NoResponseException Key: HADOOP-15228 URL: https://issues.apache.org/jira/browse/HADOOP-15228 Project: Hadoop Common

[jira] [Updated] (HADOOP-14799) Update nimbus-jose-jwt to 4.41.1

2018-02-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HADOOP-14799: -- Fix Version/s: 2.8.4 2.9.1 2.10.0 >

[jira] [Updated] (HADOOP-14972) S3A add histogram metrics types for latency, etc.

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14972: Parent Issue: HADOOP-15220 (was: HADOOP-14831) > S3A add histogram metrics types for

[jira] [Resolved] (HADOOP-14332) Document S3A SSE

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14332. - Resolution: Duplicate Assignee: Steve Loughran > Document S3A SSE >

  1   2   >