[jira] [Resolved] (HADOOP-883) Create fsck tool for S3 file system

2018-03-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-883. --- Resolution: Won't Fix given this JIRA is 11 years old, time to mark as a wontfix > Create fsc

[jira] [Created] (HADOOP-15288) TestSwiftFileSystemBlockLocation doesn't compile

2018-03-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15288: --- Summary: TestSwiftFileSystemBlockLocation doesn't compile Key: HADOOP-15288 URL: https://issues.apache.org/jira/browse/HADOOP-15288 Project: Hadoop Common

[jira] [Created] (HADOOP-15289) FileStatus.readFields() assertion incorrect

2018-03-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15289: --- Summary: FileStatus.readFields() assertion incorrect Key: HADOOP-15289 URL: https://issues.apache.org/jira/browse/HADOOP-15289 Project: Hadoop Common I

[jira] [Created] (HADOOP-15297) Make s3a etag -> checksum publishing option

2018-03-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15297: --- Summary: Make s3a etag -> checksum publishing option Key: HADOOP-15297 URL: https://issues.apache.org/jira/browse/HADOOP-15297 Project: Hadoop Common I

[jira] [Created] (HADOOP-15298) provide non-zero default for the Azure rename & delete thread pool sizes

2018-03-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15298: --- Summary: provide non-zero default for the Azure rename & delete thread pool sizes Key: HADOOP-15298 URL: https://issues.apache.org/jira/browse/HADOOP-15298 Proj

[jira] [Created] (HADOOP-15300) distcp -update to WASB and ADL copies up all the files, always

2018-03-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15300: --- Summary: distcp -update to WASB and ADL copies up all the files, always Key: HADOOP-15300 URL: https://issues.apache.org/jira/browse/HADOOP-15300 Project: Hadoo

[jira] [Created] (HADOOP-15303) make s3a read fault injection configurable including "off"

2018-03-09 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15303: --- Summary: make s3a read fault injection configurable including "off" Key: HADOOP-15303 URL: https://issues.apache.org/jira/browse/HADOOP-15303 Project: Hadoop Com

[jira] [Reopened] (HADOOP-10007) distcp / mv is not working on ftp

2018-03-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-10007: - > distcp / mv is not working on ftp > - > >

[jira] [Resolved] (HADOOP-15310) s3a: option to disable s3a://landsat-pds/ tests

2018-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15310. - Resolution: Not A Problem > s3a: option to disable s3a://landsat-pds/ tests > --

[jira] [Created] (HADOOP-15341) NativeAzureFileSystemBaseTest.testModifiedTimeForFolder modification tests fail on (overloaded?) client

2018-03-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15341: --- Summary: NativeAzureFileSystemBaseTest.testModifiedTimeForFolder modification tests fail on (overloaded?) client Key: HADOOP-15341 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HADOOP-15346) S3ARetryPolicy for 400/BadArgument to be "fail"

2018-03-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15346: --- Summary: S3ARetryPolicy for 400/BadArgument to be "fail" Key: HADOOP-15346 URL: https://issues.apache.org/jira/browse/HADOOP-15346 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14825) Über-JIRA: S3Guard Phase II: Hadoop 3.1 features

2018-03-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14825. - Resolution: Fixed Fix Version/s: 3.1.0 Closing as done for 3.1. Thanks for everyo

[jira] [Created] (HADOOP-15347) S3ARetryPolicy to handle AWS 500 responses with the throttle backoff policy

2018-03-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15347: --- Summary: S3ARetryPolicy to handle AWS 500 responses with the throttle backoff policy Key: HADOOP-15347 URL: https://issues.apache.org/jira/browse/HADOOP-15347 P

[jira] [Created] (HADOOP-15348) S3A Input Stream bytes read counter isn't getting through to StorageStatistics/insturmentation properly

2018-03-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15348: --- Summary: S3A Input Stream bytes read counter isn't getting through to StorageStatistics/insturmentation properly Key: HADOOP-15348 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HADOOP-14717) Add StreamCapabilities support to s3a

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14717. - Resolution: Duplicate Assignee: Steve Loughran (was: Sean Mackrory) Fix

[jira] [Created] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15349: --- Summary: S3Guard DDB retryBackoff to be more informative on limits exceeded Key: HADOOP-15349 URL: https://issues.apache.org/jira/browse/HADOOP-15349 Project: H

[jira] [Reopened] (HADOOP-14651) Update okhttp version to 2.7.5

2018-03-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-14651: - reopening to cherry pick back > Update okhttp version to 2.7.5 > -

[jira] [Created] (HADOOP-15354) hadoop-allyun module to mark hadoop-common as provided

2018-03-29 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15354: --- Summary: hadoop-allyun module to mark hadoop-common as provided Key: HADOOP-15354 URL: https://issues.apache.org/jira/browse/HADOOP-15354 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14831) Über-jira: S3a phase IV: Hadoop 3.1 features

2018-04-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14831. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 3.1.0 Moving u

[jira] [Resolved] (HADOOP-14122) Add ADLS to hadoop-cloud-storage-project

2018-04-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14122. - Resolution: Duplicate Assignee: Steve Loughran Fix Version/s: 3.1.0 > Ad

[jira] [Created] (HADOOP-15363) (transient) ITestS3AInconsistency.testOpenFailOnRead S3Guard failure

2018-04-04 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15363: --- Summary: (transient) ITestS3AInconsistency.testOpenFailOnRead S3Guard failure Key: HADOOP-15363 URL: https://issues.apache.org/jira/browse/HADOOP-15363 Project:

[jira] [Created] (HADOOP-15364) Add support for S3 Select to S3A

2018-04-04 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15364: --- Summary: Add support for S3 Select to S3A Key: HADOOP-15364 URL: https://issues.apache.org/jira/browse/HADOOP-15364 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-15370) S3A log message on rm s3a://bucket/ not intuitive

2018-04-06 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15370: --- Summary: S3A log message on rm s3a://bucket/ not intuitive Key: HADOOP-15370 URL: https://issues.apache.org/jira/browse/HADOOP-15370 Project: Hadoop Common

[jira] [Created] (HADOOP-15371) Wasb fs prints (jetty's) "Logging initialized" message when instantiated

2018-04-06 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15371: --- Summary: Wasb fs prints (jetty's) "Logging initialized" message when instantiated Key: HADOOP-15371 URL: https://issues.apache.org/jira/browse/HADOOP-15371 Proj

[jira] [Created] (HADOOP-15379) Make IrqHandler.bind() public

2018-04-11 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15379: --- Summary: Make IrqHandler.bind() public Key: HADOOP-15379 URL: https://issues.apache.org/jira/browse/HADOOP-15379 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-15383) wasb FS init hangs for minutes if the container name is wrong (e.g wasb://example.azure/)

2018-04-12 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15383: --- Summary: wasb FS init hangs for minutes if the container name is wrong (e.g wasb://example.azure/) Key: HADOOP-15383 URL: https://issues.apache.org/jira/browse/HADOOP-15383

[jira] [Created] (HADOOP-15384) distcp numListstatusThreads option doesn't get to -delete scan

2018-04-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15384: --- Summary: distcp numListstatusThreads option doesn't get to -delete scan Key: HADOOP-15384 URL: https://issues.apache.org/jira/browse/HADOOP-15384 Project: Hadoo

[jira] [Resolved] (HADOOP-14584) WASB to support high-performance commit protocol

2018-04-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14584. - Resolution: Won't Fix wasb is fast enough without this > WASB to support high-performan

[jira] [Created] (HADOOP-15387) Produce a shaded hadoop-cloudstorage JAR for downstream use

2018-04-16 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15387: --- Summary: Produce a shaded hadoop-cloudstorage JAR for downstream use Key: HADOOP-15387 URL: https://issues.apache.org/jira/browse/HADOOP-15387 Project: Hadoop C

[jira] [Created] (HADOOP-15405) adl:// use Configuration.getPassword() to look up fs.adl.oauth2.refresh.url

2018-04-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15405: --- Summary: adl:// use Configuration.getPassword() to look up fs.adl.oauth2.refresh.url Key: HADOOP-15405 URL: https://issues.apache.org/jira/browse/HADOOP-15405 P

[jira] [Created] (HADOOP-15409) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2018-04-24 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15409: --- Summary: S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2 Key: HADOOP-15409 URL: https://issues.apache.org/jira/browse/HADOOP-15409 Project: Had

[jira] [Created] (HADOOP-15416) s3guard diff assert failure

2018-04-26 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15416: --- Summary: s3guard diff assert failure Key: HADOOP-15416 URL: https://issues.apache.org/jira/browse/HADOOP-15416 Project: Hadoop Common Issue Type: Sub-t

[jira] [Resolved] (HADOOP-15417) retrieveBlock hangs when the configuration file is corrupted

2018-04-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15417. - Resolution: Won't Fix > retrieveBlock hangs when the configuration file is corrupted > -

[jira] [Created] (HADOOP-15421) Stabilise/formalise the JSON _SUCCESS format used in the S3A committers

2018-04-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15421: --- Summary: Stabilise/formalise the JSON _SUCCESS format used in the S3A committers Key: HADOOP-15421 URL: https://issues.apache.org/jira/browse/HADOOP-15421 Proje

[jira] [Created] (HADOOP-15422) s3guard doesnt init when the secrets are in the s3a URI

2018-04-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15422: --- Summary: s3guard doesnt init when the secrets are in the s3a URI Key: HADOOP-15422 URL: https://issues.apache.org/jira/browse/HADOOP-15422 Project: Hadoop Common

[jira] [Created] (HADOOP-15426) S3guard throttle event on delete => 400 error code => exception

2018-04-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15426: --- Summary: S3guard throttle event on delete => 400 error code => exception Key: HADOOP-15426 URL: https://issues.apache.org/jira/browse/HADOOP-15426 Project: Hado

[jira] [Created] (HADOOP-15427) hadoop shell complains needlessly about "ERROR: Tools helper .. not found"

2018-04-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15427: --- Summary: hadoop shell complains needlessly about "ERROR: Tools helper .. not found" Key: HADOOP-15427 URL: https://issues.apache.org/jira/browse/HADOOP-15427 Pr

[jira] [Created] (HADOOP-15428) s3guard bucket-info -unguarded will guard bucket if FS is set to do this automatically

2018-04-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15428: --- Summary: s3guard bucket-info -unguarded will guard bucket if FS is set to do this automatically Key: HADOOP-15428 URL: https://issues.apache.org/jira/browse/HADOOP-15428

[jira] [Created] (HADOOP-15430) hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard

2018-04-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15430: --- Summary: hadoop fs -mkdir -p path-ending-with-slash/ fails with s3guard Key: HADOOP-15430 URL: https://issues.apache.org/jira/browse/HADOOP-15430 Project: Hadoo

[jira] [Created] (HADOOP-15439) KDiag to add cli options for proxies and taking to HDFS for listing & DT retrieval

2018-05-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15439: --- Summary: KDiag to add cli options for proxies and taking to HDFS for listing & DT retrieval Key: HADOOP-15439 URL: https://issues.apache.org/jira/browse/HADOOP-15439

[jira] [Created] (HADOOP-15460) S3A FS to add "s3a:no-existence-checks" to the builder file creation option set

2018-05-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15460: --- Summary: S3A FS to add "s3a:no-existence-checks" to the builder file creation option set Key: HADOOP-15460 URL: https://issues.apache.org/jira/browse/HADOOP-15460

[jira] [Reopened] (HADOOP-15250) Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong

2018-05-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-15250: - > Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong > -

[jira] [Created] (HADOOP-15469) S3A directory committer commit job fails if _temporary directory created under set

2018-05-15 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15469: --- Summary: S3A directory committer commit job fails if _temporary directory created under set Key: HADOOP-15469 URL: https://issues.apache.org/jira/browse/HADOOP-15469

[jira] [Created] (HADOOP-15470) S3A staging committers to not log FNFEs on job abort listings

2018-05-15 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15470: --- Summary: S3A staging committers to not log FNFEs on job abort listings Key: HADOOP-15470 URL: https://issues.apache.org/jira/browse/HADOOP-15470 Project: Hadoop

[jira] [Created] (HADOOP-15479) s3guard bucket-info command to add a verify-property =

2018-05-18 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15479: --- Summary: s3guard bucket-info command to add a verify-property = Key: HADOOP-15479 URL: https://issues.apache.org/jira/browse/HADOOP-15479 Project: Hadoop Commo

[jira] [Created] (HADOOP-15485) reduce/tune read failure fault injection on inconsistent client

2018-05-21 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15485: --- Summary: reduce/tune read failure fault injection on inconsistent client Key: HADOOP-15485 URL: https://issues.apache.org/jira/browse/HADOOP-15485 Project: Hado

[jira] [Created] (HADOOP-15489) S3Guard to self update on directory listings of S3

2018-05-22 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15489: --- Summary: S3Guard to self update on directory listings of S3 Key: HADOOP-15489 URL: https://issues.apache.org/jira/browse/HADOOP-15489 Project: Hadoop Common

[jira] [Created] (HADOOP-15492) increase performance of s3guard import command

2018-05-24 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15492: --- Summary: increase performance of s3guard import command Key: HADOOP-15492 URL: https://issues.apache.org/jira/browse/HADOOP-15492 Project: Hadoop Common

[jira] [Created] (HADOOP-15503) strip s3.amazonaws.com off hostnames before making s3a calls

2018-05-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15503: --- Summary: strip s3.amazonaws.com off hostnames before making s3a calls Key: HADOOP-15503 URL: https://issues.apache.org/jira/browse/HADOOP-15503 Project: Hadoop

[jira] [Created] (HADOOP-15509) Release Hadoop 2.7.7

2018-06-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15509: --- Summary: Release Hadoop 2.7.7 Key: HADOOP-15509 URL: https://issues.apache.org/jira/browse/HADOOP-15509 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-15512) clean up Shell from JDK7 workarounds

2018-06-04 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15512: --- Summary: clean up Shell from JDK7 workarounds Key: HADOOP-15512 URL: https://issues.apache.org/jira/browse/HADOOP-15512 Project: Hadoop Common Issue Ty

[jira] [Created] (HADOOP-15540) ABFS: Commit of core codebase

2018-06-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15540: --- Summary: ABFS: Commit of core codebase Key: HADOOP-15540 URL: https://issues.apache.org/jira/browse/HADOOP-15540 Project: Hadoop Common Issue Type: Sub

[jira] [Resolved] (HADOOP-15542) S3AFileSystem - FileAlreadyExistsException when prefix is a file and part of a directory tree

2018-06-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15542. - Resolution: Won't Fix > S3AFileSystem - FileAlreadyExistsException when prefix is a fil

[jira] [Created] (HADOOP-15544) ABFS: validate packing, transient classpath, hadoop fs CLI

2018-06-15 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15544: --- Summary: ABFS: validate packing, transient classpath, hadoop fs CLI Key: HADOOP-15544 URL: https://issues.apache.org/jira/browse/HADOOP-15544 Project: Hadoop Com

[jira] [Created] (HADOOP-15545) ABFS initialize() throws string out of bounds exception of the URI isn't fully qualified

2018-06-15 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15545: --- Summary: ABFS initialize() throws string out of bounds exception of the URI isn't fully qualified Key: HADOOP-15545 URL: https://issues.apache.org/jira/browse/HADOOP-15545

[jira] [Created] (HADOOP-15546) ABFS: tune imports & javadocs

2018-06-15 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15546: --- Summary: ABFS: tune imports & javadocs Key: HADOOP-15546 URL: https://issues.apache.org/jira/browse/HADOOP-15546 Project: Hadoop Common Issue Type: Sub

[jira] [Created] (HADOOP-15556) S3AFileStatus to add a serialVersionUID; review & test serialization

2018-06-21 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15556: --- Summary: S3AFileStatus to add a serialVersionUID; review & test serialization Key: HADOOP-15556 URL: https://issues.apache.org/jira/browse/HADOOP-15556 Project:

[jira] [Created] (HADOOP-15555) S3AFileStatus to add a serialVersionUID; review & test serialization

2018-06-21 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-1: --- Summary: S3AFileStatus to add a serialVersionUID; review & test serialization Key: HADOOP-1 URL: https://issues.apache.org/jira/browse/HADOOP-1 Project:

[jira] [Resolved] (HADOOP-13844) Move swift duration stats tracking to hadoop common utils

2018-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13844. - Resolution: Won't Fix > Move swift duration stats tracking to hadoop common utils > ---

[jira] [Created] (HADOOP-15563) s3guard init and set-capacity to support DDB autoscaling

2018-06-26 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15563: --- Summary: s3guard init and set-capacity to support DDB autoscaling Key: HADOOP-15563 URL: https://issues.apache.org/jira/browse/HADOOP-15563 Project: Hadoop Commo

[jira] [Reopened] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2018-06-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-13811: - > s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to > sanitize

[jira] [Resolved] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2018-06-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13811. - Resolution: Cannot Reproduce No Vinod, this is nothing to do with HADOOP-13786 except t

[jira] [Created] (HADOOP-15568) fix some typos in the .sh comments

2018-06-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15568: --- Summary: fix some typos in the .sh comments Key: HADOOP-15568 URL: https://issues.apache.org/jira/browse/HADOOP-15568 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-15427) hadoop shell complains needlessly about "ERROR: Tools helper .. not found"

2018-06-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15427. - Resolution: Cannot Reproduce > hadoop shell complains needlessly about "ERROR: Tools he

[jira] [Created] (HADOOP-15569) Expand S3A Assumed Role docs

2018-06-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15569: --- Summary: Expand S3A Assumed Role docs Key: HADOOP-15569 URL: https://issues.apache.org/jira/browse/HADOOP-15569 Project: Hadoop Common Issue Type: Sub-

[jira] [Created] (HADOOP-15570) s3guard uploads command to list date and initiator of outstanding uploads

2018-06-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15570: --- Summary: s3guard uploads command to list date and initiator of outstanding uploads Key: HADOOP-15570 URL: https://issues.apache.org/jira/browse/HADOOP-15570 Pro

[jira] [Created] (HADOOP-15572) Test S3Guard ops with assumed roles & verify required permissions

2018-06-29 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15572: --- Summary: Test S3Guard ops with assumed roles & verify required permissions Key: HADOOP-15572 URL: https://issues.apache.org/jira/browse/HADOOP-15572 Project: Ha

[jira] [Created] (HADOOP-15573) s3guard set-capacity to not retry on an access denied exception

2018-06-29 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15573: --- Summary: s3guard set-capacity to not retry on an access denied exception Key: HADOOP-15573 URL: https://issues.apache.org/jira/browse/HADOOP-15573 Project: Hado

[jira] [Created] (HADOOP-15575) Add a way for an FS instance to say "really, no trash interval at all"

2018-07-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15575: --- Summary: Add a way for an FS instance to say "really, no trash interval at all" Key: HADOOP-15575 URL: https://issues.apache.org/jira/browse/HADOOP-15575 Projec

[jira] [Created] (HADOOP-15576) S3A Multipart Uploader API implementation to work with S3Guard

2018-07-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15576: --- Summary: S3A Multipart Uploader API implementation to work with S3Guard Key: HADOOP-15576 URL: https://issues.apache.org/jira/browse/HADOOP-15576 Project: Hado

[jira] [Resolved] (HADOOP-14614) Hive doesn't let s3a patch the credential provider path

2018-07-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14614. - Resolution: Won't Fix we can't fix this: put fully qualified account/secrets in your JC

[jira] [Resolved] (HADOOP-15577) Update distcp to use zero-rename s3 committers

2018-07-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15577. - Resolution: Duplicate We don't need the 0-rename stuff, because distcp, except in the -

[jira] [Created] (HADOOP-15579) ABFS: TestAbfsConfigurationFieldsValidation breaks if FS is configured in core-site

2018-07-03 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15579: --- Summary: ABFS: TestAbfsConfigurationFieldsValidation breaks if FS is configured in core-site Key: HADOOP-15579 URL: https://issues.apache.org/jira/browse/HADOOP-15579

[jira] [Resolved] (HADOOP-15545) ABFS initialize() throws string out of bounds exception of the URI isn't fully qualified

2018-07-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15545. - Resolution: Duplicate Assignee: Steve Loughran Fix Version/s: 3.2.0 Fix

[jira] [Created] (HADOOP-15582) Document ABFS

2018-07-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15582: --- Summary: Document ABFS Key: HADOOP-15582 URL: https://issues.apache.org/jira/browse/HADOOP-15582 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-15583) S3Guard to get AWS Credential chain from S3AFS

2018-07-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15583: --- Summary: S3Guard to get AWS Credential chain from S3AFS Key: HADOOP-15583 URL: https://issues.apache.org/jira/browse/HADOOP-15583 Project: Hadoop Common

[jira] [Created] (HADOOP-15592) AssumedRoleProvider to propagate connection settings of S3A FS

2018-07-09 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15592: --- Summary: AssumedRoleProvider to propagate connection settings of S3A FS Key: HADOOP-15592 URL: https://issues.apache.org/jira/browse/HADOOP-15592 Project: Hadoo

[jira] [Resolved] (HADOOP-14592) ITestS3ATemporaryCredentials to cover all ddb metastore ops with session credentials

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14592. - Resolution: Duplicate HADOOP-15572 does this only more strictly > ITestS3ATemporaryCre

[jira] [Resolved] (HADOOP-15232) AWSCredentialProviderList to throw custom NoCredentialsException; retry logic to handle

2018-07-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15232. - Resolution: Duplicate > AWSCredentialProviderList to throw custom NoCredentialsExceptio

[jira] [Created] (HADOOP-15603) S3A to support configuring various AWS S3 client extended options

2018-07-12 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15603: --- Summary: S3A to support configuring various AWS S3 client extended options Key: HADOOP-15603 URL: https://issues.apache.org/jira/browse/HADOOP-15603 Project: Ha

[jira] [Created] (HADOOP-15606) FSDataInputStream/FSInputStream to implement a length()/size() method for amount of data

2018-07-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15606: --- Summary: FSDataInputStream/FSInputStream to implement a length()/size() method for amount of data Key: HADOOP-15606 URL: https://issues.apache.org/jira/browse/HADOOP-15606

[jira] [Resolved] (HADOOP-15556) S3AFileStatus to add a serialVersionUID; review & test serialization

2018-07-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15556. - Resolution: Duplicate Jira submission screw up; duplicate > S3AFileStatus to add a ser

[jira] [Resolved] (HADOOP-15579) ABFS: TestAbfsConfigurationFieldsValidation breaks if FS is configured in core-site

2018-07-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15579. - Resolution: Duplicate Assignee: Steve Loughran fixed in HADOOP-15546; just create

[jira] [Created] (HADOOP-15619) Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features

2018-07-19 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15619: --- Summary: Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features Key: HADOOP-15619 URL: https://issues.apache.org/jira/browse/HADOOP-15619 Project: Hadoop Common

[jira] [Created] (HADOOP-15620) Über-jira: S3a phase VI: Hadoop 3.3 features

2018-07-19 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15620: --- Summary: Über-jira: S3a phase VI: Hadoop 3.3 features Key: HADOOP-15620 URL: https://issues.apache.org/jira/browse/HADOOP-15620 Project: Hadoop Common

[jira] [Resolved] (HADOOP-15105) add htrace context to HTTP requests as ? parameter

2018-07-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15105. - Resolution: Won't Fix Wontfix * HTrace is dead; will be replaced by opentrace at some p

[jira] [Resolved] (HADOOP-15509) Release Hadoop 2.7.7

2018-07-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15509. - Resolution: Fixed Fix Version/s: 2.7.7 > Release Hadoop 2.7.7 >

[jira] [Created] (HADOOP-15624) Release Hadoop 2.7.8

2018-07-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15624: --- Summary: Release Hadoop 2.7.8 Key: HADOOP-15624 URL: https://issues.apache.org/jira/browse/HADOOP-15624 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-15625) S3A input stream to use etags to detect changed source files

2018-07-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15625: --- Summary: S3A input stream to use etags to detect changed source files Key: HADOOP-15625 URL: https://issues.apache.org/jira/browse/HADOOP-15625 Project: Hadoop

[jira] [Created] (HADOOP-15626) FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append.

2018-07-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15626: --- Summary: FileContextMainOperationsBaseTest.testBuilderCreateAppendExistingFile fails on filesystems without append. Key: HADOOP-15626 URL: https://issues.apache.org/jira/br

[jira] [Created] (HADOOP-15627) Failure in ITestS3GuardWriteBack.testListStatusWriteBack

2018-07-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15627: --- Summary: Failure in ITestS3GuardWriteBack.testListStatusWriteBack Key: HADOOP-15627 URL: https://issues.apache.org/jira/browse/HADOOP-15627 Project: Hadoop Commo

[jira] [Resolved] (HADOOP-15572) Test S3Guard ops with assumed roles & verify required permissions

2018-07-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15572. - Resolution: Duplicate > Test S3Guard ops with assumed roles & verify required permissio

[jira] [Resolved] (HADOOP-12949) Add HTrace to the s3a connector

2018-07-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12949. - Resolution: Won't Fix closing as WONTFIX as htrace is being pulled from hadoop. Once we

[jira] [Resolved] (HADOOP-13853) S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts

2018-07-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13853. - Resolution: Won't Fix for s3 io, the local FS isn't normally the bottleneck > S3ADataB

[jira] [Resolved] (HADOOP-14528) s3a encryption tests fail when dest bucket has SSE-KMS enabled

2018-07-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14528. - Resolution: Won't Fix something to be aware when you run the tests: if you force encryp

[jira] [Resolved] (HADOOP-15627) S3A ITests failing if bucket explicitly set to s3guard+DDB

2018-07-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15627. - Resolution: Duplicate > S3A ITests failing if bucket explicitly set to s3guard+DDB > --

[jira] [Resolved] (HADOOP-15592) AssumedRoleCredentialProvider to propagate connection settings of S3A FS

2018-07-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15592. - Resolution: Duplicate > AssumedRoleCredentialProvider to propagate connection settings

[jira] [Created] (HADOOP-15631) remove transient dependency on hadoop-hdfs-client

2018-07-25 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15631: --- Summary: remove transient dependency on hadoop-hdfs-client Key: HADOOP-15631 URL: https://issues.apache.org/jira/browse/HADOOP-15631 Project: Hadoop Common

[jira] [Resolved] (HADOOP-15634) LocalDirAllocator using up local nonDFS when set to S3

2018-07-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15634. - Resolution: Invalid > LocalDirAllocator using up local nonDFS when set to S3 >

[jira] [Resolved] (HADOOP-13311) S3A shell entry point to support commands specific to S3A.

2018-07-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13311. - Resolution: Done > S3A shell entry point to support commands specific to S3A. > ---

<    5   6   7   8   9   10   11   12   13   14   >