[jira] [Resolved] (HADOOP-13379) Hadoop: Failed to set permissions of path: \tmp\hadoop-User\mapred\staging\ while running testdriver from eclipse

2016-07-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13379. - Resolution: Invalid This is the kind of question for mailing lists and google searches,

[jira] [Resolved] (HADOOP-13370) After creating HA, getting java.net.UnknownHostException

2016-07-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13370. - Resolution: Invalid JIRA isn't a support channel, sorry

[jira] [Created] (HADOOP-13371) S3A globber to use bulk listObject call over recursive directory scan

2016-07-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13371: --- Summary: S3A globber to use bulk listObject call over recursive directory scan Key: HADOOP-13371 URL: https://issues.apache.org/jira/browse/HADOOP-13371

[jira] [Created] (HADOOP-13323) Downgrade stack trace on FS load from Warn to debug

2016-06-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13323: --- Summary: Downgrade stack trace on FS load from Warn to debug Key: HADOOP-13323 URL: https://issues.apache.org/jira/browse/HADOOP-13323 Project: Hadoop Common

[jira] [Created] (HADOOP-13327) Add OutputStream + Syncable to the Filesystem Specification

2016-06-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13327: --- Summary: Add OutputStream + Syncable to the Filesystem Specification Key: HADOOP-13327 URL: https://issues.apache.org/jira/browse/HADOOP-13327 Project: Hadoop

[jira] [Created] (HADOOP-13407) s3a directory housekeeping operations to be done in async thread

2016-07-22 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13407: --- Summary: s3a directory housekeeping operations to be done in async thread Key: HADOOP-13407 URL: https://issues.apache.org/jira/browse/HADOOP-13407 Project:

[jira] [Resolved] (HADOOP-13331) azure TestFileSystemOperationExceptionHandling failing; object timestamps 30s out

2016-06-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13331. - Resolution: Cannot Reproduce Closing as cannot reproduce, leaving the stack traces here

[jira] [Created] (HADOOP-13334) AmazonClient 30x exceptions to include redirect URL in message

2016-06-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13334: --- Summary: AmazonClient 30x exceptions to include redirect URL in message Key: HADOOP-13334 URL: https://issues.apache.org/jira/browse/HADOOP-13334 Project:

[jira] [Created] (HADOOP-13336) support cross-region operations in S3a

2016-07-01 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13336: --- Summary: support cross-region operations in S3a Key: HADOOP-13336 URL: https://issues.apache.org/jira/browse/HADOOP-13336 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-13331) azure TestFileSystemOperationExceptionHandling failing; object timestamps 30s out

2016-06-29 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13331: --- Summary: azure TestFileSystemOperationExceptionHandling failing; object timestamps 30s out Key: HADOOP-13331 URL: https://issues.apache.org/jira/browse/HADOOP-13331

[jira] [Resolved] (HADOOP-13505) Fuzzy match issue in Hadoop commands

2016-08-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13505. - Resolution: Invalid That's your shell expanding * and ? before Hadoop gets to see them.

[jira] [Created] (HADOOP-13507) export s3a BlockingThreadPoolExecutorService pool info (size, load) as metrics

2016-08-17 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13507: --- Summary: export s3a BlockingThreadPoolExecutorService pool info (size, load) as metrics Key: HADOOP-13507 URL: https://issues.apache.org/jira/browse/HADOOP-13507

[jira] [Reopened] (HADOOP-14054) NativeAzureFileSystem has multiple synchronized BufferedStream:read() calls in it

2017-02-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-14054: - > NativeAzureFileSystem has multiple synchronized BufferedStream:read() calls > in it >

[jira] [Resolved] (HADOOP-14054) NativeAzureFileSystem has multiple synchronized BufferedStream:read() calls in it

2017-02-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14054. - Resolution: Invalid resolving as invalid. Not our code, see > NativeAzureFileSystem

[jira] [Created] (HADOOP-14059) typo in s3a rename(self, subdir) error message

2017-02-04 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14059: --- Summary: typo in s3a rename(self, subdir) error message Key: HADOOP-14059 URL: https://issues.apache.org/jira/browse/HADOOP-14059 Project: Hadoop Common

[jira] [Created] (HADOOP-14019) fix some typos in the s3a docs

2017-01-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14019: --- Summary: fix some typos in the s3a docs Key: HADOOP-14019 URL: https://issues.apache.org/jira/browse/HADOOP-14019 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-14103) sort out hadoop-aws contract-test-options.xml

2017-02-22 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14103: --- Summary: sort out hadoop-aws contract-test-options.xml Key: HADOOP-14103 URL: https://issues.apache.org/jira/browse/HADOOP-14103 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14101) MultiObjectDeleteException thrown when writing directly to s3a

2017-02-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14101. - Resolution: Duplicate > MultiObjectDeleteException thrown when writing directly to s3a

[jira] [Created] (HADOOP-14099) Split s3 testing section out into its own file

2017-02-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14099: --- Summary: Split s3 testing section out into its own file Key: HADOOP-14099 URL: https://issues.apache.org/jira/browse/HADOOP-14099 Project: Hadoop Common

[jira] [Resolved] (HADOOP-13991) Retry management in NativeS3FileSystem to avoid file upload problem

2017-02-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13991. - Resolution: Won't Fix > Retry management in NativeS3FileSystem to avoid file upload

[jira] [Resolved] (HADOOP-12376) S3NInputStream.close() downloads the remaining bytes of the object from S3

2017-02-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12376. - Resolution: Won't Fix Closing as a wontfix as there is a solution "move to S3a". That

[jira] [Created] (HADOOP-14118) move jets3t into a dependency on hadoop-aws JAR

2017-02-24 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14118: --- Summary: move jets3t into a dependency on hadoop-aws JAR Key: HADOOP-14118 URL: https://issues.apache.org/jira/browse/HADOOP-14118 Project: Hadoop Common

[jira] [Created] (HADOOP-14120) needless S3AFileSystem.setOptionalPutRequestParameters in S3ABlockOutputStream putObject()

2017-02-24 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14120: --- Summary: needless S3AFileSystem.setOptionalPutRequestParameters in S3ABlockOutputStream putObject() Key: HADOOP-14120 URL:

[jira] [Created] (HADOOP-14111) cut some obsolete, ignored s3 tests in TestS3Credentials

2017-02-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14111: --- Summary: cut some obsolete, ignored s3 tests in TestS3Credentials Key: HADOOP-14111 URL: https://issues.apache.org/jira/browse/HADOOP-14111 Project: Hadoop

[jira] [Created] (HADOOP-14110) mark S3AFileSystem.getAmazonClient package private, export getBucketLocation(fs.getBucket());

2017-02-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14110: --- Summary: mark S3AFileSystem.getAmazonClient package private, export getBucketLocation(fs.getBucket()); Key: HADOOP-14110 URL:

[jira] [Reopened] (HADOOP-13271) Intermittent failure of TestS3AContractRootDir.testListEmptyRootDirectory

2017-02-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-13271: - > Intermittent failure of TestS3AContractRootDir.testListEmptyRootDirectory >

[jira] [Created] (HADOOP-14109) improvements to S3GuardTool destroy command

2017-02-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14109: --- Summary: improvements to S3GuardTool destroy command Key: HADOOP-14109 URL: https://issues.apache.org/jira/browse/HADOOP-14109 Project: Hadoop Common

[jira] [Created] (HADOOP-14112) Über-jira ADL Phase I: Stabilization

2017-02-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14112: --- Summary: Über-jira ADL Phase I: Stabilization Key: HADOOP-14112 URL: https://issues.apache.org/jira/browse/HADOOP-14112 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14113) review/correct ADL Docs

2017-02-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14113: --- Summary: review/correct ADL Docs Key: HADOOP-14113 URL: https://issues.apache.org/jira/browse/HADOOP-14113 Project: Hadoop Common Issue Type: Sub-task

[jira] [Resolved] (HADOOP-14071) S3a: Failed to reset the request input stream

2017-02-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14071. - Resolution: Duplicate > S3a: Failed to reset the request input stream >

[jira] [Reopened] (HADOOP-11694) Über-jira: S3a phase II: robustness, scale and performance

2017-02-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-11694: - assuming this covers all for 2.8, there are some late-breaking bugs coming up..reopening

[jira] [Created] (HADOOP-14093) add tests/docs for HAR files on s3a

2017-02-17 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14093: --- Summary: add tests/docs for HAR files on s3a Key: HADOOP-14093 URL: https://issues.apache.org/jira/browse/HADOOP-14093 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-01-17 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13994: --- Summary: explicitly declare the commons-lang3 dependency as 3.4 Key: HADOOP-13994 URL: https://issues.apache.org/jira/browse/HADOOP-13994 Project: Hadoop Common

[jira] [Created] (HADOOP-13993) transient

2017-01-16 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13993: --- Summary: transient Key: HADOOP-13993 URL: https://issues.apache.org/jira/browse/HADOOP-13993 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-13993) transient failure of ITestS3AInputStreamPerformance.testDecompressionSequential128K

2017-01-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13993. - Resolution: Cannot Reproduce > transient failure of >

[jira] [Created] (HADOOP-13998) initial s3guard preview

2017-01-18 Thread Steve Loughran (JIRA)
Reporter: Steve Loughran JIRA to link in all the things we think are needed for a preview/merge into trunk -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr

[jira] [Created] (HADOOP-14000) s3guard metadata stores to support millons of children

2017-01-18 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14000: --- Summary: s3guard metadata stores to support millons of children Key: HADOOP-14000 URL: https://issues.apache.org/jira/browse/HADOOP-14000 Project: Hadoop Common

[jira] [Created] (HADOOP-14007) cli to list info about a bucket (S3guard or not)

2017-01-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14007: --- Summary: cli to list info about a bucket (S3guard or not) Key: HADOOP-14007 URL: https://issues.apache.org/jira/browse/HADOOP-14007 Project: Hadoop Common

[jira] [Created] (HADOOP-14012) make sure dynamo exceptions are handled in translateException

2017-01-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14012: --- Summary: make sure dynamo exceptions are handled in translateException Key: HADOOP-14012 URL: https://issues.apache.org/jira/browse/HADOOP-14012 Project:

[jira] [Created] (HADOOP-13519) Make Path serializable

2016-08-19 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13519: --- Summary: Make Path serializable Key: HADOOP-13519 URL: https://issues.apache.org/jira/browse/HADOOP-13519 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13525) Optimize uses of FS operations in the ASF analysis frameworks,

2016-08-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13525: --- Summary: Optimize uses of FS operations in the ASF analysis frameworks, Key: HADOOP-13525 URL: https://issues.apache.org/jira/browse/HADOOP-13525 Project:

[jira] [Created] (HADOOP-13517) TestS3NContractRootDir.testRecursiveRootListing failing

2016-08-18 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13517: --- Summary: TestS3NContractRootDir.testRecursiveRootListing failing Key: HADOOP-13517 URL: https://issues.apache.org/jira/browse/HADOOP-13517 Project: Hadoop

[jira] [Resolved] (HADOOP-13530) Upgrade S3 fs.s3.buffer.dir to support multi directories

2016-08-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13530. - Resolution: Won't Fix > Upgrade S3 fs.s3.buffer.dir to support multi directories >

[jira] [Created] (HADOOP-13531) S3A output streams to share a single LocalDirAllocator for round-robin drive use

2016-08-22 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13531: --- Summary: S3A output streams to share a single LocalDirAllocator for round-robin drive use Key: HADOOP-13531 URL: https://issues.apache.org/jira/browse/HADOOP-13531

[jira] [Created] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14125: --- Summary: s3guard tool tests aren't isolated; can't run in parallel Key: HADOOP-14125 URL: https://issues.apache.org/jira/browse/HADOOP-14125 Project: Hadoop

[jira] [Created] (HADOOP-14132) Filesystem discovery to stop loading implementation classes

2017-02-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14132: --- Summary: Filesystem discovery to stop loading implementation classes Key: HADOOP-14132 URL: https://issues.apache.org/jira/browse/HADOOP-14132 Project: Hadoop

[jira] [Created] (HADOOP-14138) Remove S3A ref from META-INF service discovery, rely on existing core-default entry

2017-03-02 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14138: --- Summary: Remove S3A ref from META-INF service discovery, rely on existing core-default entry Key: HADOOP-14138 URL: https://issues.apache.org/jira/browse/HADOOP-14138

[jira] [Created] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-02-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14126: --- Summary: remove jackson, joda and other transient aws SDK dependencies from hadoop-aws Key: HADOOP-14126 URL: https://issues.apache.org/jira/browse/HADOOP-14126

[jira] [Resolved] (HADOOP-13834) use JUnit categories for s3a scale tests and others

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13834. - Resolution: Won't Fix > use JUnit categories for s3a scale tests and others >

[jira] [Resolved] (HADOOP-13572) fs.s3native.mkdirs does not work if the user is only authorized to a subdirectory

2016-09-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13572. - Resolution: Duplicate > fs.s3native.mkdirs does not work if the user is only authorized

[jira] [Created] (HADOOP-13586) Hadoop 3.0 doesn't build on windows

2016-09-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13586: --- Summary: Hadoop 3.0 doesn't build on windows Key: HADOOP-13586 URL: https://issues.apache.org/jira/browse/HADOOP-13586 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-13585) shell rm command to not rename to ~/.Trash in object stores

2016-09-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13585: --- Summary: shell rm command to not rename to ~/.Trash in object stores Key: HADOOP-13585 URL: https://issues.apache.org/jira/browse/HADOOP-13585 Project: Hadoop

[jira] [Resolved] (HADOOP-13569) S3AFastOutputStream to take ProgressListener in file create()

2016-09-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13569. - Resolution: Duplicate Fix Version/s: 2.9.0 > S3AFastOutputStream to take

[jira] [Created] (HADOOP-13561) make sure s3 blob >5GB files copies, with metadata

2016-08-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13561: --- Summary: make sure s3 blob >5GB files copies, with metadata Key: HADOOP-13561 URL: https://issues.apache.org/jira/browse/HADOOP-13561 Project: Hadoop Common

[jira] [Created] (HADOOP-13560) make sure s3 blob >5GB files copies, with metadata

2016-08-30 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13560: --- Summary: make sure s3 blob >5GB files copies, with metadata Key: HADOOP-13560 URL: https://issues.apache.org/jira/browse/HADOOP-13560 Project: Hadoop Common

[jira] [Created] (HADOOP-13566) NPE in S3AFastOutputStream.write

2016-08-31 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13566: --- Summary: NPE in S3AFastOutputStream.write Key: HADOOP-13566 URL: https://issues.apache.org/jira/browse/HADOOP-13566 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13567) S3AFileSystem to override getStoragetStatistics() and so serve up its statistics

2016-08-31 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13567: --- Summary: S3AFileSystem to override getStoragetStatistics() and so serve up its statistics Key: HADOOP-13567 URL: https://issues.apache.org/jira/browse/HADOOP-13567

[jira] [Created] (HADOOP-13568) S3AFastOutputStream to implement flush()

2016-08-31 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13568: --- Summary: S3AFastOutputStream to implement flush() Key: HADOOP-13568 URL: https://issues.apache.org/jira/browse/HADOOP-13568 Project: Hadoop Common

[jira] [Created] (HADOOP-13569) S3AFastOutputStream to take ProgressListener in file create()

2016-08-31 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13569: --- Summary: S3AFastOutputStream to take ProgressListener in file create() Key: HADOOP-13569 URL: https://issues.apache.org/jira/browse/HADOOP-13569 Project:

[jira] [Created] (HADOOP-13611) FileSystem/s3a processDeleteOnExit to skip the exists() check

2016-09-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13611: --- Summary: FileSystem/s3a processDeleteOnExit to skip the exists() check Key: HADOOP-13611 URL: https://issues.apache.org/jira/browse/HADOOP-13611 Project:

[jira] [Created] (HADOOP-13612) FileSystem static mkdirs(FS, path, permissions) to invoke FS.mkdirs(path, permissions)

2016-09-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13612: --- Summary: FileSystem static mkdirs(FS, path, permissions) to invoke FS.mkdirs(path, permissions) Key: HADOOP-13612 URL: https://issues.apache.org/jira/browse/HADOOP-13612

[jira] [Created] (HADOOP-13605) Clean up FileSystem javadocs, logging; improve diagnostics on FS load

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13605: --- Summary: Clean up FileSystem javadocs, logging; improve diagnostics on FS load Key: HADOOP-13605 URL: https://issues.apache.org/jira/browse/HADOOP-13605

[jira] [Created] (HADOOP-13614) Purge some superfluous/obsolete S3 FS tests that are slowing test runs down

2016-09-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13614: --- Summary: Purge some superfluous/obsolete S3 FS tests that are slowing test runs down Key: HADOOP-13614 URL: https://issues.apache.org/jira/browse/HADOOP-13614

[jira] [Created] (HADOOP-13606) swift FS to add a service load metadata file

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13606: --- Summary: swift FS to add a service load metadata file Key: HADOOP-13606 URL: https://issues.apache.org/jira/browse/HADOOP-13606 Project: Hadoop Common

[jira] [Created] (HADOOP-13599) s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13599: --- Summary: s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown Key: HADOOP-13599 URL: https://issues.apache.org/jira/browse/HADOOP-13599

[jira] [Created] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

2016-09-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13600: --- Summary: S3a rename() to copy files in a directory in parallel Key: HADOOP-13600 URL: https://issues.apache.org/jira/browse/HADOOP-13600 Project: Hadoop Common

[jira] [Created] (HADOOP-13680) fs.s3a.readahead.range to use getLongBytes

2016-10-04 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13680: --- Summary: fs.s3a.readahead.range to use getLongBytes Key: HADOOP-13680 URL: https://issues.apache.org/jira/browse/HADOOP-13680 Project: Hadoop Common

[jira] [Created] (HADOOP-13695) S3A to use a thread pool for async path operations

2016-10-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13695: --- Summary: S3A to use a thread pool for async path operations Key: HADOOP-13695 URL: https://issues.apache.org/jira/browse/HADOOP-13695 Project: Hadoop Common

[jira] [Created] (HADOOP-13696) change hadoop-common dependency scope of jsch to provided.

2016-10-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13696: --- Summary: change hadoop-common dependency scope of jsch to provided. Key: HADOOP-13696 URL: https://issues.apache.org/jira/browse/HADOOP-13696 Project: Hadoop

[jira] [Created] (HADOOP-13703) S3ABlockOutputStream to pass Yetus & Jenkins

2016-10-10 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13703: --- Summary: S3ABlockOutputStream to pass Yetus & Jenkins Key: HADOOP-13703 URL: https://issues.apache.org/jira/browse/HADOOP-13703 Project: Hadoop Common

[jira] [Resolved] (HADOOP-12387) Improve S3AFastOutputStream memory management

2016-10-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12387. - Resolution: Duplicate Assignee: Steve Loughran (was: Thomas Demoor) > Improve

[jira] [Created] (HADOOP-13623) regression: ITestS3NContractRootDir

2016-09-19 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13623: --- Summary: regression: ITestS3NContractRootDir Key: HADOOP-13623 URL: https://issues.apache.org/jira/browse/HADOOP-13623 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-13367) Support more types of Store in S3Native File System

2016-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13367. - Resolution: Not A Problem Fix Version/s: 2.8.0 resolving as the Aliyun work

[jira] [Created] (HADOOP-13627) Have an explicit KerberosAuthException for UGI to throw, text from public constants

2016-09-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13627: --- Summary: Have an explicit KerberosAuthException for UGI to throw, text from public constants Key: HADOOP-13627 URL: https://issues.apache.org/jira/browse/HADOOP-13627

[jira] [Created] (HADOOP-13636) s3a rm on the CLI generates deprecation warning on io.bytes.per.checksum

2016-09-21 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13636: --- Summary: s3a rm on the CLI generates deprecation warning on io.bytes.per.checksum Key: HADOOP-13636 URL: https://issues.apache.org/jira/browse/HADOOP-13636

[jira] [Created] (HADOOP-13637) improve setting of max connections in AWS client

2016-09-21 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13637: --- Summary: improve setting of max connections in AWS client Key: HADOOP-13637 URL: https://issues.apache.org/jira/browse/HADOOP-13637 Project: Hadoop Common

[jira] [Created] (HADOOP-13648) s3a home directory to be "/"

2016-09-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13648: --- Summary: s3a home directory to be "/" Key: HADOOP-13648 URL: https://issues.apache.org/jira/browse/HADOOP-13648 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13630) split up AWS index.md

2016-09-20 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13630: --- Summary: split up AWS index.md Key: HADOOP-13630 URL: https://issues.apache.org/jira/browse/HADOOP-13630 Project: Hadoop Common Issue Type: Sub-task

[jira] [Resolved] (HADOOP-13271) Intermittent failure of TestS3AContractRootDir.testListEmptyRootDirectory

2016-08-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13271. - Resolution: Cannot Reproduce Fix Version/s: 2.8.0 > Intermittent failure of

[jira] [Resolved] (HADOOP-13516) Listing an empty s3a NON root directory throws FileNotFound.

2016-08-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13516. - Resolution: Duplicate Assignee: Lei (Eddy) Xu Fix Version/s: 2.8.0 >

[jira] [Reopened] (HADOOP-13516) Listing an empty s3a NON root directory throws FileNotFound.

2016-08-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-13516: - Assignee: Steve Loughran (was: Lei (Eddy) Xu) > Listing an empty s3a NON root

[jira] [Created] (HADOOP-13518) backport HADOOP-9258 to branch-2

2016-08-18 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13518: --- Summary: backport HADOOP-9258 to branch-2 Key: HADOOP-13518 URL: https://issues.apache.org/jira/browse/HADOOP-13518 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-13553) hook up AwsSdkMetrics to hadoop metrics

2016-08-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13553. - Resolution: Duplicate > hook up AwsSdkMetrics to hadoop metrics >

[jira] [Created] (HADOOP-13550) Azure threaded deleter logs too much at info

2016-08-26 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13550: --- Summary: Azure threaded deleter logs too much at info Key: HADOOP-13550 URL: https://issues.apache.org/jira/browse/HADOOP-13550 Project: Hadoop Common

[jira] [Created] (HADOOP-13553) hook up AwsSdkMetrics to hadoop metrics

2016-08-26 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13553: --- Summary: hook up AwsSdkMetrics to hadoop metrics Key: HADOOP-13553 URL: https://issues.apache.org/jira/browse/HADOOP-13553 Project: Hadoop Common

[jira] [Created] (HADOOP-13551) hook up AwsSdkMetrics to hadoop metrics

2016-08-26 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13551: --- Summary: hook up AwsSdkMetrics to hadoop metrics Key: HADOOP-13551 URL: https://issues.apache.org/jira/browse/HADOOP-13551 Project: Hadoop Common

[jira] [Created] (HADOOP-13540) improve section on troubleshooting s3a auth problems

2016-08-24 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13540: --- Summary: improve section on troubleshooting s3a auth problems Key: HADOOP-13540 URL: https://issues.apache.org/jira/browse/HADOOP-13540 Project: Hadoop Common

[jira] [Created] (HADOOP-13541) explicitly declare the Joda time version S3A depends on

2016-08-24 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13541: --- Summary: explicitly declare the Joda time version S3A depends on Key: HADOOP-13541 URL: https://issues.apache.org/jira/browse/HADOOP-13541 Project: Hadoop

[jira] [Created] (HADOOP-13664) S3AInputStream to use a retry policy on read failures

2016-09-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13664: --- Summary: S3AInputStream to use a retry policy on read failures Key: HADOOP-13664 URL: https://issues.apache.org/jira/browse/HADOOP-13664 Project: Hadoop Common

[jira] [Resolved] (HADOOP-13567) S3AFileSystem to override getStorageStatistics() and so serve up its statistics

2016-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13567. - Resolution: Duplicate Fix Version/s: 2.9.0 This was fixed during HADOOP-13560

[jira] [Created] (HADOOP-13656) fs -expunge to take a filesystem

2016-09-26 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13656: --- Summary: fs -expunge to take a filesystem Key: HADOOP-13656 URL: https://issues.apache.org/jira/browse/HADOOP-13656 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-13655) document object store use with fs shell and distcp

2016-09-25 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13655: --- Summary: document object store use with fs shell and distcp Key: HADOOP-13655 URL: https://issues.apache.org/jira/browse/HADOOP-13655 Project: Hadoop Common

[jira] [Created] (HADOOP-13654) S3A create() to support asynchronous check of dest & parent paths

2016-09-25 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13654: --- Summary: S3A create() to support asynchronous check of dest & parent paths Key: HADOOP-13654 URL: https://issues.apache.org/jira/browse/HADOOP-13654 Project:

[jira] [Resolved] (HADOOP-13281) S3A to track multipart upload count, size, duration

2016-09-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13281. - Resolution: Duplicate Assignee: Steve Loughran Fix Version/s: 2.9.0 >

[jira] [Resolved] (HADOOP-13566) NPE in S3AFastOutputStream.write

2016-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13566. - Resolution: Duplicate Fix Version/s: 2.9.0 > NPE in S3AFastOutputStream.write >

[jira] [Created] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

2016-10-10 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13704: --- Summary: S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use Key: HADOOP-13704 URL: https://issues.apache.org/jira/browse/HADOOP-13704

[jira] [Resolved] (HADOOP-9680) Extend S3FS and S3NativeFS to work with AWS IAM Temporary Security Credentials

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-9680. Resolution: Won't Fix closing as WONTFIX; it's in s3a. > Extend S3FS and S3NativeFS to

[jira] [Created] (HADOOP-13801) regression: ITestS3AMiniYarnCluster failing

2016-11-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13801: --- Summary: regression: ITestS3AMiniYarnCluster failing Key: HADOOP-13801 URL: https://issues.apache.org/jira/browse/HADOOP-13801 Project: Hadoop Common

[jira] [Created] (HADOOP-13808) replace `Can't get Master Kerberos principal` message with useful information about principal and configuration item

2016-11-11 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13808: --- Summary: replace `Can't get Master Kerberos principal` message with useful information about principal and configuration item Key: HADOOP-13808 URL:

[jira] [Resolved] (HADOOP-13731) Cant compile Hadoop 2.7.2 on Ubuntu Xenial (16.04) with JDK 7/8

2016-10-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13731. - Resolution: Won't Fix Going to have to close this as a wontfix I'm afraid; bug in

<    1   2   3   4   5   6   7   8   9   10   >