[
https://issues.apache.org/jira/browse/HADOOP-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13379.
-
Resolution: Invalid
This is the kind of question for mailing lists and google searches,
[
https://issues.apache.org/jira/browse/HADOOP-13370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13370.
-
Resolution: Invalid
JIRA isn't a support channel, sorry
Steve Loughran created HADOOP-13371:
---
Summary: S3A globber to use bulk listObject call over recursive
directory scan
Key: HADOOP-13371
URL: https://issues.apache.org/jira/browse/HADOOP-13371
Steve Loughran created HADOOP-13323:
---
Summary: Downgrade stack trace on FS load from Warn to debug
Key: HADOOP-13323
URL: https://issues.apache.org/jira/browse/HADOOP-13323
Project: Hadoop Common
Steve Loughran created HADOOP-13327:
---
Summary: Add OutputStream + Syncable to the Filesystem
Specification
Key: HADOOP-13327
URL: https://issues.apache.org/jira/browse/HADOOP-13327
Project: Hadoop
Steve Loughran created HADOOP-13407:
---
Summary: s3a directory housekeeping operations to be done in async
thread
Key: HADOOP-13407
URL: https://issues.apache.org/jira/browse/HADOOP-13407
Project:
[
https://issues.apache.org/jira/browse/HADOOP-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13331.
-
Resolution: Cannot Reproduce
Closing as cannot reproduce, leaving the stack traces here
Steve Loughran created HADOOP-13334:
---
Summary: AmazonClient 30x exceptions to include redirect URL in
message
Key: HADOOP-13334
URL: https://issues.apache.org/jira/browse/HADOOP-13334
Project:
Steve Loughran created HADOOP-13336:
---
Summary: support cross-region operations in S3a
Key: HADOOP-13336
URL: https://issues.apache.org/jira/browse/HADOOP-13336
Project: Hadoop Common
Issue
Steve Loughran created HADOOP-13331:
---
Summary: azure TestFileSystemOperationExceptionHandling failing;
object timestamps 30s out
Key: HADOOP-13331
URL: https://issues.apache.org/jira/browse/HADOOP-13331
[
https://issues.apache.org/jira/browse/HADOOP-13505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13505.
-
Resolution: Invalid
That's your shell expanding * and ? before Hadoop gets to see them.
Steve Loughran created HADOOP-13507:
---
Summary: export s3a BlockingThreadPoolExecutorService pool info
(size, load) as metrics
Key: HADOOP-13507
URL: https://issues.apache.org/jira/browse/HADOOP-13507
[
https://issues.apache.org/jira/browse/HADOOP-14054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened HADOOP-14054:
-
> NativeAzureFileSystem has multiple synchronized BufferedStream:read() calls
> in it
>
[
https://issues.apache.org/jira/browse/HADOOP-14054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-14054.
-
Resolution: Invalid
resolving as invalid. Not our code, see
> NativeAzureFileSystem
Steve Loughran created HADOOP-14059:
---
Summary: typo in s3a rename(self, subdir) error message
Key: HADOOP-14059
URL: https://issues.apache.org/jira/browse/HADOOP-14059
Project: Hadoop Common
Steve Loughran created HADOOP-14019:
---
Summary: fix some typos in the s3a docs
Key: HADOOP-14019
URL: https://issues.apache.org/jira/browse/HADOOP-14019
Project: Hadoop Common
Issue Type:
Steve Loughran created HADOOP-14103:
---
Summary: sort out hadoop-aws contract-test-options.xml
Key: HADOOP-14103
URL: https://issues.apache.org/jira/browse/HADOOP-14103
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-14101.
-
Resolution: Duplicate
> MultiObjectDeleteException thrown when writing directly to s3a
Steve Loughran created HADOOP-14099:
---
Summary: Split s3 testing section out into its own file
Key: HADOOP-14099
URL: https://issues.apache.org/jira/browse/HADOOP-14099
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-13991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13991.
-
Resolution: Won't Fix
> Retry management in NativeS3FileSystem to avoid file upload
[
https://issues.apache.org/jira/browse/HADOOP-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-12376.
-
Resolution: Won't Fix
Closing as a wontfix as there is a solution "move to S3a". That
Steve Loughran created HADOOP-14118:
---
Summary: move jets3t into a dependency on hadoop-aws JAR
Key: HADOOP-14118
URL: https://issues.apache.org/jira/browse/HADOOP-14118
Project: Hadoop Common
Steve Loughran created HADOOP-14120:
---
Summary: needless S3AFileSystem.setOptionalPutRequestParameters in
S3ABlockOutputStream putObject()
Key: HADOOP-14120
URL:
Steve Loughran created HADOOP-14111:
---
Summary: cut some obsolete, ignored s3 tests in TestS3Credentials
Key: HADOOP-14111
URL: https://issues.apache.org/jira/browse/HADOOP-14111
Project: Hadoop
Steve Loughran created HADOOP-14110:
---
Summary: mark S3AFileSystem.getAmazonClient package private,
export getBucketLocation(fs.getBucket());
Key: HADOOP-14110
URL:
[
https://issues.apache.org/jira/browse/HADOOP-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened HADOOP-13271:
-
> Intermittent failure of TestS3AContractRootDir.testListEmptyRootDirectory
>
Steve Loughran created HADOOP-14109:
---
Summary: improvements to S3GuardTool destroy command
Key: HADOOP-14109
URL: https://issues.apache.org/jira/browse/HADOOP-14109
Project: Hadoop Common
Steve Loughran created HADOOP-14112:
---
Summary: Über-jira ADL Phase I: Stabilization
Key: HADOOP-14112
URL: https://issues.apache.org/jira/browse/HADOOP-14112
Project: Hadoop Common
Issue
Steve Loughran created HADOOP-14113:
---
Summary: review/correct ADL Docs
Key: HADOOP-14113
URL: https://issues.apache.org/jira/browse/HADOOP-14113
Project: Hadoop Common
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HADOOP-14071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-14071.
-
Resolution: Duplicate
> S3a: Failed to reset the request input stream
>
[
https://issues.apache.org/jira/browse/HADOOP-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened HADOOP-11694:
-
assuming this covers all for 2.8, there are some late-breaking bugs coming
up..reopening
Steve Loughran created HADOOP-14093:
---
Summary: add tests/docs for HAR files on s3a
Key: HADOOP-14093
URL: https://issues.apache.org/jira/browse/HADOOP-14093
Project: Hadoop Common
Issue
Steve Loughran created HADOOP-13994:
---
Summary: explicitly declare the commons-lang3 dependency as 3.4
Key: HADOOP-13994
URL: https://issues.apache.org/jira/browse/HADOOP-13994
Project: Hadoop Common
Steve Loughran created HADOOP-13993:
---
Summary: transient
Key: HADOOP-13993
URL: https://issues.apache.org/jira/browse/HADOOP-13993
Project: Hadoop Common
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HADOOP-13993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13993.
-
Resolution: Cannot Reproduce
> transient failure of
>
Reporter: Steve Loughran
JIRA to link in all the things we think are needed for a preview/merge into
trunk
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: common-dev-unsubscr
Steve Loughran created HADOOP-14000:
---
Summary: s3guard metadata stores to support millons of children
Key: HADOOP-14000
URL: https://issues.apache.org/jira/browse/HADOOP-14000
Project: Hadoop Common
Steve Loughran created HADOOP-14007:
---
Summary: cli to list info about a bucket (S3guard or not)
Key: HADOOP-14007
URL: https://issues.apache.org/jira/browse/HADOOP-14007
Project: Hadoop Common
Steve Loughran created HADOOP-14012:
---
Summary: make sure dynamo exceptions are handled in
translateException
Key: HADOOP-14012
URL: https://issues.apache.org/jira/browse/HADOOP-14012
Project:
Steve Loughran created HADOOP-13519:
---
Summary: Make Path serializable
Key: HADOOP-13519
URL: https://issues.apache.org/jira/browse/HADOOP-13519
Project: Hadoop Common
Issue Type:
Steve Loughran created HADOOP-13525:
---
Summary: Optimize uses of FS operations in the ASF analysis
frameworks,
Key: HADOOP-13525
URL: https://issues.apache.org/jira/browse/HADOOP-13525
Project:
Steve Loughran created HADOOP-13517:
---
Summary: TestS3NContractRootDir.testRecursiveRootListing failing
Key: HADOOP-13517
URL: https://issues.apache.org/jira/browse/HADOOP-13517
Project: Hadoop
[
https://issues.apache.org/jira/browse/HADOOP-13530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13530.
-
Resolution: Won't Fix
> Upgrade S3 fs.s3.buffer.dir to support multi directories
>
Steve Loughran created HADOOP-13531:
---
Summary: S3A output streams to share a single LocalDirAllocator
for round-robin drive use
Key: HADOOP-13531
URL: https://issues.apache.org/jira/browse/HADOOP-13531
Steve Loughran created HADOOP-14125:
---
Summary: s3guard tool tests aren't isolated; can't run in parallel
Key: HADOOP-14125
URL: https://issues.apache.org/jira/browse/HADOOP-14125
Project: Hadoop
Steve Loughran created HADOOP-14132:
---
Summary: Filesystem discovery to stop loading implementation
classes
Key: HADOOP-14132
URL: https://issues.apache.org/jira/browse/HADOOP-14132
Project: Hadoop
Steve Loughran created HADOOP-14138:
---
Summary: Remove S3A ref from META-INF service discovery, rely on
existing core-default entry
Key: HADOOP-14138
URL: https://issues.apache.org/jira/browse/HADOOP-14138
Steve Loughran created HADOOP-14126:
---
Summary: remove jackson, joda and other transient aws SDK
dependencies from hadoop-aws
Key: HADOOP-14126
URL: https://issues.apache.org/jira/browse/HADOOP-14126
[
https://issues.apache.org/jira/browse/HADOOP-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13834.
-
Resolution: Won't Fix
> use JUnit categories for s3a scale tests and others
>
[
https://issues.apache.org/jira/browse/HADOOP-13572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13572.
-
Resolution: Duplicate
> fs.s3native.mkdirs does not work if the user is only authorized
Steve Loughran created HADOOP-13586:
---
Summary: Hadoop 3.0 doesn't build on windows
Key: HADOOP-13586
URL: https://issues.apache.org/jira/browse/HADOOP-13586
Project: Hadoop Common
Issue
Steve Loughran created HADOOP-13585:
---
Summary: shell rm command to not rename to ~/.Trash in object
stores
Key: HADOOP-13585
URL: https://issues.apache.org/jira/browse/HADOOP-13585
Project: Hadoop
[
https://issues.apache.org/jira/browse/HADOOP-13569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13569.
-
Resolution: Duplicate
Fix Version/s: 2.9.0
> S3AFastOutputStream to take
Steve Loughran created HADOOP-13561:
---
Summary: make sure s3 blob >5GB files copies, with metadata
Key: HADOOP-13561
URL: https://issues.apache.org/jira/browse/HADOOP-13561
Project: Hadoop Common
Steve Loughran created HADOOP-13560:
---
Summary: make sure s3 blob >5GB files copies, with metadata
Key: HADOOP-13560
URL: https://issues.apache.org/jira/browse/HADOOP-13560
Project: Hadoop Common
Steve Loughran created HADOOP-13566:
---
Summary: NPE in S3AFastOutputStream.write
Key: HADOOP-13566
URL: https://issues.apache.org/jira/browse/HADOOP-13566
Project: Hadoop Common
Issue Type:
Steve Loughran created HADOOP-13567:
---
Summary: S3AFileSystem to override getStoragetStatistics() and so
serve up its statistics
Key: HADOOP-13567
URL: https://issues.apache.org/jira/browse/HADOOP-13567
Steve Loughran created HADOOP-13568:
---
Summary: S3AFastOutputStream to implement flush()
Key: HADOOP-13568
URL: https://issues.apache.org/jira/browse/HADOOP-13568
Project: Hadoop Common
Steve Loughran created HADOOP-13569:
---
Summary: S3AFastOutputStream to take ProgressListener in file
create()
Key: HADOOP-13569
URL: https://issues.apache.org/jira/browse/HADOOP-13569
Project:
Steve Loughran created HADOOP-13611:
---
Summary: FileSystem/s3a processDeleteOnExit to skip the exists()
check
Key: HADOOP-13611
URL: https://issues.apache.org/jira/browse/HADOOP-13611
Project:
Steve Loughran created HADOOP-13612:
---
Summary: FileSystem static mkdirs(FS, path, permissions) to invoke
FS.mkdirs(path, permissions)
Key: HADOOP-13612
URL: https://issues.apache.org/jira/browse/HADOOP-13612
Steve Loughran created HADOOP-13605:
---
Summary: Clean up FileSystem javadocs, logging; improve
diagnostics on FS load
Key: HADOOP-13605
URL: https://issues.apache.org/jira/browse/HADOOP-13605
Steve Loughran created HADOOP-13614:
---
Summary: Purge some superfluous/obsolete S3 FS tests that are
slowing test runs down
Key: HADOOP-13614
URL: https://issues.apache.org/jira/browse/HADOOP-13614
Steve Loughran created HADOOP-13606:
---
Summary: swift FS to add a service load metadata file
Key: HADOOP-13606
URL: https://issues.apache.org/jira/browse/HADOOP-13606
Project: Hadoop Common
Steve Loughran created HADOOP-13599:
---
Summary: s3a close() to be non-synchronized, so avoid risk of
deadlock on shutdown
Key: HADOOP-13599
URL: https://issues.apache.org/jira/browse/HADOOP-13599
Steve Loughran created HADOOP-13600:
---
Summary: S3a rename() to copy files in a directory in parallel
Key: HADOOP-13600
URL: https://issues.apache.org/jira/browse/HADOOP-13600
Project: Hadoop Common
Steve Loughran created HADOOP-13680:
---
Summary: fs.s3a.readahead.range to use getLongBytes
Key: HADOOP-13680
URL: https://issues.apache.org/jira/browse/HADOOP-13680
Project: Hadoop Common
Steve Loughran created HADOOP-13695:
---
Summary: S3A to use a thread pool for async path operations
Key: HADOOP-13695
URL: https://issues.apache.org/jira/browse/HADOOP-13695
Project: Hadoop Common
Steve Loughran created HADOOP-13696:
---
Summary: change hadoop-common dependency scope of jsch to provided.
Key: HADOOP-13696
URL: https://issues.apache.org/jira/browse/HADOOP-13696
Project: Hadoop
Steve Loughran created HADOOP-13703:
---
Summary: S3ABlockOutputStream to pass Yetus & Jenkins
Key: HADOOP-13703
URL: https://issues.apache.org/jira/browse/HADOOP-13703
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-12387.
-
Resolution: Duplicate
Assignee: Steve Loughran (was: Thomas Demoor)
> Improve
Steve Loughran created HADOOP-13623:
---
Summary: regression: ITestS3NContractRootDir
Key: HADOOP-13623
URL: https://issues.apache.org/jira/browse/HADOOP-13623
Project: Hadoop Common
Issue
[
https://issues.apache.org/jira/browse/HADOOP-13367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13367.
-
Resolution: Not A Problem
Fix Version/s: 2.8.0
resolving as the Aliyun work
Steve Loughran created HADOOP-13627:
---
Summary: Have an explicit KerberosAuthException for UGI to throw,
text from public constants
Key: HADOOP-13627
URL: https://issues.apache.org/jira/browse/HADOOP-13627
Steve Loughran created HADOOP-13636:
---
Summary: s3a rm on the CLI generates deprecation warning on
io.bytes.per.checksum
Key: HADOOP-13636
URL: https://issues.apache.org/jira/browse/HADOOP-13636
Steve Loughran created HADOOP-13637:
---
Summary: improve setting of max connections in AWS client
Key: HADOOP-13637
URL: https://issues.apache.org/jira/browse/HADOOP-13637
Project: Hadoop Common
Steve Loughran created HADOOP-13648:
---
Summary: s3a home directory to be "/"
Key: HADOOP-13648
URL: https://issues.apache.org/jira/browse/HADOOP-13648
Project: Hadoop Common
Issue Type:
Steve Loughran created HADOOP-13630:
---
Summary: split up AWS index.md
Key: HADOOP-13630
URL: https://issues.apache.org/jira/browse/HADOOP-13630
Project: Hadoop Common
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HADOOP-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13271.
-
Resolution: Cannot Reproduce
Fix Version/s: 2.8.0
> Intermittent failure of
[
https://issues.apache.org/jira/browse/HADOOP-13516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13516.
-
Resolution: Duplicate
Assignee: Lei (Eddy) Xu
Fix Version/s: 2.8.0
>
[
https://issues.apache.org/jira/browse/HADOOP-13516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened HADOOP-13516:
-
Assignee: Steve Loughran (was: Lei (Eddy) Xu)
> Listing an empty s3a NON root
Steve Loughran created HADOOP-13518:
---
Summary: backport HADOOP-9258 to branch-2
Key: HADOOP-13518
URL: https://issues.apache.org/jira/browse/HADOOP-13518
Project: Hadoop Common
Issue Type:
[
https://issues.apache.org/jira/browse/HADOOP-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13553.
-
Resolution: Duplicate
> hook up AwsSdkMetrics to hadoop metrics
>
Steve Loughran created HADOOP-13550:
---
Summary: Azure threaded deleter logs too much at info
Key: HADOOP-13550
URL: https://issues.apache.org/jira/browse/HADOOP-13550
Project: Hadoop Common
Steve Loughran created HADOOP-13553:
---
Summary: hook up AwsSdkMetrics to hadoop metrics
Key: HADOOP-13553
URL: https://issues.apache.org/jira/browse/HADOOP-13553
Project: Hadoop Common
Steve Loughran created HADOOP-13551:
---
Summary: hook up AwsSdkMetrics to hadoop metrics
Key: HADOOP-13551
URL: https://issues.apache.org/jira/browse/HADOOP-13551
Project: Hadoop Common
Steve Loughran created HADOOP-13540:
---
Summary: improve section on troubleshooting s3a auth problems
Key: HADOOP-13540
URL: https://issues.apache.org/jira/browse/HADOOP-13540
Project: Hadoop Common
Steve Loughran created HADOOP-13541:
---
Summary: explicitly declare the Joda time version S3A depends on
Key: HADOOP-13541
URL: https://issues.apache.org/jira/browse/HADOOP-13541
Project: Hadoop
Steve Loughran created HADOOP-13664:
---
Summary: S3AInputStream to use a retry policy on read failures
Key: HADOOP-13664
URL: https://issues.apache.org/jira/browse/HADOOP-13664
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-13567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13567.
-
Resolution: Duplicate
Fix Version/s: 2.9.0
This was fixed during HADOOP-13560
Steve Loughran created HADOOP-13656:
---
Summary: fs -expunge to take a filesystem
Key: HADOOP-13656
URL: https://issues.apache.org/jira/browse/HADOOP-13656
Project: Hadoop Common
Issue Type:
Steve Loughran created HADOOP-13655:
---
Summary: document object store use with fs shell and distcp
Key: HADOOP-13655
URL: https://issues.apache.org/jira/browse/HADOOP-13655
Project: Hadoop Common
Steve Loughran created HADOOP-13654:
---
Summary: S3A create() to support asynchronous check of dest &
parent paths
Key: HADOOP-13654
URL: https://issues.apache.org/jira/browse/HADOOP-13654
Project:
[
https://issues.apache.org/jira/browse/HADOOP-13281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13281.
-
Resolution: Duplicate
Assignee: Steve Loughran
Fix Version/s: 2.9.0
>
[
https://issues.apache.org/jira/browse/HADOOP-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13566.
-
Resolution: Duplicate
Fix Version/s: 2.9.0
> NPE in S3AFastOutputStream.write
>
Steve Loughran created HADOOP-13704:
---
Summary: S3A getContentSummary() to move to listFiles(recursive)
to count children; instrument use
Key: HADOOP-13704
URL: https://issues.apache.org/jira/browse/HADOOP-13704
[
https://issues.apache.org/jira/browse/HADOOP-9680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-9680.
Resolution: Won't Fix
closing as WONTFIX; it's in s3a.
> Extend S3FS and S3NativeFS to
Steve Loughran created HADOOP-13801:
---
Summary: regression: ITestS3AMiniYarnCluster failing
Key: HADOOP-13801
URL: https://issues.apache.org/jira/browse/HADOOP-13801
Project: Hadoop Common
Steve Loughran created HADOOP-13808:
---
Summary: replace `Can't get Master Kerberos principal` message
with useful information about principal and configuration item
Key: HADOOP-13808
URL:
[
https://issues.apache.org/jira/browse/HADOOP-13731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-13731.
-
Resolution: Won't Fix
Going to have to close this as a wontfix I'm afraid; bug in
401 - 500 of 2477 matches
Mail list logo