[jira] [Updated] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HADOOP-15223: - Status: Patch Available (was: Open) > Replace Collections.EMPTY_SET and EMPTY_MAP with

[jira] [Updated] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HADOOP-15223: - Attachment: HADOOP-15223.001.patch > Replace Collections.EMPTY_SET and EMPTY_MAP with

[jira] [Commented] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361891#comment-16361891 ] fang zhenyi commented on HADOOP-15223: -- Thanks [~ajisakaa]  for reporting this.I will attach a

[jira] [Assigned] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi reassigned HADOOP-15223: Assignee: fang zhenyi > Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and

[jira] [Updated] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15223: --- Labels: newbie (was: ) > Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and

[jira] [Comment Edited] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361861#comment-16361861 ] Akira Ajisaka edited comment on HADOOP-15223 at 2/13/18 6:08 AM: - For

[jira] [Moved] (HADOOP-15223) Replace Collections.EMPTY_SET and EMPTY_MAP with emptySet() and emptyMap() when available

[ https://issues.apache.org/jira/browse/HADOOP-15223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka moved YARN-7924 to HADOOP-15223: -- Key: HADOOP-15223 (was: YARN-7924) Project: Hadoop Common

[jira] [Commented] (HADOOP-15195) With SELinux enabled, directories mounted with start-build-env.sh may not be accessible.

[ https://issues.apache.org/jira/browse/HADOOP-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361846#comment-16361846 ] Hudson commented on HADOOP-15195: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13650 (See

[jira] [Commented] (HADOOP-15195) With SELinux enabled, directories mounted with start-build-env.sh may not be accessible.

[ https://issues.apache.org/jira/browse/HADOOP-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361836#comment-16361836 ] Hudson commented on HADOOP-15195: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13649 (See

[jira] [Commented] (HADOOP-15195) With SELinux enabled, directories mounted with start-build-env.sh may not be accessible.

[ https://issues.apache.org/jira/browse/HADOOP-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361831#comment-16361831 ] Chris Douglas commented on HADOOP-15195: Sorry for the revert noise; pushed v003 the first time.

[jira] [Updated] (HADOOP-15195) With SELinux enabled, directories mounted with start-build-env.sh may not be accessible.

[ https://issues.apache.org/jira/browse/HADOOP-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-15195: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status:

[jira] [Commented] (HADOOP-15222) Refine proxy user authorization to support multiple ACL list

[ https://issues.apache.org/jira/browse/HADOOP-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361799#comment-16361799 ] Eric Yang commented on HADOOP-15222: [~lmccay] Sorry, until a better proposal is feasible to secure

[jira] [Commented] (HADOOP-13119) Add ability to secure log servlet using proxy users

[ https://issues.apache.org/jira/browse/HADOOP-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361794#comment-16361794 ] Eric Yang commented on HADOOP-13119: [~arpitagarwal] the test case is invalid. Your curl command

[jira] [Commented] (HADOOP-15222) Refine proxy user authorization to support multiple ACL list

[ https://issues.apache.org/jira/browse/HADOOP-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361756#comment-16361756 ] Larry McCay commented on HADOOP-15222: -- Revert it from all branches and put it back to proper

[jira] [Commented] (HADOOP-15222) Refine proxy user authorization to support multiple ACL list

[ https://issues.apache.org/jira/browse/HADOOP-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361731#comment-16361731 ] Eric Yang commented on HADOOP-15222: [~lmccay] Thank you for the summary. This is aligned with the

[jira] [Commented] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361615#comment-16361615 ] Jason Lowe commented on HADOOP-15206: - Thanks for updating the patch! bq. In the current

[jira] [Commented] (HADOOP-15222) Refine proxy user authorization to support multiple ACL list

[ https://issues.apache.org/jira/browse/HADOOP-15222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361602#comment-16361602 ] Larry McCay commented on HADOOP-15222: -- [~eyang] - IMO, we need to revert both HADOOP-14077 and

[jira] [Commented] (HADOOP-15178) Generalize NetUtils#wrapException to handle other subclasses with String Constructor.

[ https://issues.apache.org/jira/browse/HADOOP-15178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361584#comment-16361584 ] genericqa commented on HADOOP-15178: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-15222) Refine proxy user authorization to support multiple ACL list

Eric Yang created HADOOP-15222: -- Summary: Refine proxy user authorization to support multiple ACL list Key: HADOOP-15222 URL: https://issues.apache.org/jira/browse/HADOOP-15222 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361506#comment-16361506 ] Ajay Kumar edited comment on HADOOP-15129 at 2/12/18 9:54 PM: -- {quote} The

[jira] [Commented] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361506#comment-16361506 ] Ajay Kumar commented on HADOOP-15129: - {quote} The local IP address for the connection is

[jira] [Commented] (HADOOP-15178) Generalize NetUtils#wrapException to handle other subclasses with String Constructor.

[ https://issues.apache.org/jira/browse/HADOOP-15178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361494#comment-16361494 ] Ajay Kumar commented on HADOOP-15178: - Rebased for trunk. > Generalize NetUtils#wrapException to

[jira] [Updated] (HADOOP-15178) Generalize NetUtils#wrapException to handle other subclasses with String Constructor.

[ https://issues.apache.org/jira/browse/HADOOP-15178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15178: Attachment: HADOOP-15178.003.patch > Generalize NetUtils#wrapException to handle other subclasses

[jira] [Commented] (HADOOP-15112) create-release didn't sign artifacts

[ https://issues.apache.org/jira/browse/HADOOP-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361434#comment-16361434 ] genericqa commented on HADOOP-15112: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14961. - Resolution: Duplicate Fixed by HADOOP-14816. > Docker failed to build yetus/hadoop:0de40f0:

[jira] [Reopened] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-14961: - > Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed >

[jira] [Updated] (HADOOP-15112) create-release didn't sign artifacts

[ https://issues.apache.org/jira/browse/HADOOP-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-15112: --- Status: Patch Available (was: Open) > create-release didn't sign artifacts >

[jira] [Updated] (HADOOP-15112) create-release didn't sign artifacts

[ https://issues.apache.org/jira/browse/HADOOP-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-15112: --- Attachment: HADOOP-15112.01.patch > create-release didn't sign artifacts >

[jira] [Commented] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361358#comment-16361358 ] Arpit Agarwal commented on HADOOP-15129: The test case {{testIpcFlakyHostResolution}} also lgtm.

[jira] [Comment Edited] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361358#comment-16361358 ] Arpit Agarwal edited comment on HADOOP-15129 at 2/12/18 7:53 PM: - The

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361272#comment-16361272 ] Arpit Agarwal commented on HADOOP-12897: The v5 patch looks good. One minor comment. We need

[jira] [Commented] (HADOOP-13551) hook up AwsSdkMetrics to hadoop metrics

[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361241#comment-16361241 ] Sean Mackrory commented on HADOOP-13551: I hadn't started on it, no. Do you know what kind of

[jira] [Commented] (HADOOP-15139) [Umbrella] Improvements and fixes for Hadoop shaded client work

[ https://issues.apache.org/jira/browse/HADOOP-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361199#comment-16361199 ] Bharat Viswanadham commented on HADOOP-15139: - Hi [~leftnoteasy] For this Umbrella Jira,

[jira] [Updated] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HADOOP-14961: - Committer of this patch, please set the *Fix Version/s* for this JIRA. >

[jira] [Created] (HADOOP-15221) Swift driver should not fail if JSONUtils reports UnknowPropertyException

Chen He created HADOOP-15221: Summary: Swift driver should not fail if JSONUtils reports UnknowPropertyException Key: HADOOP-15221 URL: https://issues.apache.org/jira/browse/HADOOP-15221 Project: Hadoop

[jira] [Commented] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361090#comment-16361090 ] Steve Loughran commented on HADOOP-15040: - Tested s3 ireland, s3guard on, all well +1 >

[jira] [Commented] (HADOOP-14603) S3A input stream to support ByteBufferReadable

[ https://issues.apache.org/jira/browse/HADOOP-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360973#comment-16360973 ] Keith Godwin Chapman commented on HADOOP-14603: --- [~ste...@apache.org] Do you have any

[jira] [Commented] (HADOOP-14831) Über-jira: S3a phase IV: Hadoop 3.1 features

[ https://issues.apache.org/jira/browse/HADOOP-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360946#comment-16360946 ] Wangda Tan commented on HADOOP-14831: - [~ste...@apache.org], thanks for splitting 3.1.0 and 3.2.0

[jira] [Commented] (HADOOP-14831) Über-jira: S3a phase IV: Hadoop 3.1 features

[ https://issues.apache.org/jira/browse/HADOOP-14831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360907#comment-16360907 ] Steve Loughran commented on HADOOP-14831: - I've just created a Hadoop 3.2 Uber JIRA

[jira] [Updated] (HADOOP-15040) Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation

[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15040: Summary: Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation (was:

[jira] [Commented] (HADOOP-15187) Remove ADL mock test dependency on REST call invoked from Java SDK

[ https://issues.apache.org/jira/browse/HADOOP-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360889#comment-16360889 ] Hudson commented on HADOOP-15187: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13644 (See

[jira] [Commented] (HADOOP-14661) S3A to support Requester Pays Buckets

[ https://issues.apache.org/jira/browse/HADOOP-14661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360887#comment-16360887 ] genericqa commented on HADOOP-14661: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (HADOOP-14975) S3AInputStream/OutputStream statistics aren't getting into StorageStatistics

[ https://issues.apache.org/jira/browse/HADOOP-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14975. - Resolution: Duplicate Duplicate of HADOOP-15161; that is fixed so closing this one >

[jira] [Updated] (HADOOP-13525) Optimize uses of FS operations in the ASF analysis frameworks and libraries

[ https://issues.apache.org/jira/browse/HADOOP-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13525: Parent: HADOOP-15220 (was: HADOOP-14831) > Optimize uses of FS operations in the ASF

[jira] [Updated] (HADOOP-14661) S3A to support Requester Pays Buckets

[ https://issues.apache.org/jira/browse/HADOOP-14661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14661: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A to support Requester Pays Buckets >

[jira] [Updated] (HADOOP-14833) Move s3a user:secret auth out of the main chain of auth mechanisms

[ https://issues.apache.org/jira/browse/HADOOP-14833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14833: Parent: HADOOP-15220 (was: HADOOP-14831) > Move s3a user:secret auth out of the main

[jira] [Updated] (HADOOP-13853) S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts

[ https://issues.apache.org/jira/browse/HADOOP-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13853: Parent: HADOOP-15220 (was: HADOOP-14831) > S3ADataBlocks.DiskBlock to lazy create dest

[jira] [Updated] (HADOOP-13330) s3a large subdir delete to do listObjects() and delete() calls in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13330: Parent: HADOOP-15220 (was: HADOOP-14831) > s3a large subdir delete to do listObjects()

[jira] [Updated] (HADOOP-13007) cherry pick s3 ehancements from PrestoS3FileSystem

[ https://issues.apache.org/jira/browse/HADOOP-13007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13007: Parent: HADOOP-15220 (was: HADOOP-14831) > cherry pick s3 ehancements from

[jira] [Updated] (HADOOP-15105) add htrace context to HTTP requests as ? parameter

[ https://issues.apache.org/jira/browse/HADOOP-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15105: Parent: HADOOP-15220 (was: HADOOP-14831) > add htrace context to HTTP requests as ?

[jira] [Updated] (HADOOP-14556) S3A to support Delegation Tokens

[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14556: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A to support Delegation Tokens >

[jira] [Updated] (HADOOP-13507) export s3a BlockingThreadPoolExecutorService pool info (size, load) as metrics

[ https://issues.apache.org/jira/browse/HADOOP-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13507: Parent: HADOOP-15220 (was: HADOOP-14831) > export s3a BlockingThreadPoolExecutorService

[jira] [Updated] (HADOOP-14093) add tests/docs for HAR files on s3a

[ https://issues.apache.org/jira/browse/HADOOP-14093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14093: Parent: HADOOP-15220 (was: HADOOP-14831) > add tests/docs for HAR files on s3a >

[jira] [Updated] (HADOOP-13611) FileSystem/s3a processDeleteOnExit to skip the exists() check

[ https://issues.apache.org/jira/browse/HADOOP-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13611: Parent: HADOOP-15220 (was: HADOOP-14831) > FileSystem/s3a processDeleteOnExit to skip

[jira] [Updated] (HADOOP-13704) S3A getContentSummary() to move to listFiles(recursive) to count children; instrument use

[ https://issues.apache.org/jira/browse/HADOOP-13704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13704: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A getContentSummary() to move to

[jira] [Updated] (HADOOP-13846) S3A to implement rename(final Path src, final Path dst, final Rename... options)

[ https://issues.apache.org/jira/browse/HADOOP-13846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13846: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A to implement rename(final Path src, final

[jira] [Updated] (HADOOP-13293) add a special 0 byte input stream for empty blobs

[ https://issues.apache.org/jira/browse/HADOOP-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13293: Parent: HADOOP-15220 (was: HADOOP-14831) > add a special 0 byte input stream for empty

[jira] [Updated] (HADOOP-13892) use s3 tags/headers to record permissions on objects, so preserving them through distcp round trips

[ https://issues.apache.org/jira/browse/HADOOP-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13892: Parent: HADOOP-15220 (was: HADOOP-14831) > use s3 tags/headers to record permissions on

[jira] [Updated] (HADOOP-13311) S3A shell entry point to support commands specific to S3A.

[ https://issues.apache.org/jira/browse/HADOOP-13311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13311: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A shell entry point to support commands

[jira] [Updated] (HADOOP-14132) Filesystem discovery to stop loading implementation classes

[ https://issues.apache.org/jira/browse/HADOOP-14132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14132: Parent: HADOOP-15220 (was: HADOOP-14831) > Filesystem discovery to stop loading

[jira] [Updated] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13600: Parent: HADOOP-15220 (was: HADOOP-14831) > S3a rename() to copy files in a directory in

[jira] [Updated] (HADOOP-15201) Automatically determine region & hence S3 endpoint of buckets

[ https://issues.apache.org/jira/browse/HADOOP-15201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15201: Parent: HADOOP-15220 (was: HADOOP-14831) > Automatically determine region & hence S3

[jira] [Updated] (HADOOP-14837) Handle S3A "glacier" data

[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14837: Parent: HADOOP-15220 (was: HADOOP-14831) > Handle S3A "glacier" data >

[jira] [Updated] (HADOOP-15135) S3a to support get/set permissions through S3 object tags

[ https://issues.apache.org/jira/browse/HADOOP-15135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15135: Parent: HADOOP-15220 (was: HADOOP-14831) > S3a to support get/set permissions through S3

[jira] [Updated] (HADOOP-14603) S3A input stream to support ByteBufferReadable

[ https://issues.apache.org/jira/browse/HADOOP-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14603: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A input stream to support

[jira] [Updated] (HADOOP-13695) S3A to use a thread pool for async path operations

[ https://issues.apache.org/jira/browse/HADOOP-13695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13695: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A to use a thread pool for async path

[jira] [Updated] (HADOOP-13407) s3a directory housekeeping operations to be done in async thread

[ https://issues.apache.org/jira/browse/HADOOP-13407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13407: Parent: HADOOP-15220 (was: HADOOP-14831) > s3a directory housekeeping operations to be

[jira] [Updated] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

[ https://issues.apache.org/jira/browse/HADOOP-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12020: Parent: HADOOP-15220 (was: HADOOP-14831) > Support AWS S3 reduced redundancy storage

[jira] [Updated] (HADOOP-13432) S3A: Consider using TransferManager.download for copyToLocalFile

[ https://issues.apache.org/jira/browse/HADOOP-13432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13432: Parent: HADOOP-15220 (was: HADOOP-14831) > S3A: Consider using TransferManager.download

[jira] [Updated] (HADOOP-14747) S3AInputStream to implement CanUnbuffer

[ https://issues.apache.org/jira/browse/HADOOP-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14747: Parent: HADOOP-15220 (was: HADOOP-14831) > S3AInputStream to implement CanUnbuffer >

[jira] [Resolved] (HADOOP-13974) S3Guard CLI to support list/purge of pending multipart commits

[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13974. - Resolution: Fixed > S3Guard CLI to support list/purge of pending multipart commits >

[jira] [Updated] (HADOOP-15187) Remove ADL mock test dependency on REST call invoked from Java SDK

[ https://issues.apache.org/jira/browse/HADOOP-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15187: Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-15187) Remove ADL mock test dependency on REST call invoked from Java SDK

[ https://issues.apache.org/jira/browse/HADOOP-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15187: Summary: Remove ADL mock test dependency on REST call invoked from Java SDK (was:

[jira] [Updated] (HADOOP-12949) Add HTrace to the s3a connector

[ https://issues.apache.org/jira/browse/HADOOP-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12949: Target Version/s: 3.2.0 (was: 3.1.0) pushing out 3.2, but still hoping to see some

[jira] [Updated] (HADOOP-12949) Add HTrace to the s3a connector

[ https://issues.apache.org/jira/browse/HADOOP-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-12949: Parent Issue: HADOOP-15220 (was: HADOOP-14831) > Add HTrace to the s3a connector >

[jira] [Commented] (HADOOP-14439) regression: secret stripping from S3x URIs breaks some downstream code

[ https://issues.apache.org/jira/browse/HADOOP-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360747#comment-16360747 ] Steve Loughran commented on HADOOP-14439: - [~vinayrpet] reviewing this, we've not had anyone

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Priority: Critical (was: Major) > extend per-bucket secret key config with explicit

[jira] [Resolved] (HADOOP-13892) use s3 tags/headers to record permissions on objects, so preserving them through distcp round trips

[ https://issues.apache.org/jira/browse/HADOOP-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13892. - Resolution: Won't Fix > use s3 tags/headers to record permissions on objects, so

[jira] [Commented] (HADOOP-13892) use s3 tags/headers to record permissions on objects, so preserving them through distcp round trips

[ https://issues.apache.org/jira/browse/HADOOP-13892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360737#comment-16360737 ] Steve Loughran commented on HADOOP-13892: - Given the need for xattrs, for full distcp we really

[jira] [Resolved] (HADOOP-13648) s3a home directory to be "/"

[ https://issues.apache.org/jira/browse/HADOOP-13648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13648. - Resolution: Won't Fix too late to fix this, I suspect > s3a home directory to be "/" >

[jira] [Updated] (HADOOP-13884) s3a create(overwrite=true) to only look for dir/ and list entries, not file

[ https://issues.apache.org/jira/browse/HADOOP-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13884: Parent Issue: HADOOP-15220 (was: HADOOP-14831) > s3a create(overwrite=true) to only look

[jira] [Commented] (HADOOP-13884) s3a create(overwrite=true) to only look for dir/ and list entries, not file

[ https://issues.apache.org/jira/browse/HADOOP-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360726#comment-16360726 ] Steve Loughran commented on HADOOP-13884: - * Moot for S3Guard * For raw S3, that initial HEAD

[jira] [Resolved] (HADOOP-13371) S3A globber to use bulk listObject call over recursive directory scan

[ https://issues.apache.org/jira/browse/HADOOP-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13371. - Resolution: Won't Fix > S3A globber to use bulk listObject call over recursive

[jira] [Commented] (HADOOP-13371) S3A globber to use bulk listObject call over recursive directory scan

[ https://issues.apache.org/jira/browse/HADOOP-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360718#comment-16360718 ] ASF GitHub Bot commented on HADOOP-13371: - Github user steveloughran commented on the issue:

[jira] [Commented] (HADOOP-13371) S3A globber to use bulk listObject call over recursive directory scan

[ https://issues.apache.org/jira/browse/HADOOP-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360716#comment-16360716 ] Steve Loughran commented on HADOOP-13371: - thinking of closing PR 204 and tagging this as a

[jira] [Commented] (HADOOP-13371) S3A globber to use bulk listObject call over recursive directory scan

[ https://issues.apache.org/jira/browse/HADOOP-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360717#comment-16360717 ] ASF GitHub Bot commented on HADOOP-13371: - Github user steveloughran closed the pull request at:

[jira] [Commented] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

[ https://issues.apache.org/jira/browse/HADOOP-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360706#comment-16360706 ] Steve Loughran commented on HADOOP-12020: - Would welcome this in Hadoop 3.1; keep test costs

[jira] [Updated] (HADOOP-14630) Contract Tests to verify create, mkdirs and rename under a file is forbidden

[ https://issues.apache.org/jira/browse/HADOOP-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14630: Priority: Major (was: Minor) > Contract Tests to verify create, mkdirs and rename under

[jira] [Commented] (HADOOP-13873) log DNS addresses on s3a init

[ https://issues.apache.org/jira/browse/HADOOP-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360705#comment-16360705 ] Steve Loughran commented on HADOOP-13873: - +list https proxy settings being picked up in

[jira] [Updated] (HADOOP-14707) AbstractContractDistCpTest to test attr preservation with -p, verify blobstores downgrade

[ https://issues.apache.org/jira/browse/HADOOP-14707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14707: Priority: Major (was: Minor) Target Version/s: 3.1.0 >

[jira] [Updated] (HADOOP-14556) S3A to support Delegation Tokens

[ https://issues.apache.org/jira/browse/HADOOP-14556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14556: Assignee: Steve Loughran Target Version/s: 3.2.0 (was: 3.1.0)

[jira] [Created] (HADOOP-15220) Über-jira: S3a phase V: Hadoop 3.2 features

Steve Loughran created HADOOP-15220: --- Summary: Über-jira: S3a phase V: Hadoop 3.2 features Key: HADOOP-15220 URL: https://issues.apache.org/jira/browse/HADOOP-15220 Project: Hadoop Common

[jira] [Updated] (HADOOP-13551) hook up AwsSdkMetrics to hadoop metrics

[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13551: Priority: Critical (was: Minor) Target Version/s: 3.1.0 uprating to major &

[jira] [Commented] (HADOOP-13551) hook up AwsSdkMetrics to hadoop metrics

[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360687#comment-16360687 ] Steve Loughran commented on HADOOP-13551: - Sean? Started this? I'd like to get it into 3.1 if

[jira] [Updated] (HADOOP-15040) Upgrade AWS SDK: NPE bug spams logs w/ Yarn Log Aggregation

[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15040: Priority: Blocker (was: Major) > Upgrade AWS SDK: NPE bug spams logs w/ Yarn Log

[jira] [Commented] (HADOOP-13308) S3A delete and rename may fail to preserve parent directory.

[ https://issues.apache.org/jira/browse/HADOOP-13308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360683#comment-16360683 ] Steve Loughran commented on HADOOP-13308: - I think we may just have to accept that this can

[jira] [Resolved] (HADOOP-14736) S3AInputStream to implement an efficient skip() call through seeking

[ https://issues.apache.org/jira/browse/HADOOP-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14736. - Resolution: Duplicate I should fix HADOOP-14606 instead of filing the same bug whenever

[jira] [Updated] (HADOOP-14606) S3AInputStream: Handle http stream skip(n) skipping < n bytes in a forward seek

[ https://issues.apache.org/jira/browse/HADOOP-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14606: Priority: Critical (was: Major) Target Version/s: 3.1.0 > S3AInputStream:

[jira] [Commented] (HADOOP-13330) s3a large subdir delete to do listObjects() and delete() calls in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360678#comment-16360678 ] Steve Loughran commented on HADOOP-13330: - it'll be fun handling failures in this world: if one

[jira] [Updated] (HADOOP-14396) Add builder interface to FileContext

[ https://issues.apache.org/jira/browse/HADOOP-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14396: Priority: Blocker (was: Major) > Add builder interface to FileContext >

  1   2   >