[jira] [Resolved] (HADOOP-19190) Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms

2024-06-03 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19190. Resolution: Fixed > Skip

[jira] [Created] (HADOOP-19190) Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms

2024-05-31 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19190: -- Summary: Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms Key: HADOOP-19190 URL:

[jira] [Resolved] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-05-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18679. Resolution: Fixed > Add API for bulk/paged delete of files and objects >

[jira] [Resolved] (HADOOP-19184) TestStagingCommitter.testJobCommitFailure failing

2024-05-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19184. Fix Version/s: 3.4.1 Resolution: Fixed >

[jira] [Created] (HADOOP-19184) TestStagingCommitter.testJobCommitFailure failing

2024-05-22 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19184: -- Summary: TestStagingCommitter.testJobCommitFailure failing Key: HADOOP-19184 URL: https://issues.apache.org/jira/browse/HADOOP-19184 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-15 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19013. Resolution: Fixed > fs.getXattrs(path) for S3FS doesn't have >

[jira] [Created] (HADOOP-19177) TestS3ACachingBlockManager fails intermittently in Yetus

2024-05-15 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19177: -- Summary: TestS3ACachingBlockManager fails intermittently in Yetus Key: HADOOP-19177 URL: https://issues.apache.org/jira/browse/HADOOP-19177 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19150. Fix Version/s: 3.4.1 Resolution: Fixed > Test

[jira] [Created] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19150: -- Summary: Test ITestAbfsRestOperationException#testAuthFailException is broken. Key: HADOOP-19150 URL: https://issues.apache.org/jira/browse/HADOOP-19150

[jira] [Created] (HADOOP-19149) ABFS: Implement ThreadLocal for ObjectMapper in AzureHttpOperation via config option with static shared instance as an alternative.

2024-04-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19149: -- Summary: ABFS: Implement ThreadLocal for ObjectMapper in AzureHttpOperation via config option with static shared instance as an alternative. Key: HADOOP-19149 URL:

[jira] [Created] (HADOOP-19110) ITestExponentialRetryPolicy failing in branch-3.4

2024-03-13 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19110: -- Summary: ITestExponentialRetryPolicy failing in branch-3.4 Key: HADOOP-19110 URL: https://issues.apache.org/jira/browse/HADOOP-19110 Project: Hadoop Common

[jira] [Created] (HADOOP-19106) [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE

2024-03-11 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19106: -- Summary: [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE Key: HADOOP-19106 URL: https://issues.apache.org/jira/browse/HADOOP-19106

[jira] [Created] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2023-12-19 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19015: -- Summary: Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool Key: HADOOP-19015 URL:

[jira] [Created] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2023-12-14 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19013: -- Summary: fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header. Key: HADOOP-19013 URL:

[jira] [Resolved] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18929. Fix Version/s: 3.3.9 Resolution: Fixed > Build failure while trying to create

[jira] [Reopened] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-10-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reopened HADOOP-18895: > upgrade to commons-compress 1.24.0 due to CVE >

[jira] [Created] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-10 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18929: -- Summary: Build failure while trying to create apache 3.3.7 release locally. Key: HADOOP-18929 URL: https://issues.apache.org/jira/browse/HADOOP-18929 Project:

[jira] [Resolved] (HADOOP-18845) Add ability to configure ConnectionTTL of http connections while creating S3 Client.

2023-08-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18845. Resolution: Fixed > Add ability to configure ConnectionTTL of http connections while

[jira] [Created] (HADOOP-18845) Add ability to configure ConnectionTTL of http connections while creating S3 Client.

2023-08-09 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18845: -- Summary: Add ability to configure ConnectionTTL of http connections while creating S3 Client. Key: HADOOP-18845 URL: https://issues.apache.org/jira/browse/HADOOP-18845

[jira] [Resolved] (HADOOP-18763) Upgrade aws-java-sdk to 1.12.367+

2023-06-14 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18763. Fix Version/s: 3.3.6 Resolution: Fixed > Upgrade aws-java-sdk to 1.12.367+ >

[jira] [Resolved] (HADOOP-18103) High performance vectored read API in Hadoop

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18103. Fix Version/s: 3.3.5 (was: 3.4.0) Resolution: Fixed > High

[jira] [Resolved] (HADOOP-18507) VectorIO FileRange type to support a "reference" field

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18507. Fix Version/s: 3.3.5 Resolution: Fixed > VectorIO FileRange type to support a

[jira] [Reopened] (HADOOP-11867) Add a high-performance vectored read API.

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reopened HADOOP-11867: > Add a high-performance vectored read API. > - > >

[jira] [Resolved] (HADOOP-11867) Add a high-performance vectored read API.

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-11867. Resolution: Fixed > Add a high-performance vectored read API. >

[jira] [Resolved] (HADOOP-18320) Improve S3A delegations token documentation

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18320. Fix Version/s: 3.3.9 Resolution: Fixed > Improve S3A delegations token

[jira] [Resolved] (HADOOP-18408) [ABFS]: ITestAbfsManifestCommitProtocol fails on nonHNS configuration

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18408. Resolution: Fixed > [ABFS]: ITestAbfsManifestCommitProtocol fails on nonHNS

[jira] [Resolved] (HADOOP-7370) Optimize pread on ChecksumFileSystem

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-7370. --- Resolution: Won't Fix Vectored IO superceedes this feature.  > Optimize pread on

[jira] [Resolved] (HADOOP-18347) Restrict vectoredIO threadpool to reduce memory pressure

2022-09-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18347. Fix Version/s: 3.3.5 Resolution: Fixed > Restrict vectoredIO threadpool to reduce

[jira] [Resolved] (HADOOP-18463) Add an integration test to process data asynchronously during vectored read.

2022-09-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18463. Fix Version/s: 3.3.5 Resolution: Fixed > Add an integration test to process data

[jira] [Created] (HADOOP-18470) Release hadoop 3.3.5

2022-09-27 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18470: -- Summary: Release hadoop 3.3.5 Key: HADOOP-18470 URL: https://issues.apache.org/jira/browse/HADOOP-18470 Project: Hadoop Common Issue Type: New Feature

[jira] [Created] (HADOOP-18463) Add an integration test process data asynchronously during vectored read.

2022-09-21 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18463: -- Summary: Add an integration test process data asynchronously during vectored read. Key: HADOOP-18463 URL: https://issues.apache.org/jira/browse/HADOOP-18463

[jira] [Resolved] (HADOOP-18455) s3a prefetching Executor should be closed

2022-09-21 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18455. Resolution: Fixed > s3a prefetching Executor should be closed >

[jira] [Resolved] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18439. Resolution: Fixed > Fix VectoredIO for LocalFileSystem when checksum is enabled. >

[jira] [Created] (HADOOP-18439) Fix VectoredIO for LocalFileSystem for small files.

2022-09-02 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18439: -- Summary: Fix VectoredIO for LocalFileSystem for small files. Key: HADOOP-18439 URL: https://issues.apache.org/jira/browse/HADOOP-18439 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18407) Improve vectored IO api spec.

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18407. Resolution: Fixed merged to branch-3.3 > Improve vectored IO api spec. >

[jira] [Resolved] (HADOOP-18391) Improve VectoredReadUtils#readVectored() for direct buffers

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18391. Resolution: Fixed merged to branch-3.3 > Improve VectoredReadUtils#readVectored() for

[jira] [Resolved] (HADOOP-18403) Fix FileSystem leak in ITestS3AAWSCredentialsProvider

2022-08-18 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18403. Fix Version/s: 3.3.9 Resolution: Fixed > Fix FileSystem leak in

[jira] [Created] (HADOOP-18407) Update vectored IO api spec.

2022-08-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18407: -- Summary: Update vectored IO api spec. Key: HADOOP-18407 URL: https://issues.apache.org/jira/browse/HADOOP-18407 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-18371) s3a FS init logs at warn if fs.s3a.create.storage.class is unset

2022-08-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18371. Resolution: Fixed > s3a FS init logs at warn if fs.s3a.create.storage.class is unset >

[jira] [Resolved] (HADOOP-18355) Update previous index properly while validating overlapping ranges.

2022-08-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18355. Resolution: Fixed > Update previous index properly while validating overlapping ranges.

[jira] [Resolved] (HADOOP-18392) Propagate vectored s3a input stream stats to file system stats.

2022-08-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18392. Resolution: Fixed > Propagate vectored s3a input stream stats to file system stats. >

[jira] [Resolved] (HADOOP-18227) Add input stream IOstats for vectored IO api in S3A.

2022-08-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18227. Resolution: Fixed > Add input stream IOstats for vectored IO api in S3A. >

[jira] [Resolved] (HADOOP-18353) HEAD OBJECT returns only 400 BAD REQUEST when token is expired

2022-08-05 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18353. Resolution: Information Provided > HEAD OBJECT returns only 400 BAD REQUEST when token

[jira] [Created] (HADOOP-18392) Propagate vectored s3a input stream stats to file system stats.

2022-08-04 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18392: -- Summary: Propagate vectored s3a input stream stats to file system stats. Key: HADOOP-18392 URL: https://issues.apache.org/jira/browse/HADOOP-18392 Project:

[jira] [Resolved] (HADOOP-18368) ITestCustomSigner fails when access point name has '-'

2022-08-01 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18368. Assignee: Ahmar Suhail Resolution: Fixed > ITestCustomSigner fails when access

[jira] [Created] (HADOOP-18355) Update previous index properly while validating overlapping ranges.

2022-07-22 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18355: -- Summary: Update previous index properly while validating overlapping ranges. Key: HADOOP-18355 URL: https://issues.apache.org/jira/browse/HADOOP-18355 Project:

[jira] [Created] (HADOOP-18353) HEAD OBJECT returns only 400 BAD REQUEST when token is expired

2022-07-20 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18353: -- Summary: HEAD OBJECT returns only 400 BAD REQUEST when token is expired Key: HADOOP-18353 URL: https://issues.apache.org/jira/browse/HADOOP-18353 Project: Hadoop

[jira] [Resolved] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2022-07-14 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18296. Resolution: Won't Fix > Memory fragmentation in ChecksumFileSystem Vectored IO

[jira] [Resolved] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-07-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18322. Resolution: Fixed > Yetus build failure in branch-3.3. >

[jira] [Created] (HADOOP-18322) Yetus build failure in branch-3.3.

2022-06-30 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18322: -- Summary: Yetus build failure in branch-3.3. Key: HADOOP-18322 URL: https://issues.apache.org/jira/browse/HADOOP-18322 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-18106) Handle memory fragmentation in S3 Vectored IO implementation.

2022-06-20 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18106. Resolution: Fixed > Handle memory fragmentation in S3 Vectored IO implementation. >

[jira] [Created] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2022-06-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18296: -- Summary: Memory fragmentation in ChecksumFileSystem Vectored IO implementation. Key: HADOOP-18296 URL: https://issues.apache.org/jira/browse/HADOOP-18296

[jira] [Resolved] (HADOOP-18107) Vectored IO support for large S3 files.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18107. Resolution: Fixed Merged in feature branch 

[jira] [Resolved] (HADOOP-18105) Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

2022-06-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18105. Resolution: Fixed Merged in feature branch 

[jira] [Created] (HADOOP-18227) Add IOstats for vectored IO api.

2022-05-06 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18227: -- Summary: Add IOstats for vectored IO api. Key: HADOOP-18227 URL: https://issues.apache.org/jira/browse/HADOOP-18227 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-04-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18104. Resolution: Fixed > Add configs to configure minSeekForVectorReads and

[jira] [Resolved] (HADOOP-18112) Implement paging during multi object delete.

2022-03-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18112. Resolution: Fixed > Implement paging during multi object delete. >

[jira] [Created] (HADOOP-18156) Java doc errors in classes like MarkerTool, S3ObjectAttributes etc

2022-03-08 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18156: -- Summary: Java doc errors in classes like MarkerTool, S3ObjectAttributes etc Key: HADOOP-18156 URL: https://issues.apache.org/jira/browse/HADOOP-18156 Project:

[jira] [Created] (HADOOP-18112) Rename operation fails during multi object delete of size more than 1000.

2022-02-03 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18112: -- Summary: Rename operation fails during multi object delete of size more than 1000. Key: HADOOP-18112 URL: https://issues.apache.org/jira/browse/HADOOP-18112

[jira] [Created] (HADOOP-18107) Vectored IO support for large S3 files.

2022-02-01 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18107: -- Summary: Vectored IO support for large S3 files. Key: HADOOP-18107 URL: https://issues.apache.org/jira/browse/HADOOP-18107 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-11867) Add a high-performance vectored read API.

2022-02-01 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-11867. Resolution: Done Merged in feature branch

[jira] [Created] (HADOOP-18106) Handle memory fragmentation in S3 Vectored IO implementation.

2022-02-01 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18106: -- Summary: Handle memory fragmentation in S3 Vectored IO implementation. Key: HADOOP-18106 URL: https://issues.apache.org/jira/browse/HADOOP-18106 Project: Hadoop

[jira] [Created] (HADOOP-18105) Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

2022-02-01 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18105: -- Summary: Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection. Key: HADOOP-18105 URL:

[jira] [Created] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-02-01 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18104: -- Summary: Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads Key: HADOOP-18104 URL: https://issues.apache.org/jira/browse/HADOOP-18104

[jira] [Created] (HADOOP-18103) High performance vectored read API in Hadoop

2022-02-01 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18103: -- Summary: High performance vectored read API in Hadoop Key: HADOOP-18103 URL: https://issues.apache.org/jira/browse/HADOOP-18103 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18076) S3Object must be closed/ref set to null in S3AInputStream.closeStream()

2022-01-24 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18076. Assignee: Mukund Thakur Resolution: Invalid After looking at the s3object one

[jira] [Created] (HADOOP-18076) WrappedStream and S3Object must be closed during S3AInputStream.close()

2022-01-10 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18076: -- Summary: WrappedStream and S3Object must be closed during S3AInputStream.close() Key: HADOOP-18076 URL: https://issues.apache.org/jira/browse/HADOOP-18076

[jira] [Resolved] (HADOOP-18065) ExecutorHelper.logThrowableFromAfterExecute() is too noisy.

2022-01-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18065. Resolution: Fixed > ExecutorHelper.logThrowableFromAfterExecute() is too noisy. >

[jira] [Created] (HADOOP-18065) ExecutorHelper.logThrowableFromAfterExecute() is too noisy.

2022-01-05 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18065: -- Summary: ExecutorHelper.logThrowableFromAfterExecute() is too noisy. Key: HADOOP-18065 URL: https://issues.apache.org/jira/browse/HADOOP-18065 Project: Hadoop

[jira] [Resolved] (HADOOP-18016) Make certain methods LimitedPrivate in S3AUtils.java

2021-11-24 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18016. Resolution: Fixed > Make certain methods LimitedPrivate in S3AUtils.java >

[jira] [Resolved] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18002. Resolution: Fixed > abfs rename idempotency broken -remove recovery >

[jira] [Created] (HADOOP-17949) Improve logging for abfs rename failures.

2021-10-01 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17949: -- Summary: Improve logging for abfs rename failures. Key: HADOOP-17949 URL: https://issues.apache.org/jira/browse/HADOOP-17949 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17156) Clear abfs readahead requests on stream close

2021-09-07 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17156. Resolution: Fixed > Clear abfs readahead requests on stream close >

[jira] [Resolved] (HADOOP-17250) ABFS: Random read perf improvement

2021-07-05 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17250. Resolution: Fixed > ABFS: Random read perf improvement >

[jira] [Resolved] (HADOOP-17400) Optimize S3A for maximum performance in directory listings

2021-05-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17400. Resolution: Fixed > Optimize S3A for maximum performance in directory listings >

[jira] [Resolved] (HADOOP-17335) s3a listing operation will fail in async prefetch if fs closed

2021-05-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17335. Resolution: Cannot Reproduce > s3a listing operation will fail in async prefetch if fs

[jira] [Created] (HADOOP-17521) Pass exception to the caller in AbfsClient#appendSASTokenToQuery

2021-02-09 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17521: -- Summary: Pass exception to the caller in AbfsClient#appendSASTokenToQuery Key: HADOOP-17521 URL: https://issues.apache.org/jira/browse/HADOOP-17521 Project:

[jira] [Resolved] (HADOOP-16507) S3Guard fsck: Add option to configure severity (level) for the scan

2021-02-02 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-16507. Resolution: Won't Fix > S3Guard fsck: Add option to configure severity (level) for the

[jira] [Created] (HADOOP-17457) Seeing test ITestS3AInconsistency.testGetFileStatus failure.

2021-01-05 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17457: -- Summary: Seeing test ITestS3AInconsistency.testGetFileStatus failure. Key: HADOOP-17457 URL: https://issues.apache.org/jira/browse/HADOOP-17457 Project: Hadoop

[jira] [Created] (HADOOP-17398) Integration test failures because of HADOOP-17323

2020-11-26 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17398: -- Summary: Integration test failures because of HADOOP-17323 Key: HADOOP-17398 URL: https://issues.apache.org/jira/browse/HADOOP-17398 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17323) s3a getFileStatus("/") to skip IO

2020-11-24 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17323. Resolution: Fixed > s3a getFileStatus("/") to skip IO >

[jira] [Resolved] (HADOOP-17305) ITestCustomSigner fails with gcs s3 compatible endpoint.

2020-11-01 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-17305. Resolution: Fixed > ITestCustomSigner fails with gcs s3 compatible endpoint. >

[jira] [Created] (HADOOP-17305) ITestCustomSigner fails with gcs s3 compatible endpoint.

2020-10-14 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17305: -- Summary: ITestCustomSigner fails with gcs s3 compatible endpoint. Key: HADOOP-17305 URL: https://issues.apache.org/jira/browse/HADOOP-17305 Project: Hadoop

[jira] [Created] (HADOOP-17303) TestWebHDFS.testLargeDirectory faling because of HADOOP-17281

2020-10-12 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17303: -- Summary: TestWebHDFS.testLargeDirectory faling because of HADOOP-17281 Key: HADOOP-17303 URL: https://issues.apache.org/jira/browse/HADOOP-17303 Project: Hadoop

[jira] [Created] (HADOOP-17300) FileSystem.DirListingIterator.next() call should return NoSuchElementException

2020-10-06 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17300: -- Summary: FileSystem.DirListingIterator.next() call should return NoSuchElementException Key: HADOOP-17300 URL: https://issues.apache.org/jira/browse/HADOOP-17300

[jira] [Created] (HADOOP-17281) Implement FileSystem.listStatusIterator() in S3aFileSystem

2020-09-23 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17281: -- Summary: Implement FileSystem.listStatusIterator() in S3aFileSystem Key: HADOOP-17281 URL: https://issues.apache.org/jira/browse/HADOOP-17281 Project: Hadoop

[jira] [Created] (HADOOP-17192) ITestS3AHugeFilesSSECDiskBlock failing because of bucket overrides

2020-08-07 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17192: -- Summary: ITestS3AHugeFilesSSECDiskBlock failing because of bucket overrides Key: HADOOP-17192 URL: https://issues.apache.org/jira/browse/HADOOP-17192 Project:

[jira] [Created] (HADOOP-17190) ITestTerasortOnS3A.test_120_terasort failing

2020-08-06 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17190: -- Summary: ITestTerasortOnS3A.test_120_terasort failing Key: HADOOP-17190 URL: https://issues.apache.org/jira/browse/HADOOP-17190 Project: Hadoop Common

[jira] [Created] (HADOOP-17136) ITestS3ADirectoryPerformance.testListOperations failing

2020-07-17 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17136: -- Summary: ITestS3ADirectoryPerformance.testListOperations failing Key: HADOOP-17136 URL: https://issues.apache.org/jira/browse/HADOOP-17136 Project: Hadoop Common

[jira] [Created] (HADOOP-17131) Update listing to use OperationCallback for calling s3a apis.

2020-07-15 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17131: -- Summary: Update listing to use OperationCallback for calling s3a apis. Key: HADOOP-17131 URL: https://issues.apache.org/jira/browse/HADOOP-17131 Project: Hadoop

[jira] [Created] (HADOOP-17130) Configuration.getValByRegex() shouldn't be updating the results while fetching.

2020-07-15 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17130: -- Summary: Configuration.getValByRegex() shouldn't be updating the results while fetching. Key: HADOOP-17130 URL: https://issues.apache.org/jira/browse/HADOOP-17130

[jira] [Created] (HADOOP-17074) Optimise Listing to be fully asynchronous.

2020-06-17 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17074: -- Summary: Optimise Listing to be fully asynchronous. Key: HADOOP-17074 URL: https://issues.apache.org/jira/browse/HADOOP-17074 Project: Hadoop Common

[jira] [Resolved] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2020-05-14 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-16965. Resolution: Fixed > Introduce StreamContext for Abfs Input and Output streams. >

[jira] [Created] (HADOOP-17023) Tune listStatus() api of s3a.

2020-04-30 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17023: -- Summary: Tune listStatus() api of s3a. Key: HADOOP-17023 URL: https://issues.apache.org/jira/browse/HADOOP-17023 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-17022) Tune listFiles() api.

2020-04-30 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-17022: -- Summary: Tune listFiles() api. Key: HADOOP-17022 URL: https://issues.apache.org/jira/browse/HADOOP-17022 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-16979) S3Guard auth mode should be set to false by default in integration tests.

2020-04-13 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-16979: -- Summary: S3Guard auth mode should be set to false by default in integration tests. Key: HADOOP-16979 URL: https://issues.apache.org/jira/browse/HADOOP-16979

[jira] [Created] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2020-04-09 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-16965: -- Summary: Introduce StreamContext for Abfs Input and Output streams. Key: HADOOP-16965 URL: https://issues.apache.org/jira/browse/HADOOP-16965 Project: Hadoop

[jira] [Created] (HADOOP-16937) Multiple Tests failure in hadoop-azure componnt

2020-03-24 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-16937: -- Summary: Multiple Tests failure in hadoop-azure componnt Key: HADOOP-16937 URL: https://issues.apache.org/jira/browse/HADOOP-16937 Project: Hadoop Common

[jira] [Created] (HADOOP-16832) Add required parameters to be set in testing doc for S3Gurad testing.

2020-01-28 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-16832: -- Summary: Add required parameters to be set in testing doc for S3Gurad testing. Key: HADOOP-16832 URL: https://issues.apache.org/jira/browse/HADOOP-16832 Project:

[jira] [Created] (HADOOP-16794) S3 Encryption is always using default region-specific AWS-managed KMS key

2020-01-08 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-16794: -- Summary: S3 Encryption is always using default region-specific AWS-managed KMS key Key: HADOOP-16794 URL: https://issues.apache.org/jira/browse/HADOOP-16794

  1   2   >