[jira] [Created] (HADOOP-15423) Use single hash Path -> tuple(DirListingMetadata, PathMetadata) in LocalMetadataStore

2018-04-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15423: --- Summary: Use single hash Path -> tuple(DirListingMetadata, PathMetadata) in LocalMetadataStore Key: HADOOP-15423 URL: https://issues.apache.org/jira/browse/HADOOP-15423

[jira] [Created] (HADOOP-15480) AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo

2018-05-18 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15480: --- Summary: AbstractS3GuardToolTestBase.testDiffCommand fails when using dynamo Key: HADOOP-15480 URL: https://issues.apache.org/jira/browse/HADOOP-15480 Project: Hadoop

[jira] [Created] (HADOOP-15511) ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence doTestRenameSequence

2018-06-04 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15511: --- Summary: ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence doTestRenameSequence Key: HADOOP-15511 URL:

[jira] [Resolved] (HADOOP-15511) ITestS3GuardListConsistency#testRollingRenames bad parameters passed to doTestRenameSequence

2018-06-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15511. - Resolution: Not A Problem Sorry for the noise on this, as it turns out the test is working as

[jira] [Reopened] (HADOOP-15382) Log kinit output in credential renewal thread

2018-05-03 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HADOOP-15382: - Backport to 2.7 (original issue reported to 2.7) > Log kinit output in credential renewal thread >

[jira] [Created] (HADOOP-15674) Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite

2018-08-15 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15674: --- Summary: Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite Key: HADOOP-15674 URL:

[jira] [Resolved] (HADOOP-15519) KMS fails to read the existing key metadata after upgrading to JDK 1.8u171

2018-08-17 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15519. - Resolution: Duplicate > KMS fails to read the existing key metadata after upgrading to JDK

[jira] [Created] (HADOOP-15622) UserGroupInformation TGT renewer refreshTime should be based on getNextTgtRenewalTime

2018-07-20 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15622: --- Summary: UserGroupInformation TGT renewer refreshTime should be based on getNextTgtRenewalTime Key: HADOOP-15622 URL: https://issues.apache.org/jira/browse/HADOOP-15622

[jira] [Created] (HADOOP-15709) Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants

2018-08-31 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15709: --- Summary: Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants Key: HADOOP-15709 URL: https://issues.apache.org/jira/browse/HADOOP-15709

[jira] [Created] (HADOOP-15604) Test for for unprocessed items in DynamoDB metadata store

2018-07-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15604: --- Summary: Test for for unprocessed items in DynamoDB metadata store Key: HADOOP-15604 URL: https://issues.apache.org/jira/browse/HADOOP-15604 Project: Hadoop Common

[jira] [Created] (HADOOP-15332) Fix typos in hadoop-aws markdown docs

2018-03-20 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15332: --- Summary: Fix typos in hadoop-aws markdown docs Key: HADOOP-15332 URL: https://issues.apache.org/jira/browse/HADOOP-15332 Project: Hadoop Common Issue Type:

[jira] [Created] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-09-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15796: --- Summary: ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled Key: HADOOP-15796 URL: https://issues.apache.org/jira/browse/HADOOP-15796

[jira] [Created] (HADOOP-15798) ITestS3GuardListConsistency#testConsistentListAfterDelete failing with LocalMetadataStore

2018-09-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15798: --- Summary: ITestS3GuardListConsistency#testConsistentListAfterDelete failing with LocalMetadataStore Key: HADOOP-15798 URL: https://issues.apache.org/jira/browse/HADOOP-15798

[jira] [Created] (HADOOP-15848) ITestS3AContractMultipartUploader#testMultipartUploadEmptyPart test failure

2018-10-12 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15848: --- Summary: ITestS3AContractMultipartUploader#testMultipartUploadEmptyPart test failure Key: HADOOP-15848 URL: https://issues.apache.org/jira/browse/HADOOP-15848 Project:

[jira] [Created] (HADOOP-15819) S3A integration test failures: FileSystem is closed! - without parallel test run

2018-10-04 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15819: --- Summary: S3A integration test failures: FileSystem is closed! - without parallel test run Key: HADOOP-15819 URL: https://issues.apache.org/jira/browse/HADOOP-15819

[jira] [Resolved] (HADOOP-15796) ClassCastException: S3AFileSystem cannot be cast to MockS3AFileSystem when fs caching is disabled

2018-12-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15796. - Resolution: Cannot Reproduce Closing this as I was not able to reproduce the issue during the

[jira] [Created] (HADOOP-15987) ITestDynamoDBMetadataStore should check if test ddb table set properly before the test

2018-12-07 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15987: --- Summary: ITestDynamoDBMetadataStore should check if test ddb table set properly before the test Key: HADOOP-15987 URL: https://issues.apache.org/jira/browse/HADOOP-15987

[jira] [Created] (HADOOP-15988) Set empty directory flag to TRUE in DynamoDBMetadataStore#innerGet when using authoritative mode

2018-12-07 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15988: --- Summary: Set empty directory flag to TRUE in DynamoDBMetadataStore#innerGet when using authoritative mode Key: HADOOP-15988 URL: https://issues.apache.org/jira/browse/HADOOP-15988

[jira] [Created] (HADOOP-15960) Update guava to 27.0-jre in hadoop-common

2018-11-29 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15960: --- Summary: Update guava to 27.0-jre in hadoop-common Key: HADOOP-15960 URL: https://issues.apache.org/jira/browse/HADOOP-15960 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-15947) Fix ITestDynamoDBMetadataStore test error issues

2018-11-25 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-15947: --- Summary: Fix ITestDynamoDBMetadataStore test error issues Key: HADOOP-15947 URL: https://issues.apache.org/jira/browse/HADOOP-15947 Project: Hadoop Common

[jira] [Created] (HADOOP-16027) [DOC] Effective use of FS instances during S3A integration tests

2019-01-04 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16027: --- Summary: [DOC] Effective use of FS instances during S3A integration tests Key: HADOOP-16027 URL: https://issues.apache.org/jira/browse/HADOOP-16027 Project: Hadoop

[jira] [Created] (HADOOP-16230) Corrcet findbug ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

2019-04-02 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16230: --- Summary: Corrcet findbug ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project Key: HADOOP-16230 URL:

[jira] [Resolved] (HADOOP-15780) S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

2019-03-29 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15780. - Resolution: Fixed > S3Guard: document how to deal with non-S3Guard processes writing data to

[jira] [Resolved] (HADOOP-16230) Correct findbug ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

2019-04-03 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16230. - Resolution: Won't Fix I'll resolve it as won't fix. I will fix this in HADOOP-16210. >

[jira] [Created] (HADOOP-16209) Create simple docker based pseudo-cluster for hdfs

2019-03-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16209: --- Summary: Create simple docker based pseudo-cluster for hdfs Key: HADOOP-16209 URL: https://issues.apache.org/jira/browse/HADOOP-16209 Project: Hadoop Common

[jira] [Created] (HADOOP-16210) Update guava to 27.0-jre in hadoop-project trunk

2019-03-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16210: --- Summary: Update guava to 27.0-jre in hadoop-project trunk Key: HADOOP-16210 URL: https://issues.apache.org/jira/browse/HADOOP-16210 Project: Hadoop Common

[jira] [Created] (HADOOP-16212) Update guava to 27.0-jre in hadoop-project branch-3.0

2019-03-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16212: --- Summary: Update guava to 27.0-jre in hadoop-project branch-3.0 Key: HADOOP-16212 URL: https://issues.apache.org/jira/browse/HADOOP-16212 Project: Hadoop Common

[jira] [Created] (HADOOP-16213) Update guava to 27.0-jre in hadoop-project branch-3.1

2019-03-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16213: --- Summary: Update guava to 27.0-jre in hadoop-project branch-3.1 Key: HADOOP-16213 URL: https://issues.apache.org/jira/browse/HADOOP-16213 Project: Hadoop Common

[jira] [Created] (HADOOP-16237) Fix new findbugs issues after update guava to 27.0-jre in hadoop-project trunk

2019-04-04 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16237: --- Summary: Fix new findbugs issues after update guava to 27.0-jre in hadoop-project trunk Key: HADOOP-16237 URL: https://issues.apache.org/jira/browse/HADOOP-16237

[jira] [Created] (HADOOP-16220) Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

2019-03-29 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16220: --- Summary: Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project Key: HADOOP-16220 URL: https://issues.apache.org/jira/browse/HADOOP-16220

[jira] [Created] (HADOOP-16211) Update guava to 27.0-jre in hadoop-project branch-3.2 and branch-3.1

2019-03-27 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16211: --- Summary: Update guava to 27.0-jre in hadoop-project branch-3.2 and branch-3.1 Key: HADOOP-16211 URL: https://issues.apache.org/jira/browse/HADOOP-16211 Project: Hadoop

[jira] [Created] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

2019-03-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16185: --- Summary: S3Guard: Optimize performance of handling OOB operations in non-authoritative mode Key: HADOOP-16185 URL: https://issues.apache.org/jira/browse/HADOOP-16185

[jira] [Created] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-03-13 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16184: --- Summary: S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker Key: HADOOP-16184 URL: https://issues.apache.org/jira/browse/HADOOP-16184

[jira] [Resolved] (HADOOP-16201) S3AFileSystem#innerMkdirs does not create parent directories

2019-03-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16201. - Resolution: Invalid > S3AFileSystem#innerMkdirs does not create parent directories >

[jira] [Resolved] (HADOOP-15272) Update Guava, see what breaks

2019-04-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15272. - Resolution: Fixed Fixed in HADOOP-16210. > Update Guava, see what breaks >

[jira] [Resolved] (HADOOP-15888) ITestDynamoDBMetadataStore can leak (large) DDB tables in test failures/timeout

2019-06-04 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15888. - Resolution: Workaround > ITestDynamoDBMetadataStore can leak (large) DDB tables in test >

[jira] [Reopened] (HADOOP-15888) ITestDynamoDBMetadataStore can leak (large) DDB tables in test failures/timeout

2019-06-06 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HADOOP-15888: - Reopened. This depends on HADOOP-15563 we will close when that is in. >

[jira] [Created] (HADOOP-16383) Pass ITtlTimeProvider instance in initialize method in MetadataStore interface

2019-06-20 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16383: --- Summary: Pass ITtlTimeProvider instance in initialize method in MetadataStore interface Key: HADOOP-16383 URL: https://issues.apache.org/jira/browse/HADOOP-16383

[jira] [Resolved] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

2019-06-18 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16184. - Resolution: Fixed > S3Guard: Handle OOB deletions and creation of a file which has a tombstone

[jira] [Created] (HADOOP-16326) S3Guard: Remove LocalMetadataStore

2019-05-23 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16326: --- Summary: S3Guard: Remove LocalMetadataStore Key: HADOOP-16326 URL: https://issues.apache.org/jira/browse/HADOOP-16326 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2019-05-20 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-14468. - Resolution: Fixed Release Note: Resolved this with HADOOP-15999 : fix for OOB operations.

[jira] [Created] (HADOOP-16280) S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened

2019-04-30 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16280: --- Summary: S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened Key: HADOOP-16280 URL: https://issues.apache.org/jira/browse/HADOOP-16280

[jira] [Created] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-04-30 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16279: --- Summary: S3Guard: Implement time-based (TTL) expiry for entries (and tombstones) Key: HADOOP-16279 URL: https://issues.apache.org/jira/browse/HADOOP-16279 Project:

[jira] [Created] (HADOOP-16426) S3Guard fsck: Implement fixing mechanism for inconsistencies between S3 and MetadataStore

2019-07-11 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16426: --- Summary: S3Guard fsck: Implement fixing mechanism for inconsistencies between S3 and MetadataStore Key: HADOOP-16426 URL: https://issues.apache.org/jira/browse/HADOOP-16426

[jira] [Created] (HADOOP-16425) S3Guard fsck: Export MetadataStore and S3 bucket hierarchy

2019-07-11 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16425: --- Summary: S3Guard fsck: Export MetadataStore and S3 bucket hierarchy Key: HADOOP-16425 URL: https://issues.apache.org/jira/browse/HADOOP-16425 Project: Hadoop Common

[jira] [Created] (HADOOP-16422) AbstractITCommitMRJob.testMRJob test failures

2019-07-11 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16422: --- Summary: AbstractITCommitMRJob.testMRJob test failures Key: HADOOP-16422 URL: https://issues.apache.org/jira/browse/HADOOP-16422 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16424) S3Guard fsck: Check internal consistency of the MetadataStore

2019-07-11 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16424: --- Summary: S3Guard fsck: Check internal consistency of the MetadataStore Key: HADOOP-16424 URL: https://issues.apache.org/jira/browse/HADOOP-16424 Project: Hadoop Common

[jira] [Created] (HADOOP-16423) S3Guarld fsck: Check metadata consistency between S3 and metadatastore (log)

2019-07-11 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16423: --- Summary: S3Guarld fsck: Check metadata consistency between S3 and metadatastore (log) Key: HADOOP-16423 URL: https://issues.apache.org/jira/browse/HADOOP-16423

[jira] [Resolved] (HADOOP-16409) Allow authoritative mode on non-qualified paths

2019-07-08 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16409. - Resolution: Fixed Fix Version/s: 3.3.0 > Allow authoritative mode on non-qualified

[jira] [Created] (HADOOP-16433) Filter expired entries and tombstones when listing with MetadataStore#listChildren

2019-07-16 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16433: --- Summary: Filter expired entries and tombstones when listing with MetadataStore#listChildren Key: HADOOP-16433 URL: https://issues.apache.org/jira/browse/HADOOP-16433

[jira] [Created] (HADOOP-16507) S3Guard fsck: Add option to configure severity (level) for the scan

2019-08-12 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16507: --- Summary: S3Guard fsck: Add option to configure severity (level) for the scan Key: HADOOP-16507 URL: https://issues.apache.org/jira/browse/HADOOP-16507 Project: Hadoop

[jira] [Resolved] (HADOOP-16500) S3ADelegationTokens to only log at debug on startup

2019-08-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16500. - Resolution: Fixed Fix Version/s: 3.3.0 Committed to trunk. > S3ADelegationTokens to

[jira] [Created] (HADOOP-16529) Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set from abfs.xml property

2019-08-22 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16529: --- Summary: Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set from abfs.xml property Key: HADOOP-16529 URL: https://issues.apache.org/jira/browse/HADOOP-16529

[jira] [Resolved] (HADOOP-16550) Spark config name error on the Launching Applications Using Docker Containers page

2019-09-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16550. - Resolution: Fixed > Spark config name error on the Launching Applications Using Docker

[jira] [Created] (HADOOP-16563) S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16563: --- Summary: S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it Key: HADOOP-16563 URL: https://issues.apache.org/jira/browse/HADOOP-16563

[jira] [Created] (HADOOP-16564) S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify)

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16564: --- Summary: S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify) Key: HADOOP-16564 URL: https://issues.apache.org/jira/browse/HADOOP-16564 Project: Hadoop

[jira] [Created] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16565: --- Summary: Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain." Key: HADOOP-16565 URL: https://issues.apache.org/jira/browse/HADOOP-16565

[jira] [Created] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16566: --- Summary: S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch Key: HADOOP-16566 URL: https://issues.apache.org/jira/browse/HADOOP-16566

[jira] [Resolved] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16566. - Resolution: Fixed > S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of >

[jira] [Resolved] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

2019-09-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16423. - Resolution: Fixed > S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log) >

[jira] [Reopened] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HADOOP-16565: - Reopened to add a message. > Fix "com.amazonaws.SdkClientException: Unable to find a region via

[jira] [Resolved] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

2019-09-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16565. - Resolution: Workaround > Fix "com.amazonaws.SdkClientException: Unable to find a region via

[jira] [Resolved] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16547. - Resolution: Fixed > s3guard prune command doesn't get AWS auth chain from FS >

[jira] [Created] (HADOOP-16476) Intermittent failure of ITestS3GuardConcurrentOps#testConcurrentTableCreations

2019-07-31 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16476: --- Summary: Intermittent failure of ITestS3GuardConcurrentOps#testConcurrentTableCreations Key: HADOOP-16476 URL: https://issues.apache.org/jira/browse/HADOOP-16476

[jira] [Created] (HADOOP-16483) S3Guarld fsck: Check metadata consistency from metadatastore to S3 (log)

2019-08-02 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16483: --- Summary: S3Guarld fsck: Check metadata consistency from metadatastore to S3 (log) Key: HADOOP-16483 URL: https://issues.apache.org/jira/browse/HADOOP-16483 Project:

[jira] [Created] (HADOOP-16502) Add fsck to S3A tests where additional diagnosis is needed

2019-08-09 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16502: --- Summary: Add fsck to S3A tests where additional diagnosis is needed Key: HADOOP-16502 URL: https://issues.apache.org/jira/browse/HADOOP-16502 Project: Hadoop Common

[jira] [Resolved] (HADOOP-16499) S3A retry policy to be exponential

2019-08-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16499. - Resolution: Fixed Fix Version/s: 3.3.0 Target Version/s: 3.3.0 > S3A retry

[jira] [Resolved] (HADOOP-16481) ITestS3GuardDDBRootOperations.test_300_MetastorePrune needs to set region

2019-08-09 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16481. - Resolution: Fixed Fix Version/s: 3.3.0 Target Version/s: 3.3.0 >

[jira] [Resolved] (HADOOP-16383) Pass ITtlTimeProvider instance in initialize method in MetadataStore interface

2019-07-17 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16383. - Resolution: Fixed Fix Version/s: 3.3.0 > Pass ITtlTimeProvider instance in initialize

[jira] [Created] (HADOOP-16436) Fix ITestS3GuardToolLocal#testInitNegativeRead test failure

2019-07-17 Thread Gabor Bota (JIRA)
Gabor Bota created HADOOP-16436: --- Summary: Fix ITestS3GuardToolLocal#testInitNegativeRead test failure Key: HADOOP-16436 URL: https://issues.apache.org/jira/browse/HADOOP-16436 Project: Hadoop Common

[jira] [Resolved] (HADOOP-15960) Update guava to 27.0-jre in hadoop-project

2019-06-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15960. - Resolution: Fixed All subtasks are resolved, guava updated on branches 3.0, 3.1, 3.2 and

[jira] [Resolved] (HADOOP-16729) Extract version numbers to head of pom.xml

2019-12-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16729. - Resolution: Fixed > Extract version numbers to head of pom.xml >

[jira] [Created] (HADOOP-16745) S3Guard fsck: Use enum instead of int for severity in violations

2019-12-04 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16745: --- Summary: S3Guard fsck: Use enum instead of int for severity in violations Key: HADOOP-16745 URL: https://issues.apache.org/jira/browse/HADOOP-16745 Project: Hadoop

[jira] [Resolved] (HADOOP-16424) S3Guard fsck: Check internal consistency of the MetadataStore

2019-12-10 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16424. - Resolution: Fixed Got +1 on #1691 from [~ste...@apache.org]. Committing. > S3Guard fsck:

[jira] [Resolved] (HADOOP-16450) ITestS3ACommitterFactory failing, S3 client is not inconsistent

2019-12-16 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16450. - Resolution: Fixed > ITestS3ACommitterFactory failing, S3 client is not inconsistent >

[jira] [Resolved] (HADOOP-16653) S3Guard DDB overreacts to no tag access

2019-10-28 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16653. - Resolution: Fixed > S3Guard DDB overreacts to no tag access >

[jira] [Resolved] (HADOOP-16709) S3Guard: Make authoritative mode exclusive for metadata - don't check for expiry for authoritative paths

2019-11-26 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16709. - Resolution: Fixed > S3Guard: Make authoritative mode exclusive for metadata - don't check for

[jira] [Resolved] (HADOOP-16484) S3A to warn or fail if S3Guard is disabled

2019-11-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16484. - Fix Version/s: 3.3.0 Target Version/s: 3.3.0 (was: 3.2.2) Resolution: Fixed

[jira] [Resolved] (HADOOP-16138) hadoop fs mkdir / of nonexistent abfs container raises NPE

2019-09-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16138. - Target Version/s: 3.3.0 Resolution: Fixed > hadoop fs mkdir / of nonexistent abfs

[jira] [Resolved] (HADOOP-16529) Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set from abfs.xml property

2019-09-25 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16529. - Resolution: Workaround > Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set

[jira] [Resolved] (HADOOP-16349) DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on retry

2019-10-11 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16349. - Resolution: Fixed > DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on retry

[jira] [Resolved] (HADOOP-16520) Race condition in DDB table init and waiting threads

2019-10-11 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16520. - Resolution: Fixed > Race condition in DDB table init and waiting threads >

[jira] [Created] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16860: --- Summary: Prune -tombstones to remove children entries Key: HADOOP-16860 URL: https://issues.apache.org/jira/browse/HADOOP-16860 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16860. - Resolution: Invalid > Prune -tombstones to remove children entries >

[jira] [Created] (HADOOP-16858) S3Guard fsck: Add option to prune orphaned entries

2020-02-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16858: --- Summary: S3Guard fsck: Add option to prune orphaned entries Key: HADOOP-16858 URL: https://issues.apache.org/jira/browse/HADOOP-16858 Project: Hadoop Common

[jira] [Created] (HADOOP-16904) ABFS test failures when running with a storage account without a hierarchical namespace

2020-03-04 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16904: --- Summary: ABFS test failures when running with a storage account without a hierarchical namespace Key: HADOOP-16904 URL: https://issues.apache.org/jira/browse/HADOOP-16904

[jira] [Created] (HADOOP-16878) Copy command in FileUtil to LOG at warn level if the source and destination is the same

2020-02-24 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16878: --- Summary: Copy command in FileUtil to LOG at warn level if the source and destination is the same Key: HADOOP-16878 URL: https://issues.apache.org/jira/browse/HADOOP-16878

[jira] [Resolved] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2020-03-03 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-14936. - Resolution: Fixed > S3Guard: remove "experimental" from documentation >

[jira] [Resolved] (HADOOP-16801) S3Guard queries S3 with recursive file listings

2020-01-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16801. - Resolution: Fixed > S3Guard queries S3 with recursive file listings >

[jira] [Resolved] (HADOOP-16832) S3Guard testing doc: Add required parameters for S3Guard testing in IDE

2020-02-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16832. - Resolution: Fixed > S3Guard testing doc: Add required parameters for S3Guard testing in IDE >

[jira] [Resolved] (HADOOP-16772) Extract version numbers to head of pom.xml (addendum)

2020-01-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16772. - Resolution: Fixed > Extract version numbers to head of pom.xml (addendum) >

[jira] [Created] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

2020-04-08 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16961: --- Summary: ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) Key: HADOOP-16961 URL: https://issues.apache.org/jira/browse/HADOOP-16961 Project: Hadoop

[jira] [Resolved] (HADOOP-16979) S3Guard auth mode should be set to false by default in integration tests.

2020-04-16 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16979. - Resolution: Fixed > S3Guard auth mode should be set to false by default in integration tests.

[jira] [Resolved] (HADOOP-16910) ABFS Streams to update FileSystem.Statistics counters on IO.

2020-03-31 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16910. - Resolution: Fixed > ABFS Streams to update FileSystem.Statistics counters on IO. >

[jira] [Resolved] (HADOOP-16858) S3Guard fsck: Add option to remove orphaned entries

2020-03-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16858. - Resolution: Fixed > S3Guard fsck: Add option to remove orphaned entries >

[jira] [Created] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-05-20 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17050: --- Summary: Add support for multiple delegation tokens in S3AFilesystem Key: HADOOP-17050 URL: https://issues.apache.org/jira/browse/HADOOP-17050 Project: Hadoop Common

[jira] [Created] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17454: --- Summary: [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 Key: HADOOP-17454 URL: https://issues.apache.org/jira/browse/HADOOP-17454 Project: Hadoop

[jira] [Resolved] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-17454. - Resolution: Fixed got +1 from Steve on PR, committed to trunk > [s3a] Disable bucket

[jira] [Resolved] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16995. - Resolution: Fixed got +1 from Steve on the PR, committed to trunk > ITestS3AConfiguration

[jira] [Created] (HADOOP-17455) [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir

2021-01-05 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17455: --- Summary: [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir Key: HADOOP-17455 URL: https://issues.apache.org/jira/browse/HADOOP-17455 Project:

  1   2   >