[jira] [Commented] (HADOOP-16878) FileUtil.copy() to throw IOException if the source and destination are the same

2021-05-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352444#comment-17352444 ] Gabor Bota commented on HADOOP-16878: - I think fixing the broken functionality would be better then

[jira] [Resolved] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16995. - Resolution: Fixed got +1 from Steve on the PR, committed to trunk > ITestS3AConfiguration

[jira] [Resolved] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-17454. - Resolution: Fixed got +1 from Steve on PR, committed to trunk > [s3a] Disable bucket

[jira] [Created] (HADOOP-17455) [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir

2021-01-05 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17455: --- Summary: [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir Key: HADOOP-17455 URL: https://issues.apache.org/jira/browse/HADOOP-17455 Project:

[jira] [Commented] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258861#comment-17258861 ] Gabor Bota commented on HADOOP-16995: - https://github.com/apache/hadoop/pull/2593 >

[jira] [Commented] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258860#comment-17258860 ] Gabor Bota commented on HADOOP-17454: - https://github.com/apache/hadoop/pull/2593 > [s3a] Disable

[jira] [Updated] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16995: Priority: Major (was: Minor) > ITestS3AConfiguration proxy tests fail when bucket probes == 0 >

[jira] [Work started] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17454 started by Gabor Bota. --- > [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 >

[jira] [Updated] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-17454: Description: Set the value of fs.s3a.bucket.probe to 0 by default. Bucket existence checks are

[jira] [Work started] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16995 started by Gabor Bota. --- > ITestS3AConfiguration proxy tests fail when bucket probes == 0 >

[jira] [Assigned] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16995: --- Assignee: Gabor Bota (was: Mukund Thakur) > ITestS3AConfiguration proxy tests fail when

[jira] [Updated] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-17454: Release Note: S3A bucket existence check is disabled (fs.s3a.bucket.probe is 0), so there will

[jira] [Commented] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258817#comment-17258817 ] Gabor Bota commented on HADOOP-17454: - cc [~ste...@apache.org] > [s3a] Disable bucket existence

[jira] [Updated] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-17454: Affects Version/s: 3.3.0 > [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 >

[jira] [Created] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

2021-01-05 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17454: --- Summary: [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 Key: HADOOP-17454 URL: https://issues.apache.org/jira/browse/HADOOP-17454 Project: Hadoop

[jira] [Updated] (HADOOP-16211) Update guava to 27.0-jre in hadoop-project branch-3.2

2020-09-14 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16211: Labels: incompatible (was: ) > Update guava to 27.0-jre in hadoop-project branch-3.2 >

[jira] [Commented] (HADOOP-16211) Update guava to 27.0-jre in hadoop-project branch-3.2

2020-09-14 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195447#comment-17195447 ] Gabor Bota commented on HADOOP-16211: - Sorry [~ayushtkn], I hope that did not do any damage, and it

[jira] [Commented] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-06-05 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126549#comment-17126549 ] Gabor Bota commented on HADOOP-17050: - so it will be the "in s3a" option from above > Add support

[jira] [Assigned] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-05-26 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-17050: --- Assignee: Steve Loughran (was: Gabor Bota) > Add support for multiple delegation tokens

[jira] [Created] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

2020-05-20 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-17050: --- Summary: Add support for multiple delegation tokens in S3AFilesystem Key: HADOOP-17050 URL: https://issues.apache.org/jira/browse/HADOOP-17050 Project: Hadoop Common

[jira] [Updated] (HADOOP-16193) add extra S3A MPU test to see what happens if a file is created during the MPU

2020-04-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16193: Fix Version/s: (was: 3.1.4) 3.1.5 > add extra S3A MPU test to see what

[jira] [Updated] (HADOOP-16917) Update dependency in branch-3.1

2020-04-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16917: Target Version/s: 3.1.5 (was: 3.1.4) > Update dependency in branch-3.1 >

[jira] [Commented] (HADOOP-16341) ShutDownHookManager: Regressed performance on Hook removals after HADOOP-15679

2020-04-22 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089427#comment-17089427 ] Gabor Bota commented on HADOOP-16341: - The hadoop release 3.1.4 code freeze is today

[jira] [Commented] (HADOOP-16917) Update dependency in branch-3.1

2020-04-22 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089421#comment-17089421 ] Gabor Bota commented on HADOOP-16917: - The hadoop release 3.1.4 code freeze is today

[jira] [Commented] (HADOOP-16193) add extra S3A MPU test to see what happens if a file is created during the MPU

2020-04-22 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089424#comment-17089424 ] Gabor Bota commented on HADOOP-16193: - The hadoop release 3.1.4 code freeze is today

[jira] [Assigned] (HADOOP-16473) S3Guard prune to only remove auth dir marker if files (not tombstones) are removed

2020-04-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16473: --- Assignee: (was: Gabor Bota) > S3Guard prune to only remove auth dir marker if files

[jira] [Work started] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

2020-04-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16961 started by Gabor Bota. --- > ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) >

[jira] [Assigned] (HADOOP-15489) S3Guard to self update on directory listings of S3

2020-04-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15489: --- Assignee: (was: Gabor Bota) > S3Guard to self update on directory listings of S3 >

[jira] [Assigned] (HADOOP-16063) Docker based pseudo-cluster definitions and test scripts for Hdfs/Yarn

2020-04-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16063: --- Assignee: (was: Gabor Bota) > Docker based pseudo-cluster definitions and test

[jira] [Assigned] (HADOOP-13980) S3Guard CLI: Add fsck check and fix commands

2020-04-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-13980: --- Assignee: (was: Gabor Bota) > S3Guard CLI: Add fsck check and fix commands >

[jira] [Resolved] (HADOOP-16979) S3Guard auth mode should be set to false by default in integration tests.

2020-04-16 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16979. - Resolution: Fixed > S3Guard auth mode should be set to false by default in integration tests.

[jira] [Commented] (HADOOP-16979) S3Guard auth mode should be set to false by default in integration tests.

2020-04-16 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084765#comment-17084765 ] Gabor Bota commented on HADOOP-16979: - LGTM +1, merging the PR #1958 > S3Guard auth mode should be

[jira] [Updated] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16961: Description: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) can improve the

[jira] [Created] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

2020-04-08 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16961: --- Summary: ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) Key: HADOOP-16961 URL: https://issues.apache.org/jira/browse/HADOOP-16961 Project: Hadoop

[jira] [Assigned] (HADOOP-16426) S3Guard fsck: Implement fixing mechanism for inconsistencies between S3 and MetadataStore

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16426: --- Assignee: (was: Gabor Bota) > S3Guard fsck: Implement fixing mechanism for

[jira] [Assigned] (HADOOP-14109) improvements to S3GuardTool destroy command

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14109: --- Assignee: (was: Gabor Bota) > improvements to S3GuardTool destroy command >

[jira] [Assigned] (HADOOP-14425) Add more s3guard metrics

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14425: --- Assignee: (was: Gabor Bota) > Add more s3guard metrics > > >

[jira] [Assigned] (HADOOP-15779) S3guard: add inconsistency detection metrics

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15779: --- Assignee: (was: Gabor Bota) > S3guard: add inconsistency detection metrics >

[jira] [Assigned] (HADOOP-16425) S3Guard fsck: Export MetadataStore and S3 bucket hierarchy

2020-04-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16425: --- Assignee: (was: Gabor Bota) > S3Guard fsck: Export MetadataStore and S3 bucket

[jira] [Commented] (HADOOP-16910) ABFS Streams to update FileSystem.Statistics counters on IO.

2020-03-31 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071751#comment-17071751 ] Gabor Bota commented on HADOOP-16910: - compile error fixed. committed. > ABFS Streams to update

[jira] [Resolved] (HADOOP-16910) ABFS Streams to update FileSystem.Statistics counters on IO.

2020-03-31 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16910. - Resolution: Fixed > ABFS Streams to update FileSystem.Statistics counters on IO. >

[jira] [Commented] (HADOOP-16878) Copy command in FileUtil to throw an exception if the source and destination is the same

2020-03-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071074#comment-17071074 ] Gabor Bota commented on HADOOP-16878: - Yeah, I already updated the PR with that, but I cannot see

[jira] [Commented] (HADOOP-16878) Copy command in FileUtil to throw an exception if the source and destination is the same

2020-03-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071038#comment-17071038 ] Gabor Bota commented on HADOOP-16878: - [~ayushtkn], I was not able to reproduce this test failure.

[jira] [Updated] (HADOOP-16878) Copy command in FileUtil to throw an exception if the source and destination is the same

2020-03-25 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16878: Status: Patch Available (was: In Progress) > Copy command in FileUtil to throw an exception if

[jira] [Commented] (HADOOP-16878) Copy command in FileUtil to throw an exception if the source and destination is the same

2020-03-25 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066757#comment-17066757 ] Gabor Bota commented on HADOOP-16878: - PR is up with the small change and test. > Copy command in

[jira] [Updated] (HADOOP-14918) Remove the Local Dynamo DB test option

2020-03-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14918: Resolution: Fixed Status: Resolved (was: Patch Available) > Remove the Local Dynamo DB

[jira] [Updated] (HADOOP-14918) Remove the Local Dynamo DB test option

2020-03-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14918: Fix Version/s: 2.10.1 > Remove the Local Dynamo DB test option >

[jira] [Commented] (HADOOP-14918) Remove the Local Dynamo DB test option

2020-03-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064787#comment-17064787 ] Gabor Bota commented on HADOOP-14918: - yes, I'm doing that. sorry for the delay. > Remove the

[jira] [Resolved] (HADOOP-16858) S3Guard fsck: Add option to remove orphaned entries

2020-03-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16858. - Resolution: Fixed > S3Guard fsck: Add option to remove orphaned entries >

[jira] [Commented] (HADOOP-16858) S3Guard fsck: Add option to remove orphaned entries

2020-03-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061655#comment-17061655 ] Gabor Bota commented on HADOOP-16858: - Got +1 from @stevel on PR #1851, merging. > S3Guard fsck:

[jira] [Updated] (HADOOP-16858) S3Guard fsck: Add option to remove orphaned entries

2020-03-18 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16858: Fix Version/s: 3.3.1 > S3Guard fsck: Add option to remove orphaned entries >

[jira] [Commented] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2020-03-09 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055096#comment-17055096 ] Gabor Bota commented on HADOOP-16769: - Sure, but there are some comments already in the PR which

[jira] [Updated] (HADOOP-16904) ABFS test failures when running with a storage account without a hierarchical namespace

2020-03-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16904: Component/s: fs/azure > ABFS test failures when running with a storage account without a

[jira] [Commented] (HADOOP-16904) ABFS test failures when running with a storage account without a hierarchical namespace

2020-03-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051359#comment-17051359 ] Gabor Bota commented on HADOOP-16904: - FYI [~ste...@apache.org] > ABFS test failures when running

[jira] [Created] (HADOOP-16904) ABFS test failures when running with a storage account without a hierarchical namespace

2020-03-04 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16904: --- Summary: ABFS test failures when running with a storage account without a hierarchical namespace Key: HADOOP-16904 URL: https://issues.apache.org/jira/browse/HADOOP-16904

[jira] [Commented] (HADOOP-16507) S3Guard fsck: Add option to configure severity (level) for the scan

2020-03-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051353#comment-17051353 ] Gabor Bota commented on HADOOP-16507: - Maybe worth to do this jira as well:

[jira] [Assigned] (HADOOP-16745) S3Guard fsck: Use enum instead of int for severity in violations

2020-03-04 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16745: --- Assignee: (was: Gabor Bota) > S3Guard fsck: Use enum instead of int for severity in

[jira] [Resolved] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2020-03-03 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-14936. - Resolution: Fixed > S3Guard: remove "experimental" from documentation >

[jira] [Assigned] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2020-02-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14936: --- Assignee: Gabor Bota (was: Steve Loughran) > S3Guard: remove "experimental" from

[jira] [Commented] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2020-02-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046741#comment-17046741 ] Gabor Bota commented on HADOOP-14936: - [~ste...@apache.org] asked me offline to add a PR for this.

[jira] [Work started] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2020-02-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-14936 started by Gabor Bota. --- > S3Guard: remove "experimental" from documentation >

[jira] [Comment Edited] (HADOOP-14918) Remove the Local Dynamo DB test option

2020-02-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046740#comment-17046740 ] Gabor Bota edited comment on HADOOP-14918 at 2/27/20 3:34 PM: -- Thanks for

[jira] [Commented] (HADOOP-14918) Remove the Local Dynamo DB test option

2020-02-27 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046740#comment-17046740 ] Gabor Bota commented on HADOOP-14918: - Thanks for [~jhung] for working on this. Could you create a

[jira] [Work started] (HADOOP-16878) Copy command in FileUtil to throw an exception if the source and destination is the same

2020-02-26 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16878 started by Gabor Bota. --- > Copy command in FileUtil to throw an exception if the source and destination

[jira] [Updated] (HADOOP-16878) Copy command in FileUtil to throw an exception if the source and destination is the same

2020-02-26 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16878: Summary: Copy command in FileUtil to throw an exception if the source and destination is the

[jira] [Commented] (HADOOP-16878) Copy command in FileUtil to LOG at warn level if the source and destination is the same

2020-02-26 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045544#comment-17045544 ] Gabor Bota commented on HADOOP-16878: - That is true, we should check for the fs as well not just

[jira] [Updated] (HADOOP-16878) Copy command in FileUtil to LOG at warn level if the source and destination is the same

2020-02-24 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16878: Description: We encountered an error during a test in our QE when the file destination and

[jira] [Updated] (HADOOP-16878) Copy command in FileUtil to LOG at warn level if the source and destination is the same

2020-02-24 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16878: Description: We encountered an error during a test in our QE when the file destination and

[jira] [Created] (HADOOP-16878) Copy command in FileUtil to LOG at warn level if the source and destination is the same

2020-02-24 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16878: --- Summary: Copy command in FileUtil to LOG at warn level if the source and destination is the same Key: HADOOP-16878 URL: https://issues.apache.org/jira/browse/HADOOP-16878

[jira] [Updated] (HADOOP-16222) Fix new deprecations after guava 27.0 update in trunk

2020-02-24 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16222: Fix Version/s: 3.3.0 > Fix new deprecations after guava 27.0 update in trunk >

[jira] [Commented] (HADOOP-16222) Fix new deprecations after guava 27.0 update in trunk

2020-02-24 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043370#comment-17043370 ] Gabor Bota commented on HADOOP-16222: - Done. > Fix new deprecations after guava 27.0 update in

[jira] [Updated] (HADOOP-13980) S3Guard CLI: Add fsck check and fix commands

2020-02-19 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-13980: Summary: S3Guard CLI: Add fsck check and fix commands (was: S3Guard CLI: Add fsck check

[jira] [Updated] (HADOOP-16858) S3Guard fsck: Add option to remove orphaned entries

2020-02-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16858: Summary: S3Guard fsck: Add option to remove orphaned entries (was: S3Guard fsck: Add option to

[jira] [Assigned] (HADOOP-16858) S3Guard fsck: Add option to prune orphaned entries

2020-02-14 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16858: --- Assignee: Gabor Bota > S3Guard fsck: Add option to prune orphaned entries >

[jira] [Work started] (HADOOP-16858) S3Guard fsck: Add option to prune orphaned entries

2020-02-14 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16858 started by Gabor Bota. --- > S3Guard fsck: Add option to prune orphaned entries >

[jira] [Commented] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036371#comment-17036371 ] Gabor Bota commented on HADOOP-16860: - We don't remove directories during prune. However, there are

[jira] [Resolved] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16860. - Resolution: Invalid > Prune -tombstones to remove children entries >

[jira] [Updated] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16860: Description: When you prune a directory in S3Guard the children entries are not pruned with the

[jira] [Updated] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16860: Description: When you prune a directory in S3Guard the children entries are not pruned with the

[jira] [Updated] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16860: Parent: HADOOP-15619 Issue Type: Sub-task (was: Bug) > Prune -tombstones to remove

[jira] [Created] (HADOOP-16860) Prune -tombstones to remove children entries

2020-02-13 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16860: --- Summary: Prune -tombstones to remove children entries Key: HADOOP-16860 URL: https://issues.apache.org/jira/browse/HADOOP-16860 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16858) S3Guard fsck: Add option to prune orphaned entries

2020-02-12 Thread Gabor Bota (Jira)
Gabor Bota created HADOOP-16858: --- Summary: S3Guard fsck: Add option to prune orphaned entries Key: HADOOP-16858 URL: https://issues.apache.org/jira/browse/HADOOP-16858 Project: Hadoop Common

[jira] [Assigned] (HADOOP-15964) Add S3A support for Async Scatter/Gather IO

2020-02-12 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15964: --- Assignee: Gabor Bota > Add S3A support for Async Scatter/Gather IO >

[jira] [Commented] (HADOOP-16848) add initial S3A layering + async init

2020-02-09 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033292#comment-17033292 ] Gabor Bota commented on HADOOP-16848: - Good idea, happy to do the review and help with the work. >

[jira] [Commented] (HADOOP-16832) S3Guard testing doc: Add required parameters for S3Guard testing in IDE

2020-02-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031612#comment-17031612 ] Gabor Bota commented on HADOOP-16832: - +1 on PR #1822, committing. > S3Guard testing doc: Add

[jira] [Resolved] (HADOOP-16832) S3Guard testing doc: Add required parameters for S3Guard testing in IDE

2020-02-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16832. - Resolution: Fixed > S3Guard testing doc: Add required parameters for S3Guard testing in IDE >

[jira] [Updated] (HADOOP-16832) S3Guard testing doc: Add required parameters for S3Guard testing in IDE

2020-02-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16832: Summary: S3Guard testing doc: Add required parameters for S3Guard testing in IDE (was:

[jira] [Updated] (HADOOP-16832) [S3Guard] Testing doc: Add required parameters for S3Guard testing in IDE

2020-02-06 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16832: Summary: [S3Guard] Testing doc: Add required parameters for S3Guard testing in IDE (was: Add

[jira] [Updated] (HADOOP-16801) S3Guard listFiles will not query S3 if all listings are authoritative

2020-01-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16801: Summary: S3Guard listFiles will not query S3 if all listings are authoritative (was: S3Guard

[jira] [Resolved] (HADOOP-16801) S3Guard queries S3 with recursive file listings

2020-01-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16801. - Resolution: Fixed > S3Guard queries S3 with recursive file listings >

[jira] [Commented] (HADOOP-16801) S3Guard queries S3 with recursive file listings

2020-01-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026559#comment-17026559 ] Gabor Bota commented on HADOOP-16801: - +1 on PR#1815, committing. > S3Guard queries S3 with

[jira] [Assigned] (HADOOP-16794) S3 Encryption is always using default region-specific AWS-managed KMS key

2020-01-30 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-16794: --- Assignee: Mukund Thakur > S3 Encryption is always using default region-specific

[jira] [Assigned] (HADOOP-16832) Add required parameters to be set in testing doc for S3Guard testing.

2020-01-30 Thread Gabor Bota (Jira)

[jira] [Commented] (HADOOP-16832) Add required parameters to be set in testing doc for S3Guard testing.

2020-01-29 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025762#comment-17025762 ] Gabor Bota commented on HADOOP-16832: - Please describe what are these parameters required for, and

[jira] [Updated] (HADOOP-16832) Add required parameters to be set in testing doc for S3Guard testing.

2020-01-29 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-16832: Summary: Add required parameters to be set in testing doc for S3Guard testing. (was: Add

[jira] [Commented] (HADOOP-16732) S3Guard to support encrypted DynamoDB table

2020-01-23 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022085#comment-17022085 ] Gabor Bota commented on HADOOP-16732: - +1 on PR #1752. Committing. > S3Guard to support encrypted

[jira] [Comment Edited] (HADOOP-16792) Let s3 clients configure request timeout

2020-01-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017943#comment-17017943 ] Gabor Bota edited comment on HADOOP-16792 at 1/17/20 12:42 PM: --- Yes,

[jira] [Commented] (HADOOP-16792) Let s3 clients configure request timeout

2020-01-17 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017943#comment-17017943 ] Gabor Bota commented on HADOOP-16792: - Yes, sure. > Let s3 clients configure request timeout >

[jira] [Commented] (HADOOP-16732) S3Guard to support encrypted DynamoDB table

2020-01-14 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015045#comment-17015045 ] Gabor Bota commented on HADOOP-16732: - [~liuml07], are you still working on this? I've done the

[jira] [Commented] (HADOOP-16772) Extract version numbers to head of pom.xml (addendum)

2020-01-08 Thread Gabor Bota (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010597#comment-17010597 ] Gabor Bota commented on HADOOP-16772: - I committed 1773 as well. Thanks for your contribution

  1   2   3   4   5   6   7   8   9   10   >