[jira] [Resolved] (HADOOP-16995) ITestS3AConfiguration proxy tests fail when bucket probes == 0

[ https://issues.apache.org/jira/browse/HADOOP-16995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16995. - Resolution: Fixed got +1 from Steve on the PR, committed to trunk > ITestS3AConfigurat

[jira] [Resolved] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

[ https://issues.apache.org/jira/browse/HADOOP-17454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-17454. - Resolution: Fixed got +1 from Steve on PR, committed to trunk > [s3a] Disable buc

[jira] [Created] (HADOOP-17455) [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir

Gabor Bota created HADOOP-17455: --- Summary: [s3a] Intermittent failure of ITestS3ADeleteCost.testDeleteSingleFileInDir Key: HADOOP-17455 URL: https://issues.apache.org/jira/browse/HADOOP-17455 Project

[jira] [Created] (HADOOP-17454) [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0

Gabor Bota created HADOOP-17454: --- Summary: [s3a] Disable bucket existence check - set fs.s3a.bucket.probe to 0 Key: HADOOP-17454 URL: https://issues.apache.org/jira/browse/HADOOP-17454 Project: Hadoop

[ANNOUNCE] Apache Hadoop 3.1.4 release

://hadoop.apache.org/docs/r3.1.4/hadoop-project-dist/hadoop-common/release/3.1.4/RELEASENOTES.3.1.4.html [4] https://hadoop.apache.org/releases.html Regards, Gabor Bota

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

, 2020 at 11:08 AM Gabor Bota wrote: > > Hi All, > > With 6 binding and 1 non-binding +1s and no -1s the vote for Apache > hadoop-3.1.4 Release passes. > > Thank you everybody for contributing to the release, testing, and voting. > > Binding +1s: > - Masatake Iwasak

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)

eragen with automatic tests [1] > * checked "hadoop version" and compared with git revision > * checked if the staging repository contains src packages > > > Thanks the work (and the toughness) Gabor Bota. > > Marton > > > [1]: https://github.com/elek/ozo

[VOTE] Release Apache Hadoop 3.1.4 (RC4)

Hi folks, I have put together a release candidate (RC4) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix for HDFS-15313. Ensure inodes in active filesystem are not deleted during snapshot delete * fix for YARN-10347. Fix double locking in

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC3)

Thank you all for the suggestions and testing. As there's a data loss issue in the release, I've created a new RC with the patch included. I'll send the update soon. Regards, Gabor Bota On Thu, Jul 16, 2020 at 1:29 PM Stephen O'Donnell wrote: > > Hi Gabor, > > We recently discovered

[VOTE] Release Apache Hadoop 3.1.4 (RC3)

Hi folks, I have put together a release candidate (RC3) for Hadoop 3.1.4. * The RC includes in addition to the previous ones: * fix of YARN-10347. Fix double locking in CapacityScheduler#reinitialize in branch-3.1 (https://issues.apache.org/jira/browse/YARN-10347) * the revert of HDFS-14941,

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC2)

Yes, sure. I'll do another RC for next week. Thank you all for working on this! On Thu, Jul 9, 2020 at 8:20 AM Masatake Iwasaki wrote: > > Hi Gabor Bota, > > I committed the fix of YARN-10347 to branch-3.1. > I think this should be blocker for 3.1.4. > Could you cherry-pick

[VOTE] Release Apache Hadoop 3.1.4 (RC2)

Hi folks, I have put together a release candidate (RC2) for Hadoop 3.1.4. The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC2/ The RC tag in git is here: https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC2 The maven artifacts are staged at

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

ase include : HDFS-15323 as well if possible. > > https://issues.apache.org/jira/browse/HDFS-15323 > > Remember tagging you there but at that time RC0 was up, try if that could > make into the release as well. > > Thanx!!! > -Ayush > > On Wed, 24 Jun 2020 at 16:16, Gabor B

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

you for your work! > > > > Kihwal reported IBR leak in standby NameNode: > > https://issues.apache.org/jira/browse/HDFS-15421. > > I think this is a blocker and this affects 3.1.4-RC1. Would you check this? > > > > Best regards, > > Akira > > > > On Mo

[VOTE] Release Apache Hadoop 3.1.4 (RC1)

Hi folks, I have put together a release candidate (RC1) for Hadoop 3.1.4. The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC1/ The RC tag in git is here: https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC1 The maven artifacts are staged at

[jira] [Created] (HADOOP-17050) Add support for multiple delegation tokens in S3AFilesystem

Gabor Bota created HADOOP-17050: --- Summary: Add support for multiple delegation tokens in S3AFilesystem Key: HADOOP-17050 URL: https://issues.apache.org/jira/browse/HADOOP-17050 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC0)

eys only. And abfs tests work fine in the current > trunk branch with my same azure-auth-keys.xml file. > Fyi: I am running mvn -T 1C -Dparallel-tests=abfs clean verify > *One thing I noticed here is , in this branch there are no ABFS related > classes.* > > @Gabor Bota

[VOTE] Release Apache Hadoop 3.1.4 (RC0)

Hi folks, I have put together a release candidate (RC0) for Hadoop 3.1.4. The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC0/ The RC tag in git is here: https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC0 The maven artifacts are staged at

Signing hadoop releases

Hi common-dev, I'm the RM for hadoop 3.1.4 release and today I was able to build the release artifacts, but I need to sign it before staging them to the open. I was following the docs under https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease, but the page does describe how to

[jira] [Resolved] (HADOOP-16979) S3Guard auth mode should be set to false by default in integration tests.

[ https://issues.apache.org/jira/browse/HADOOP-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16979. - Resolution: Fixed > S3Guard auth mode should be set to false by default in integration te

[jira] [Created] (HADOOP-16961) ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics)

Gabor Bota created HADOOP-16961: --- Summary: ABFS: Adding metrics to AbfsInputStream (AbfsInputStreamStatistics) Key: HADOOP-16961 URL: https://issues.apache.org/jira/browse/HADOOP-16961 Project: Hadoop

[jira] [Resolved] (HADOOP-16910) ABFS Streams to update FileSystem.Statistics counters on IO.

[ https://issues.apache.org/jira/browse/HADOOP-16910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16910. - Resolution: Fixed > ABFS Streams to update FileSystem.Statistics counters on

[jira] [Resolved] (HADOOP-16858) S3Guard fsck: Add option to remove orphaned entries

[ https://issues.apache.org/jira/browse/HADOOP-16858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16858. - Resolution: Fixed > S3Guard fsck: Add option to remove orphaned entr

[jira] [Created] (HADOOP-16904) ABFS test failures when running with a storage account without a hierarchical namespace

Gabor Bota created HADOOP-16904: --- Summary: ABFS test failures when running with a storage account without a hierarchical namespace Key: HADOOP-16904 URL: https://issues.apache.org/jira/browse/HADOOP-16904

[jira] [Resolved] (HADOOP-14936) S3Guard: remove "experimental" from documentation

[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-14936. - Resolution: Fixed > S3Guard: remove "experimental" from

[jira] [Created] (HADOOP-16878) Copy command in FileUtil to LOG at warn level if the source and destination is the same

Gabor Bota created HADOOP-16878: --- Summary: Copy command in FileUtil to LOG at warn level if the source and destination is the same Key: HADOOP-16878 URL: https://issues.apache.org/jira/browse/HADOOP-16878

[jira] [Resolved] (HADOOP-16860) Prune -tombstones to remove children entries

[ https://issues.apache.org/jira/browse/HADOOP-16860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16860. - Resolution: Invalid > Prune -tombstones to remove children entr

[jira] [Created] (HADOOP-16860) Prune -tombstones to remove children entries

Gabor Bota created HADOOP-16860: --- Summary: Prune -tombstones to remove children entries Key: HADOOP-16860 URL: https://issues.apache.org/jira/browse/HADOOP-16860 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16858) S3Guard fsck: Add option to prune orphaned entries

Gabor Bota created HADOOP-16858: --- Summary: S3Guard fsck: Add option to prune orphaned entries Key: HADOOP-16858 URL: https://issues.apache.org/jira/browse/HADOOP-16858 Project: Hadoop Common

[jira] [Resolved] (HADOOP-16832) S3Guard testing doc: Add required parameters for S3Guard testing in IDE

[ https://issues.apache.org/jira/browse/HADOOP-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16832. - Resolution: Fixed > S3Guard testing doc: Add required parameters for S3Guard testing in

[jira] [Resolved] (HADOOP-16801) S3Guard queries S3 with recursive file listings

[ https://issues.apache.org/jira/browse/HADOOP-16801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16801. - Resolution: Fixed > S3Guard queries S3 with recursive file listi

Hadoop 3.1.4 Release Plan Proposal

d timeline for the release is the following: * Feature Freeze Date: Wednesday, 11 March 2020 * Code Freeze Date: Wednesday, 22 April 2020 * Release Date: Wednesday, 29 April 2020 Please let me know if you have any suggestions. Regards, Gabor Bota References: [1] project in (HADOOP, MAPREDUCE,

Re: [DISCUSS] Hadoop 2019 Release Planning

> > have > > > bandwidth to help releases, I think we can do 3.2.2 first then 3.1.4. > > > > > > Thoughts? > > > - Wangda > > > > > > On Mon, Jan 6, 2020 at 5:50 AM Brahma Reddy Battula > > > > wrote: > > > > > >&

[jira] [Resolved] (HADOOP-16772) Extract version numbers to head of pom.xml (addendum)

[ https://issues.apache.org/jira/browse/HADOOP-16772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16772. - Resolution: Fixed > Extract version numbers to head of pom.xml (adden

Re: [DISCUSS] Hadoop 2019 Release Planning

I'm interested in doing a release of hadoop. The version we need an RM is 3.1.3 right? What's the target date for that? Thanks, Gabor On Mon, Jan 6, 2020 at 8:31 AM Akira Ajisaka wrote: > Thank you Wangda. > > Now it's 2020. Let's release Hadoop 3.3.0. > I created a wiki page for tracking

[jira] [Resolved] (HADOOP-16450) ITestS3ACommitterFactory failing, S3 client is not inconsistent

[ https://issues.apache.org/jira/browse/HADOOP-16450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16450. - Resolution: Fixed > ITestS3ACommitterFactory failing, S3 client is not inconsist

[jira] [Resolved] (HADOOP-16424) S3Guard fsck: Check internal consistency of the MetadataStore

[ https://issues.apache.org/jira/browse/HADOOP-16424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16424. - Resolution: Fixed Got +1 on #1691 from [~ste...@apache.org]. Committing. > S3Guard f

[jira] [Created] (HADOOP-16745) S3Guard fsck: Use enum instead of int for severity in violations

Gabor Bota created HADOOP-16745: --- Summary: S3Guard fsck: Use enum instead of int for severity in violations Key: HADOOP-16745 URL: https://issues.apache.org/jira/browse/HADOOP-16745 Project: Hadoop

[jira] [Resolved] (HADOOP-16729) Extract version numbers to head of pom.xml

[ https://issues.apache.org/jira/browse/HADOOP-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16729. - Resolution: Fixed > Extract version numbers to head of pom.

[jira] [Resolved] (HADOOP-16709) S3Guard: Make authoritative mode exclusive for metadata - don't check for expiry for authoritative paths

[ https://issues.apache.org/jira/browse/HADOOP-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16709. - Resolution: Fixed > S3Guard: Make authoritative mode exclusive for metadata - don't ch

[jira] [Resolved] (HADOOP-16484) S3A to warn or fail if S3Guard is disabled

[ https://issues.apache.org/jira/browse/HADOOP-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16484. - Fix Version/s: 3.3.0 Target Version/s: 3.3.0 (was: 3.2.2) Resolution: Fixed

[jira] [Resolved] (HADOOP-16653) S3Guard DDB overreacts to no tag access

[ https://issues.apache.org/jira/browse/HADOOP-16653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16653. - Resolution: Fixed > S3Guard DDB overreacts to no tag acc

[jira] [Resolved] (HADOOP-16520) Race condition in DDB table init and waiting threads

[ https://issues.apache.org/jira/browse/HADOOP-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16520. - Resolution: Fixed > Race condition in DDB table init and waiting thre

[jira] [Resolved] (HADOOP-16349) DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on retry

[ https://issues.apache.org/jira/browse/HADOOP-16349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16349. - Resolution: Fixed > DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on re

[jira] [Resolved] (HADOOP-16529) Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set from abfs.xml property

[ https://issues.apache.org/jira/browse/HADOOP-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16529. - Resolution: Workaround > Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be

[jira] [Resolved] (HADOOP-16138) hadoop fs mkdir / of nonexistent abfs container raises NPE

[ https://issues.apache.org/jira/browse/HADOOP-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16138. - Target Version/s: 3.3.0 Resolution: Fixed > hadoop fs mkdir / of nonexistent a

[jira] [Resolved] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16547. - Resolution: Fixed > s3guard prune command doesn't get AWS auth chain from

[jira] [Reopened] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HADOOP-16565: - Reopened to add a message. > Fix "com.amazonaws.SdkClientException: Unable to find a re

[jira] [Resolved] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

[ https://issues.apache.org/jira/browse/HADOOP-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16565. - Resolution: Workaround > Fix "com.amazonaws.SdkClientException: Unable to find a re

[jira] [Resolved] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

[ https://issues.apache.org/jira/browse/HADOOP-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16566. - Resolution: Fixed > S3Guard fsck: Use org.apache.hadoop.util.StopWatch inst

[jira] [Resolved] (HADOOP-16423) S3Guarld fsck: Check metadata consistency from S3 to metadatastore (log)

[ https://issues.apache.org/jira/browse/HADOOP-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16423. - Resolution: Fixed > S3Guarld fsck: Check metadata consistency from S3 to metadatastore (

[jira] [Created] (HADOOP-16566) S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch

Gabor Bota created HADOOP-16566: --- Summary: S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch Key: HADOOP-16566 URL: https://issues.apache.org/jira/browse/HADOOP-16566

[jira] [Created] (HADOOP-16565) Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain."

Gabor Bota created HADOOP-16565: --- Summary: Fix "com.amazonaws.SdkClientException: Unable to find a region via the region provider chain." Key: HADOOP-16565 URL: https://issues.apache.org/jira/browse/HA

[jira] [Created] (HADOOP-16564) S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify)

Gabor Bota created HADOOP-16564: --- Summary: S3Guarld fsck: Add docs to the first iteration (S3->ddbMS, -verify) Key: HADOOP-16564 URL: https://issues.apache.org/jira/browse/HADOOP-16564 Project: Had

[jira] [Created] (HADOOP-16563) S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it

Gabor Bota created HADOOP-16563: --- Summary: S3Guard fsck: Detect if a directory if authoritative and highlight errors if detected in it Key: HADOOP-16563 URL: https://issues.apache.org/jira/browse/HADOOP-16563

[jira] [Resolved] (HADOOP-16550) Spark config name error on the Launching Applications Using Docker Containers page

[ https://issues.apache.org/jira/browse/HADOOP-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16550. - Resolution: Fixed > Spark config name error on the Launching Applications Using Doc

[jira] [Created] (HADOOP-16529) Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set from abfs.xml property

Gabor Bota created HADOOP-16529: --- Summary: Allow AZURE_CREATE_REMOTE_FILESYSTEM_DURING_INITIALIZATION to be set from abfs.xml property Key: HADOOP-16529 URL: https://issues.apache.org/jira/browse/HADOOP-16529

[jira] [Resolved] (HADOOP-16500) S3ADelegationTokens to only log at debug on startup

[ https://issues.apache.org/jira/browse/HADOOP-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16500. - Resolution: Fixed Fix Version/s: 3.3.0 Committed to trunk. > S3ADelegationTok

[jira] [Created] (HADOOP-16507) S3Guard fsck: Add option to configure severity (level) for the scan

Gabor Bota created HADOOP-16507: --- Summary: S3Guard fsck: Add option to configure severity (level) for the scan Key: HADOOP-16507 URL: https://issues.apache.org/jira/browse/HADOOP-16507 Project: Hadoop

[jira] [Resolved] (HADOOP-16481) ITestS3GuardDDBRootOperations.test_300_MetastorePrune needs to set region

[ https://issues.apache.org/jira/browse/HADOOP-16481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16481. - Resolution: Fixed Fix Version/s: 3.3.0 Target Version/s: 3.3.0

[jira] [Resolved] (HADOOP-16499) S3A retry policy to be exponential

[ https://issues.apache.org/jira/browse/HADOOP-16499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16499. - Resolution: Fixed Fix Version/s: 3.3.0 Target Version/s: 3.3.0 > S3A re

[jira] [Created] (HADOOP-16502) Add fsck to S3A tests where additional diagnosis is needed

Gabor Bota created HADOOP-16502: --- Summary: Add fsck to S3A tests where additional diagnosis is needed Key: HADOOP-16502 URL: https://issues.apache.org/jira/browse/HADOOP-16502 Project: Hadoop Common

[jira] [Created] (HADOOP-16483) S3Guarld fsck: Check metadata consistency from metadatastore to S3 (log)

Gabor Bota created HADOOP-16483: --- Summary: S3Guarld fsck: Check metadata consistency from metadatastore to S3 (log) Key: HADOOP-16483 URL: https://issues.apache.org/jira/browse/HADOOP-16483 Project

[jira] [Created] (HADOOP-16476) Intermittent failure of ITestS3GuardConcurrentOps#testConcurrentTableCreations

Gabor Bota created HADOOP-16476: --- Summary: Intermittent failure of ITestS3GuardConcurrentOps#testConcurrentTableCreations Key: HADOOP-16476 URL: https://issues.apache.org/jira/browse/HADOOP-16476

Re: [DISCUSS] Prefer Github PR Integration over patch in JIRA

Although we will use github with PRs, I'd still prefer adding a +1 as a jira comment stating which PR was the last and approved one among the many. On Tue, Jul 23, 2019 at 11:22 AM Steve Loughran wrote: > On Mon, Jul 22, 2019 at 7:29 PM Eric Badger > wrote: > > > Where would JIRA fit into the

[jira] [Created] (HADOOP-16436) Fix ITestS3GuardToolLocal#testInitNegativeRead test failure

Gabor Bota created HADOOP-16436: --- Summary: Fix ITestS3GuardToolLocal#testInitNegativeRead test failure Key: HADOOP-16436 URL: https://issues.apache.org/jira/browse/HADOOP-16436 Project: Hadoop Common

[jira] [Resolved] (HADOOP-16383) Pass ITtlTimeProvider instance in initialize method in MetadataStore interface

[ https://issues.apache.org/jira/browse/HADOOP-16383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16383. - Resolution: Fixed Fix Version/s: 3.3.0 > Pass ITtlTimeProvider instance in initial

Re: [VOTE] Force "squash and merge" option for PR merge on github UI

+1 Good idea. On Wed, Jul 17, 2019 at 9:37 AM Ayush Saxena wrote: > Thanks Marton, Makes Sense +1 > > > On 17-Jul-2019, at 11:37 AM, Elek, Marton wrote: > > > > Hi, > > > > Github UI (ui!) helps to merge Pull Requests to the proposed branch. > > There are three different ways to do it [1]: > >

[jira] [Created] (HADOOP-16433) Filter expired entries and tombstones when listing with MetadataStore#listChildren

Gabor Bota created HADOOP-16433: --- Summary: Filter expired entries and tombstones when listing with MetadataStore#listChildren Key: HADOOP-16433 URL: https://issues.apache.org/jira/browse/HADOOP-16433

[jira] [Created] (HADOOP-16426) S3Guard fsck: Implement fixing mechanism for inconsistencies between S3 and MetadataStore

Gabor Bota created HADOOP-16426: --- Summary: S3Guard fsck: Implement fixing mechanism for inconsistencies between S3 and MetadataStore Key: HADOOP-16426 URL: https://issues.apache.org/jira/browse/HADOOP-16426

[jira] [Created] (HADOOP-16425) S3Guard fsck: Export MetadataStore and S3 bucket hierarchy

Gabor Bota created HADOOP-16425: --- Summary: S3Guard fsck: Export MetadataStore and S3 bucket hierarchy Key: HADOOP-16425 URL: https://issues.apache.org/jira/browse/HADOOP-16425 Project: Hadoop Common

[jira] [Created] (HADOOP-16424) S3Guard fsck: Check internal consistency of the MetadataStore

Gabor Bota created HADOOP-16424: --- Summary: S3Guard fsck: Check internal consistency of the MetadataStore Key: HADOOP-16424 URL: https://issues.apache.org/jira/browse/HADOOP-16424 Project: Hadoop Common

[jira] [Created] (HADOOP-16423) S3Guarld fsck: Check metadata consistency between S3 and metadatastore (log)

Gabor Bota created HADOOP-16423: --- Summary: S3Guarld fsck: Check metadata consistency between S3 and metadatastore (log) Key: HADOOP-16423 URL: https://issues.apache.org/jira/browse/HADOOP-16423 Project

[jira] [Created] (HADOOP-16422) AbstractITCommitMRJob.testMRJob test failures

Gabor Bota created HADOOP-16422: --- Summary: AbstractITCommitMRJob.testMRJob test failures Key: HADOOP-16422 URL: https://issues.apache.org/jira/browse/HADOOP-16422 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-16409) Allow authoritative mode on non-qualified paths

[ https://issues.apache.org/jira/browse/HADOOP-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16409. - Resolution: Fixed Fix Version/s: 3.3.0 > Allow authoritative mode on non-qualif

Re: new committer: Gabor Bota

Thank you! On Thu, Jul 4, 2019 at 8:50 AM Szilard Nemeth wrote: > Congrats, Gabor! > > On Tue, Jul 2, 2019, 01:36 Sean Mackrory wrote: > > > The Project Management Committee (PMC) for Apache Hadoop > > has invited Gabor Bota to become a committer and we are pleased >

[jira] [Created] (HADOOP-16383) Pass ITtlTimeProvider instance in initialize method in MetadataStore interface

Gabor Bota created HADOOP-16383: --- Summary: Pass ITtlTimeProvider instance in initialize method in MetadataStore interface Key: HADOOP-16383 URL: https://issues.apache.org/jira/browse/HADOOP-16383

[jira] [Resolved] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

[ https://issues.apache.org/jira/browse/HADOOP-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16184. - Resolution: Fixed > S3Guard: Handle OOB deletions and creation of a file which has a tombst

[jira] [Resolved] (HADOOP-15960) Update guava to 27.0-jre in hadoop-project

[ https://issues.apache.org/jira/browse/HADOOP-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15960. - Resolution: Fixed All subtasks are resolved, guava updated on branches 3.0, 3.1, 3.2 and trunk

[jira] [Reopened] (HADOOP-15888) ITestDynamoDBMetadataStore can leak (large) DDB tables in test failures/timeout

[ https://issues.apache.org/jira/browse/HADOOP-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reopened HADOOP-15888: - Reopened. This depends on HADOOP-15563 we will close when

[jira] [Resolved] (HADOOP-15888) ITestDynamoDBMetadataStore can leak (large) DDB tables in test failures/timeout

[ https://issues.apache.org/jira/browse/HADOOP-15888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15888. - Resolution: Workaround > ITestDynamoDBMetadataStore can leak (large) DDB tables in t

[jira] [Created] (HADOOP-16326) S3Guard: Remove LocalMetadataStore

Gabor Bota created HADOOP-16326: --- Summary: S3Guard: Remove LocalMetadataStore Key: HADOOP-16326 URL: https://issues.apache.org/jira/browse/HADOOP-16326 Project: Hadoop Common Issue Type: Bug

[jira] [Resolved] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-14468. - Resolution: Fixed Release Note: Resolved this with HADOOP-15999 : fix for OOB operations

[jira] [Created] (HADOOP-16280) S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened

Gabor Bota created HADOOP-16280: --- Summary: S3Guard: Retry failed read with backoff in Authoritative mode when file can be opened Key: HADOOP-16280 URL: https://issues.apache.org/jira/browse/HADOOP-16280

[jira] [Created] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

Gabor Bota created HADOOP-16279: --- Summary: S3Guard: Implement time-based (TTL) expiry for entries (and tombstones) Key: HADOOP-16279 URL: https://issues.apache.org/jira/browse/HADOOP-16279 Project

[jira] [Resolved] (HADOOP-15272) Update Guava, see what breaks

[ https://issues.apache.org/jira/browse/HADOOP-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15272. - Resolution: Fixed Fixed in HADOOP-16210. > Update Guava, see what bre

[jira] [Created] (HADOOP-16237) Fix new findbugs issues after update guava to 27.0-jre in hadoop-project trunk

Gabor Bota created HADOOP-16237: --- Summary: Fix new findbugs issues after update guava to 27.0-jre in hadoop-project trunk Key: HADOOP-16237 URL: https://issues.apache.org/jira/browse/HADOOP-16237

[jira] [Resolved] (HADOOP-16230) Correct findbug ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

[ https://issues.apache.org/jira/browse/HADOOP-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16230. - Resolution: Won't Fix I'll resolve it as won't fix. I will fix this in HADOOP-16210

[jira] [Created] (HADOOP-16230) Corrcet findbug ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

Gabor Bota created HADOOP-16230: --- Summary: Corrcet findbug ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project Key: HADOOP-16230 URL: https://issues.apache.org/jira/browse/HADOOP

Update guava to 27.0-jre in hadoop-project

Hi devs, I'm working on the guava version from 11.0.2 to 27.0-jre in hadoop-project. We need to do the upgrade because of CVE-2018-10237 . I've created an issue (HADOOP-15960 ) to track progress

[jira] [Resolved] (HADOOP-15780) S3Guard: document how to deal with non-S3Guard processes writing data to S3Guarded buckets

[ https://issues.apache.org/jira/browse/HADOOP-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-15780. - Resolution: Fixed > S3Guard: document how to deal with non-S3Guard processes writing d

[jira] [Created] (HADOOP-16220) Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

Gabor Bota created HADOOP-16220: --- Summary: Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project Key: HADOOP-16220 URL: https://issues.apache.org/jira/browse/HADOOP-16220

[jira] [Created] (HADOOP-16213) Update guava to 27.0-jre in hadoop-project branch-3.1

Gabor Bota created HADOOP-16213: --- Summary: Update guava to 27.0-jre in hadoop-project branch-3.1 Key: HADOOP-16213 URL: https://issues.apache.org/jira/browse/HADOOP-16213 Project: Hadoop Common

[jira] [Created] (HADOOP-16212) Update guava to 27.0-jre in hadoop-project branch-3.0

Gabor Bota created HADOOP-16212: --- Summary: Update guava to 27.0-jre in hadoop-project branch-3.0 Key: HADOOP-16212 URL: https://issues.apache.org/jira/browse/HADOOP-16212 Project: Hadoop Common

[jira] [Created] (HADOOP-16211) Update guava to 27.0-jre in hadoop-project branch-3.2 and branch-3.1

Gabor Bota created HADOOP-16211: --- Summary: Update guava to 27.0-jre in hadoop-project branch-3.2 and branch-3.1 Key: HADOOP-16211 URL: https://issues.apache.org/jira/browse/HADOOP-16211 Project: Hadoop

[jira] [Created] (HADOOP-16210) Update guava to 27.0-jre in hadoop-project trunk

Gabor Bota created HADOOP-16210: --- Summary: Update guava to 27.0-jre in hadoop-project trunk Key: HADOOP-16210 URL: https://issues.apache.org/jira/browse/HADOOP-16210 Project: Hadoop Common

[jira] [Created] (HADOOP-16209) Create simple docker based pseudo-cluster for hdfs

Gabor Bota created HADOOP-16209: --- Summary: Create simple docker based pseudo-cluster for hdfs Key: HADOOP-16209 URL: https://issues.apache.org/jira/browse/HADOOP-16209 Project: Hadoop Common

[jira] [Resolved] (HADOOP-16201) S3AFileSystem#innerMkdirs does not create parent directories

[ https://issues.apache.org/jira/browse/HADOOP-16201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota resolved HADOOP-16201. - Resolution: Invalid > S3AFileSystem#innerMkdirs does not create parent director

[jira] [Created] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

Gabor Bota created HADOOP-16185: --- Summary: S3Guard: Optimize performance of handling OOB operations in non-authoritative mode Key: HADOOP-16185 URL: https://issues.apache.org/jira/browse/HADOOP-16185

[jira] [Created] (HADOOP-16184) S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker

Gabor Bota created HADOOP-16184: --- Summary: S3Guard: Handle OOB deletions and creation of a file which has a tombstone marker Key: HADOOP-16184 URL: https://issues.apache.org/jira/browse/HADOOP-16184

  1   2   >