Re: [VOTE] Hadoop 3.2.x EOL

+1 On Tue, Dec 5, 2023 at 8:09 PM Xiaoqiao He wrote: > Dear Hadoop devs, > > Given the feedback from the discussion thread [1], I'd like to start > an official thread for the community to vote on release line 3.2 EOL. > > It will include, > a. An official announcement informs no further regular

Re: [ANNOUNCE] New Hadoop Committer - Simbarashe Dzinamarira

Congratulations! On Tue, Oct 3, 2023 at 8:55 AM Ayush Saxena wrote: > Congratulations!!! > > -Ayush > > > On 03-Oct-2023, at 5:42 AM, Erik Krogen wrote: > > > > Congratulations Simba! Thanks for the great work you've done on making > HDFS > > more scalable! > > > >> On Mon, Oct 2, 2023 at

[jira] [Resolved] (HADOOP-18592) Sasl connection failure should log remote address

[ https://issues.apache.org/jira/browse/HADOOP-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-18592. Fix Version/s: 3.4.0 3.3.9 Hadoop Flags: Reviewed

Disable auto-posting comment on pull requests to JIRA?

Hi all, I find for any new comment on a pull request (PR), it will get auto-posted to the JIRA as comments. As we are moving to GitHub for code reviews, the JIRA is more about the problem definition, discussion on solution and design. Comments happening in the PR are likely scoped to the

Re: [DISCUSS] JIRA Public Signup Disabled

Thanks Ayush for taking care of this. I think option 1 sounds good. > On Nov 22, 2022, at 2:51 PM, Ayush Saxena wrote: > > Hi Folks, > Just driving the attention towards the recent change from Infra, which > disables new people from creating a Jira account, in order to prevent spams > around

[jira] [Reopened] (HADOOP-17728) Deadlock in FileSystem StatisticsDataReferenceCleaner cleanUp

[ https://issues.apache.org/jira/browse/HADOOP-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-17728: > Deadlock in FileSystem StatisticsDataReferenceCleaner clea

[jira] [Resolved] (HADOOP-17728) Deadlock in FileSystem StatisticsDataReferenceCleaner cleanUp

[ https://issues.apache.org/jira/browse/HADOOP-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-17728. Fix Version/s: 3.2.3 3.4.0 3.3.1 Hadoop Flags

Re: Hadoop 3.1 branch broken?

:51 PM Akira Ajisaka > wrote: > >> > >> In branch-3.1, JDK 9 is installed and the default java version is set > >> to 9. In other branches, the default java version is 8. I'll backport > >> some related JIRAs to branch-3.2. > >> > >>

Hadoop 3.1 branch broken?

Hi, From this build log for PR 2799 in branch-3.1, I see there are failures complaining the sun.misc.Cleaner class is not found. Did we upgrade the JDK version, or any build file for that branch? I can check this

[ANNOUNCE] Mukund Thakur is a new Apache Hadoop Committer

is a great addition to the Hadoop project. His reviews are comprehensive with high standards to "approve a pull request". The granting of committership to him will enable better productivity. Please join me in congratulating him. Welcome aboard, Mukund! Mingliang Liu (on behalf of the Apa

[jira] [Resolved] (HADOOP-16355) ZookeeperMetadataStore: Use Zookeeper as S3Guard backend store

[ https://issues.apache.org/jira/browse/HADOOP-16355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-16355. Resolution: Abandoned As documented by [[HADOOP-17480]], AWS S3 is consistent

Re: [VOTE] Moving Ozone to a separated Apache project

+1 On Tue, Sep 29, 2020 at 3:44 PM Wangda Tan wrote: > +1, > > Thanks, > Wangda Tan > > On Tue, Sep 29, 2020 at 10:10 AM Aravindan Vijayan > wrote: > > > +1, thank you Marton. > > > > On Tue, Sep 29, 2020 at 9:17 AM Bharat Viswanadham > > wrote: > > > > > +1 > > > Thank You @Elek, Marton for

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

+1 (binding) 1. Download binary and check signature / checksum successfully 2. Create a 3 node cluster in Docker containers and start the HDFS/YARN services 3. Verify the running version 4. Run simple HDFS/YARN client/admin commands and verify the output 5. Run example programs wordcount and grep

Re: Unstable Unit Tests in Trunk

Thanks Eric. I also see some intermittent test failures in recent builds. Maybe we can mark those failing tests as @Flaky, and/or add the RetryRule() to them. Thoughts? On Tue, Sep 1, 2020 at 10:48 AM Eric Badger wrote: > While putting up patches for HADOOP-17169 >

Re: How to manually trigger a PreCommit build for a github PR?

gt; You can see an option 'replay' on the left, Clicking on it will rerun the > build. > > Secondly, If the last build isn't available, then I think creating an empty > commit is the only way as Dinesh also suggested. > > -Ayush > > On Wed, 9 Sep 2020 at 03:43, Mingliang Liu wr

Re: How to manually trigger a PreCommit build for a github PR?

. > > git commit --allow-empty -m 'trigger new CI check' && git push > > > Thanks, > Dinesh > > > > On Tue, Sep 8, 2020 at 5:39 PM Mingliang Liu wrote: > >> Hi, >> >> To trigger a PreCommit build without code change, I can make the JI

[jira] [Created] (HADOOP-17252) Website to link to latest Hadoop wiki

Mingliang Liu created HADOOP-17252: -- Summary: Website to link to latest Hadoop wiki Key: HADOOP-17252 URL: https://issues.apache.org/jira/browse/HADOOP-17252 Project: Hadoop Common Issue

How to manually trigger a PreCommit build for a github PR?

Hi, To trigger a PreCommit build without code change, I can make the JIRA status "Patch Available" and provide the JIRA number to "Build With Parameters" link . Not sure how to do that for a PR without a real

Re: [DISCUSS] Hadoop 2.10.1 release

I can see how I can help, but I can not take the RM role this time. Thanks, On Mon, Aug 31, 2020 at 12:15 PM Wei-Chiu Chuang wrote: > Hello, > > I see that Masatake graciously agreed to volunteer with the Hadoop 2.10.1 > release work in the 2.9 branch EOL discussion thread >

Re: [VOTE] End of Life Hadoop 2.9

+1 (binding) p.s. We should still maintain 2.10 for Hadoop 2 users and encourage them to upgrade to Hadoop 3. On Mon, Aug 31, 2020 at 12:10 PM Wei-Chiu Chuang wrote: > Dear fellow Hadoop developers, > > Given the overwhelming feedback from the discussion thread >

[jira] [Resolved] (HADOOP-17159) Make UGI support forceful relogin from keytab ignoring the last login time

[ https://issues.apache.org/jira/browse/HADOOP-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-17159. Fix Version/s: 2.10.1 Hadoop Flags: Reviewed Resolution: Fixed Committed

Re: [DISCUSS] fate of branch-2.9

> are there any Hadoop branch-2 releases planned, ever? If so I'll need to backport my s3a directory compatibility patch to whatever is still live. The branch-2 is gone. I think you mean branch-2.10, Steve. Many HBase users are still using Hadoop 2, so I hope Hadoop 2.10.x should still be

Re: [DISCUSS] GitHub PR link auto-posting to JIRA?

arily) and I just saw one > notification on HDFS-15025 from Github. > Can you check if that solves the issue? > > -Ayush > > On Thu, 27 Aug 2020 at 03:41, Mingliang Liu wrote: > >> Hi, >> >> I found that GitHub PR will not show up as "links" of the JIRA

Re: [DISCUSS] fate of branch-2.9

+1 for putting 2.9 lines to EOL. Let's focus on 2.10 releases for Hadoop 2. Also is there any plan for 2.10.1? It has been 11 months since 2.10 first release. Thanks, On Wed, Aug 26, 2020 at 10:57 PM Wei-Chiu Chuang wrote: > Bump up this thread after 6 months. > > Is anyone still interested

[DISCUSS] GitHub PR link auto-posting to JIRA?

Hi, I found that GitHub PR will not show up as "links" of the JIRA even if the PR subject starts with a JIRA number. Is this a known issue? I see this works for HBase projects, but not Hadoop. Thanks,

[jira] [Created] (HADOOP-17184) Add --mvn-custom-repos parameter to yetus calls

Mingliang Liu created HADOOP-17184: -- Summary: Add --mvn-custom-repos parameter to yetus calls Key: HADOOP-17184 URL: https://issues.apache.org/jira/browse/HADOOP-17184 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17052) NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort

[ https://issues.apache.org/jira/browse/HADOOP-17052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-17052. Fix Version/s: 3.4.0 3.3.1 2.10.1

Re: [DISCUSS] making Ozone a separate Apache project

+1 On Mon, May 18, 2020 at 12:37 AM Elek, Marton wrote: > > > > One question, for the committers who contributed to Ozone before and got > > the committer-role in the past (like me), will they carry the > > committer-role to the new repo? > > > In short: yes. > > > In more details: > > This

Re: [Hadoop-3.3 Release update]- branch-3.3 has created

Brahma, What about https://issues.apache.org/jira/browse/HADOOP-17007? Thanks, On Fri, Apr 24, 2020 at 11:07 AM Brahma Reddy Battula wrote: > Ok. Done. Branch created. > > Following blockers are pending, will closely track this. > > https://issues.apache.org/jira/browse/HDFS-15287 ( Open:

[jira] [Resolved] (HADOOP-17013) this bug is bla bla bla

[ https://issues.apache.org/jira/browse/HADOOP-17013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-17013. Fix Version/s: (was: 0.24.0) Target Version/s: (was: 3.2.1

[jira] [Resolved] (HADOOP-16853) ITestS3GuardOutOfBandOperations failing on versioned S3 buckets

[ https://issues.apache.org/jira/browse/HADOOP-16853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-16853. Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Committed

[jira] [Resolved] (HADOOP-16827) TestHarFileSystem.testInheritedMethodsImplemented broken

[ https://issues.apache.org/jira/browse/HADOOP-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-16827. Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Resolved] (HADOOP-16759) Filesystem openFile() builder to take a FileStatus param

[ https://issues.apache.org/jira/browse/HADOOP-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-16759. Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Committed

[jira] [Created] (HADOOP-16758) Refine testing.md to tell user better how to use auth-keys.xml

Mingliang Liu created HADOOP-16758: -- Summary: Refine testing.md to tell user better how to use auth-keys.xml Key: HADOOP-16758 URL: https://issues.apache.org/jira/browse/HADOOP-16758 Project: Hadoop

[jira] [Created] (HADOOP-16757) Increase timeout unit test rule for ITestDynamoDBMetadataStore

Mingliang Liu created HADOOP-16757: -- Summary: Increase timeout unit test rule for ITestDynamoDBMetadataStore Key: HADOOP-16757 URL: https://issues.apache.org/jira/browse/HADOOP-16757 Project: Hadoop

[jira] [Created] (HADOOP-16735) Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN

Mingliang Liu created HADOOP-16735: -- Summary: Make it clearer in config default that EnvironmentVariableCredentialsProvider supports AWS_SESSION_TOKEN Key: HADOOP-16735 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HADOOP-16732) S3Guard to support encrypted DynamoDB table

Mingliang Liu created HADOOP-16732: -- Summary: S3Guard to support encrypted DynamoDB table Key: HADOOP-16732 URL: https://issues.apache.org/jira/browse/HADOOP-16732 Project: Hadoop Common

[jira] [Created] (HADOOP-16722) S3GuardTool to support FilterFileSystem

Mingliang Liu created HADOOP-16722: -- Summary: S3GuardTool to support FilterFileSystem Key: HADOOP-16722 URL: https://issues.apache.org/jira/browse/HADOOP-16722 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16355) ZookeeperMetadataStore: Use Zookeeper as S3Guard backend store

Mingliang Liu created HADOOP-16355: -- Summary: ZookeeperMetadataStore: Use Zookeeper as S3Guard backend store Key: HADOOP-16355 URL: https://issues.apache.org/jira/browse/HADOOP-16355 Project: Hadoop

Re: HADOOP-14163 proposal for new hadoop.apache.org

mentation and hugo is best for > >>> generating site. > >>> > >>> > >>> I would like to finish this effort/jira: I would like to start a > >>> discussion about using this proposed version and approach as a new > >>> site of Apache Hadoop. Please let me know what you think. > >>> > >>> > >>> Thanks a lot, > >>> Marton > >>> > >>> - > >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >>> > >> > >> > >> - > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >> > > > > - > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > -- Mingliang Liu

Re: [VOTE] Release Apache Hadoop 2.8.4 (RC0)

gt; The maven artifacts are available via repository.apache.org< > http://repository.apache.org> at: > https://repository.apache.org/content/repositories/orgapachehadoop-1118 > > Please try the release and vote; the vote will run for the usual 5 > working days, ending on 5/14/2018 PST time. > > Thanks, > > Junping > -- Mingliang Liu

Re: [DISCUSS] official docker image(s) for hadoop

> It would be very helpful for testing the RC. For testing and voting, I have been using docker containers for a while, see code at: https://github.com/weiqingy/caochong > TL;DR: I propose to create official hadoop images and upload them to the >

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)

Thanks Junping for doing this! +1 (non-binding) - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value - Build package using maven (skipping tests) with Java 8 - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM) - Operate the basic

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

; good point. Lei: you will get a special mention the next time I do the >> demo >>> >>> >>> Again, great demo, enjoyed it! >>> >>> -AF >>> >>> >>> its actually quite hard to show any benefits of s3guard on the command >

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

+1 (non-binding) I also worked on this project from start to finish and I really enjoyed the collaboration in community. The feature is to solve the very important and challenging consistency problem as stated in the design doc. All patches were reviewed by feature/trunk committers and we have

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Thanks Konstantin! +1 (non-binding) I have tried several steps including: - Download source package and check the checksums - Build from source using Java 8 - Deploy a test cluster using docker containers w/ 5 DNs and 1 NN - Run basic HDFS client/admin operations (e.g. read/write files,

[jira] [Created] (HADOOP-14601) Azure: Reuse ObjectMapper

Mingliang Liu created HADOOP-14601: -- Summary: Azure: Reuse ObjectMapper Key: HADOOP-14601 URL: https://issues.apache.org/jira/browse/HADOOP-14601 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-14594) ITestS3AFileOperationCost::testFakeDirectoryDeletion to uncomment metric assertions

Mingliang Liu created HADOOP-14594: -- Summary: ITestS3AFileOperationCost::testFakeDirectoryDeletion to uncomment metric assertions Key: HADOOP-14594 URL: https://issues.apache.org/jira/browse/HADOOP-14594

[jira] [Created] (HADOOP-14536) Update azure-storage sdk to version 5.2.0

Mingliang Liu created HADOOP-14536: -- Summary: Update azure-storage sdk to version 5.2.0 Key: HADOOP-14536 URL: https://issues.apache.org/jira/browse/HADOOP-14536 Project: Hadoop Common

[jira] [Resolved] (HADOOP-14516) Update WASB driver to use the latest version (5.2.0) of SDK for Microsoft Azure Storage Clients

[ https://issues.apache.org/jira/browse/HADOOP-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-14516. Resolution: Duplicate Closing as duplicates. Please see [HADOOP-14490] and comment

[jira] [Created] (HADOOP-14500) Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails

Mingliang Liu created HADOOP-14500: -- Summary: Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails Key: HADOOP-14500 URL: https://issues.apache.org/jira/browse/HADOOP-14500 Project

[jira] [Created] (HADOOP-14498) HADOOP_OPTIONAL_TOOLS not parsed correctly

Mingliang Liu created HADOOP-14498: -- Summary: HADOOP_OPTIONAL_TOOLS not parsed correctly Key: HADOOP-14498 URL: https://issues.apache.org/jira/browse/HADOOP-14498 Project: Hadoop Common

[jira] [Created] (HADOOP-14491) Azure has messed doc structure

Mingliang Liu created HADOOP-14491: -- Summary: Azure has messed doc structure Key: HADOOP-14491 URL: https://issues.apache.org/jira/browse/HADOOP-14491 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14490) Upgrade azure-storage sdk version

Mingliang Liu created HADOOP-14490: -- Summary: Upgrade azure-storage sdk version Key: HADOOP-14490 URL: https://issues.apache.org/jira/browse/HADOOP-14490 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14472) Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently

Mingliang Liu created HADOOP-14472: -- Summary: Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently Key: HADOOP-14472 URL: https://issues.apache.org/jira/browse/HADOOP-14472 Project: Hadoop

[jira] [Created] (HADOOP-14460) Azure: fs.azure.account.key.youraccount.blob.core.windows.net -> fs.azure.account.key.youraccount

Mingliang Liu created HADOOP-14460: -- Summary: Azure: fs.azure.account.key.youraccount.blob.core.windows.net -> fs.azure.account.key.youraccount Key: HADOOP-14460 URL: https://issues.apache.org/jira/bro

Re: s3a hadoop 2.8.0 tests vs 2.7.3

Hi, Many tests of S3A have been moved to “integration tests”, whose names start with “ITestS3A”. Moreover, the phase of Maven for those tests are “verify” instead of “test” now. So, you can specify the "mvn -Dit.test=‘ITestS3A*’ verify" for integration tests (and unit tests). “mvn test” will

[jira] [Created] (HADOOP-14458) TestAliyunOSSFileSystemContract missing imports/

Mingliang Liu created HADOOP-14458: -- Summary: TestAliyunOSSFileSystemContract missing imports/ Key: HADOOP-14458 URL: https://issues.apache.org/jira/browse/HADOOP-14458 Project: Hadoop Common

[jira] [Created] (HADOOP-14438) Make ADLS doc of setting up client key up to date

Mingliang Liu created HADOOP-14438: -- Summary: Make ADLS doc of setting up client key up to date Key: HADOOP-14438 URL: https://issues.apache.org/jira/browse/HADOOP-14438 Project: Hadoop Common

[jira] [Created] (HADOOP-14363) Inconsistent default block location in FileSystem javadoc

Mingliang Liu created HADOOP-14363: -- Summary: Inconsistent default block location in FileSystem javadoc Key: HADOOP-14363 URL: https://issues.apache.org/jira/browse/HADOOP-14363 Project: Hadoop

[jira] [Created] (HADOOP-14349) Rename ADLS CONTRACT_ENABLE_KEY

Mingliang Liu created HADOOP-14349: -- Summary: Rename ADLS CONTRACT_ENABLE_KEY Key: HADOOP-14349 URL: https://issues.apache.org/jira/browse/HADOOP-14349 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-14165) Add S3Guard.dirListingUnion in S3AFileSystem#listFiles, listLocatedStatus

[ https://issues.apache.org/jira/browse/HADOOP-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-14165. Resolution: Duplicate Resolving as duplicate to [HADOOP-13926] and [HADOOP-14266]. >

[jira] [Resolved] (HADOOP-14215) DynamoDB client should waitForActive on existing tables

[ https://issues.apache.org/jira/browse/HADOOP-14215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-14215. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345

[jira] [Created] (HADOOP-14282) S3Guard: DynamoDBMetadata::prune() should self interrupt correctly

Mingliang Liu created HADOOP-14282: -- Summary: S3Guard: DynamoDBMetadata::prune() should self interrupt correctly Key: HADOOP-14282 URL: https://issues.apache.org/jira/browse/HADOOP-14282 Project

[jira] [Created] (HADOOP-14266) S3Guard: S3AFileSystem::listFiles() to employ MetadataStore

Mingliang Liu created HADOOP-14266: -- Summary: S3Guard: S3AFileSystem::listFiles() to employ MetadataStore Key: HADOOP-14266 URL: https://issues.apache.org/jira/browse/HADOOP-14266 Project: Hadoop

[jira] [Created] (HADOOP-14255) S3A to delete unnecessary fake directory objects in mkdirs()

Mingliang Liu created HADOOP-14255: -- Summary: S3A to delete unnecessary fake directory objects in mkdirs() Key: HADOOP-14255 URL: https://issues.apache.org/jira/browse/HADOOP-14255 Project: Hadoop

[jira] [Created] (HADOOP-14248) Retire SharedInstanceProfileCredentialsProvider after AWS SDK upgrade

Mingliang Liu created HADOOP-14248: -- Summary: Retire SharedInstanceProfileCredentialsProvider after AWS SDK upgrade Key: HADOOP-14248 URL: https://issues.apache.org/jira/browse/HADOOP-14248 Project

[jira] [Created] (HADOOP-14247) FileContextMainOperationsBaseTest should clean up test root path

Mingliang Liu created HADOOP-14247: -- Summary: FileContextMainOperationsBaseTest should clean up test root path Key: HADOOP-14247 URL: https://issues.apache.org/jira/browse/HADOOP-14247 Project

[jira] [Created] (HADOOP-14236) S3Guard: S3AFileSystem::rename() should move non-listed sub-directory entries in metadata store

Mingliang Liu created HADOOP-14236: -- Summary: S3Guard: S3AFileSystem::rename() should move non-listed sub-directory entries in metadata store Key: HADOOP-14236 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Created] (HADOOP-14227) S3Guard: ITestS3AConcurrentOps is not cleaning up test data

Mingliang Liu created HADOOP-14227: -- Summary: S3Guard: ITestS3AConcurrentOps is not cleaning up test data Key: HADOOP-14227 URL: https://issues.apache.org/jira/browse/HADOOP-14227 Project: Hadoop

[jira] [Created] (HADOOP-14226) S3Guard: ITestDynamoDBMetadataStoreScale is not cleaning up test data

Mingliang Liu created HADOOP-14226: -- Summary: S3Guard: ITestDynamoDBMetadataStoreScale is not cleaning up test data Key: HADOOP-14226 URL: https://issues.apache.org/jira/browse/HADOOP-14226 Project

[jira] [Created] (HADOOP-14214) DomainSocketWatcher::add()/delete() should not self interrupt while looping await()

Mingliang Liu created HADOOP-14214: -- Summary: DomainSocketWatcher::add()/delete() should not self interrupt while looping await() Key: HADOOP-14214 URL: https://issues.apache.org/jira/browse/HADOOP-14214

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Thanks Junping for doing this. +1 (non-binding) 0. Download the src tar.gz file; checked the MD5 checksum 1. Build Hadoop from source successfully 2. Deploy a single node cluster and start the cluster successfully 3. Operate the HDFS from command line: ls, put, distcp, dfsadmin etc 4. Run hadoop

[jira] [Created] (HADOOP-14194) Alyun OSS should not use empty endpoint as default

Mingliang Liu created HADOOP-14194: -- Summary: Alyun OSS should not use empty endpoint as default Key: HADOOP-14194 URL: https://issues.apache.org/jira/browse/HADOOP-14194 Project: Hadoop Common

[jira] [Created] (HADOOP-14192) Aliyun OSS FileSystem contract test should implement getTestBaseDir()

Mingliang Liu created HADOOP-14192: -- Summary: Aliyun OSS FileSystem contract test should implement getTestBaseDir() Key: HADOOP-14192 URL: https://issues.apache.org/jira/browse/HADOOP-14192 Project

[jira] [Resolved] (HADOOP-13959) S3guard: replace dynamo.describe() call in init with more efficient query

[ https://issues.apache.org/jira/browse/HADOOP-13959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-13959. Resolution: Fixed As [HADOOP-13985] is committed, I think we can resolve this one. Feel

[jira] [Created] (HADOOP-14180) FileSystem contract tests to replace JUnit 3 with 4

Mingliang Liu created HADOOP-14180: -- Summary: FileSystem contract tests to replace JUnit 3 with 4 Key: HADOOP-14180 URL: https://issues.apache.org/jira/browse/HADOOP-14180 Project: Hadoop Common

[jira] [Created] (HADOOP-14170) FileSystemContractBaseTest is not cleaning up test directory clearly

Mingliang Liu created HADOOP-14170: -- Summary: FileSystemContractBaseTest is not cleaning up test directory clearly Key: HADOOP-14170 URL: https://issues.apache.org/jira/browse/HADOOP-14170 Project

[jira] [Created] (HADOOP-14153) ADL module has messed doc structure

Mingliang Liu created HADOOP-14153: -- Summary: ADL module has messed doc structure Key: HADOOP-14153 URL: https://issues.apache.org/jira/browse/HADOOP-14153 Project: Hadoop Common Issue Type

[jira] [Reopened] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-14129: > ITestS3ACredentialsInURL sometimes fa

[jira] [Created] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

Mingliang Liu created HADOOP-14135: -- Summary: Remove URI parameter in AWSCredentialProvider constructors Key: HADOOP-14135 URL: https://issues.apache.org/jira/browse/HADOOP-14135 Project: Hadoop

[jira] [Created] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

Mingliang Liu created HADOOP-14130: -- Summary: Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients Key: HADOOP-14130 URL: https://issues.apache.org/jira/browse/HADOOP-14130 Project

[jira] [Resolved] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-13994. Resolution: Fixed > explicitly declare the commons-lang3 dependency as

[jira] [Reopened] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-13994: > explicitly declare the commons-lang3 dependency as

[jira] [Resolved] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-14091. Resolution: Fixed Sure, but let's track in our private channel. This is for community

[jira] [Created] (HADOOP-14107) ITestS3GuardListConsistency fails intermittently

Mingliang Liu created HADOOP-14107: -- Summary: ITestS3GuardListConsistency fails intermittently Key: HADOOP-14107 URL: https://issues.apache.org/jira/browse/HADOOP-14107 Project: Hadoop Common

[jira] [Created] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in unit test

Mingliang Liu created HADOOP-14106: -- Summary: Fix deprecated FileSystem inefficient calls in unit test Key: HADOOP-14106 URL: https://issues.apache.org/jira/browse/HADOOP-14106 Project: Hadoop Common

[jira] [Created] (HADOOP-14102) Relax error message assertion in S3A test ITestS3AEncryptionSSEC::testCreateFileAndReadWithDifferentEncryptionKey

Mingliang Liu created HADOOP-14102: -- Summary: Relax error message assertion in S3A test ITestS3AEncryptionSSEC::testCreateFileAndReadWithDifferentEncryptionKey Key: HADOOP-14102 URL: https://issues.apache.org

[jira] [Created] (HADOOP-14079) Fix breaking link in s3guard.md

Mingliang Liu created HADOOP-14079: -- Summary: Fix breaking link in s3guard.md Key: HADOOP-14079 URL: https://issues.apache.org/jira/browse/HADOOP-14079 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-13960) Initialize DynamoDBMetadataStore without associated S3AFileSystem

Mingliang Liu created HADOOP-13960: -- Summary: Initialize DynamoDBMetadataStore without associated S3AFileSystem Key: HADOOP-13960 URL: https://issues.apache.org/jira/browse/HADOOP-13960 Project

[jira] [Reopened] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-13946: > Document how HDFS updates timestamps in the FS spec; compare with object >

[jira] [Resolved] (HADOOP-13938) Address javadoc errors in Azure WASB.

[ https://issues.apache.org/jira/browse/HADOOP-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-13938. Resolution: Duplicate > Address javadoc errors in Azure W

[jira] [Created] (HADOOP-13937) Mock bucket locations in MockS3ClientFactory

Mingliang Liu created HADOOP-13937: -- Summary: Mock bucket locations in MockS3ClientFactory Key: HADOOP-13937 URL: https://issues.apache.org/jira/browse/HADOOP-13937 Project: Hadoop Common

[jira] [Created] (HADOOP-13908) Existing tables may not be initialized correctly in DynamoDBMetadataStore

Mingliang Liu created HADOOP-13908: -- Summary: Existing tables may not be initialized correctly in DynamoDBMetadataStore Key: HADOOP-13908 URL: https://issues.apache.org/jira/browse/HADOOP-13908

[jira] [Created] (HADOOP-13813) TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing

Mingliang Liu created HADOOP-13813: -- Summary: TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing Key: HADOOP-13813 URL: https://issues.apache.org/jira/browse/HADOOP-13813

Re: Multiple node Hadoop cluster on Docker for test and debugging

I know a similar tool; it has Ambari and Spark integration as well. https://github.com/weiqingy/caochong Thanks, L > On Nov 9, 2016, at 5:38 AM, Sasaki Kai wrote: > > Hi Hadoop developers > > The other day I created a tool for

Re: [DISCUSS] Pre-commit build in Windows platform

I also like the idea of having a precommit build in Windows. If only the pre-commit infrastructure was reliable. If this is a pain, I see little value making Windows unit test failures release blockers. Thanks, Sent from my iPhone > On Oct 28, 2016, at 8:16 AM, Allen Wittenauer

[jira] [Created] (HADOOP-13697) LogLevel#main throws exception if no arguments provided

Mingliang Liu created HADOOP-13697: -- Summary: LogLevel#main throws exception if no arguments provided Key: HADOOP-13697 URL: https://issues.apache.org/jira/browse/HADOOP-13697 Project: Hadoop Common

[jira] [Resolved] (HADOOP-11513) Artifact errors with Maven build

[ https://issues.apache.org/jira/browse/HADOOP-11513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-11513. Resolution: Cannot Reproduce Feel free to re-open if it happens again. Thanks

[jira] [Created] (HADOOP-13644) Replace config key literal strings with config key names

Mingliang Liu created HADOOP-13644: -- Summary: Replace config key literal strings with config key names Key: HADOOP-13644 URL: https://issues.apache.org/jira/browse/HADOOP-13644 Project: Hadoop

  1   2   >