[jira] [Resolved] (HDFS-13293) RBF: The RouterRPCServer should transfer CallerContext and client ip to NamenodeRpcServer
[ https://issues.apache.org/jira/browse/HDFS-13293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong resolved HDFS-13293. --- Resolution: Duplicate > RBF: The RouterRPCServer should transfer CallerContext and client ip to > NamenodeRpcServer > - > > Key: HDFS-13293 > URL: https://issues.apache.org/jira/browse/HDFS-13293 > Project: Hadoop HDFS > Issue Type: Sub-task >Reporter: maobaolong >Priority: Major > > Otherwise, the namenode don't know the client's callerContext -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13420) License header is displayed in ArchivalStorage.html
Akira Ajisaka created HDFS-13420: Summary: License header is displayed in ArchivalStorage.html Key: HDFS-13420 URL: https://issues.apache.org/jira/browse/HDFS-13420 Project: Hadoop HDFS Issue Type: Bug Components: documentation Reporter: Akira Ajisaka Apache License header is wrongly displayed in http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13421) [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode
Ewan Higgs created HDFS-13421: - Summary: [PROVIDED Phase 2] Implement DNA_BACKUP command in Datanode Key: HDFS-13421 URL: https://issues.apache.org/jira/browse/HDFS-13421 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Ewan Higgs Assignee: Ewan Higgs Attachments: HDFS-13421-HDFS-12090.001.patch HDFS-13310 introduces an API for DNA_BACKUP. Here, we implement DNA_BACKUP command in Datanode. These have been broken up to make reviewing it easier. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13422) Ozone: Fix checkstyle, javac, whitespaces and findbugs issues in HDFS-7240 branch
Mukul Kumar Singh created HDFS-13422: Summary: Ozone: Fix checkstyle, javac, whitespaces and findbugs issues in HDFS-7240 branch Key: HDFS-13422 URL: https://issues.apache.org/jira/browse/HDFS-13422 Project: Hadoop HDFS Issue Type: Sub-task Components: ozone Affects Versions: HDFS-7240 Reporter: Mukul Kumar Singh Assignee: Mukul Kumar Singh Fix For: HDFS-7240 This jira will be used to fix various findbugs, javac, license and findbugs issues in HDFS-7240 branch. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/ [Apr 9, 2018 3:47:22 PM] (sunilg) YARN-7574. Add support for Node Labels on Auto Created Leaf Queue [Apr 9, 2018 4:16:48 PM] (inigoiri) HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs [Apr 9, 2018 5:09:25 PM] (inigoiri) HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota [Apr 9, 2018 5:48:42 PM] (james.clampffer) HDFS-13376. Specify minimum GCC version to avoid TLS support error in [Apr 9, 2018 10:19:21 PM] (jlowe) YARN-7667. Docker Stop grace period should be configurable. Contributed [Apr 9, 2018 11:37:49 PM] (Bharat) HADOOP-15328. Fix the typo in HttpAuthentication.md. Contributed by fang -1 overall The following subsystems voted -1: unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.TestDiskFailures cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-compile-javac-root.txt [288K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-checkstyle-root.txt [17M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/xml.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/diff-javadoc-javadoc-root.txt [760K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [300K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/747/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [84K] Powered by Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Thanks Lie for working on this. - Downloaded src tarball and verified checksums - Built from src on mac with java 1.8.0_111 - Built a pseudo distributed hdfs cluster - Run test mr jobs (pi, dfsio,wordcount - Verified basic hdfs operations - Basic validation for webui ** I checked maven artifacts and it seems source jars are not there (checked hadoop-hdfs , hadoop-client). Not sure if they are required for release. On 4/9/18, 4:19 PM, "Xiao Chen" wrote: Thanks Eddy for the effort! +1 (binding) - Downloaded src tarball and verified checksums - Built from src - Started a pseudo distributed hdfs cluster - Verified basic hdfs operations work - Sanity checked logs / webui Best, -Xiao On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne wrote: > Thanks a lot for working to produce this release. > > +1 (binding) > Tested the following: > - built from source and installed on 6-node pseudo-cluster > - tested Capacity Scheduler FairOrderingPolicy and FifoOrderingPolicy to > determine that capacity was assigned as expected in each case > - tested user weights with FifoOrderingPolicy to ensure that weights were > assigned to users as expected. > > Eric Payne > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu wrote: > > > > > > Hi, All > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > fix shaded jars in apache maven repository. The codebase of 3.0.2 > release is the same as 3.0.1. New bug fixes will be included in > Apache Hadoop 3.0.3 instead. > > The release page is: > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release > > New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ > > The git tag is release-3.0.2-RC0, and the latest commit is > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > The maven artifacts are available at > https://repository.apache.org/content/repositories/orgapachehadoop-1096/ > > Please try the release, especially, *verify the maven artifacts*, and vote. > > The vote will run 5 days, ending 4/11/2018. > > Thanks for everyone who helped to spot the error and proposed fixes! > > - > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13423) Ozone: Clean-up of ozone related change from hadoop-hdfs-project
Nanda kumar created HDFS-13423: -- Summary: Ozone: Clean-up of ozone related change from hadoop-hdfs-project Key: HDFS-13423 URL: https://issues.apache.org/jira/browse/HDFS-13423 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Nanda kumar Assignee: Nanda kumar This jira is for tracking the clean-up and rever the changes made in hadoop-hdfs-project which are related to ozone. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13424) Ozone: Refactor MiniOzoneClassicCluster
Nanda kumar created HDFS-13424: -- Summary: Ozone: Refactor MiniOzoneClassicCluster Key: HDFS-13424 URL: https://issues.apache.org/jira/browse/HDFS-13424 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Nanda kumar Assignee: Nanda kumar This jira will track the refactoring work on {{MiniOzoneClassicCluster}} which removes the dependency and changes made in {{MiniDFSCluster}} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13425) Ozone: Clean-up of ozone related change from hadoop-common-project
Nanda kumar created HDFS-13425: -- Summary: Ozone: Clean-up of ozone related change from hadoop-common-project Key: HDFS-13425 URL: https://issues.apache.org/jira/browse/HDFS-13425 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Nanda kumar This jira is for tracking the clean-up and rever the changes made in hadoop-common-project which are related to ozone. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)
A note to release managers. As discussed in https://issues.apache.org/jira/browse/HADOOP-15205 We are producing release artifacts without sources jars. See e.g. https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-common/3.1.0/ I believe this has something to do with maven deployment stage, potentially maven-source-plugin. This is similar for all releases now, and I believe it should be fixed. Thanks, --Konstantin On Fri, Apr 6, 2018 at 2:01 PM, Wangda Tan wrote: > Thanks guys for the additional votes! I just sent out announcement email. > > Best, > Wangda > > On Fri, Apr 6, 2018 at 2:32 AM, 俊平堵 wrote: > > > Thanks Wangda for the great work! Sorry for my late coming +1 (binding), > > based on: > > > > - Verified signatures > > > > - Verified checksums for source and binary artifacts > > > > - Built from source > > > > - Deployed a single node cluster > > > > - Verified web UIs, include Namenode, RM, etc. > > > > * Tried shell commands of HDFS and YARN > > > > * Ran sample MR jobs, include PI, Sleep, Terasort, etc. > > > > > > Thanks, > > > > > > Junping > > > > > > > > Wangda Tan 于2018年3月30日 周五下午12:15写道: > > > >> Hi folks, > >> > >> Thanks to the many who helped with this release since Dec 2017 [1]. > We've > >> created RC1 for Apache Hadoop 3.1.0. The artifacts are available here: > >> > >> http://people.apache.org/~wangda/hadoop-3.1.0-RC1 > >> > >> The RC tag in git is release-3.1.0-RC1. Last git commit SHA is > >> 16b70619a24cdcf5d3b0fcf4b58ca77238ccbe6d > >> > >> The maven artifacts are available via repository.apache.org at > >> https://repository.apache.org/content/repositories/ > orgapachehadoop-1090/ > >> This vote will run 5 days, ending on Apr 3 at 11:59 pm Pacific. > >> > >> 3.1.0 contains 766 [2] fixed JIRA issues since 3.0.0. Notable additions > >> include the first class GPU/FPGA support on YARN, Native services, > Support > >> rich placement constraints in YARN, S3-related enhancements, allow HDFS > >> block replicas to be provided by an external storage system, etc. > >> > >> For 3.1.0 RC0 vote discussion, please see [3]. > >> > >> We’d like to use this as a starting release for 3.1.x [1], depending on > >> how > >> it goes, get it stabilized and potentially use a 3.1.1 in several weeks > as > >> the stable release. > >> > >> We have done testing with a pseudo cluster: > >> - Ran distributed job. > >> - GPU scheduling/isolation. > >> - Placement constraints (intra-application anti-affinity) by using > >> distributed shell. > >> > >> My +1 to start. > >> > >> Best, > >> Wangda/Vinod > >> > >> [1] > >> https://lists.apache.org/thread.html/b3fb3b6da8b6357a68513a6dfd104b > >> c9e19e559aedc5ebedb4ca08c8@%3Cyarn-dev.hadoop.apache.org%3E > >> [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.0) > >> AND fixVersion not in (3.0.0, 3.0.0-beta1) AND status = Resolved ORDER > BY > >> fixVersion ASC > >> [3] > >> https://lists.apache.org/thread.html/b3a7dc075b7329fd660f65b48237d7 > >> 2d4061f26f83547e41d0983ea6@%3Cyarn-dev.hadoop.apache.org%3E > >> > > >
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
Ajay, thanks for spotting this. I am working on fix the deploy. On Tue, Apr 10, 2018 at 8:32 AM, Ajay Kumar wrote: > Thanks Lie for working on this. > >- Downloaded src tarball and verified checksums >- Built from src on mac with java 1.8.0_111 >- Built a pseudo distributed hdfs cluster >- Run test mr jobs (pi, dfsio,wordcount >- Verified basic hdfs operations >- Basic validation for webui > > ** I checked maven artifacts and it seems source jars are not there (checked > hadoop-hdfs , hadoop-client). Not sure if they are required for release. > > > On 4/9/18, 4:19 PM, "Xiao Chen" wrote: > > Thanks Eddy for the effort! > > +1 (binding) > >- Downloaded src tarball and verified checksums >- Built from src >- Started a pseudo distributed hdfs cluster >- Verified basic hdfs operations work >- Sanity checked logs / webui > > Best, > -Xiao > > > On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne > > wrote: > > > Thanks a lot for working to produce this release. > > > > +1 (binding) > > Tested the following: > > - built from source and installed on 6-node pseudo-cluster > > - tested Capacity Scheduler FairOrderingPolicy and FifoOrderingPolicy to > > determine that capacity was assigned as expected in each case > > - tested user weights with FifoOrderingPolicy to ensure that weights > were > > assigned to users as expected. > > > > Eric Payne > > > > > > > > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu > wrote: > > > > > > > > > > > > Hi, All > > > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > > fix shaded jars in apache maven repository. The codebase of 3.0.2 > > release is the same as 3.0.1. New bug fixes will be included in > > Apache Hadoop 3.0.3 instead. > > > > The release page is: > > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release > > > > New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC0/ > > > > The git tag is release-3.0.2-RC0, and the latest commit is > > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > > > The maven artifacts are available at > > https://repository.apache.org/content/repositories/orgapachehadoop-1096/ > > > > Please try the release, especially, *verify the maven artifacts*, and > vote. > > > > The vote will run 5 days, ending 4/11/2018. > > > > Thanks for everyone who helped to spot the error and proposed fixes! > > > > - > > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > > > > > > - > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > -- Lei (Eddy) Xu Software Engineer, Cloudera - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.2 (RC0)
A note to release managers. As discussed in https://issues.apache.org/jira/browse/HADOOP-15205 We are producing release artifacts without sources jars. See e.g. https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-common/3.0.1/ Based on what is staged on Nexus for 3.0.2 (RC0) I see the next release will not have sources as well. https://repository.apache.org/#stagingRepositories I believe this has something to do with maven deployment stage, potentially maven-source-plugin. This is similar for all releases now, and I believe it should be fixed. Thanks, --Konstantin On Tue, Apr 10, 2018 at 8:32 AM, Ajay Kumar wrote: > Thanks Lie for working on this. > >- Downloaded src tarball and verified checksums >- Built from src on mac with java 1.8.0_111 >- Built a pseudo distributed hdfs cluster >- Run test mr jobs (pi, dfsio,wordcount >- Verified basic hdfs operations >- Basic validation for webui > > ** I checked maven artifacts and it seems source jars are not there > (checked hadoop-hdfs , hadoop-client). Not sure if they are required for > release. > > > On 4/9/18, 4:19 PM, "Xiao Chen" wrote: > > Thanks Eddy for the effort! > > +1 (binding) > >- Downloaded src tarball and verified checksums >- Built from src >- Started a pseudo distributed hdfs cluster >- Verified basic hdfs operations work >- Sanity checked logs / webui > > Best, > -Xiao > > > On Mon, Apr 9, 2018 at 11:28 AM, Eric Payne invalid> > wrote: > > > Thanks a lot for working to produce this release. > > > > +1 (binding) > > Tested the following: > > - built from source and installed on 6-node pseudo-cluster > > - tested Capacity Scheduler FairOrderingPolicy and > FifoOrderingPolicy to > > determine that capacity was assigned as expected in each case > > - tested user weights with FifoOrderingPolicy to ensure that weights > were > > assigned to users as expected. > > > > Eric Payne > > > > > > > > > > > > > > On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu > wrote: > > > > > > > > > > > > Hi, All > > > > I've created release candidate RC-0 for Apache Hadoop 3.0.2. > > > > Please note: this is an amendment for Apache Hadoop 3.0.1 release to > > fix shaded jars in apache maven repository. The codebase of 3.0.2 > > release is the same as 3.0.1. New bug fixes will be included in > > Apache Hadoop 3.0.3 instead. > > > > The release page is: > > https://cwiki.apache.org/confluence/display/HADOOP/ > Hadoop+3.0+Release > > > > New RC is available at: http://home.apache.org/~lei/ > hadoop-3.0.2-RC0/ > > > > The git tag is release-3.0.2-RC0, and the latest commit is > > 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee > > > > The maven artifacts are available at > > https://repository.apache.org/content/repositories/ > orgapachehadoop-1096/ > > > > Please try the release, especially, *verify the maven artifacts*, > and vote. > > > > The vote will run 5 days, ending 4/11/2018. > > > > Thanks for everyone who helped to spot the error and proposed fixes! > > > > > - > > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: mapreduce-dev-help@hadoop. > apache.org > > > > > > > - > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org >
Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)
Thanks @Konstantin for reporting this issue, I will post comments on the JIRA (HADOOP-15205) - Wangda On Tue, Apr 10, 2018 at 12:08 PM, Konstantin Shvachko wrote: > A note to release managers. As discussed in > https://issues.apache.org/jira/browse/HADOOP-15205 > We are producing release artifacts without sources jars. See e.g. > https://repository.apache.org/content/repositories/releases/ > org/apache/hadoop/hadoop-common/3.1.0/ > I believe this has something to do with maven deployment stage, > potentially maven-source-plugin. > This is similar for all releases now, and I believe it should be fixed. > > Thanks, > --Konstantin > > On Fri, Apr 6, 2018 at 2:01 PM, Wangda Tan wrote: > >> Thanks guys for the additional votes! I just sent out announcement email. >> >> Best, >> Wangda >> >> On Fri, Apr 6, 2018 at 2:32 AM, 俊平堵 wrote: >> >> > Thanks Wangda for the great work! Sorry for my late coming +1 (binding), >> > based on: >> > >> > - Verified signatures >> > >> > - Verified checksums for source and binary artifacts >> > >> > - Built from source >> > >> > - Deployed a single node cluster >> > >> > - Verified web UIs, include Namenode, RM, etc. >> > >> > * Tried shell commands of HDFS and YARN >> > >> > * Ran sample MR jobs, include PI, Sleep, Terasort, etc. >> > >> > >> > Thanks, >> > >> > >> > Junping >> > >> > >> > >> > Wangda Tan 于2018年3月30日 周五下午12:15写道: >> > >> >> Hi folks, >> >> >> >> Thanks to the many who helped with this release since Dec 2017 [1]. >> We've >> >> created RC1 for Apache Hadoop 3.1.0. The artifacts are available here: >> >> >> >> http://people.apache.org/~wangda/hadoop-3.1.0-RC1 >> >> >> >> The RC tag in git is release-3.1.0-RC1. Last git commit SHA is >> >> 16b70619a24cdcf5d3b0fcf4b58ca77238ccbe6d >> >> >> >> The maven artifacts are available via repository.apache.org at >> >> https://repository.apache.org/content/repositories/orgapache >> hadoop-1090/ >> >> This vote will run 5 days, ending on Apr 3 at 11:59 pm Pacific. >> >> >> >> 3.1.0 contains 766 [2] fixed JIRA issues since 3.0.0. Notable additions >> >> include the first class GPU/FPGA support on YARN, Native services, >> Support >> >> rich placement constraints in YARN, S3-related enhancements, allow HDFS >> >> block replicas to be provided by an external storage system, etc. >> >> >> >> For 3.1.0 RC0 vote discussion, please see [3]. >> >> >> >> We’d like to use this as a starting release for 3.1.x [1], depending on >> >> how >> >> it goes, get it stabilized and potentially use a 3.1.1 in several >> weeks as >> >> the stable release. >> >> >> >> We have done testing with a pseudo cluster: >> >> - Ran distributed job. >> >> - GPU scheduling/isolation. >> >> - Placement constraints (intra-application anti-affinity) by using >> >> distributed shell. >> >> >> >> My +1 to start. >> >> >> >> Best, >> >> Wangda/Vinod >> >> >> >> [1] >> >> https://lists.apache.org/thread.html/b3fb3b6da8b6357a68513a6dfd104b >> >> c9e19e559aedc5ebedb4ca08c8@%3Cyarn-dev.hadoop.apache.org%3E >> >> [2] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in >> (3.1.0) >> >> AND fixVersion not in (3.0.0, 3.0.0-beta1) AND status = Resolved ORDER >> BY >> >> fixVersion ASC >> >> [3] >> >> https://lists.apache.org/thread.html/b3a7dc075b7329fd660f65b48237d7 >> >> 2d4061f26f83547e41d0983ea6@%3Cyarn-dev.hadoop.apache.org%3E >> >> >> > >> > >
Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/433/ [Apr 9, 2018 3:47:22 PM] (sunilg) YARN-7574. Add support for Node Labels on Auto Created Leaf Queue [Apr 9, 2018 4:16:48 PM] (inigoiri) HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs [Apr 9, 2018 5:09:25 PM] (inigoiri) HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota [Apr 9, 2018 5:48:42 PM] (james.clampffer) HDFS-13376. Specify minimum GCC version to avoid TLS support error in [Apr 9, 2018 10:19:21 PM] (jlowe) YARN-7667. Docker Stop grace period should be configurable. Contributed [Apr 9, 2018 11:37:49 PM] (Bharat) HADOOP-15328. Fix the typo in HttpAuthentication.md. Contributed by fang [Apr 10, 2018 6:29:28 AM] (yqlin) HDFS-13410. RBF: Support federation with no subclusters. Contributed by [Apr 10, 2018 7:34:42 AM] (yqlin) HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by [Apr 10, 2018 9:59:40 AM] (aajisaka) HADOOP-15374. Add links of the new features of 3.1.0 to the top page [Apr 10, 2018 10:39:09 AM] (sunilg) YARN-7804. [UI2] Refresh action on Grid view page should not be -1 overall The following subsystems voted -1: compile mvninstall unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFileUtil hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.fs.TestLocalFileSystem hadoop.fs.TestRawLocalFileSystemContract hadoop.fs.TestTrash hadoop.fs.viewfs.TestViewFileSystemWithAuthorityLocalFileSystem hadoop.http.TestHttpServer hadoop.http.TestHttpServerLogs hadoop.io.nativeio.TestNativeIO hadoop.ipc.TestIPC hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal hadoop.security.TestSecurityUtil hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestNativeCodeLoader hadoop.fs.TestResolveHdfsSymlink hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.crypto.TestHdfsCryptoStreams hadoop.hdfs.qjournal.client.TestQuorumJournalManager hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.balancer.TestBalancer hadoop.hdfs.server.balancer.TestBalancerRPCDelay hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestBlockRecovery hadoop.hdfs.server.datanode.TestBlockScanner hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeMetrics hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestHSync hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand hadoop.hdfs.server.diskbalancer.TestDiskBalancer hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.mover.TestMover hadoop.hdfs.server.mover.TestStorageMover hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestDNFencing hadoop.hdfs.server.namenode.ha.TestHAAppend hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot hadoop.hdfs.server.namenode.snapshot.TestOpenFile