[VOTE] [RESULT] Release Apache Hadoop 2.8.5 (RC0)
Thanks all who helped to verify and vote! I give my binding +1 to conclude the vote for 2.8.5 RC0: - Built from source and verified signatures - Deployed a small distributed cluster and run simple jobs - Verified UI of daemons, such as: NN, RM, DN, NM, etc Now, our RC0 for 2.8.5 got: 6 binding +1s, from: Jason Lowe, Eric Payne, Kihwal Lee, Brahma Reddy Battula, Yesha Vora, Junping Du 4 non-binding +1s, from: Gabor Bota, Eric Badger, Zsolt Venczel, Kitti Nánási and no -1s. So I am glad to announce that the vote for 2.8.5 RC0 passes. Thanks everyone listed above who tried the release candidate and vote and all who ever help with 2.8.5 release effort in all kinds of ways. I'll push the release bits and send out an announcement for 2.8.5 soon. Thanks, Junping Kitti Nánási 于2018年9月13日周四 上午8:34写道： > Thanks for working on this Junping! > > +1 (non-binding) > > - checked out git tag release-2.8.5-RC0 > - built from source on Mac OS X 10.13.4, java version 8.0.172-zulu > - deployed on a 3 node cluster > - ran terasort, teragen, teravalidate with success > - executed basic hdfs and dfsadmin commands > > Thanks, > Kitti > > > On Wed, Sep 12, 2018 at 2:37 PM, Yesha Vora wrote: > >> +1 (binding) >> >> Tested the following: >> - launch Pseudo-Distributed 1 node cluster >> - Tested with word count / teragen / terasort / nnbench/ mrbench on yarn >> - Validate yarn UI >> - Test basic yarn cli operations such as -kill, -status, -appStates, >> -appTypes >> >> -- >> Yesha Vora >> >> >> >> From: 俊平堵 >> Sent: Monday, September 10, 2018 5:00 AM >> To: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; >> yarn-...@hadoop.apache.org >> Cc: junpingdu(堵俊平) >> Subject: [VOTE] Release Apache Hadoop 2.8.5 (RC0) >> >> Hi all, >> >> I've created the first release candidate (RC0) for Apache >> Hadoop 2.8.5. This is our next point release to follow up 2.8.4. It >> includes 33 important fixes and improvements. >> >> >> The RC artifacts are available at: >> http://home.apache.org/~junping_du/hadoop-2.8.5-RC0 >> >> >> The RC tag in git is: release-2.8.5-RC0 >> >> >> >> The maven artifacts are available via repository.apache.org< >> http://repository.apache.org> at: >> >> https://repository.apache.org/content/repositories/orgapachehadoop-1140 >> >> >> Please try the release and vote; the vote will run for the usual 5 >> working >> days, ending on 9/15/2018 PST time. >> >> >> Thanks, >> >> >> Junping >> >> >> - >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >> >> >
Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)(Internet mail)
Hi Ajay,
I cannot reproduce this issue. Can you check if there is some issues with
your system settings or configurations?
Thanks,
Junping
On 13/09/2018, 00:17, "Ajay Kumar" wrote:
Built from source. Not sure if I am missing some config but MR test jobs
(Pi) are failing with error. ("Error: Could not find or load main class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster".)
Anyone else facing same issue?
See below exception in Nodemanager which I haven't seen earlier.
2018-09-11 11:26:31,343 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl:
NodeManager metrics system started
2018-09-11 11:26:31,386 WARN
org.apache.hadoop.yarn.util.ResourceCalculatorPlugin:
java.lang.UnsupportedOperationException: Could not determine OS: Failed to
instantiate default resource calculator.
java.lang.UnsupportedOperationException: Could not determine OS
at org.apache.hadoop.util.SysInfo.newInstance(SysInfo.java:43)
at
org.apache.hadoop.yarn.util.ResourceCalculatorPlugin.(ResourceCalculatorPlugin.java:41)
at
org.apache.hadoop.yarn.util.ResourceCalculatorPlugin.getResourceCalculatorPlugin(ResourceCalculatorPlugin.java:191)
at
org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl.serviceInit(NodeResourceMonitorImpl.java:74)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:357)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:636)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
Thanks,
Ajay
On 9/12/18, 6:31 AM, "Kihwal Lee" wrote:
+1 (binding)
- Built from source
- Brought up a single node cluster
- Checked basic HDFS functions and checked the UIs
- Ran several simple jobs.
On Mon, Sep 10, 2018 at 7:01 AM 俊平堵 wrote:
> Hi all,
>
> I've created the first release candidate (RC0) for Apache
> Hadoop 2.8.5. This is our next point release to follow up 2.8.4. It
> includes 33 important fixes and improvements.
>
>
> The RC artifacts are available at:
> http://home.apache.org/~junping_du/hadoop-2.8.5-RC0
>
>
> The RC tag in git is: release-2.8.5-RC0
>
>
>
> The maven artifacts are available via repository.apache.org<
> http://repository.apache.org> at:
>
>
https://repository.apache.org/content/repositories/orgapachehadoop-1140
>
>
> Please try the release and vote; the vote will run for the usual 5
> working
> days, ending on 9/15/2018 PST time.
>
>
> Thanks,
>
>
> Junping
>
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/ [Sep 15, 2018 11:21:32 AM] (elek) HDDS-409. Ozone acceptance-test and integration-test packages have [Sep 15, 2018 11:35:21 AM] (elek) HDDS-449. Add a NULL check to protect DeadNodeHandler#onMessage. [Sep 15, 2018 5:41:39 PM] (nanda) HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. [Sep 15, 2018 5:44:57 PM] (nanda) HDDS-465. Suppress group mapping lookup warnings for ozone. Contributed -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine Unread field:FSBasedSubmarineStorageImpl.java:[line 39] Found reliance on default encoding in org.apache.hadoop.yarn.submarine.runtimes.yarnservice.YarnServiceJobSubmitter.generateCommandLaunchScript(RunJobParameters, TaskType, Component):in org.apache.hadoop.yarn.submarine.runtimes.yarnservice.YarnServiceJobSubmitter.generateCommandLaunchScript(RunJobParameters, TaskType, Component): new java.io.FileWriter(File) At YarnServiceJobSubmitter.java:[line 195] org.apache.hadoop.yarn.submarine.runtimes.yarnservice.YarnServiceJobSubmitter.generateCommandLaunchScript(RunJobParameters, TaskType, Component) may fail to clean up java.io.Writer on checked exception Obligation to clean up resource created at YarnServiceJobSubmitter.java:to clean up java.io.Writer on checked exception Obligation to clean up resource created at YarnServiceJobSubmitter.java:[line 195] is not discharged org.apache.hadoop.yarn.submarine.runtimes.yarnservice.YarnServiceUtils.getComponentArrayJson(String, int, String) concatenates strings using + in a loop At YarnServiceUtils.java:using + in a loop At YarnServiceUtils.java:[line 72] Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static test_libhdfs_threaded_hdfspp_test_shim_static Failed junit tests : hadoop.hdfs.TestLeaseRecovery2 hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.client.api.impl.TestAMRMProxy cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-compile-javac-root.txt [300K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/xml.txt [4.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-submarine-warnings.html [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/branch-findbugs-hadoop-hdds_client.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/branch-findbugs-hadoop-hdds_framework.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/898/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [4.0K]
