Re: [VOTE] Moving branch-2 precommit/nightly test builds to java 8
Belated binding +1 from my side (on vacation). Thanks Jonathan for initiating this. -Subru On Thu, Feb 7, 2019 at 6:13 PM Jonathan Hung wrote: > My non-binding +1 to finish. This vote passes with 6 binding +1, 3 > non-binding +1, and no vetoes. We will make the changes as part > of HADOOP-15711, please follow there. > > Thanks all! > > Jonathan Hung > > > On Tue, Feb 5, 2019 at 11:38 PM Akira Ajisaka wrote: > > > +1 > > > > -Akira > > > > On Wed, Feb 6, 2019 at 9:13 AM Wangda Tan wrote: > > > > > > +1, make sense to me. > > > > > > On Tue, Feb 5, 2019 at 3:29 PM Konstantin Shvachko < > shv.had...@gmail.com > > > > > > wrote: > > > > > > > +1 Makes sense to me. > > > > > > > > Thanks, > > > > --Konst > > > > > > > > On Mon, Feb 4, 2019 at 6:14 PM Jonathan Hung > > wrote: > > > > > > > > > Hello, > > > > > > > > > > Starting a vote based on the discuss thread [1] for moving branch-2 > > > > > precommit/nightly test builds to openjdk8. After this change, the > > test > > > > > phase for precommit builds [2] and branch-2 nightly build [3] will > > run on > > > > > openjdk8. To maintain source compatibility, these builds will still > > run > > > > > their compile phase for branch-2 on openjdk7 as they do now (in > > addition > > > > to > > > > > compiling on openjdk8). > > > > > > > > > > Vote will run for three business days until Thursday Feb 7 6:00PM > > PDT. > > > > > > > > > > [1] > > > > > > > > > > > > > > > > > https://lists.apache.org/thread.html/7e6fb28fc67560f83a2eb62752df35a8d58d86b2a3df4cacb5d738ca@%3Ccommon-dev.hadoop.apache.org%3E > > > > > > > > > > [2] > > > > > > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-HADOOP-Build/ > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-HDFS-Build/ > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-YARN-Build/ > > > > > > > > > > > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-MAPREDUCE-Build/ > > > > > > > > > > [3] > > > > > > > > > > > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch2-java7-linux-x86/ > > > > > > > > > > Jonathan Hung > > > > > > > > > > > >
Re: [VOTE] Moving branch-2 precommit/nightly test builds to java 8
My non-binding +1 to finish. This vote passes with 6 binding +1, 3 non-binding +1, and no vetoes. We will make the changes as part of HADOOP-15711, please follow there. Thanks all! Jonathan Hung On Tue, Feb 5, 2019 at 11:38 PM Akira Ajisaka wrote: > +1 > > -Akira > > On Wed, Feb 6, 2019 at 9:13 AM Wangda Tan wrote: > > > > +1, make sense to me. > > > > On Tue, Feb 5, 2019 at 3:29 PM Konstantin Shvachko > > > wrote: > > > > > +1 Makes sense to me. > > > > > > Thanks, > > > --Konst > > > > > > On Mon, Feb 4, 2019 at 6:14 PM Jonathan Hung > wrote: > > > > > > > Hello, > > > > > > > > Starting a vote based on the discuss thread [1] for moving branch-2 > > > > precommit/nightly test builds to openjdk8. After this change, the > test > > > > phase for precommit builds [2] and branch-2 nightly build [3] will > run on > > > > openjdk8. To maintain source compatibility, these builds will still > run > > > > their compile phase for branch-2 on openjdk7 as they do now (in > addition > > > to > > > > compiling on openjdk8). > > > > > > > > Vote will run for three business days until Thursday Feb 7 6:00PM > PDT. > > > > > > > > [1] > > > > > > > > > > > > https://lists.apache.org/thread.html/7e6fb28fc67560f83a2eb62752df35a8d58d86b2a3df4cacb5d738ca@%3Ccommon-dev.hadoop.apache.org%3E > > > > > > > > [2] > > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-HADOOP-Build/ > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-HDFS-Build/ > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-YARN-Build/ > > > > > > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-MAPREDUCE-Build/ > > > > > > > > [3] > > > > > > > > > > > > https://builds.apache.org/view/H-L/view/Hadoop/job/hadoop-qbt-branch2-java7-linux-x86/ > > > > > > > > Jonathan Hung > > > > > > > >
[jira] [Created] (HADOOP-16099) Fix handling of path with multiple trailing slash in SwiftNativeFileSystem
Masatake Iwasaki created HADOOP-16099: - Summary: Fix handling of path with multiple trailing slash in SwiftNativeFileSystem Key: HADOOP-16099 URL: https://issues.apache.org/jira/browse/HADOOP-16099 Project: Hadoop Common Issue Type: Bug Components: fs/swift Affects Versions: 3.3.0 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Contract tests failed on Rackspace due to unremovable object from SwiftNativeFileSystem created by TestSwiftContractMkdir#testMkdirSlashHandling. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16098) Fix javadoc warnings in hadoop-aws
Masatake Iwasaki created HADOOP-16098: - Summary: Fix javadoc warnings in hadoop-aws Key: HADOOP-16098 URL: https://issues.apache.org/jira/browse/HADOOP-16098 Project: Hadoop Common Issue Type: Bug Components: fs/s3 Affects Versions: 3.3.0 Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki mvn package -Pdist fails due to javadoc warnings in hadoop-aws. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16097) Provide proper documentation for FairCallQueue
Erik Krogen created HADOOP-16097: Summary: Provide proper documentation for FairCallQueue Key: HADOOP-16097 URL: https://issues.apache.org/jira/browse/HADOOP-16097 Project: Hadoop Common Issue Type: Improvement Components: documentation, ipc Reporter: Erik Krogen Assignee: Erik Krogen FairCallQueue, added in HADOOP-10282, doesn't seem to be well-documented anywhere. Let's add in a new documentation for it and related components. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16096) HADOOP-15281 breaks 3.1 build
Eric Payne created HADOOP-16096:
---
Summary: HADOOP-15281 breaks 3.1 build
Key: HADOOP-16096
URL: https://issues.apache.org/jira/browse/HADOOP-16096
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 3.1.3
Reporter: Eric Payne
HADOOP-15281 breaks the branch-3.1 build when building with java 1.8.
{code:title="RetriableFileCopyCommand.java"}
LOG.info("Copying {} to {}", source.getPath(), target);
{code}
Multiple lines have this error:
{panel:title="Build Failure"}
[ERROR]
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/mapred/RetriableFileCopyCommand.java:[121,8]
no suitable method found for
info(java.lang.String,org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path)
[ERROR] method org.apache.commons.logging.Log.info(java.lang.Object) is not
applicable
[ERROR] (actual and formal argument lists differ in length)
[ERROR] method
org.apache.commons.logging.Log.info(java.lang.Object,java.lang.Throwable) is
not applicable
[ERROR] (actual and formal argument lists differ in length)
{panel}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[ANNOUNCE] Apache Hadoop 3.1.2 release
It gives us great pleasure to announce that the Apache Hadoop community has voted to release Apache Hadoop 3.1.2. IMPORTANT NOTES 3.1.2 is the second stable release of 3.1 line which is considered to be production-ready. Hadoop 3.1.2 brings a number of enhancements. The Hadoop community fixed 325 JIRAs [1] in total as part of the 3.1.2 release. Of these fixes: Apache Hadoop 3.1.2 contains a number of significant features and enhancements. A few of them are noted below. - Nvidia-docker-plugin v2 support for GPU support on YARN. - YARN service upgrade improvements and bug fixes. - YARN UIv2 improvements and bug fixes. - AliyunOSS related improvements and bug fixes. - Docker on YARN support related improvements and bug fixes. Please see the Hadoop 3.1.2 CHANGES for the detailed list of issues resolved. The release news is posted on the Apache Hadoop website too, you can go to the downloads section. Many thanks to everyone who contributed to the release, and everyone in the Apache Hadoop community! The release is a result of direct and indirect efforts from many contributors, listed below are the those who contributed directly by submitting patches and/or reporting issues. (148 contributors, Sorted by ID) BilwaST, Charo Zhang, GeLiXin, Harsha1206, Huachao, Jim_Brennan, LiJinglun, Naganarasimha, OrDTesters, RANith, Rakesh_Shah, Ray Burgemeestre, Sen Zhao, SoumyaPN, SouryakantaDwivedy, Tao Yang, Zian Chen, abmodi, adam.antal, ajayydv, ajisakaa, akhilpb, akhilsnaik, amihalyi, arpitagarwal, aw, ayushtkn, banditka, belugabehr, benlau, bibinchundatt, billie.rinaldi, boky01, bolke, borisvu, botong, brahmareddy, briandburton, bsteinbach, candychencan, ccondit-target, charanh, cheersyang, cltlfcjin, collinma, crh, csingh, csun, daisuke.kobayashi, daryn, dibyendu_hadoop, dineshchitlangia, ebadger, eepayne, elgoiri, erwaman, eyang, fengchuang, ferhui, fly_in_gis, gabor.bota, gezapeti, gsaha, haibochen, hexiaoqiao, hfyang20071, hgadre, jeagles, jhung, jiangjianfei, jianliang.wu, jira.shegalov, jiwq, jlowe, jojochuang, jonBoone, kanwaljeets, karams, kennethlnnn, kgyrtkirk, kihwal, knanasi, kshukla, laszlok, leftnoteasy, leiqiang, liaoyuxiangqin, linyiqun, ljain, lukmajercak, maniraj...@gmail.com, masatana, nandakumar131, oliverhuh...@gmail.com, oshevchenko, pbacsko, peruguusha, photogamrun, pj.fanning, prabham, pradeepambati, pranay_singh, revans2, rkanter, rohithsharma, shaneku...@gmail.com, shubham.dewan, shuzirra, shv, simonprewo, sinago, smeng, snemeth, sodonnell, sreenivasulureddy, ssath...@hortonworks.com, ssulav, ste...@apache.org, study, suma.shivaprasad, sunilg, surendrasingh, tangzhankun, tarunparimi, tasanuma0829, templedf, thinktaocs, tlipcon, tmarquardt, trjianjianjiao, uranus, varun_saxena, vinayrpet, vrushalic, wilfreds, write2kish...@gmail.com, wujinhu, xiaochen, xiaoheipangzi, xkrogen, yangjiandan, yeshavora, yiran, yoelee, yuzhih...@gmail.com, zichensun, zvenczel Wangda Tan and Sunil Govind [1] JIRA query: project in (YARN, HADOOP, MAPREDUCE, HDFS) AND resolution = Fixed AND fixVersion = 3.1.2 ORDER BY key ASC, updated ASC, created DESC, priority DESC
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/ [Feb 6, 2019 6:02:38 AM] (msingh) HDDS-1027. Add blockade Tests for datanode isolation and scm failures. [Feb 6, 2019 2:36:51 PM] (wwei) YARN-9253. Add UT to verify Placement Constraint in Distributed Shell. [Feb 6, 2019 5:54:47 PM] (xkrogen) HDFS-14250. [SBN read]. msync should always direct to active NameNode to [Feb 6, 2019 8:19:21 PM] (weichiu) HDFS-14242. OIV WebImageViewer: NPE when param op is not specified. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.mapred.TestJobCounters hadoop.yarn.service.TestYarnNativeServices cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-patch-hadolint.txt [8.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-patch-pylint.txt [124K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/whitespace-eol.txt [9.6M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/whitespace-tabs.txt [1.1M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-hdds_client.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-hdds_framework.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_common.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_s3gateway.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/diff-javadoc-javadoc-root.txt [752K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [480K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [84K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1040/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [108K]
