Re: branch-3. Was it a created by mistake?
IIRC, This was created accidentally. You should take a look at earlier discussion thread for more info i.e https://s.apache.org/zla4u -Rohith Sharma K S On Wed, 28 Aug 2019 at 04:54, Wei-Chiu Chuang wrote: > I just realized there is a branch-3 in the Hadoop repo. Was this created by > mistake? > > I don't think we've decided to create a branch-3. It also looks like the > branch is rarely used. The last commit was > > commit bf90a27b51b1f1ac102fa861eb28025d21aad19b (origin/branch-3, branch-3) > Author: Chen Liang > Date: Thu Nov 29 13:31:58 2018 -0800 > > HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen > Liang. >
branch-3. Was it a created by mistake?
I just realized there is a branch-3 in the Hadoop repo. Was this created by mistake? I don't think we've decided to create a branch-3. It also looks like the branch is rarely used. The last commit was commit bf90a27b51b1f1ac102fa861eb28025d21aad19b (origin/branch-3, branch-3) Author: Chen Liang Date: Thu Nov 29 13:31:58 2018 -0800 HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen Liang.
Re: [DISCUSS] GitHub PRs without JIRA number
I wouldn't go for #3 and always require a JIRA for a PR. In general, I think we should state the best practices for using GitHub PRs. There were some guidelines but they were kind of open For example, adding always a link to the JIRA to the description. I think PRs can have a template as a start. The other thing I would do is to disable the automatic Jenkins trigger. I've seen the "retest this" and others: https://wiki.jenkins.io/display/JENKINS/GitHub+pull+request+builder+plugin https://github.com/jenkinsci/ghprb-plugin/blob/master/README.md On Tue, Aug 27, 2019 at 10:47 AM Wei-Chiu Chuang wrote: > Hi, > There are hundreds of GitHub PRs pending review. Many of them just sit > there wasting Jenkins resources. > > I suggest: > (1) close PRs that went stale (i.e. doesn't compile). Or even close PRs > that hasn't been reviewed for more than a year. > (1) close PRs that doesn't have a JIRA number. No one is going to review a > big PR that doesn't have a JIRA anyway. > (2) For PRs without JIRA number, file JIRAs for the PR on behalf of the > reporter. > (3) For typo fixes, merge the PRs directly without a JIRA. IMO, this is the > best use of GitHub PR. > > Thoughts? >
Re: [VOTE] Merge YARN-8200 to branch-2 and branch-3.0
+1 for the merge. We probably should not bother with branch-3.0 merge since it's been voted EOL. Thanks, --Konstantin On Thu, Aug 22, 2019 at 4:43 PM Jonathan Hung wrote: > Hi folks, > > As per [1], starting a vote to merge YARN-8200 (and YARN-8200.branch3) > feature branch to branch-2 (and branch-3.0). > > Vote runs for 7 days, to Thursday, Aug 29 5:00PM PDT. > > Thanks. > > [1] > > http://mail-archives.apache.org/mod_mbox/hadoop-yarn-dev/201908.mbox/%3cCAHzWLgcX7f5Tr3q=csrqgysvpdf7mh-iu17femgx89dhr+1...@mail.gmail.com%3e > > Jonathan Hung >
Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL
+1 for the proposal. I thought we already EOL-ed 2.6 though some time ago. Thanks, --Konstantin On Tue, Aug 20, 2019 at 8:03 PM Wangda Tan wrote: > Hi all, > > This is a vote thread to mark any versions smaller than 2.7 (inclusive), > and 3.0 EOL. This is based on discussions of [1] > > This discussion runs for 7 days and will conclude on Aug 28 Wed. > > Please feel free to share your thoughts. > > Thanks, > Wangda > > [1] > > http://mail-archives.apache.org/mod_mbox/hadoop-yarn-dev/201908.mbox/%3cCAD++eC=ou-tit1faob-dbecqe6ht7ede7t1dyra2p1yinpe...@mail.gmail.com%3e > , >
[DISCUSS] GitHub PRs without JIRA number
Hi, There are hundreds of GitHub PRs pending review. Many of them just sit there wasting Jenkins resources. I suggest: (1) close PRs that went stale (i.e. doesn't compile). Or even close PRs that hasn't been reviewed for more than a year. (1) close PRs that doesn't have a JIRA number. No one is going to review a big PR that doesn't have a JIRA anyway. (2) For PRs without JIRA number, file JIRAs for the PR on behalf of the reporter. (3) For typo fixes, merge the PRs directly without a JIRA. IMO, this is the best use of GitHub PR. Thoughts?
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/ [Aug 26, 2019 10:37:26 AM] (ewan.higgs) Revert "HADOOP-16193. Add extra S3A MPU test to see what happens if a [Aug 26, 2019 3:36:15 PM] (rohithsharmaks) YARN-8917. Absolute (maximum) capacity of level3+ queues is wrongly [Aug 26, 2019 4:12:35 PM] (ebadger) YARN-9771. Add GPU in the container-executor.cfg example. Contributed by [Aug 26, 2019 5:51:33 PM] (bibinchundatt) YARN-9642. Fix Memory Leak in AbstractYarnScheduler caused by timer. [Aug 26, 2019 6:05:40 PM] (github) HDDS-1975. Implement default acls for bucket/volume/key for OM HA code. [Aug 26, 2019 10:50:33 PM] (jhung) YARN-9775. RMWebServices /scheduler-conf GET returns all hadoop [Aug 26, 2019 10:57:55 PM] (arp) HDFS-2470. NN should automatically set permissions on -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core Class org.apache.hadoop.applications.mawo.server.common.TaskStatus implements Cloneable but does not define or use clone method At TaskStatus.java:does not define or use clone method At TaskStatus.java:[lines 39-346] Equals method for org.apache.hadoop.applications.mawo.server.worker.WorkerId assumes the argument is of type WorkerId At WorkerId.java:the argument is of type WorkerId At WorkerId.java:[line 114] org.apache.hadoop.applications.mawo.server.worker.WorkerId.equals(Object) does not check for null argument At WorkerId.java:null argument At WorkerId.java:[lines 114-115] Failed CTEST tests : test_test_libhdfs_ops_hdfs_static test_test_libhdfs_threaded_hdfs_static test_test_libhdfs_zerocopy_hdfs_static test_test_native_mini_dfs test_libhdfs_threaded_hdfspp_test_shim_static test_hdfspp_mini_dfs_smoke_hdfspp_test_shim_static libhdfs_mini_stress_valgrind_hdfspp_test_static memcheck_libhdfs_mini_stress_valgrind_hdfspp_test_static test_libhdfs_mini_stress_hdfspp_test_shim_static test_hdfs_ext_hdfspp_test_shim_static Failed junit tests : hadoop.hdfs.server.federation.router.TestRouterWithSecureStartup hadoop.hdfs.server.federation.security.TestRouterHttpDelegationToken hadoop.yarn.sls.appmaster.TestAMSimulator cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-compile-javac-root.txt [332K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-patch-pylint.txt [220K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/diff-patch-shelldocs.txt [44K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/whitespace-eol.txt [9.6M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1241/artifact/out/xml.txt [16K] findbugs:
Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/ [Aug 26, 2019 9:32:27 PM] (cliang) HDFS-13977. NameNode can kill itself if it tries to send too many txns [Aug 26, 2019 11:05:25 PM] (jhung) YARN-9775. RMWebServices /scheduler-conf GET returns all hadoop -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client Boxed value is unboxed and then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:then immediately reboxed in org.apache.hadoop.yarn.server.timelineservice.storage.common.ColumnRWHelper.readResultsWithTimestamps(Result, byte[], byte[], KeyConverter, ValueConverter, boolean) At ColumnRWHelper.java:[line 335] Failed junit tests : hadoop.hdfs.TestRollingUpgrade hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.registry.secure.TestSecureLogins hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2 hadoop.yarn.client.cli.TestRMAdminCLI cc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-compile-cc-root-jdk1.7.0_95.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-compile-javac-root-jdk1.7.0_95.txt [328K] cc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-compile-cc-root-jdk1.8.0_222.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-compile-javac-root-jdk1.8.0_222.txt [308K] checkstyle: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-checkstyle-root.txt [16M] hadolint: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-patch-hadolint.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-patch-shellcheck.txt [72K] shelldocs: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-patch-shelldocs.txt [8.0K] whitespace: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/whitespace-tabs.txt [1.2M] xml: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/xml.txt [12K] findbugs: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase_hadoop-yarn-server-timelineservice-hbase-client-warnings.html [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-javadoc-javadoc-root-jdk1.7.0_95.txt [16K] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/diff-javadoc-javadoc-root-jdk1.8.0_222.txt [1.1M] unit: https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [232K] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-registry.txt [12K] https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/426/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [20K]
[jira] [Created] (HADOOP-16534) Exclude submarine code from hadoop source build
Nanda kumar created HADOOP-16534: Summary: Exclude submarine code from hadoop source build Key: HADOOP-16534 URL: https://issues.apache.org/jira/browse/HADOOP-16534 Project: Hadoop Common Issue Type: Bug Reporter: Nanda kumar Assignee: Nanda kumar When we do source package of hadoop, it should not contain submarine project/code. -- This message was sent by Atlassian Jira (v8.3.2#803003) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
