Thanks Artem, appreciate the report.

HBASE-20096


On Mon, Feb 26, 2018 at 1:21 PM, Artem Ervits <artemerv...@gmail.com> wrote:

> Ted's correct, I mistakenly pulled the wrong hbase-site. Please see other
> warning on missing plugin version.
>
> On Feb 26, 2018 4:12 PM, "Ted Yu" <yuzhih...@gmail.com> wrote:
>
> > Artem:
> > Please check your hbase-site.xml and remove BackupLogCleaner which should
> > be left over from another deployment.
> >
> > Cheers
> >
> > On Mon, Feb 26, 2018 at 1:07 PM, Andrew Purtell <apurt...@apache.org>
> > wrote:
> >
> > > Thanks for the vote Artem.
> > >
> > > ​> FAILURE! - in org.apache.hadoop.hbase.http.TestSpnegoHttpServer
> > >
> > > Is this due to the same reason as before? The minikdc doesn't come up
> > > because of a missing configuration file directory? Perhaps with your
> > Linux
> > > variant installing the client package isn't enough, you'll also have to
> > put
> > > in place a valid configuration?
> > >
> > > > java.lang.ClassNotFoundException: org.apache.hadoop.hbase.
> > > backup.master.BackupLogCleaner
> > >
> > > This class doesn't exist in HBase 1.x so I am confused as to how this
> is
> > > possible.
> > >
> > >
> > > On Mon, Feb 26, 2018 at 1:01 PM, Artem Ervits <artemerv...@gmail.com>
> > > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > Hadoop Pseudo-distrbibuted: 2.7.5
> > > > $M2_HOME from scratch
> > > > Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d;
> > > > 2017-10-18T07:58:13Z)
> > > > Maven home: /opt/maven/apache-maven-3.5.2
> > > > Java version: 1.8.0_161, vendor: Oracle Corporation
> > > > Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.
> > > > x86_64/jre
> > > > Default locale: en_US, platform encoding: UTF-8
> > > > OS name: "linux", version: "3.10.0-693.11.6.el7.x86_64", arch:
> "amd64",
> > > > family: "unix"
> > > >
> > > > Binary Release:
> > > > Java 1M rows: OK
> > > > LTT 1M rows: OK
> > > > PE 1M rows: OK
> > > > MD5: OK
> > > >
> > > > hbase shell: OK
> > > > create, list, scan, count, truncate, disable, drop
> > > > snapshot, restore_snapshot
> > > > UI: OK
> > > >
> > > > Source Release:
> > > > Build with: mvn clean -DskipTests -Dhadoop-two.version=2.7.5 install
> &&
> > > mvn
> > > > clean -DskipTests -Dhadoop-two.version=2.7.5 package assembly:single
> > > > MD5: OK
> > > >         installed and ran from src: OK
> > > >
> > > > reviewed the logs, all OK except for master:
> > > >
> > > > 2018-02-26 20:12:47,478 WARN  [hadoop:16000.activeMasterManager]
> > > > cleaner.CleanerChore: Can NOT create CleanerDelegate:
> > > > org.apache.hadoop.hbase
> > > > .backup.master.BackupLogCleaner
> > > > java.lang.ClassNotFoundException:
> > > > org.apache.hadoop.hbase.backup.master.BackupLogCleaner
> > > >         at java.net.URLClassLoader.findClass(URLClassLoader.java:
> 381)
> > > >         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > > >         at sun.misc.Launcher$AppClassLoader.loadClass(
> > Launcher.java:338)
> > > >         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > > >         at java.lang.Class.forName0(Native Method)
> > > >         at java.lang.Class.forName(Class.java:264)
> > > >         at
> > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.
> > > > newFileCleaner(CleanerChore.java:109)
> > > >         at
> > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.
> > > > initCleanerChain(CleanerChore.java:91)
> > > >         at
> > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.<
> > > > init>(CleanerChore.java:71)
> > > >         at
> > > > org.apache.hadoop.hbase.master.cleaner.LogCleaner.<
> > > > init>(LogCleaner.java:49)
> > > >         at
> > > > org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.
> > > > java:1222)
> > > >         at
> > > > org.apache.hadoop.hbase.master.HMaster.
> finishActiveMasterInitializati
> > > > on(HMaster.java:781)
> > > >         at
> > > > org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:205)
> > > >         at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster.
> > > java:2023)
> > > >         at java.lang.Thread.run(Thread.java:748)
> > > >
> > > >
> > > > Noticed the following:
> > > >
> > > > *[WARNING]*
> > > > *[WARNING] Some problems were encountered while building the
> effective
> > > > model for org.apache.hbase:hbase-shaded-check-invariants:pom:1.4.2*
> > > > *[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo: is
> > > > missing. @
> > > > org.apache.hbase:hbase-shaded-check-invariants:[unknown-version],
> > > > /tmp/hbase-1.4.2/hbase-shaded/hbase-shaded-check-invariants/pom.xml,
> > > line
> > > > 161, column 15*
> > > > *[WARNING]*
> > > > *[WARNING] It is highly recommended to fix these problems because
> they
> > > > threaten the stability of your build.*
> > > > *[WARNING]*
> > > > *[WARNING] For this reason, future Maven versions might no longer
> > support
> > > > building such malformed projects.*
> > > >
> > > > this is addressed in master
> > > > https://github.com/apache/hbase/blob/master/hbase-
> > > > shaded/hbase-shaded-check-invariants/pom.xml#L164
> > > >
> > > > ran the
> > > >
> > > > mvn test -P runSmallTests: not OK
> > > >
> > > > I pointed it out in hbase-1.4.1 vote and perhaps it is due to my dev
> > env
> > > > though I did try installing Kerberos libs previously and errors
> > > persisted.
> > > >
> > > >
> > > > *[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time
> > > elapsed:
> > > > 0.263 s - in org.apache.hadoop.hbase.TestTimeout*
> > > >
> > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time
> > > elapsed:
> > > > 1.937 s - in org.apache.hadoop.hbase.client.TestClientNoCluster*
> > > >
> > > > *WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time
> > elapsed:
> > > > 6.424 s - in org.apache.hadoop.hbase.client.TestHBaseAdminNoCluster*
> > > >
> > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time
> > > elapsed:
> > > > 0 s - in
> > > > org.apache.hadoop.hbase.master.balancer.
> TestFavoredNodeAssignmentHelpe
> > r*
> > > >
> > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time
> > > elapsed:
> > > > 5.837 s - in org.apache.hadoop.hbase.security.TestSecureIPC*
> > > >
> > > > *[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time
> > > elapsed:
> > > > 0 s - in org.apache.hadoop.hbase.ipc.TestRpcHandlerException*
> > > >
> > > > *[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time
> > > elapsed:
> > > > 1.237 s - in org.apache.hadoop.hbase.http.TestServletFilter*
> > > >
> > > > *[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 3, Time
> > > elapsed:
> > > > 3.626 s - in org.apache.hadoop.hbase.http.TestHttpServer*
> > > > *[INFO] Running org.apache.hadoop.hbase.http.TestSpnegoHttpServer*
> > > > *[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> > elapsed:
> > > > 0.001 s <<< FAILURE! - in org.apache.hadoop.hbase.http.
> > > > TestSpnegoHttpServer*
> > > > *[ERROR] org.apache.hadoop.hbase.http.TestSpnegoHttpServer  Time
> > > elapsed:
> > > > 0
> > > > s  <<< ERROR!*
> > > > *java.lang.RuntimeException: Unable to parse:includedir
> > > /etc/krb5.conf.d/*
> > > > * at
> > > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.buildMiniKdc(
> > > > TestSpnegoHttpServer.java:143)*
> > > > * at
> > > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.setupServer(
> > > > TestSpnegoHttpServer.java:91)*
> > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time
> > > elapsed:
> > > > 0 s - in org.apache.hadoop.hbase.http.TestHttpServerLifecycle*
> > > >
> > > > *[INFO]*
> > > > *[INFO] Results:*
> > > > *[INFO]*
> > > > *[ERROR] Errors:*
> > > > *[ERROR]   TestSpnegoHttpServer.setupServer:91->buildMiniKdc:143 »
> > > Runtime
> > > > Unable to pars...*
> > > > *[INFO]*
> > > > *[ERROR] Tests run: 1157, Failures: 0, Errors: 1, Skipped: 22*
> > > > *[INFO]*
> > > > *[INFO]
> > > > ------------------------------------------------------------
> > > ------------*
> > > > *[INFO] Reactor Summary:*
> > > > *[INFO]*
> > > > *[INFO] Apache HBase .......................................
> SUCCESS [
> > > > 3.101 s]*
> > > > *[INFO] Apache HBase - Checkstyle .......................... SUCCESS
> [
> > > > 0.700 s]*
> > > > *[INFO] Apache HBase - Resource Bundle ..................... SUCCESS
> [
> > > > 0.255 s]*
> > > > *[INFO] Apache HBase - Annotations ......................... SUCCESS
> [
> > > > 0.839 s]*
> > > > *[INFO] Apache HBase - Protocol ............................ SUCCESS
> [
> > > > 0.349 s]*
> > > > *[INFO] Apache HBase - Common .............................. SUCCESS
> > > [02:07
> > > > min]*
> > > > *[INFO] Apache HBase - Procedure ........................... SUCCESS
> > > [03:16
> > > > min]*
> > > > *[INFO] Apache HBase - Metrics API ......................... SUCCESS
> [
> > > > 2.668 s]*
> > > > *[INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS
> [
> > > > 13.360 s]*
> > > > *[INFO] Apache HBase - Metrics Implementation .............. SUCCESS
> [
> > > > 8.440 s]*
> > > > *[INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS
> [
> > > > 19.941 s]*
> > > > *[INFO] Apache HBase - Client .............................. SUCCESS
> > > [02:13
> > > > min]*
> > > > *[INFO] Apache HBase - Prefix Tree ......................... SUCCESS
> [
> > > > 15.483 s]*
> > > > *[INFO] Apache HBase - Server .............................. FAILURE
> > > [28:53
> > > > min]*
> > > > *[INFO] Apache HBase - Testing Util ........................ SKIPPED*
> > > > *[INFO] Apache HBase - Thrift .............................. SKIPPED*
> > > > *[INFO] Apache HBase - Rest ................................
> SKIPPED*
> > > > *[INFO] Apache HBase - RSGroup ............................. SKIPPED*
> > > > *[INFO] Apache HBase - Shell ...............................
> SKIPPED*
> > > > *[INFO] Apache HBase - Integration Tests ................... SKIPPED*
> > > > *[INFO] Apache HBase - Examples ............................ SKIPPED*
> > > > *[INFO] Apache HBase - External Block Cache ................ SKIPPED*
> > > > *[INFO] Apache HBase - Assembly ............................ SKIPPED*
> > > > *[INFO] Apache HBase - Shaded .............................. SKIPPED*
> > > > *[INFO] Apache HBase - Shaded - Client ..................... SKIPPED*
> > > > *[INFO] Apache HBase - Shaded - Server ..................... SKIPPED*
> > > > *[INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED*
> > > > *[INFO] Apache HBase - Archetypes .......................... SKIPPED*
> > > > *[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED*
> > > > *[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype
> > > SKIPPED*
> > > > *[INFO] Apache HBase - Archetype builder ................... SKIPPED*
> > > > *[INFO]
> > > > ------------------------------------------------------------
> > > ------------*
> > > > *[INFO] BUILD FAILURE*
> > > > *[INFO]
> > > > ------------------------------------------------------------
> > > ------------*
> > > > *[INFO] Total time: 37:39 min*
> > > > *[INFO] Finished at: 2018-02-26T19:10:39Z*
> > > > *[INFO] Final Memory: 84M/345M*
> > > > *[INFO]
> > > > ------------------------------------------------------------
> > > ------------*
> > > > *[ERROR] Failed to execute goal
> > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test
> > > (default-test)
> > > > on project hbase-server: There are test failures.*
> > > > *[ERROR]*
> > > > *[ERROR] Please refer to
> > > > /tmp/hbase-1.4.2/hbase-server/target/surefire-reports for the
> > individual
> > > > test results.*
> > > > *[ERROR] Please refer to dump files (if any exist)
> > [date]-jvmRun[N].dump,
> > > > [date].dumpstream and [date]-jvmRun[N].dumpstream.*
> > > > *[ERROR] -> [Help 1]*
> > > > *[ERROR]*
> > > > *[ERROR] To see the full stack trace of the errors, re-run Maven with
> > the
> > > > -e switch.*
> > > > *[ERROR] Re-run Maven using the -X switch to enable full debug
> > logging.*
> > > > *[ERROR]*
> > > > *[ERROR] For more information about the errors and possible
> solutions,
> > > > please read the following articles:*
> > > > *[ERROR] [Help 1]
> > > > http://cwiki.apache.org/confluence/display/MAVEN/
> MojoFailureException
> > > > <http://cwiki.apache.org/confluence/display/MAVEN/
> MojoFailureException
> > >*
> > > > *[ERROR]*
> > > > *[ERROR] After correcting the problems, you can resume the build with
> > the
> > > > command*
> > > > *[ERROR]   mvn <goals> -rf :hbase-server *
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Mon, Feb 26, 2018 at 1:28 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> > > >
> > > > > +1
> > > > >
> > > > > Checked signatures
> > > > > Ran unit test suite against JDK 1.8 - passed
> > > > > Tried some basic shell commands
> > > > >
> > > > > On Mon, Feb 26, 2018 at 9:24 AM, Josh Elser <els...@apache.org>
> > wrote:
> > > > >
> > > > > > +1 (binding)
> > > > > >
> > > > > > * src release contents looks OK
> > > > > > * sigs/xsums OK
> > > > > > * apache-rat:check OK
> > > > > > * Can build src release
> > > > > > * LICENSE looks OK
> > > > > > * Copyright in NOTICE needs updating for 2018
> > > > > >
> > > > > > Only thing I noticed is that we need to update the checksum
> naming
> > > > > > convention for SHA*. Per [1], .sha filenames should only contain
> > > SHA1,
> > > > > and
> > > > > > .sha512 file names should be used for SHA512 xsum. I believe this
> > > means
> > > > > we
> > > > > > just need to modify make_rc.sh to put the xsum into .sha512
> instead
> > > of
> > > > > > .sha. We do not need to distribute SHA1 xsums and, afaik, there
> is
> > > > little
> > > > > > cryptographic value to this.
> > > > > >
> > > > > > [1] http://www.apache.org/dev/release-distribution.html#
> > > sigs-and-sums
> > > > > >
> > > > > > On 2/22/18 6:55 PM, Andrew Purtell wrote:
> > > > > >
> > > > > >> The second HBase 1.4.2 release candidate (RC1) is available for
> > > > download
> > > > > >> at
> > > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/
> and
> > > > Maven
> > > > > >> artifacts are available in the temporary repository
> > > > > >> https://repository.apache.org/content/repositories/
> > > > orgapachehbase-1196/
> > > > > .
> > > > > >>
> > > > > >> The git tag corresponding to the candidate is '1.4.2RC1'
> > > (b4ec89059c).
> > > > > >> Note
> > > > > >> this is different from branch-1.4 by one commit because we had
> an
> > > > > >> intervening commit between tag and push (08b9939974,
> HBASE-20016)
> > > > while
> > > > > I
> > > > > >> was running tests. The only difference is the CHANGES.txt update
> > for
> > > > > >> 1.4.2RC1 is placed ahead of the commit for HBASE-20016, but does
> > not
> > > > > >> mention it, which is fine, because 1.4.2RC1 does not contain
> > > > > HBASE-20016.
> > > > > >>
> > > > > >> A detailed source and binary compatibility report for this
> release
> > > is
> > > > > >> available for your review at
> > > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/
> > > > > >> compat-check-report.html
> > > > > >> .
> > > > > >>
> > > > > >> A list of the 22 issues resolved in this release can be found at
> > > > > >> https://s.apache.org/aGcb .
> > > > > >>
> > > > > >> Please try out the candidate and vote +1/0/-1.
> > > > > >>
> > > > > >> This vote will be open for at least 72 hours. Unless objection I
> > > will
> > > > > try
> > > > > >> to close it Thursday February 28, 2018 if we have sufficient
> > votes.
> > > > > >>
> > > > > >> Prior to making this announcement I made the following preflight
> > > > checks:
> > > > > >>
> > > > > >>     - RAT check passes (7u80)
> > > > > >>     - Unit test suite passes (8u131)
> > > > > >>     - LTT load 1M rows with 100% verification and 20% updates
> > > (8u131)
> > > > > >>     - PE sequentialWrite, sequentialRead, randomWrite,
> randomRead,
> > > > > >>     scanRange100 (8u131)
> > > > > >>     - ITBLL Loop 1 100M rows (8u131)
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > >
> > > >
> > >
> >
>

Reply via email to