Artem: Please check your hbase-site.xml and remove BackupLogCleaner which should be left over from another deployment.
Cheers On Mon, Feb 26, 2018 at 1:07 PM, Andrew Purtell <apurt...@apache.org> wrote: > Thanks for the vote Artem. > > > FAILURE! - in org.apache.hadoop.hbase.http.TestSpnegoHttpServer > > Is this due to the same reason as before? The minikdc doesn't come up > because of a missing configuration file directory? Perhaps with your Linux > variant installing the client package isn't enough, you'll also have to put > in place a valid configuration? > > > java.lang.ClassNotFoundException: org.apache.hadoop.hbase. > backup.master.BackupLogCleaner > > This class doesn't exist in HBase 1.x so I am confused as to how this is > possible. > > > On Mon, Feb 26, 2018 at 1:01 PM, Artem Ervits <artemerv...@gmail.com> > wrote: > > > +1 (non-binding) > > > > Hadoop Pseudo-distrbibuted: 2.7.5 > > $M2_HOME from scratch > > Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; > > 2017-10-18T07:58:13Z) > > Maven home: /opt/maven/apache-maven-3.5.2 > > Java version: 1.8.0_161, vendor: Oracle Corporation > > Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4. > > x86_64/jre > > Default locale: en_US, platform encoding: UTF-8 > > OS name: "linux", version: "3.10.0-693.11.6.el7.x86_64", arch: "amd64", > > family: "unix" > > > > Binary Release: > > Java 1M rows: OK > > LTT 1M rows: OK > > PE 1M rows: OK > > MD5: OK > > > > hbase shell: OK > > create, list, scan, count, truncate, disable, drop > > snapshot, restore_snapshot > > UI: OK > > > > Source Release: > > Build with: mvn clean -DskipTests -Dhadoop-two.version=2.7.5 install && > mvn > > clean -DskipTests -Dhadoop-two.version=2.7.5 package assembly:single > > MD5: OK > > installed and ran from src: OK > > > > reviewed the logs, all OK except for master: > > > > 2018-02-26 20:12:47,478 WARN [hadoop:16000.activeMasterManager] > > cleaner.CleanerChore: Can NOT create CleanerDelegate: > > org.apache.hadoop.hbase > > .backup.master.BackupLogCleaner > > java.lang.ClassNotFoundException: > > org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > > at java.lang.Class.forName0(Native Method) > > at java.lang.Class.forName(Class.java:264) > > at > > org.apache.hadoop.hbase.master.cleaner.CleanerChore. > > newFileCleaner(CleanerChore.java:109) > > at > > org.apache.hadoop.hbase.master.cleaner.CleanerChore. > > initCleanerChain(CleanerChore.java:91) > > at > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.< > > init>(CleanerChore.java:71) > > at > > org.apache.hadoop.hbase.master.cleaner.LogCleaner.< > > init>(LogCleaner.java:49) > > at > > org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster. > > java:1222) > > at > > org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitializati > > on(HMaster.java:781) > > at > > org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:205) > > at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster. > java:2023) > > at java.lang.Thread.run(Thread.java:748) > > > > > > Noticed the following: > > > > *[WARNING]* > > *[WARNING] Some problems were encountered while building the effective > > model for org.apache.hbase:hbase-shaded-check-invariants:pom:1.4.2* > > *[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo: is > > missing. @ > > org.apache.hbase:hbase-shaded-check-invariants:[unknown-version], > > /tmp/hbase-1.4.2/hbase-shaded/hbase-shaded-check-invariants/pom.xml, > line > > 161, column 15* > > *[WARNING]* > > *[WARNING] It is highly recommended to fix these problems because they > > threaten the stability of your build.* > > *[WARNING]* > > *[WARNING] For this reason, future Maven versions might no longer support > > building such malformed projects.* > > > > this is addressed in master > > https://github.com/apache/hbase/blob/master/hbase- > > shaded/hbase-shaded-check-invariants/pom.xml#L164 > > > > ran the > > > > mvn test -P runSmallTests: not OK > > > > I pointed it out in hbase-1.4.1 vote and perhaps it is due to my dev env > > though I did try installing Kerberos libs previously and errors > persisted. > > > > > > *[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time > elapsed: > > 0.263 s - in org.apache.hadoop.hbase.TestTimeout* > > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time > elapsed: > > 1.937 s - in org.apache.hadoop.hbase.client.TestClientNoCluster* > > > > *WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: > > 6.424 s - in org.apache.hadoop.hbase.client.TestHBaseAdminNoCluster* > > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time > elapsed: > > 0 s - in > > org.apache.hadoop.hbase.master.balancer.TestFavoredNodeAssignmentHelper* > > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time > elapsed: > > 5.837 s - in org.apache.hadoop.hbase.security.TestSecureIPC* > > > > *[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time > elapsed: > > 0 s - in org.apache.hadoop.hbase.ipc.TestRpcHandlerException* > > > > *[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time > elapsed: > > 1.237 s - in org.apache.hadoop.hbase.http.TestServletFilter* > > > > *[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 3, Time > elapsed: > > 3.626 s - in org.apache.hadoop.hbase.http.TestHttpServer* > > *[INFO] Running org.apache.hadoop.hbase.http.TestSpnegoHttpServer* > > *[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > > 0.001 s <<< FAILURE! - in org.apache.hadoop.hbase.http. > > TestSpnegoHttpServer* > > *[ERROR] org.apache.hadoop.hbase.http.TestSpnegoHttpServer Time > elapsed: > > 0 > > s <<< ERROR!* > > *java.lang.RuntimeException: Unable to parse:includedir > /etc/krb5.conf.d/* > > * at > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.buildMiniKdc( > > TestSpnegoHttpServer.java:143)* > > * at > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.setupServer( > > TestSpnegoHttpServer.java:91)* > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time > elapsed: > > 0 s - in org.apache.hadoop.hbase.http.TestHttpServerLifecycle* > > > > *[INFO]* > > *[INFO] Results:* > > *[INFO]* > > *[ERROR] Errors:* > > *[ERROR] TestSpnegoHttpServer.setupServer:91->buildMiniKdc:143 » > Runtime > > Unable to pars...* > > *[INFO]* > > *[ERROR] Tests run: 1157, Failures: 0, Errors: 1, Skipped: 22* > > *[INFO]* > > *[INFO] > > ------------------------------------------------------------ > ------------* > > *[INFO] Reactor Summary:* > > *[INFO]* > > *[INFO] Apache HBase ....................................... SUCCESS [ > > 3.101 s]* > > *[INFO] Apache HBase - Checkstyle .......................... SUCCESS [ > > 0.700 s]* > > *[INFO] Apache HBase - Resource Bundle ..................... SUCCESS [ > > 0.255 s]* > > *[INFO] Apache HBase - Annotations ......................... SUCCESS [ > > 0.839 s]* > > *[INFO] Apache HBase - Protocol ............................ SUCCESS [ > > 0.349 s]* > > *[INFO] Apache HBase - Common .............................. SUCCESS > [02:07 > > min]* > > *[INFO] Apache HBase - Procedure ........................... SUCCESS > [03:16 > > min]* > > *[INFO] Apache HBase - Metrics API ......................... SUCCESS [ > > 2.668 s]* > > *[INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [ > > 13.360 s]* > > *[INFO] Apache HBase - Metrics Implementation .............. SUCCESS [ > > 8.440 s]* > > *[INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [ > > 19.941 s]* > > *[INFO] Apache HBase - Client .............................. SUCCESS > [02:13 > > min]* > > *[INFO] Apache HBase - Prefix Tree ......................... SUCCESS [ > > 15.483 s]* > > *[INFO] Apache HBase - Server .............................. FAILURE > [28:53 > > min]* > > *[INFO] Apache HBase - Testing Util ........................ SKIPPED* > > *[INFO] Apache HBase - Thrift .............................. SKIPPED* > > *[INFO] Apache HBase - Rest ................................ SKIPPED* > > *[INFO] Apache HBase - RSGroup ............................. SKIPPED* > > *[INFO] Apache HBase - Shell ............................... SKIPPED* > > *[INFO] Apache HBase - Integration Tests ................... SKIPPED* > > *[INFO] Apache HBase - Examples ............................ SKIPPED* > > *[INFO] Apache HBase - External Block Cache ................ SKIPPED* > > *[INFO] Apache HBase - Assembly ............................ SKIPPED* > > *[INFO] Apache HBase - Shaded .............................. SKIPPED* > > *[INFO] Apache HBase - Shaded - Client ..................... SKIPPED* > > *[INFO] Apache HBase - Shaded - Server ..................... SKIPPED* > > *[INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED* > > *[INFO] Apache HBase - Archetypes .......................... SKIPPED* > > *[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED* > > *[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype > SKIPPED* > > *[INFO] Apache HBase - Archetype builder ................... SKIPPED* > > *[INFO] > > ------------------------------------------------------------ > ------------* > > *[INFO] BUILD FAILURE* > > *[INFO] > > ------------------------------------------------------------ > ------------* > > *[INFO] Total time: 37:39 min* > > *[INFO] Finished at: 2018-02-26T19:10:39Z* > > *[INFO] Final Memory: 84M/345M* > > *[INFO] > > ------------------------------------------------------------ > ------------* > > *[ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test > (default-test) > > on project hbase-server: There are test failures.* > > *[ERROR]* > > *[ERROR] Please refer to > > /tmp/hbase-1.4.2/hbase-server/target/surefire-reports for the individual > > test results.* > > *[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, > > [date].dumpstream and [date]-jvmRun[N].dumpstream.* > > *[ERROR] -> [Help 1]* > > *[ERROR]* > > *[ERROR] To see the full stack trace of the errors, re-run Maven with the > > -e switch.* > > *[ERROR] Re-run Maven using the -X switch to enable full debug logging.* > > *[ERROR]* > > *[ERROR] For more information about the errors and possible solutions, > > please read the following articles:* > > *[ERROR] [Help 1] > > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > > <http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException>* > > *[ERROR]* > > *[ERROR] After correcting the problems, you can resume the build with the > > command* > > *[ERROR] mvn <goals> -rf :hbase-server * > > > > > > > > > > > > On Mon, Feb 26, 2018 at 1:28 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > +1 > > > > > > Checked signatures > > > Ran unit test suite against JDK 1.8 - passed > > > Tried some basic shell commands > > > > > > On Mon, Feb 26, 2018 at 9:24 AM, Josh Elser <els...@apache.org> wrote: > > > > > > > +1 (binding) > > > > > > > > * src release contents looks OK > > > > * sigs/xsums OK > > > > * apache-rat:check OK > > > > * Can build src release > > > > * LICENSE looks OK > > > > * Copyright in NOTICE needs updating for 2018 > > > > > > > > Only thing I noticed is that we need to update the checksum naming > > > > convention for SHA*. Per [1], .sha filenames should only contain > SHA1, > > > and > > > > .sha512 file names should be used for SHA512 xsum. I believe this > means > > > we > > > > just need to modify make_rc.sh to put the xsum into .sha512 instead > of > > > > .sha. We do not need to distribute SHA1 xsums and, afaik, there is > > little > > > > cryptographic value to this. > > > > > > > > [1] http://www.apache.org/dev/release-distribution.html# > sigs-and-sums > > > > > > > > On 2/22/18 6:55 PM, Andrew Purtell wrote: > > > > > > > >> The second HBase 1.4.2 release candidate (RC1) is available for > > download > > > >> at > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ and > > Maven > > > >> artifacts are available in the temporary repository > > > >> https://repository.apache.org/content/repositories/ > > orgapachehbase-1196/ > > > . > > > >> > > > >> The git tag corresponding to the candidate is '1.4.2RC1' > (b4ec89059c). > > > >> Note > > > >> this is different from branch-1.4 by one commit because we had an > > > >> intervening commit between tag and push (08b9939974, HBASE-20016) > > while > > > I > > > >> was running tests. The only difference is the CHANGES.txt update for > > > >> 1.4.2RC1 is placed ahead of the commit for HBASE-20016, but does not > > > >> mention it, which is fine, because 1.4.2RC1 does not contain > > > HBASE-20016. > > > >> > > > >> A detailed source and binary compatibility report for this release > is > > > >> available for your review at > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ > > > >> compat-check-report.html > > > >> . > > > >> > > > >> A list of the 22 issues resolved in this release can be found at > > > >> https://s.apache.org/aGcb . > > > >> > > > >> Please try out the candidate and vote +1/0/-1. > > > >> > > > >> This vote will be open for at least 72 hours. Unless objection I > will > > > try > > > >> to close it Thursday February 28, 2018 if we have sufficient votes. > > > >> > > > >> Prior to making this announcement I made the following preflight > > checks: > > > >> > > > >> - RAT check passes (7u80) > > > >> - Unit test suite passes (8u131) > > > >> - LTT load 1M rows with 100% verification and 20% updates > (8u131) > > > >> - PE sequentialWrite, sequentialRead, randomWrite, randomRead, > > > >> scanRange100 (8u131) > > > >> - ITBLL Loop 1 100M rows (8u131) > > > >> > > > >> > > > >> > > > >> > > > > > > > > > -- > Best regards, > Andrew > > Words like orphans lost among the crosstalk, meaning torn from truth's > decrepit hands > - A23, Crosstalk >
