Thanks for the vote Artem. > FAILURE! - in org.apache.hadoop.hbase.http.TestSpnegoHttpServer
Is this due to the same reason as before? The minikdc doesn't come up because of a missing configuration file directory? Perhaps with your Linux variant installing the client package isn't enough, you'll also have to put in place a valid configuration? > java.lang.ClassNotFoundException: org.apache.hadoop.hbase. backup.master.BackupLogCleaner This class doesn't exist in HBase 1.x so I am confused as to how this is possible. On Mon, Feb 26, 2018 at 1:01 PM, Artem Ervits <artemerv...@gmail.com> wrote: > +1 (non-binding) > > Hadoop Pseudo-distrbibuted: 2.7.5 > $M2_HOME from scratch > Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; > 2017-10-18T07:58:13Z) > Maven home: /opt/maven/apache-maven-3.5.2 > Java version: 1.8.0_161, vendor: Oracle Corporation > Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4. > x86_64/jre > Default locale: en_US, platform encoding: UTF-8 > OS name: "linux", version: "3.10.0-693.11.6.el7.x86_64", arch: "amd64", > family: "unix" > > Binary Release: > Java 1M rows: OK > LTT 1M rows: OK > PE 1M rows: OK > MD5: OK > > hbase shell: OK > create, list, scan, count, truncate, disable, drop > snapshot, restore_snapshot > UI: OK > > Source Release: > Build with: mvn clean -DskipTests -Dhadoop-two.version=2.7.5 install && mvn > clean -DskipTests -Dhadoop-two.version=2.7.5 package assembly:single > MD5: OK > installed and ran from src: OK > > reviewed the logs, all OK except for master: > > 2018-02-26 20:12:47,478 WARN [hadoop:16000.activeMasterManager] > cleaner.CleanerChore: Can NOT create CleanerDelegate: > org.apache.hadoop.hbase > .backup.master.BackupLogCleaner > java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.backup.master.BackupLogCleaner > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:264) > at > org.apache.hadoop.hbase.master.cleaner.CleanerChore. > newFileCleaner(CleanerChore.java:109) > at > org.apache.hadoop.hbase.master.cleaner.CleanerChore. > initCleanerChain(CleanerChore.java:91) > at > org.apache.hadoop.hbase.master.cleaner.CleanerChore.< > init>(CleanerChore.java:71) > at > org.apache.hadoop.hbase.master.cleaner.LogCleaner.< > init>(LogCleaner.java:49) > at > org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster. > java:1222) > at > org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitializati > on(HMaster.java:781) > at > org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:205) > at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster.java:2023) > at java.lang.Thread.run(Thread.java:748) > > > Noticed the following: > > *[WARNING]* > *[WARNING] Some problems were encountered while building the effective > model for org.apache.hbase:hbase-shaded-check-invariants:pom:1.4.2* > *[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo: is > missing. @ > org.apache.hbase:hbase-shaded-check-invariants:[unknown-version], > /tmp/hbase-1.4.2/hbase-shaded/hbase-shaded-check-invariants/pom.xml, line > 161, column 15* > *[WARNING]* > *[WARNING] It is highly recommended to fix these problems because they > threaten the stability of your build.* > *[WARNING]* > *[WARNING] For this reason, future Maven versions might no longer support > building such malformed projects.* > > this is addressed in master > https://github.com/apache/hbase/blob/master/hbase- > shaded/hbase-shaded-check-invariants/pom.xml#L164 > > ran the > > mvn test -P runSmallTests: not OK > > I pointed it out in hbase-1.4.1 vote and perhaps it is due to my dev env > though I did try installing Kerberos libs previously and errors persisted. > > > *[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: > 0.263 s - in org.apache.hadoop.hbase.TestTimeout* > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: > 1.937 s - in org.apache.hadoop.hbase.client.TestClientNoCluster* > > *WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: > 6.424 s - in org.apache.hadoop.hbase.client.TestHBaseAdminNoCluster* > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: > 0 s - in > org.apache.hadoop.hbase.master.balancer.TestFavoredNodeAssignmentHelper* > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: > 5.837 s - in org.apache.hadoop.hbase.security.TestSecureIPC* > > *[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: > 0 s - in org.apache.hadoop.hbase.ipc.TestRpcHandlerException* > > *[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: > 1.237 s - in org.apache.hadoop.hbase.http.TestServletFilter* > > *[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: > 3.626 s - in org.apache.hadoop.hbase.http.TestHttpServer* > *[INFO] Running org.apache.hadoop.hbase.http.TestSpnegoHttpServer* > *[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > 0.001 s <<< FAILURE! - in org.apache.hadoop.hbase.http. > TestSpnegoHttpServer* > *[ERROR] org.apache.hadoop.hbase.http.TestSpnegoHttpServer Time elapsed: > 0 > s <<< ERROR!* > *java.lang.RuntimeException: Unable to parse:includedir /etc/krb5.conf.d/* > * at > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.buildMiniKdc( > TestSpnegoHttpServer.java:143)* > * at > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.setupServer( > TestSpnegoHttpServer.java:91)* > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: > 0 s - in org.apache.hadoop.hbase.http.TestHttpServerLifecycle* > > *[INFO]* > *[INFO] Results:* > *[INFO]* > *[ERROR] Errors:* > *[ERROR] TestSpnegoHttpServer.setupServer:91->buildMiniKdc:143 » Runtime > Unable to pars...* > *[INFO]* > *[ERROR] Tests run: 1157, Failures: 0, Errors: 1, Skipped: 22* > *[INFO]* > *[INFO] > ------------------------------------------------------------------------* > *[INFO] Reactor Summary:* > *[INFO]* > *[INFO] Apache HBase ....................................... SUCCESS [ > 3.101 s]* > *[INFO] Apache HBase - Checkstyle .......................... SUCCESS [ > 0.700 s]* > *[INFO] Apache HBase - Resource Bundle ..................... SUCCESS [ > 0.255 s]* > *[INFO] Apache HBase - Annotations ......................... SUCCESS [ > 0.839 s]* > *[INFO] Apache HBase - Protocol ............................ SUCCESS [ > 0.349 s]* > *[INFO] Apache HBase - Common .............................. SUCCESS [02:07 > min]* > *[INFO] Apache HBase - Procedure ........................... SUCCESS [03:16 > min]* > *[INFO] Apache HBase - Metrics API ......................... SUCCESS [ > 2.668 s]* > *[INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [ > 13.360 s]* > *[INFO] Apache HBase - Metrics Implementation .............. SUCCESS [ > 8.440 s]* > *[INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [ > 19.941 s]* > *[INFO] Apache HBase - Client .............................. SUCCESS [02:13 > min]* > *[INFO] Apache HBase - Prefix Tree ......................... SUCCESS [ > 15.483 s]* > *[INFO] Apache HBase - Server .............................. FAILURE [28:53 > min]* > *[INFO] Apache HBase - Testing Util ........................ SKIPPED* > *[INFO] Apache HBase - Thrift .............................. SKIPPED* > *[INFO] Apache HBase - Rest ................................ SKIPPED* > *[INFO] Apache HBase - RSGroup ............................. SKIPPED* > *[INFO] Apache HBase - Shell ............................... SKIPPED* > *[INFO] Apache HBase - Integration Tests ................... SKIPPED* > *[INFO] Apache HBase - Examples ............................ SKIPPED* > *[INFO] Apache HBase - External Block Cache ................ SKIPPED* > *[INFO] Apache HBase - Assembly ............................ SKIPPED* > *[INFO] Apache HBase - Shaded .............................. SKIPPED* > *[INFO] Apache HBase - Shaded - Client ..................... SKIPPED* > *[INFO] Apache HBase - Shaded - Server ..................... SKIPPED* > *[INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED* > *[INFO] Apache HBase - Archetypes .......................... SKIPPED* > *[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED* > *[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED* > *[INFO] Apache HBase - Archetype builder ................... SKIPPED* > *[INFO] > ------------------------------------------------------------------------* > *[INFO] BUILD FAILURE* > *[INFO] > ------------------------------------------------------------------------* > *[INFO] Total time: 37:39 min* > *[INFO] Finished at: 2018-02-26T19:10:39Z* > *[INFO] Final Memory: 84M/345M* > *[INFO] > ------------------------------------------------------------------------* > *[ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test (default-test) > on project hbase-server: There are test failures.* > *[ERROR]* > *[ERROR] Please refer to > /tmp/hbase-1.4.2/hbase-server/target/surefire-reports for the individual > test results.* > *[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, > [date].dumpstream and [date]-jvmRun[N].dumpstream.* > *[ERROR] -> [Help 1]* > *[ERROR]* > *[ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch.* > *[ERROR] Re-run Maven using the -X switch to enable full debug logging.* > *[ERROR]* > *[ERROR] For more information about the errors and possible solutions, > please read the following articles:* > *[ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > <http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException>* > *[ERROR]* > *[ERROR] After correcting the problems, you can resume the build with the > command* > *[ERROR] mvn <goals> -rf :hbase-server * > > > > > > On Mon, Feb 26, 2018 at 1:28 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > +1 > > > > Checked signatures > > Ran unit test suite against JDK 1.8 - passed > > Tried some basic shell commands > > > > On Mon, Feb 26, 2018 at 9:24 AM, Josh Elser <els...@apache.org> wrote: > > > > > +1 (binding) > > > > > > * src release contents looks OK > > > * sigs/xsums OK > > > * apache-rat:check OK > > > * Can build src release > > > * LICENSE looks OK > > > * Copyright in NOTICE needs updating for 2018 > > > > > > Only thing I noticed is that we need to update the checksum naming > > > convention for SHA*. Per [1], .sha filenames should only contain SHA1, > > and > > > .sha512 file names should be used for SHA512 xsum. I believe this means > > we > > > just need to modify make_rc.sh to put the xsum into .sha512 instead of > > > .sha. We do not need to distribute SHA1 xsums and, afaik, there is > little > > > cryptographic value to this. > > > > > > [1] http://www.apache.org/dev/release-distribution.html#sigs-and-sums > > > > > > On 2/22/18 6:55 PM, Andrew Purtell wrote: > > > > > >> The second HBase 1.4.2 release candidate (RC1) is available for > download > > >> at > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ and > Maven > > >> artifacts are available in the temporary repository > > >> https://repository.apache.org/content/repositories/ > orgapachehbase-1196/ > > . > > >> > > >> The git tag corresponding to the candidate is '1.4.2RC1' (b4ec89059c). > > >> Note > > >> this is different from branch-1.4 by one commit because we had an > > >> intervening commit between tag and push (08b9939974, HBASE-20016) > while > > I > > >> was running tests. The only difference is the CHANGES.txt update for > > >> 1.4.2RC1 is placed ahead of the commit for HBASE-20016, but does not > > >> mention it, which is fine, because 1.4.2RC1 does not contain > > HBASE-20016. > > >> > > >> A detailed source and binary compatibility report for this release is > > >> available for your review at > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ > > >> compat-check-report.html > > >> . > > >> > > >> A list of the 22 issues resolved in this release can be found at > > >> https://s.apache.org/aGcb . > > >> > > >> Please try out the candidate and vote +1/0/-1. > > >> > > >> This vote will be open for at least 72 hours. Unless objection I will > > try > > >> to close it Thursday February 28, 2018 if we have sufficient votes. > > >> > > >> Prior to making this announcement I made the following preflight > checks: > > >> > > >> - RAT check passes (7u80) > > >> - Unit test suite passes (8u131) > > >> - LTT load 1M rows with 100% verification and 20% updates (8u131) > > >> - PE sequentialWrite, sequentialRead, randomWrite, randomRead, > > >> scanRange100 (8u131) > > >> - ITBLL Loop 1 100M rows (8u131) > > >> > > >> > > >> > > >> > > > -- Best regards, Andrew Words like orphans lost among the crosstalk, meaning torn from truth's decrepit hands - A23, Crosstalk