Andrew, please see HBASE-20091 On Feb 26, 2018 10:09 PM, "Andrew Purtell" <[email protected]> wrote:
> Thanks Artem, appreciate the report. > > HBASE-20096 > > > On Mon, Feb 26, 2018 at 1:21 PM, Artem Ervits <[email protected]> > wrote: > > > Ted's correct, I mistakenly pulled the wrong hbase-site. Please see other > > warning on missing plugin version. > > > > On Feb 26, 2018 4:12 PM, "Ted Yu" <[email protected]> wrote: > > > > > Artem: > > > Please check your hbase-site.xml and remove BackupLogCleaner which > should > > > be left over from another deployment. > > > > > > Cheers > > > > > > On Mon, Feb 26, 2018 at 1:07 PM, Andrew Purtell <[email protected]> > > > wrote: > > > > > > > Thanks for the vote Artem. > > > > > > > > > FAILURE! - in org.apache.hadoop.hbase.http.TestSpnegoHttpServer > > > > > > > > Is this due to the same reason as before? The minikdc doesn't come up > > > > because of a missing configuration file directory? Perhaps with your > > > Linux > > > > variant installing the client package isn't enough, you'll also have > to > > > put > > > > in place a valid configuration? > > > > > > > > > java.lang.ClassNotFoundException: org.apache.hadoop.hbase. > > > > backup.master.BackupLogCleaner > > > > > > > > This class doesn't exist in HBase 1.x so I am confused as to how this > > is > > > > possible. > > > > > > > > > > > > On Mon, Feb 26, 2018 at 1:01 PM, Artem Ervits <[email protected] > > > > > > wrote: > > > > > > > > > +1 (non-binding) > > > > > > > > > > Hadoop Pseudo-distrbibuted: 2.7.5 > > > > > $M2_HOME from scratch > > > > > Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; > > > > > 2017-10-18T07:58:13Z) > > > > > Maven home: /opt/maven/apache-maven-3.5.2 > > > > > Java version: 1.8.0_161, vendor: Oracle Corporation > > > > > Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4. > > > > > x86_64/jre > > > > > Default locale: en_US, platform encoding: UTF-8 > > > > > OS name: "linux", version: "3.10.0-693.11.6.el7.x86_64", arch: > > "amd64", > > > > > family: "unix" > > > > > > > > > > Binary Release: > > > > > Java 1M rows: OK > > > > > LTT 1M rows: OK > > > > > PE 1M rows: OK > > > > > MD5: OK > > > > > > > > > > hbase shell: OK > > > > > create, list, scan, count, truncate, disable, drop > > > > > snapshot, restore_snapshot > > > > > UI: OK > > > > > > > > > > Source Release: > > > > > Build with: mvn clean -DskipTests -Dhadoop-two.version=2.7.5 > install > > && > > > > mvn > > > > > clean -DskipTests -Dhadoop-two.version=2.7.5 package > assembly:single > > > > > MD5: OK > > > > > installed and ran from src: OK > > > > > > > > > > reviewed the logs, all OK except for master: > > > > > > > > > > 2018-02-26 20:12:47,478 WARN [hadoop:16000.activeMasterManager] > > > > > cleaner.CleanerChore: Can NOT create CleanerDelegate: > > > > > org.apache.hadoop.hbase > > > > > .backup.master.BackupLogCleaner > > > > > java.lang.ClassNotFoundException: > > > > > org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > > > at java.net.URLClassLoader.findClass(URLClassLoader.java: > > 381) > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > > > > > at sun.misc.Launcher$AppClassLoader.loadClass( > > > Launcher.java:338) > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > > > > > at java.lang.Class.forName0(Native Method) > > > > > at java.lang.Class.forName(Class.java:264) > > > > > at > > > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore. > > > > > newFileCleaner(CleanerChore.java:109) > > > > > at > > > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore. > > > > > initCleanerChain(CleanerChore.java:91) > > > > > at > > > > > org.apache.hadoop.hbase.master.cleaner.CleanerChore.< > > > > > init>(CleanerChore.java:71) > > > > > at > > > > > org.apache.hadoop.hbase.master.cleaner.LogCleaner.< > > > > > init>(LogCleaner.java:49) > > > > > at > > > > > org.apache.hadoop.hbase.master.HMaster. > startServiceThreads(HMaster. > > > > > java:1222) > > > > > at > > > > > org.apache.hadoop.hbase.master.HMaster. > > finishActiveMasterInitializati > > > > > on(HMaster.java:781) > > > > > at > > > > > org.apache.hadoop.hbase.master.HMaster.access$600( > HMaster.java:205) > > > > > at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster. > > > > java:2023) > > > > > at java.lang.Thread.run(Thread.java:748) > > > > > > > > > > > > > > > Noticed the following: > > > > > > > > > > *[WARNING]* > > > > > *[WARNING] Some problems were encountered while building the > > effective > > > > > model for org.apache.hbase:hbase-shaded- > check-invariants:pom:1.4.2* > > > > > *[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo: is > > > > > missing. @ > > > > > org.apache.hbase:hbase-shaded-check-invariants:[unknown-version], > > > > > /tmp/hbase-1.4.2/hbase-shaded/hbase-shaded-check-invariants/ > pom.xml, > > > > line > > > > > 161, column 15* > > > > > *[WARNING]* > > > > > *[WARNING] It is highly recommended to fix these problems because > > they > > > > > threaten the stability of your build.* > > > > > *[WARNING]* > > > > > *[WARNING] For this reason, future Maven versions might no longer > > > support > > > > > building such malformed projects.* > > > > > > > > > > this is addressed in master > > > > > https://github.com/apache/hbase/blob/master/hbase- > > > > > shaded/hbase-shaded-check-invariants/pom.xml#L164 > > > > > > > > > > ran the > > > > > > > > > > mvn test -P runSmallTests: not OK > > > > > > > > > > I pointed it out in hbase-1.4.1 vote and perhaps it is due to my > dev > > > env > > > > > though I did try installing Kerberos libs previously and errors > > > > persisted. > > > > > > > > > > > > > > > *[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time > > > > elapsed: > > > > > 0.263 s - in org.apache.hadoop.hbase.TestTimeout* > > > > > > > > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time > > > > elapsed: > > > > > 1.937 s - in org.apache.hadoop.hbase.client.TestClientNoCluster* > > > > > > > > > > *WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time > > > elapsed: > > > > > 6.424 s - in org.apache.hadoop.hbase.client. > TestHBaseAdminNoCluster* > > > > > > > > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time > > > > elapsed: > > > > > 0 s - in > > > > > org.apache.hadoop.hbase.master.balancer. > > TestFavoredNodeAssignmentHelpe > > > r* > > > > > > > > > > *[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time > > > > elapsed: > > > > > 5.837 s - in org.apache.hadoop.hbase.security.TestSecureIPC* > > > > > > > > > > *[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time > > > > elapsed: > > > > > 0 s - in org.apache.hadoop.hbase.ipc.TestRpcHandlerException* > > > > > > > > > > *[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time > > > > elapsed: > > > > > 1.237 s - in org.apache.hadoop.hbase.http.TestServletFilter* > > > > > > > > > > *[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 3, Time > > > > elapsed: > > > > > 3.626 s - in org.apache.hadoop.hbase.http.TestHttpServer* > > > > > *[INFO] Running org.apache.hadoop.hbase.http.TestSpnegoHttpServer* > > > > > *[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time > > > elapsed: > > > > > 0.001 s <<< FAILURE! - in org.apache.hadoop.hbase.http. > > > > > TestSpnegoHttpServer* > > > > > *[ERROR] org.apache.hadoop.hbase.http.TestSpnegoHttpServer Time > > > > elapsed: > > > > > 0 > > > > > s <<< ERROR!* > > > > > *java.lang.RuntimeException: Unable to parse:includedir > > > > /etc/krb5.conf.d/* > > > > > * at > > > > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.buildMiniKdc( > > > > > TestSpnegoHttpServer.java:143)* > > > > > * at > > > > > org.apache.hadoop.hbase.http.TestSpnegoHttpServer.setupServer( > > > > > TestSpnegoHttpServer.java:91)* > > > > > *[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time > > > > elapsed: > > > > > 0 s - in org.apache.hadoop.hbase.http.TestHttpServerLifecycle* > > > > > > > > > > *[INFO]* > > > > > *[INFO] Results:* > > > > > *[INFO]* > > > > > *[ERROR] Errors:* > > > > > *[ERROR] TestSpnegoHttpServer.setupServer:91->buildMiniKdc:143 » > > > > Runtime > > > > > Unable to pars...* > > > > > *[INFO]* > > > > > *[ERROR] Tests run: 1157, Failures: 0, Errors: 1, Skipped: 22* > > > > > *[INFO]* > > > > > *[INFO] > > > > > ------------------------------------------------------------ > > > > ------------* > > > > > *[INFO] Reactor Summary:* > > > > > *[INFO]* > > > > > *[INFO] Apache HBase ....................................... > > SUCCESS [ > > > > > 3.101 s]* > > > > > *[INFO] Apache HBase - Checkstyle .......................... > SUCCESS > > [ > > > > > 0.700 s]* > > > > > *[INFO] Apache HBase - Resource Bundle ..................... > SUCCESS > > [ > > > > > 0.255 s]* > > > > > *[INFO] Apache HBase - Annotations ......................... > SUCCESS > > [ > > > > > 0.839 s]* > > > > > *[INFO] Apache HBase - Protocol ............................ > SUCCESS > > [ > > > > > 0.349 s]* > > > > > *[INFO] Apache HBase - Common .............................. > SUCCESS > > > > [02:07 > > > > > min]* > > > > > *[INFO] Apache HBase - Procedure ........................... > SUCCESS > > > > [03:16 > > > > > min]* > > > > > *[INFO] Apache HBase - Metrics API ......................... > SUCCESS > > [ > > > > > 2.668 s]* > > > > > *[INFO] Apache HBase - Hadoop Compatibility ................ > SUCCESS > > [ > > > > > 13.360 s]* > > > > > *[INFO] Apache HBase - Metrics Implementation .............. > SUCCESS > > [ > > > > > 8.440 s]* > > > > > *[INFO] Apache HBase - Hadoop Two Compatibility ............ > SUCCESS > > [ > > > > > 19.941 s]* > > > > > *[INFO] Apache HBase - Client .............................. > SUCCESS > > > > [02:13 > > > > > min]* > > > > > *[INFO] Apache HBase - Prefix Tree ......................... > SUCCESS > > [ > > > > > 15.483 s]* > > > > > *[INFO] Apache HBase - Server .............................. > FAILURE > > > > [28:53 > > > > > min]* > > > > > *[INFO] Apache HBase - Testing Util ........................ > SKIPPED* > > > > > *[INFO] Apache HBase - Thrift .............................. > SKIPPED* > > > > > *[INFO] Apache HBase - Rest ................................ > > SKIPPED* > > > > > *[INFO] Apache HBase - RSGroup ............................. > SKIPPED* > > > > > *[INFO] Apache HBase - Shell ............................... > > SKIPPED* > > > > > *[INFO] Apache HBase - Integration Tests ................... > SKIPPED* > > > > > *[INFO] Apache HBase - Examples ............................ > SKIPPED* > > > > > *[INFO] Apache HBase - External Block Cache ................ > SKIPPED* > > > > > *[INFO] Apache HBase - Assembly ............................ > SKIPPED* > > > > > *[INFO] Apache HBase - Shaded .............................. > SKIPPED* > > > > > *[INFO] Apache HBase - Shaded - Client ..................... > SKIPPED* > > > > > *[INFO] Apache HBase - Shaded - Server ..................... > SKIPPED* > > > > > *[INFO] Apache HBase Shaded Packaging Invariants ........... > SKIPPED* > > > > > *[INFO] Apache HBase - Archetypes .......................... > SKIPPED* > > > > > *[INFO] Apache HBase - Exemplar for hbase-client archetype . > SKIPPED* > > > > > *[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype > > > > SKIPPED* > > > > > *[INFO] Apache HBase - Archetype builder ................... > SKIPPED* > > > > > *[INFO] > > > > > ------------------------------------------------------------ > > > > ------------* > > > > > *[INFO] BUILD FAILURE* > > > > > *[INFO] > > > > > ------------------------------------------------------------ > > > > ------------* > > > > > *[INFO] Total time: 37:39 min* > > > > > *[INFO] Finished at: 2018-02-26T19:10:39Z* > > > > > *[INFO] Final Memory: 84M/345M* > > > > > *[INFO] > > > > > ------------------------------------------------------------ > > > > ------------* > > > > > *[ERROR] Failed to execute goal > > > > > org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test > > > > (default-test) > > > > > on project hbase-server: There are test failures.* > > > > > *[ERROR]* > > > > > *[ERROR] Please refer to > > > > > /tmp/hbase-1.4.2/hbase-server/target/surefire-reports for the > > > individual > > > > > test results.* > > > > > *[ERROR] Please refer to dump files (if any exist) > > > [date]-jvmRun[N].dump, > > > > > [date].dumpstream and [date]-jvmRun[N].dumpstream.* > > > > > *[ERROR] -> [Help 1]* > > > > > *[ERROR]* > > > > > *[ERROR] To see the full stack trace of the errors, re-run Maven > with > > > the > > > > > -e switch.* > > > > > *[ERROR] Re-run Maven using the -X switch to enable full debug > > > logging.* > > > > > *[ERROR]* > > > > > *[ERROR] For more information about the errors and possible > > solutions, > > > > > please read the following articles:* > > > > > *[ERROR] [Help 1] > > > > > http://cwiki.apache.org/confluence/display/MAVEN/ > > MojoFailureException > > > > > <http://cwiki.apache.org/confluence/display/MAVEN/ > > MojoFailureException > > > >* > > > > > *[ERROR]* > > > > > *[ERROR] After correcting the problems, you can resume the build > with > > > the > > > > > command* > > > > > *[ERROR] mvn <goals> -rf :hbase-server * > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Mon, Feb 26, 2018 at 1:28 PM, Ted Yu <[email protected]> > wrote: > > > > > > > > > > > +1 > > > > > > > > > > > > Checked signatures > > > > > > Ran unit test suite against JDK 1.8 - passed > > > > > > Tried some basic shell commands > > > > > > > > > > > > On Mon, Feb 26, 2018 at 9:24 AM, Josh Elser <[email protected]> > > > wrote: > > > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > > > * src release contents looks OK > > > > > > > * sigs/xsums OK > > > > > > > * apache-rat:check OK > > > > > > > * Can build src release > > > > > > > * LICENSE looks OK > > > > > > > * Copyright in NOTICE needs updating for 2018 > > > > > > > > > > > > > > Only thing I noticed is that we need to update the checksum > > naming > > > > > > > convention for SHA*. Per [1], .sha filenames should only > contain > > > > SHA1, > > > > > > and > > > > > > > .sha512 file names should be used for SHA512 xsum. I believe > this > > > > means > > > > > > we > > > > > > > just need to modify make_rc.sh to put the xsum into .sha512 > > instead > > > > of > > > > > > > .sha. We do not need to distribute SHA1 xsums and, afaik, there > > is > > > > > little > > > > > > > cryptographic value to this. > > > > > > > > > > > > > > [1] http://www.apache.org/dev/release-distribution.html# > > > > sigs-and-sums > > > > > > > > > > > > > > On 2/22/18 6:55 PM, Andrew Purtell wrote: > > > > > > > > > > > > > >> The second HBase 1.4.2 release candidate (RC1) is available > for > > > > > download > > > > > > >> at > > > > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ > > and > > > > > Maven > > > > > > >> artifacts are available in the temporary repository > > > > > > >> https://repository.apache.org/content/repositories/ > > > > > orgapachehbase-1196/ > > > > > > . > > > > > > >> > > > > > > >> The git tag corresponding to the candidate is '1.4.2RC1' > > > > (b4ec89059c). > > > > > > >> Note > > > > > > >> this is different from branch-1.4 by one commit because we had > > an > > > > > > >> intervening commit between tag and push (08b9939974, > > HBASE-20016) > > > > > while > > > > > > I > > > > > > >> was running tests. The only difference is the CHANGES.txt > update > > > for > > > > > > >> 1.4.2RC1 is placed ahead of the commit for HBASE-20016, but > does > > > not > > > > > > >> mention it, which is fine, because 1.4.2RC1 does not contain > > > > > > HBASE-20016. > > > > > > >> > > > > > > >> A detailed source and binary compatibility report for this > > release > > > > is > > > > > > >> available for your review at > > > > > > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ > > > > > > >> compat-check-report.html > > > > > > >> . > > > > > > >> > > > > > > >> A list of the 22 issues resolved in this release can be found > at > > > > > > >> https://s.apache.org/aGcb . > > > > > > >> > > > > > > >> Please try out the candidate and vote +1/0/-1. > > > > > > >> > > > > > > >> This vote will be open for at least 72 hours. Unless > objection I > > > > will > > > > > > try > > > > > > >> to close it Thursday February 28, 2018 if we have sufficient > > > votes. > > > > > > >> > > > > > > >> Prior to making this announcement I made the following > preflight > > > > > checks: > > > > > > >> > > > > > > >> - RAT check passes (7u80) > > > > > > >> - Unit test suite passes (8u131) > > > > > > >> - LTT load 1M rows with 100% verification and 20% updates > > > > (8u131) > > > > > > >> - PE sequentialWrite, sequentialRead, randomWrite, > > randomRead, > > > > > > >> scanRange100 (8u131) > > > > > > >> - ITBLL Loop 1 100M rows (8u131) > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > >
