+1 (non-binding)
Hadoop Pseudo-distrbibuted: 2.7.5
$M2_HOME from scratch
Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d;
2017-10-18T07:58:13Z)
Maven home: /opt/maven/apache-maven-3.5.2
Java version: 1.8.0_161, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "3.10.0-693.11.6.el7.x86_64", arch: "amd64",
family: "unix"
Binary Release:
Java 1M rows: OK
LTT 1M rows: OK
PE 1M rows: OK
MD5: OK
hbase shell: OK
create, list, scan, count, truncate, disable, drop
snapshot, restore_snapshot
UI: OK
Source Release:
Build with: mvn clean -DskipTests -Dhadoop-two.version=2.7.5 install && mvn
clean -DskipTests -Dhadoop-two.version=2.7.5 package assembly:single
MD5: OK
installed and ran from src: OK
reviewed the logs, all OK except for master:
2018-02-26 20:12:47,478 WARN [hadoop:16000.activeMasterManager]
cleaner.CleanerChore: Can NOT create CleanerDelegate:
org.apache.hadoop.hbase
.backup.master.BackupLogCleaner
java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.backup.master.BackupLogCleaner
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.newFileCleaner(CleanerChore.java:109)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.initCleanerChain(CleanerChore.java:91)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.<init>(CleanerChore.java:71)
at
org.apache.hadoop.hbase.master.cleaner.LogCleaner.<init>(LogCleaner.java:49)
at
org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.java:1222)
at
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:781)
at
org.apache.hadoop.hbase.master.HMaster.access$600(HMaster.java:205)
at org.apache.hadoop.hbase.master.HMaster$2.run(HMaster.java:2023)
at java.lang.Thread.run(Thread.java:748)
Noticed the following:
*[WARNING]*
*[WARNING] Some problems were encountered while building the effective
model for org.apache.hbase:hbase-shaded-check-invariants:pom:1.4.2*
*[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo: is
missing. @
org.apache.hbase:hbase-shaded-check-invariants:[unknown-version],
/tmp/hbase-1.4.2/hbase-shaded/hbase-shaded-check-invariants/pom.xml, line
161, column 15*
*[WARNING]*
*[WARNING] It is highly recommended to fix these problems because they
threaten the stability of your build.*
*[WARNING]*
*[WARNING] For this reason, future Maven versions might no longer support
building such malformed projects.*
this is addressed in master
https://github.com/apache/hbase/blob/master/hbase-shaded/hbase-shaded-check-invariants/pom.xml#L164
ran the
mvn test -P runSmallTests: not OK
I pointed it out in hbase-1.4.1 vote and perhaps it is due to my dev env
though I did try installing Kerberos libs previously and errors persisted.
*[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
0.263 s - in org.apache.hadoop.hbase.TestTimeout*
*[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
1.937 s - in org.apache.hadoop.hbase.client.TestClientNoCluster*
*WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
6.424 s - in org.apache.hadoop.hbase.client.TestHBaseAdminNoCluster*
*[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time elapsed:
0 s - in
org.apache.hadoop.hbase.master.balancer.TestFavoredNodeAssignmentHelper*
*[WARNING] Tests run: 8, Failures: 0, Errors: 0, Skipped: 2, Time elapsed:
5.837 s - in org.apache.hadoop.hbase.security.TestSecureIPC*
*[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
0 s - in org.apache.hadoop.hbase.ipc.TestRpcHandlerException*
*[WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
1.237 s - in org.apache.hadoop.hbase.http.TestServletFilter*
*[WARNING] Tests run: 16, Failures: 0, Errors: 0, Skipped: 3, Time elapsed:
3.626 s - in org.apache.hadoop.hbase.http.TestHttpServer*
*[INFO] Running org.apache.hadoop.hbase.http.TestSpnegoHttpServer*
*[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
0.001 s <<< FAILURE! - in org.apache.hadoop.hbase.http.TestSpnegoHttpServer*
*[ERROR] org.apache.hadoop.hbase.http.TestSpnegoHttpServer Time elapsed: 0
s <<< ERROR!*
*java.lang.RuntimeException: Unable to parse:includedir /etc/krb5.conf.d/*
* at
org.apache.hadoop.hbase.http.TestSpnegoHttpServer.buildMiniKdc(TestSpnegoHttpServer.java:143)*
* at
org.apache.hadoop.hbase.http.TestSpnegoHttpServer.setupServer(TestSpnegoHttpServer.java:91)*
*[WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time elapsed:
0 s - in org.apache.hadoop.hbase.http.TestHttpServerLifecycle*
*[INFO]*
*[INFO] Results:*
*[INFO]*
*[ERROR] Errors:*
*[ERROR] TestSpnegoHttpServer.setupServer:91->buildMiniKdc:143 ยป Runtime
Unable to pars...*
*[INFO]*
*[ERROR] Tests run: 1157, Failures: 0, Errors: 1, Skipped: 22*
*[INFO]*
*[INFO]
------------------------------------------------------------------------*
*[INFO] Reactor Summary:*
*[INFO]*
*[INFO] Apache HBase ....................................... SUCCESS [
3.101 s]*
*[INFO] Apache HBase - Checkstyle .......................... SUCCESS [
0.700 s]*
*[INFO] Apache HBase - Resource Bundle ..................... SUCCESS [
0.255 s]*
*[INFO] Apache HBase - Annotations ......................... SUCCESS [
0.839 s]*
*[INFO] Apache HBase - Protocol ............................ SUCCESS [
0.349 s]*
*[INFO] Apache HBase - Common .............................. SUCCESS [02:07
min]*
*[INFO] Apache HBase - Procedure ........................... SUCCESS [03:16
min]*
*[INFO] Apache HBase - Metrics API ......................... SUCCESS [
2.668 s]*
*[INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [
13.360 s]*
*[INFO] Apache HBase - Metrics Implementation .............. SUCCESS [
8.440 s]*
*[INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [
19.941 s]*
*[INFO] Apache HBase - Client .............................. SUCCESS [02:13
min]*
*[INFO] Apache HBase - Prefix Tree ......................... SUCCESS [
15.483 s]*
*[INFO] Apache HBase - Server .............................. FAILURE [28:53
min]*
*[INFO] Apache HBase - Testing Util ........................ SKIPPED*
*[INFO] Apache HBase - Thrift .............................. SKIPPED*
*[INFO] Apache HBase - Rest ................................ SKIPPED*
*[INFO] Apache HBase - RSGroup ............................. SKIPPED*
*[INFO] Apache HBase - Shell ............................... SKIPPED*
*[INFO] Apache HBase - Integration Tests ................... SKIPPED*
*[INFO] Apache HBase - Examples ............................ SKIPPED*
*[INFO] Apache HBase - External Block Cache ................ SKIPPED*
*[INFO] Apache HBase - Assembly ............................ SKIPPED*
*[INFO] Apache HBase - Shaded .............................. SKIPPED*
*[INFO] Apache HBase - Shaded - Client ..................... SKIPPED*
*[INFO] Apache HBase - Shaded - Server ..................... SKIPPED*
*[INFO] Apache HBase Shaded Packaging Invariants ........... SKIPPED*
*[INFO] Apache HBase - Archetypes .......................... SKIPPED*
*[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED*
*[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED*
*[INFO] Apache HBase - Archetype builder ................... SKIPPED*
*[INFO]
------------------------------------------------------------------------*
*[INFO] BUILD FAILURE*
*[INFO]
------------------------------------------------------------------------*
*[INFO] Total time: 37:39 min*
*[INFO] Finished at: 2018-02-26T19:10:39Z*
*[INFO] Final Memory: 84M/345M*
*[INFO]
------------------------------------------------------------------------*
*[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.20.1:test (default-test)
on project hbase-server: There are test failures.*
*[ERROR]*
*[ERROR] Please refer to
/tmp/hbase-1.4.2/hbase-server/target/surefire-reports for the individual
test results.*
*[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump,
[date].dumpstream and [date]-jvmRun[N].dumpstream.*
*[ERROR] -> [Help 1]*
*[ERROR]*
*[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.*
*[ERROR] Re-run Maven using the -X switch to enable full debug logging.*
*[ERROR]*
*[ERROR] For more information about the errors and possible solutions,
please read the following articles:*
*[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
<http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException>*
*[ERROR]*
*[ERROR] After correcting the problems, you can resume the build with the
command*
*[ERROR] mvn <goals> -rf :hbase-server *
On Mon, Feb 26, 2018 at 1:28 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> +1
>
> Checked signatures
> Ran unit test suite against JDK 1.8 - passed
> Tried some basic shell commands
>
> On Mon, Feb 26, 2018 at 9:24 AM, Josh Elser <els...@apache.org> wrote:
>
> > +1 (binding)
> >
> > * src release contents looks OK
> > * sigs/xsums OK
> > * apache-rat:check OK
> > * Can build src release
> > * LICENSE looks OK
> > * Copyright in NOTICE needs updating for 2018
> >
> > Only thing I noticed is that we need to update the checksum naming
> > convention for SHA*. Per [1], .sha filenames should only contain SHA1,
> and
> > .sha512 file names should be used for SHA512 xsum. I believe this means
> we
> > just need to modify make_rc.sh to put the xsum into .sha512 instead of
> > .sha. We do not need to distribute SHA1 xsums and, afaik, there is little
> > cryptographic value to this.
> >
> > [1] http://www.apache.org/dev/release-distribution.html#sigs-and-sums
> >
> > On 2/22/18 6:55 PM, Andrew Purtell wrote:
> >
> >> The second HBase 1.4.2 release candidate (RC1) is available for download
> >> at
> >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/ and Maven
> >> artifacts are available in the temporary repository
> >> https://repository.apache.org/content/repositories/orgapachehbase-1196/
> .
> >>
> >> The git tag corresponding to the candidate is '1.4.2RC1' (b4ec89059c).
> >> Note
> >> this is different from branch-1.4 by one commit because we had an
> >> intervening commit between tag and push (08b9939974, HBASE-20016) while
> I
> >> was running tests. The only difference is the CHANGES.txt update for
> >> 1.4.2RC1 is placed ahead of the commit for HBASE-20016, but does not
> >> mention it, which is fine, because 1.4.2RC1 does not contain
> HBASE-20016.
> >>
> >> A detailed source and binary compatibility report for this release is
> >> available for your review at
> >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.2RC1/
> >> compat-check-report.html
> >> .
> >>
> >> A list of the 22 issues resolved in this release can be found at
> >> https://s.apache.org/aGcb .
> >>
> >> Please try out the candidate and vote +1/0/-1.
> >>
> >> This vote will be open for at least 72 hours. Unless objection I will
> try
> >> to close it Thursday February 28, 2018 if we have sufficient votes.
> >>
> >> Prior to making this announcement I made the following preflight checks:
> >>
> >> - RAT check passes (7u80)
> >> - Unit test suite passes (8u131)
> >> - LTT load 1M rows with 100% verification and 20% updates (8u131)
> >> - PE sequentialWrite, sequentialRead, randomWrite, randomRead,
> >> scanRange100 (8u131)
> >> - ITBLL Loop 1 100M rows (8u131)
> >>
> >>
> >>
> >>
>
