+0
- tested kudu-test-utils, kudu-client, and kudu-binary artifacts with JUnit.
- compiled in RELEASE mode on Ubuntu 18.04 bionic
- ran all Java tests: all passed
- ran all C++ tests serially: "master_failover-itest.2" was flaky,
"codegen-test" failed consistently, "hms_catalog-test.0" froze consistently
Greg
On Tue, Nov 19, 2019 at 3:05 PM Grant Henke <[email protected]>
wrote:
> +1 I ran the build locally on my Mac along with a full Xenial Docker build.
>
> On Tue, Nov 19, 2019 at 3:14 AM Andrew Wong <[email protected]> wrote:
>
> > +1
> >
> > - built on CentOS 7.3 in RELEASE mode
> > - ran all Java tests (2 flaky failures)
> > - ran all C++ tests (a few failures due to concurrency of the tests)
> > - looked over the release notes
> > - looked through some of the code of some of the fixes that I expect to
> be
> > in this release
> >
> > On Mon, Nov 18, 2019 at 1:47 AM Adar Lieber-Dembo
> > <[email protected]>
> > wrote:
> >
> > > +1
> > >
> > > I ran DEBUG tests in slow mode on Ubuntu 18.04 and CentOS 6.6. All
> > passed.
> > >
> > > On Sat, Nov 16, 2019 at 1:38 PM Attila Bukor <[email protected]>
> wrote:
> > > >
> > > > +1
> > > >
> > > > - Verified checksum, the signature and that the archive was created
> > from
> > > the tag
> > > > - Successfully built Kudu in release mode on CentOS 7.3 and macOS
> > Mojave
> > > 10.14.6
> > > > - Ran Java and C++ tests in slow mode on CentOS 7.3, only one failure
> > in
> > > each,
> > > > both environmental (address already in use, too many open files)
> > > > - Ran Java tests on macOS Mojave with one failure (lsof missing).
> > > > - Successfully built Java and Spark examples using the staged JARs on
> > > CentOS and
> > > > the Java examples also on macOS. Spark examples build failed on
> > macOS,
> > > but it
> > > > seems it's not specific to this version. Opened a JIRA: KUDU-2997
> > > > - Read the release notes
> > > >
> > > > Attila
> > > >
> > > > On Fri, Nov 15, 2019 at 10:57:10PM -0800, Alexey Serbin wrote:
> > > > > Hello Kudu devs!
> > > > >
> > > > > The Apache Kudu team is happy to announce the second release
> > candidate
> > > (RC2)
> > > > > for Apache Kudu 1.11.1.
> > > > >
> > > > > Apache Kudu 1.11.1 is a bug-fix release which fixes one critical
> > > licensing
> > > > > and few other issues in Kudu 1.11.0.
> > > > >
> > > > > This is a source-only release. The artifacts have been staged here:
> > > > > https://dist.apache.org/repos/dist/dev/kudu/1.11.1-RC2/
> > > > >
> > > > > Java convenience binaries in the form of a Maven repository are
> > staged
> > > here:
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachekudu-1056
> > > > >
> > > > > Linux and macOS kudu-binary JAR artifacts are staged here
> > > correspondingly:
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachekudu-1057
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachekudu-1058
> > > > >
> > > > > It is tagged in Git as 1.11.1-RC2 and the corresponding hash is the
> > > > > following:
> > > > >
> > > > >
> > >
> >
> https://gitbox.apache.org/repos/asf?p=kudu.git;a=commit;h=069f1813b22a49caa6746ff9664a7779faeccfa3
> > > > >
> > > > > The release notes can be found here:
> > > > >
> > >
> >
> https://github.com/apache/kudu/blob/branch-1.11.x/docs/release_notes.adoc
> > > > >
> > > > > The KEYS file to verify the artifact signatures can be found here:
> > > > > https://dist.apache.org/repos/dist/release/kudu/KEYS
> > > > >
> > > > > I'd suggest going through the README and the release notes,
> building
> > > Kudu,
> > > > > and
> > > > > running the unit tests. Testing out the Maven repo would also be
> > > > > appreciated.
> > > > > Also, it's worth running Kudu Java tests against kudu-binary JAR
> > > artifact
> > > > > as described in the commit message here:
> > > > >
> > > > >
> > >
> >
> https://gitbox.apache.org/repos/asf?p=kudu.git;a=commit;h=8a6faaa93f3e206ac75e8087731daccaf7ab646a
> > > > >
> > > > > This vote runs until Tue Nov 19 19:00:00 PST 2019.
> > > > > That's over 72 hours from the time of sending out this e-mail
> message
> > > due
> > > > > to the weekend.
> > > > >
> > > > >
> > > > > Kind regards,
> > > > >
> > > > > Alexey
> > >
> >
>
>
> --
> Grant Henke
> Software Engineer | Cloudera
> [email protected] | twitter.com/gchenke | linkedin.com/in/granthenke
>
[==========] Running 12 tests from 1 test case.
[----------] Global test environment set-up.
[----------] 12 tests from CodegenTest
[ RUN ] CodegenTest.ObservablesTest
WARNING: Logging before InitGoogleLogging() is written to STDERR
I1119 18:14:04.030992 22488 test_util.cc:225] Using random seed: -1139102710
[ OK ] CodegenTest.ObservablesTest (267 ms)
[ RUN ] CodegenTest.TestEmpty
I1119 18:14:04.298079 22488 test_util.cc:225] Using random seed: -1138835620
[ OK ] CodegenTest.TestEmpty (149 ms)
[ RUN ] CodegenTest.TestKey
I1119 18:14:04.446604 22488 test_util.cc:225] Using random seed: -1138687095
[ OK ] CodegenTest.TestKey (155 ms)
[ RUN ] CodegenTest.TestInts
I1119 18:14:04.601352 22488 test_util.cc:225] Using random seed: -1138532346
[ OK ] CodegenTest.TestInts (188 ms)
[ RUN ] CodegenTest.TestStrings
I1119 18:14:04.789364 22488 test_util.cc:225] Using random seed: -1138344333
[ OK ] CodegenTest.TestStrings (246 ms)
[ RUN ] CodegenTest.TestNonNullables
I1119 18:14:05.035544 22488 test_util.cc:225] Using random seed: -1138098154
[ OK ] CodegenTest.TestNonNullables (181 ms)
[ RUN ] CodegenTest.TestNullables
I1119 18:14:05.216898 22488 test_util.cc:225] Using random seed: -1137916799
[ OK ] CodegenTest.TestNullables (251 ms)
[ RUN ] CodegenTest.TestFullSchema
I1119 18:14:05.467284 22488 test_util.cc:225] Using random seed: -1137666414
[ OK ] CodegenTest.TestFullSchema (274 ms)
[ RUN ] CodegenTest.TestDefaultsOnly
I1119 18:14:05.741248 22488 test_util.cc:225] Using random seed: -1137392450
[ OK ] CodegenTest.TestDefaultsOnly (182 ms)
[ RUN ] CodegenTest.TestFullSchemaWithDefaults
I1119 18:14:05.924011 22488 test_util.cc:225] Using random seed: -1137209687
[ OK ] CodegenTest.TestFullSchemaWithDefaults (278 ms)
[ RUN ] CodegenTest.TestDumpMC
I1119 18:14:06.201664 22488 test_util.cc:225] Using random seed: -1136932034
I1119 18:14:06.307404 22488 code_generator.cc:223] Printing read projection
function:
pushq %rbp
movq %rsp, %rbp
pushq %r15
pushq %r14
pushq %r12
pushq %rbx
movq (%rsi), %r11
movq %rdx, %r8
movq %rdi, %r15
movq 8(%rsi), %r12
xorl %eax, %eax
movl $1, %edi
movl 8(%r15), %esi
movq 8(%r11), %rdx
movq (%rdx), %rdx
movl %esi, (%rdx,%r12,4)
movl %r12d, %esi
movq 32(%r11), %rdx
movb 68(%r15), %r9b
movq 8(%rdx), %r10
testb $4, %r9b
movq %r12, %rdx
sete %al
shrq $3, %rdx
andl $7, %esi
shlxl %esi, %edi, %edi
shlxl %esi, %eax, %eax
xorl $255, %edi
movzbl (%r10,%rdx), %ecx
andl %edi, %ecx
orl %ecx, %eax
testb $4, %r9b
movb %al, (%r10,%rdx)
jne 16
movq 8(%r11), %rax
movl 12(%r15), %ecx
movq 8(%rax), %rax
movl %ecx, (%rax,%r12,4)
movq 32(%r11), %rbx
movb 68(%r15), %r9b
xorl %ecx, %ecx
movq 16(%rbx), %rbx
testb $8, %r9b
sete %cl
movzbl (%rbx,%rdx), %eax
andl %eax, %edi
shlxl %esi, %ecx, %eax
orl %edi, %eax
testb $8, %r9b
movb %al, (%rbx,%rdx)
jne 16
movq 8(%r11), %rax
movl 16(%r15), %ecx
movq 16(%rax), %rax
movl %ecx, (%rax,%r12,4)
movq 8(%r11), %rax
shlq $4, %r12
addq 24(%rax), %r12
testq %r8, %r8
jne 17
addq $20, %r15
vmovups (%r15), %xmm0
vmovups %xmm0, (%r12)
jmp 68
movq 32(%r8), %rdx
movq 28(%r15), %rsi
movl 16(%rdx), %ecx
movq 8(%rdx), %r14
leal (%rsi,%rcx), %eax
movl %eax, 16(%rdx)
cmpq %rax, 24(%rdx)
jb 52
addq %rcx, %r14
je 50
movq 20(%r15), %rsi
movq 28(%r15), %rdx
movabsq $140714800392016, %rax
movq %r14, %rdi
callq *%rax
movq 28(%r15), %rax
movq %r14, (%r12)
movq %rax, 8(%r12)
movb $1, %al
popq %rbx
popq %r12
popq %r14
popq %r15
popq %rbp
retq
Printed 89 instructions.
[ OK ] CodegenTest.TestDumpMC (106 ms)
[ RUN ] CodegenTest.TestCodeCache
I1119 18:14:06.308092 22488 test_util.cc:225] Using random seed: -1136825605
/root/kudu/src/kudu/codegen/codegen-test.cc:421: Failure
Expected: (num_hits) > (0), actual: 0 vs 0
I1119 18:14:10.814677 22488 test_util.cc:136]
-----------------------------------------------
I1119 18:14:10.814698 22488 test_util.cc:137] Had fatal failures, leaving test
files at
/tmp/kudutest-0/codegen-test.0.CodegenTest.TestCodeCache.1574216044007163-22488
[ FAILED ] CodegenTest.TestCodeCache (4507 ms)
[----------] 12 tests from CodegenTest (6784 ms total)
[----------] Global test environment tear-down
[==========] 12 tests from 1 test case ran. (6784 ms total)
[ PASSED ] 11 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] CodegenTest.TestCodeCache
1 FAILED TEST
Note: This is test shard 1 of 4.
[==========] Running 2 tests from 2 test cases.
[----------] Global test environment set-up.
[----------] 1 test from HmsCatalogStaticTest
[ RUN ] HmsCatalogStaticTest.TestNormalizeTableName
[ OK ] HmsCatalogStaticTest.TestNormalizeTableName (0 ms)
[----------] 1 test from HmsCatalogStaticTest (0 ms total)
[----------] 1 test from HmsCatalogTest
[ RUN ] HmsCatalogTest.TestReconnect
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true
-Dderby.locks.deadlockTimeout=1
-Dderby.stream.error.file=/tmp/kudutest-0/hms_catalog-test.0.HmsCatalogTest.TestReconnect.1574208152358486-12109/derby.log
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/sentry-b71a78ed960702536b35e1f048dc40dfc79992d4/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
log4j:ERROR A "org.apache.solr.util.SolrLogLayout" object is not assignable to
a "org.apache.log4j.Layout" variable.
log4j:ERROR The class "org.apache.log4j.Layout" was loaded by
log4j:ERROR [sun.misc.Launcher$AppClassLoader@271053e1] whereas object of type
log4j:ERROR "org.apache.solr.util.SolrLogLayout" was loaded by
[sun.misc.Launcher$AppClassLoader@271053e1].
Metastore connection URL:
jdbc:derby:/tmp/kudutest-0/hms_catalog-test.0.HmsCatalogTest.TestReconnect.1574208152358486-12109/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 2.4.0
Initialization script hive-schema-2.4.0.derby.sql
Initialization script completed
schemaTool completed
2019-11-19 16:02:44: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true
-Dderby.locks.deadlockTimeout=1
-Dderby.stream.error.file=/tmp/kudutest-0/hms_catalog-test.0.HmsCatalogTest.TestReconnect.1574208152358486-12109/derby.log
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/sentry-b71a78ed960702536b35e1f048dc40dfc79992d4/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
log4j:ERROR A "org.apache.solr.util.SolrLogLayout" object is not assignable to
a "org.apache.log4j.Layout" variable.
log4j:ERROR The class "org.apache.log4j.Layout" was loaded by
log4j:ERROR [sun.misc.Launcher$AppClassLoader@271053e1] whereas object of type
log4j:ERROR "org.apache.solr.util.SolrLogLayout" was loaded by
[sun.misc.Launcher$AppClassLoader@271053e1].
Starting hive metastore on port 0
log4j:ERROR No layout set for the appender named [CONSOLE].
WARNING: Logging before InitGoogleLogging() is written to STDERR
W1119 16:03:02.448683 12451 hms_client.cc:263] Time spent create HMS table:
real 1.283s user 0.000s sys 0.000s
Shutting down hive metastore.
I1119 16:03:03.414278 12451 client.cc:56] TSocket::write_partial() send()
<Host: 127.0.0.1 Port: 35919>Broken pipe
I1119 16:03:03.417244 12451 client.cc:56] TSocket::write_partial() send()
<Host: 127.0.0.1 Port: 35919>Broken pipe
W1119 16:03:03.417270 12451 client.h:204] Failed to stop Hive Metastore client:
Network error: failed to close Hive Metastore connection: write() send():
Broken pipe
I1119 16:03:03.417290 12451 client.cc:56] TSocket::write_partial() send()
<Host: 127.0.0.1 Port: 35919>Broken pipe
I1119 16:03:03.417331 12451 client.cc:56] TSocket::write_partial() send()
<Host: 127.0.0.1 Port: 35919>Broken pipe
W1119 16:03:03.417346 12451 client.h:204] Failed to stop Hive Metastore client:
Network error: failed to close Hive Metastore connection: write() send():
Broken pipe
W1119 16:03:03.417352 12451 client.h:204] Call to Hive Metastore failed after 1
retries: Network error: failed to create Hive MetaStore table: write() send():
Broken pipe
I1119 16:03:03.417429 12451 client.cc:56] TSocket::write_partial() send()
<Host: 127.0.0.1 Port: 35919>Broken pipe
I1119 16:03:03.417588 12451 client.cc:56] TSocket::open() error on socket
(after THRIFT_POLL) <Host: 127.0.0.1 Port: 35919>Connection refused
W1119 16:03:03.417642 12451 client.h:350] Failed to connect to Hive Metastore
(127.0.0.1:35919): Network error: failed to open Hive Metastore connection:
socket open() error: Connection refused
2019-11-19 16:03:04: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true
-Dderby.locks.deadlockTimeout=1
-Dderby.stream.error.file=/tmp/kudutest-0/hms_catalog-test.0.HmsCatalogTest.TestReconnect.1574208152358486-12109/derby.log
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/sentry-b71a78ed960702536b35e1f048dc40dfc79992d4/lib/log4j-slf4j-impl-2.11.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/kudu/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
log4j:ERROR A "org.apache.solr.util.SolrLogLayout" object is not assignable to
a "org.apache.log4j.Layout" variable.
log4j:ERROR The class "org.apache.log4j.Layout" was loaded by
log4j:ERROR [sun.misc.Launcher$AppClassLoader@271053e1] whereas object of type
log4j:ERROR "org.apache.solr.util.SolrLogLayout" was loaded by
[sun.misc.Launcher$AppClassLoader@271053e1].
Starting hive metastore on port 35919
log4j:ERROR No layout set for the appender named [CONSOLE].
