[
https://issues.apache.org/jira/browse/KUDU-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868166#comment-16868166
]
Alexey Serbin edited comment on KUDU-2427 at 6/20/19 1:53 AM:
--------------------------------------------------------------
Many tests fail if running Kudu at Ubuntu18.04LTS with the following
configuration (at least if built with third-party clang6.0):
{noformat}
# cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.1 LTS"
{noformat}
{noformat}
# openssl version
OpenSSL 1.1.1 11 Sep 2018
{noformat}
{noformat}
# apt show libc6:amd64
Package: libc6
Version: 2.27-3ubuntu1
Priority: required
Section: libs
Source: glibc
Origin: Ubuntu
Maintainer: Ubuntu Developers <[email protected]>
Original-Maintainer: GNU Libc Maintainers <[email protected]>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 12.2 MB
Depends: libgcc1
Suggests: glibc-doc, debconf | debconf-2.0, locales
Conflicts: openrc (<< 0.27-2~)
Breaks: hurd (<< 1:0.5.git20140203-1), libtirpc1 (<< 0.2.3), locales (<< 2.27),
locales-all (<< 2.27), nscd (<< 2.27)
Replaces: libc6-amd64
Homepage: https://www.gnu.org/software/libc/libc.html
Task: minimal
Supported: 5y
Download-Size: 2824 kB
APT-Manual-Installed: yes
APT-Sources: http://us-west-2.ec2.archive.ubuntu.com/ubuntu bionic/main amd64
Packages
Description: GNU C Library: Shared libraries
Contains the standard libraries that are used by nearly all programs on
the system. This package includes shared versions of the standard C library
and the standard math library, as well as many others.
{noformat}
{noformat}
# apt show libsasl2-2:amd64
Package: libsasl2-2
Version: 2.1.27~101-g0780600+dfsg-3ubuntu2
Priority: optional
Section: libs
Source: cyrus-sasl2
Origin: Ubuntu
Maintainer: Ubuntu Developers <[email protected]>
Original-Maintainer: Debian Cyrus SASL Team
<[email protected]>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 152 kB
Depends: libsasl2-modules-db (>= 2.1.27~101-g0780600+dfsg-3ubuntu2), libc6 (>=
2.15)
Recommends: libsasl2-modules (>= 2.1.27~101-g0780600+dfsg-3ubuntu2)
Breaks: postfix (<= 2.8.3-1), slapd (<= 2.4.25-3)
Replaces: libsasl2
Homepage: https://www.cyrusimap.org/
Task: ubuntu-desktop, mail-server, print-server, cloud-image, samba-server,
server, postgresql-server, lamp-server, kubuntu-desktop, xubuntu-core,
xubuntu-desktop, lubuntu-live-share, lubuntu-desktop-share,
lubuntu-gtk-desktop, lubuntu-desktop, lubuntu-live, lubuntu-qt-core,
lubuntu-qt-desktop, lubuntu-qt-desktop, lubuntu-live-qt, lubuntu-live-gtk,
ubuntustudio-desktop-core, ubuntustudio-desktop, ubuntukylin-desktop,
ubuntu-mate-core, ubuntu-mate-desktop, ubuntu-budgie-desktop
Supported: 5y
Download-Size: 49.2 kB
APT-Manual-Installed: yes
APT-Sources: http://us-west-2.ec2.archive.ubuntu.com/ubuntu bionic/main amd64
Packages
{noformat}
For example, the {{negotiation-test}} crashes with the following stack:
{noformat}
[ RUN ] NegotiationCombinations/TestNegotiation.TestNegotiation/10
Loading random data
Initializing database
'/tmp/kudutest-0/negotiation-test.NegotiationCombinations_TestNegotiation.Test
Negotiation_10.1560993441102421-13933/krb5kdc/principal' for realm
'KRBTEST.COM',
master key name 'K/[email protected]'
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): set up 2 sockets
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): commencing operation
krb5kdc: starting...
Authenticating as principal root/[email protected] with password.
WARNING: no policy specified for [email protected]; defaulting to no
policy
Principal "[email protected]" created.
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): AS_REQ (2 etypes {17 16})
127.0.0
.1: ISSUE: authtime 1560993443, etypes {rep=17 tkt=17 ses=17},
[email protected] for krbtgt/
[email protected]
Password for [email protected]:
Authenticating as principal client-gssapi/[email protected] with password.
WARNING: no policy specified for kudu/[email protected]; defaulting to no
policy
Principal "kudu/[email protected]" created.
Authenticating as principal client-gssapi/[email protected] with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type
aes256-cts-hmac-sha1-96 added to key
tab
WRFILE:/tmp/kudutest-0/negotiation-test.NegotiationCombinations_TestNegotiation.TestNegotiation_
10.1560993441102421-13933/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type
aes128-cts-hmac-sha1-96 added to key
tab
WRFILE:/tmp/kudutest-0/negotiation-test.NegotiationCombinations_TestNegotiation.TestNegotiation_
10.1560993441102421-13933/krb5kdc/kudu_127.0.0.1.keytab.
F0619 18:17:23.980032 14049 sasl_helper.cc:119] Server: Illegal state: Received
illegal call-id during negotiation; expected: -33, received: -3
*** Check failure stack trace: ***
*** Aborted at 1560993443 (unix time) try "date -d @1560993443" if you are
using GNU date ***
PC: @ 0x7ff0be0cbe97 gsignal
*** SIGABRT (@0x366d) received by PID 13933 (TID 0x7ff0bae1d700) from PID
13933; stack trace: ***
@ 0x7ff0be490890 (unknown)
@ 0x7ff0be0cbe97 gsignal
@ 0x7ff0be0cd801 abort
@ 0x7ff0c0357d59 google::logging_fail()
@ 0x7ff0c0359d6d google::LogMessage::Fail()
@ 0x7ff0c035bd44 google::LogMessage::SendToLog()
@ 0x7ff0c035988d google::LogMessage::Flush()
@ 0x7ff0c0359ae1 google::LogMessage::~LogMessage()
@ 0x7ff0c2c11878 kudu::rpc::SaslHelper::CheckNegotiateCallId()
@ 0x7ff0c2c163ff kudu::rpc::ServerNegotiation::RecvNegotiatePB()
@ 0x7ff0c2c152c9 kudu::rpc::ServerNegotiation::Negotiate()
@ 0x459975
kudu::rpc::TestNegotiation_TestNegotiation_Test::TestBody()::$_10::operator()()
@ 0x4598bd
_ZSt13__invoke_implIvZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10JEET_St14__invoke_otherOT0_DpOT1_
@ 0x45984d
_ZSt8__invokeIZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10JEENSt15__invoke_resultIT_JDpT0_EE4typeEOS5_DpOS6_
@ 0x459825
_ZNSt6thread8_InvokerISt5tupleIJZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE
@ 0x4597f5
_ZNSt6thread8_InvokerISt5tupleIJZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10EEEclEv
@ 0x4596e9
_ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10EEEEE6_M_runEv
@ 0x7ff0bed1057f (unknown)
@ 0x7ff0be4856db start_thread
@ 0x7ff0be1ae88f clone
Aborted (core dumped)
{noformat}
was (Author: aserbin):
Many tests fail if running Kudu at Ubuntu18.04LTS with the following
configuration (at least if built with third-party clang6.0):
{noformat}
# cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.1 LTS"
{noformat}
{noformat}
# openssl version
OpenSSL 1.1.1 11 Sep 2018
{noformat}
{noformat}
# apt show libc6:amd64
Package: libc6
Version: 2.27-3ubuntu1
Priority: required
Section: libs
Source: glibc
Origin: Ubuntu
Maintainer: Ubuntu Developers <[email protected]>
Original-Maintainer: GNU Libc Maintainers <[email protected]>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 12.2 MB
Depends: libgcc1
Suggests: glibc-doc, debconf | debconf-2.0, locales
Conflicts: openrc (<< 0.27-2~)
Breaks: hurd (<< 1:0.5.git20140203-1), libtirpc1 (<< 0.2.3), locales (<< 2.27),
locales-all (<< 2.27), nscd (<< 2.27)
Replaces: libc6-amd64
Homepage: https://www.gnu.org/software/libc/libc.html
Task: minimal
Supported: 5y
Download-Size: 2824 kB
APT-Manual-Installed: yes
APT-Sources: http://us-west-2.ec2.archive.ubuntu.com/ubuntu bionic/main amd64
Packages
Description: GNU C Library: Shared libraries
Contains the standard libraries that are used by nearly all programs on
the system. This package includes shared versions of the standard C library
and the standard math library, as well as many others.
{noformat}
For example, the {{negotiation-test}} crashes with the following stack:
{noformat}
[ RUN ] NegotiationCombinations/TestNegotiation.TestNegotiation/10
Loading random data
Initializing database
'/tmp/kudutest-0/negotiation-test.NegotiationCombinations_TestNegotiation.Test
Negotiation_10.1560993441102421-13933/krb5kdc/principal' for realm
'KRBTEST.COM',
master key name 'K/[email protected]'
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): set up 2 sockets
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): commencing operation
krb5kdc: starting...
Authenticating as principal root/[email protected] with password.
WARNING: no policy specified for [email protected]; defaulting to no
policy
Principal "[email protected]" created.
Jun 19 18:17:23 xxx.xxx.com krb5kdc[14040](info): AS_REQ (2 etypes {17 16})
127.0.0
.1: ISSUE: authtime 1560993443, etypes {rep=17 tkt=17 ses=17},
[email protected] for krbtgt/
[email protected]
Password for [email protected]:
Authenticating as principal client-gssapi/[email protected] with password.
WARNING: no policy specified for kudu/[email protected]; defaulting to no
policy
Principal "kudu/[email protected]" created.
Authenticating as principal client-gssapi/[email protected] with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type
aes256-cts-hmac-sha1-96 added to key
tab
WRFILE:/tmp/kudutest-0/negotiation-test.NegotiationCombinations_TestNegotiation.TestNegotiation_
10.1560993441102421-13933/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type
aes128-cts-hmac-sha1-96 added to key
tab
WRFILE:/tmp/kudutest-0/negotiation-test.NegotiationCombinations_TestNegotiation.TestNegotiation_
10.1560993441102421-13933/krb5kdc/kudu_127.0.0.1.keytab.
F0619 18:17:23.980032 14049 sasl_helper.cc:119] Server: Illegal state: Received
illegal call-id during negotiation; expected: -33, received: -3
*** Check failure stack trace: ***
*** Aborted at 1560993443 (unix time) try "date -d @1560993443" if you are
using GNU date ***
PC: @ 0x7ff0be0cbe97 gsignal
*** SIGABRT (@0x366d) received by PID 13933 (TID 0x7ff0bae1d700) from PID
13933; stack trace: ***
@ 0x7ff0be490890 (unknown)
@ 0x7ff0be0cbe97 gsignal
@ 0x7ff0be0cd801 abort
@ 0x7ff0c0357d59 google::logging_fail()
@ 0x7ff0c0359d6d google::LogMessage::Fail()
@ 0x7ff0c035bd44 google::LogMessage::SendToLog()
@ 0x7ff0c035988d google::LogMessage::Flush()
@ 0x7ff0c0359ae1 google::LogMessage::~LogMessage()
@ 0x7ff0c2c11878 kudu::rpc::SaslHelper::CheckNegotiateCallId()
@ 0x7ff0c2c163ff kudu::rpc::ServerNegotiation::RecvNegotiatePB()
@ 0x7ff0c2c152c9 kudu::rpc::ServerNegotiation::Negotiate()
@ 0x459975
kudu::rpc::TestNegotiation_TestNegotiation_Test::TestBody()::$_10::operator()()
@ 0x4598bd
_ZSt13__invoke_implIvZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10JEET_St14__invoke_otherOT0_DpOT1_
@ 0x45984d
_ZSt8__invokeIZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10JEENSt15__invoke_resultIT_JDpT0_EE4typeEOS5_DpOS6_
@ 0x459825
_ZNSt6thread8_InvokerISt5tupleIJZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE
@ 0x4597f5
_ZNSt6thread8_InvokerISt5tupleIJZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10EEEclEv
@ 0x4596e9
_ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN4kudu3rpc36TestNegotiation_TestNegotiation_Test8TestBodyEvE4$_10EEEEE6_M_runEv
@ 0x7ff0bed1057f (unknown)
@ 0x7ff0be4856db start_thread
@ 0x7ff0be1ae88f clone
Aborted (core dumped)
{noformat}
> Add support for Ubuntu 18.04
> ----------------------------
>
> Key: KUDU-2427
> URL: https://issues.apache.org/jira/browse/KUDU-2427
> Project: Kudu
> Issue Type: Bug
> Components: master, tserver
> Affects Versions: 1.8.0
> Reporter: Adar Dembo
> Assignee: Adar Dembo
> Priority: Major
> Fix For: 1.8.0
>
>
> Ubuntu 18.04 (Bionic) is out, and since it's the next LTS release from Ubuntu
> we should support it. Unlike previous releases, this one is chock full of
> Kudu-breaking changes. It's getting difficult for me to keep track of them
> all, so I'll use this Jira to do that.
> h3. New Java
> Bionic ships with both JDK8 and JDK10, but defaults to JDK10. I'm sure
> that'll lead to a number of issues with our Java bindings. Most immediately,
> though, is [this cmake
> bug|https://gitlab.kitware.com/cmake/cmake/issues/17938] which prevents cmake
> from finding the JDK via find_package(Java). The bug fix is scheduled for
> 3.11.2 which has yet to be released; Bionic ships with a version of cmake
> 3.10 that has been patched to include this fix.
> h3. New gcc
> Bionic ships with gcc5, gcc6, gcc7, and gcc8, but defaults to gcc7. Beyond
> the usual set of new warnings, this version of gcc cannot compile breakpad.
> [This bug|https://bugs.chromium.org/p/google-breakpad/issues/detail?id=739]
> was filed, and it seems to have been fixed in the top of the breakpad tree,
> perhaps in [this
> commit|https://chromium.googlesource.com/breakpad/breakpad/+/bddcc58860f522a0d4cbaa7e9d04058caee0db9d].
> h3. New OpenSSL
> Bionic ships with libssl1.0 and 1.1, but defaults to 1.1. The transition from
> 1.0 to 1.1 [broke all sorts of ABIs and
> APIs|https://abi-laboratory.pro/tracker/objects_report/openssl/1.0.2o/1.1.0/report.html],
> some of which have been documented by KUDU-1889.
> h3. Miscellaneous stuff
> I'm still working through several test failures that I can't yet attribute to
> any one particular thing. These are:
> # Some tests that depend on libkudu_util.so appear to load that before
> loading libc, which causes the dl_iterate_phdr dlsym() call in
> util/debug/unwind_safeness.cc to fail at startup. Commenting that out leads
> to deadlocks in debug-util-test, so whatever underlying race existed in libc
> still exists.
> # All of the tests in minidump-test fail, probably due to changes in
> breakpad.
> # Symbolization via google::Symbolize appears to produce "(unknown)" frames
> in code that has been statically linked. Perhaps the problem is not so
> generic, but this leads to failures in stack_watchdog-test, which expects to
> find the name of the test in one of the stack frames.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
