Public bug reported: == Comment: #0 - MIKHAIL S. MEDVEDEV <mmedv...@us.ibm.com> - 2019-01-04 16:16:02 == The python package became dependency for Ceilometer, part of OpenStack, recently [1]. When you try to install the package with `pip install confluent-kafka` on both Ubuntu 14.04 and Ubuntu 16.04, the install fails during binary compile because Ubuntu's librdkafka-dev is too old:
confluent-kafka-python requires librdkafka v0.11.5 or later. Install the latest version of librdkafka from the Confluent repositories, see http://docs.confluent.io/current/installation.html The same problem exists on both x86 and ppc64le Ubuntu releases if you install without using precompiled binaries with `pip install --no-binary :all: confluent-kafka`. The difference is that there are precompiled packages for x86, see https://pypi.org/simple/confluent-kafka/ This needs to be fixed by enabling ppc64le and possibly ppc64 builds for confluent-kafka to be uploaded to pypi.python.org. An alternative is to add the latest librbkafka-dev to Ubuntu's repositories, but this may not solve it in a long run, as new python confluent-kafka release may break again, and it may take much longer, or not even happen for older release. confluent-kafka builds and installs fine on recent CentOS release (7.6.1810) as it has the latest dependencies. [1] https://review.openstack.org/#/q/If56890b35bbe40141c01467e47bccdf4d5584e86 == Comment: #5 - MIKHAIL S. MEDVEDEV <mmedv...@us.ibm.com> - 2019-01-14 14:21:11 == The fix that would cover most cases would be to have automatic build and upload of confluent-kafka binary ppc64le wheel to pypi.python.org as it is now done for x86 (probably by the package maintainer). Can we reach out to the pypi package maintainer and ask them to add the ppc64le build? Is that something we should be doing? The reason I am using Ubuntu 16.04 as an example is because it is used as the base test image for OpenStack. I have tested on Ubuntu 18.04 and it shows the same problem on ppc64le: ubuntu@mmedvede-test:~$ cat /etc/issue Ubuntu 18.04.1 LTS \n \l ubuntu@mmedvede-test:~$ pip install confluent-kafka| tail Failed building wheel for confluent-kafka Command "/usr/bin/python -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-wKMupP/confluent-kafka/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-LSUwRE-record/install-record.txt --single-version-externally-managed --compile --user --prefix=" failed with error code 1 in /tmp/pip-build-wKMupP/confluent-kafka/ creating build/temp.linux-ppc64le-2.7/confluent_kafka creating build/temp.linux-ppc64le-2.7/confluent_kafka/src powerpc64le-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fdebug-prefix-map=/build/python2.7-CHPQ9e/python2.7-2.7.15~rc1=. -fstack-protector-strong -Wformat -Werror=format-security -fexceptions -fPIC -I/usr/include/python2.7 -c confluent_kafka/src/confluent_kafka.c -o build/temp.linux-ppc64le-2.7/confluent_kafka/src/confluent_kafka.o In file included from confluent_kafka/src/confluent_kafka.c:17:0: confluent_kafka/src/confluent_kafka.h:55:2: error: #error "confluent-kafka-python requires librdkafka v0.11.5 or later. Install the latest version of librdkafka from the Confluent repositories, see http://docs.confluent.io/current/installation.html" #error "confluent-kafka-python requires librdkafka v0.11.5 or later. Install the latest version of librdkafka from the Confluent repositories, see http://docs.confluent.io/current/installation.html" ^~~~~ error: command 'powerpc64le-linux-gnu-gcc' failed with exit status 1 ---------------------------------------- ubuntu@mmedvede-test:~$ dpkg -l librdkafka-dev Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-===============-============-============-=================================== ii librdkafka-dev: 0.11.3-1buil ppc64el library implementing the Apache Kaf ** Affects: ubuntu Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1812700 Title: confluent-kafka ppc64le binary wheel pip package is not available on pypi.python.org To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+bug/1812700/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs