Thanks Olaf for the list of missing shared libraries, it will become helpful as we are planing to engage maven and other communities to include missing/correct libraries in maven public repository. Meanwhile, we consider Apache bigtop 1.1.0 release for ppc as a PoC release. Thus, it is of extreme importance to have BigTop 1.1.0 release for ppc as we are planing to establish a power community around Apache BigTop 1.1.0 release. We should have all these issues resolved by Bigtop 1.2.0 release. btw, I will have a patch for BIGTOP-2305 tonight.
On Wed, Feb 17, 2016 at 3:36 PM, Olaf Flebbe <[email protected]> wrote: > Yes, there are a couple of issues all with missing shared libs in jar > files. > > BIGTOP-2305 and there are a couple of others. > > I wrote a tool to systematically search all the missing libs, stay > tuned.... > > These are the shared libs contained in all our maven repository after > compile: > ------------- > libhadoop.so > libhdfs.so > libibushandler.so > libigniteshmem.so > libjansi.so > libjblas.so > libjblas_arch_flavor.so > libjffi-1.0.so > libjffi-1.2.so > libjnidispatch.so > libjruby-cext.so > libleveldbjni.so > liblz4-java.so > libnetty-transport-native-epoll.so > libsigar.so > libsnappy.so > libsnappyjava.so > x_ignore_nofocus.so > --------------- > > These are the shared libs grouped by artefact > > > repository/com/facebook/hiveio/hive-io-exp-core/0.26/hive-io-exp-core-0.26.jar|libsigar.so > > repository/com/typesafe/sbt/incremental-compiler/0.13.5/incremental-compiler-0.13.5.jar|libjansi.so > > repository/io/netty/netty-all/4.0.21.Final/netty-all-4.0.21.Final.jar|libnetty-transport-native-epoll.so > > repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar|libnetty-transport-native-epoll.so > > repository/io/netty/netty-all/4.0.29.Final/netty-all-4.0.29.Final.jar|libnetty-transport-native-epoll.so > > repository/io/netty/netty-all/4.0.31.Final/netty-all-4.0.31.Final.jar|libnetty-transport-native-epoll.so > repository/jline/jline/2.11/jline-2.11.jar|libjansi.so > repository/jline/jline/2.12.1/jline-2.12.1.jar|libjansi.so > repository/jline/jline/2.12/jline-2.12.jar|libjansi.so > repository/jline/jline/2.13/jline-2.13.jar|libjansi.so > repository/net/java/dev/jna/jna/3.0.9/jna-3.0.9.jar|libjnidispatch.so > repository/net/java/dev/jna/jna/3.2.2/jna-3.2.2.jar|libjnidispatch.so > repository/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar|libjnidispatch.so > repository/net/java/dev/jna/jna/3.5.2/jna-3.5.2.jar|libjnidispatch.so > repository/net/java/dev/jna/jna/4.0.0/jna-4.0.0.jar|libjnidispatch.so > repository/net/java/dev/jna/jna/4.1.0/jna-4.1.0.jar|libjnidispatch.so > repository/net/jpountz/lz4/lz4/1.1.0/lz4-1.1.0.jar|liblz4-java.so > repository/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar|liblz4-java.so > repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar|liblz4-java.so > > repository/org/apache/flink/flink-shaded-hadoop2/0.10.0/flink-shaded-hadoop2-0.10.0.jar|libsnappyjava.so > > repository/org/apache/flume/flume-ng-clients/flume-ng-log4jappender/1.6.0/flume-ng-log4jappender-1.6.0-jar-with-dependencies.jar|libsnappyjava.so > > repository/org/apache/giraph/giraph-accumulo/1.1.0/giraph-accumulo-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/giraph/giraph-core/1.1.0/giraph-core-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/giraph/giraph-examples/1.1.0/giraph-examples-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/giraph/giraph-gora/1.1.0/giraph-gora-1.1.0-jar-with-dependencies.jar|libsnappyjava.so > > repository/org/apache/giraph/giraph-hbase/1.1.0/giraph-hbase-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/giraph/giraph-hcatalog/1.1.0/giraph-hcatalog-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/giraph/giraph-hive/1.1.0/giraph-hive-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/giraph/giraph-rexster-io/1.1.0/giraph-rexster-io-1.1.0-jar-with-dependencies.jar| > libjffi-1.0.so > > repository/org/apache/hadoop/hadoop-common/2.7.1/hadoop-common-2.7.1-javadoc.jar|libhadoop.so > > repository/org/apache/hadoop/hadoop-dist/2.7.1/hadoop-dist-2.7.1-javadoc.jar|libhadoop.so > > repository/org/apache/hadoop/hadoop-hdfs/2.6.0-cdh5.5.0-SNAPSHOT/hadoop-hdfs-2.6.0-cdh5.5.0-20151012.213120-541.jar|libnetty-transport-native-epoll.so > > repository/org/apache/hadoop/hadoop-hdfs/2.6.0-cdh5.5.0-SNAPSHOT/hadoop-hdfs-2.6.0-cdh5.5.0-SNAPSHOT.jar|libnetty-transport-native-epoll.so > > repository/org/apache/hadoop/hadoop-hdfs/2.7.1/hadoop-hdfs-2.7.1-javadoc.jar|libhdfs.so > > repository/org/apache/hive/hive-jdbc/1.2.1/hive-jdbc-1.2.1-standalone.jar|libjansi.so > > repository/org/apache/ignite/ignite-yarn/1.5.0.final/ignite-yarn-1.5.0.final.jar|libsnappyjava.so > > repository/org/apache/mahout/mahout-examples/0.11.1/mahout-examples-0.11.1-job.jar|libleveldbjni.so > > repository/org/apache/mahout/mahout-mr/0.11.1/mahout-mr-0.11.1-job.jar|libleveldbjni.so > > repository/org/apache/phoenix/phoenix-pherf/4.6.0-HBase-0.98/phoenix-pherf-4.6.0-HBase-0.98-jar-with-dependencies.jar|libjansi.so > > repository/org/apache/phoenix/phoenix-tracing-webapp/4.6.0-HBase-0.98/phoenix-tracing-webapp-4.6.0-HBase-0.98-runnable.jar|libjansi.so > > repository/org/apache/spark/spark-assembly_2.10/1.5.0-cdh5.5.0-SNAPSHOT/spark-assembly_2.10-1.5.0-cdh5.5.0-20151012.192015-86.jar|libjansi.so > > repository/org/apache/spark/spark-assembly_2.10/1.5.0-cdh5.5.0-SNAPSHOT/spark-assembly_2.10-1.5.0-cdh5.5.0-SNAPSHOT.jar|libjansi.so > repository/org/fusesource/jansi/jansi/1.4/jansi-1.4.jar|libjansi.so > repository/org/fusesource/jansi/jansi/1.7/jansi-1.7.jar|libjansi.so > > repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar|libleveldbjni.so > > repository/org/gridgain/ignite-shmem/1.0.0/ignite-shmem-1.0.0.jar|libigniteshmem.so > repository/org/jblas/jblas/1.2.3/jblas-1.2.3.jar|libjblas_arch_flavor.so > repository/org/jblas/jblas/1.2.4/jblas-1.2.4.jar|libjblas_arch_flavor.so > repository/org/jruby/jruby-complete/1.6.5/jruby-complete-1.6.5.jar| > libjffi-1.0.so > repository/org/jruby/jruby-complete/1.6.8/jruby-complete-1.6.8.jar| > libjffi-1.0.so > repository/org/jruby/jruby-complete/1.7.17/jruby-complete-1.7.17.jar| > libjffi-1.2.so > > repository/org/kitesdk/kite-tools/1.1.0/kite-tools-1.1.0-binary.jar|libsnappyjava.so > > repository/org/kitesdk/kite-tools/1.1.0/kite-tools-1.1.0-runtime.jar|libsnappyjava.so > > repository/org/projectlombok/lombok/1.12.4/lombok-1.12.4.jar|libjnidispatch.so > repository/org/python/jython-standalone/2.5.2/jython-standalone-2.5.2.jar| > libjffi-1.0.so > repository/org/python/jython/2.5.3/jython-2.5.3.jar|libjffi-1.0.so > repository/org/scala-lang/jline/2.10.4/jline-2.10.4.jar|libjansi.so > > repository/org/scala-lang/scala-compiler/2.11.7/scala-compiler-2.11.7.jar|libjansi.so > > repository/org/seleniumhq/selenium/selenium-firefox-driver/2.42.2/selenium-firefox-driver-2.42.2.jar|x_ignore_nofocus.so > > repository/org/seleniumhq/selenium/selenium-firefox-driver/2.45.0/selenium-firefox-driver-2.45.0.jar|x_ignore_nofocus.so > > repository/org/seleniumhq/selenium/selenium-firefox-driver/2.48.2/selenium-firefox-driver-2.48.2.jar|x_ignore_nofocus.so > repository/org/xerial/snappy/snappy-java/ > 1.0.3.2/snappy-java-1.0.3.2.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.0.4.1/snappy-java-1.0.4.1.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.0.5.3/snappy-java-1.0.5.3.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.0.5.4/snappy-java-1.0.5.4.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.0.5/snappy-java-1.0.5.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.1.0.1/snappy-java-1.1.0.1.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.1.0/snappy-java-1.1.0.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar|libsnappyjava.so > > repository/org/xerial/snappy/snappy-java/1.1.1.7/snappy-java-1.1.1.7.jar|libsnappyjava.so > > > ==== > > I think we have a problem now.... > > > Olaf > > > PS: Could you please have a look at BIGTOP-2264 ? > > > > > Am 17.02.2016 um 21:22 schrieb MrAsanjar . <[email protected]>: > > > > Excuse my newbie ignorance, but I am a bit confused here. Beside nodejs > > issue, were there other issues needed to be resolved for ppc support? I > was > > not aware there were other brokers. please let me know what needs to be > > done from my side. Again thanks for all your help. > > Cheers > > > > On Wed, Feb 17, 2016 at 2:57 PM, Olaf Flebbe <[email protected]> wrote: > > > >> > >>> Am 17.02.2016 um 18:47 schrieb Evans Ye <[email protected]>: > >>> > >>> Cos and Roman > >>> Thanks for pushing hard on the 1.1 release! > >>> The PPC packages are available here: > >>> > >> > https://ci.bigtop.apache.org/view/ppc64le/job/Bigtop-trunk-packages-ppc64le > >>> > >>> Asanjar > >>> I guess we can not easily put together PPC and the other packages > >> together > >>> in same release job because ubuntu-15.04-ppc64le require a ppc slave, > >> right? > >> > >> right. > >> > >> Olaf > >> > >> > >
