Hello, I'm trying to understand better the connection between impala and the filesystem hdfs.
I compiled impala 3.4.0 using the apache hadoop libraries ( not cdh components). When I add the Apache Hadoop libhdfs.so to the LD_LIBRARY_PATH, I get the following FATAL error (crash of my impala service ) *[libprotobuf FATAL google/protobuf/stubs/common.cc:79] This program was compiled against version 2.5.0 of the Protocol Buffer runtime library, which is not compatible with the installed version (3.5.1). Contact the program author for an update. If you compiled the program yourself, make sure that your headers are from the same version of Protocol Buffers as your link-time library. (Version verification failed in "/root/workspace/build_fileclient/fs/proto/security.pb.cc <http://security.pb.cc>".)* I tried to change the version of protocol buffer installed on my host and add it to LD_RUN_PATH/LD_PRELOAD/LD_LIBRARY_PATH, but nothing changes I compiled again impala using the cdh components ( default toolchain ) and I don't face up this issue. I noticed that: - Impala is built with 3.5.1 version of protobuf ( https://github.com/apache/impala/blob/3.4.0/bin/impala-config.sh#L134 ) - Apache Hadoop cannot be compiled with a protobuf version higher than 2.5.0 ( https://issues.apache.org/jira/browse/HADOOP-13363 ) How can I manage this issue using Apache Hadoop libraries ? Is impala not compatible with the Apache Hadoop ? Are Java Native Libraries of CDH Hadoop built using the 3.5.1 version of protobuf ? In case I would like to add a connection to another storage like kudu, should I provide the libkuduclient.so compiled with the same version of protobuf used in impala ? Thanks a lot Alessio
