I just started hitting this issue this morning and posted a fix: https://gerrit.cloudera.org/#/c/4976/ https://issues.cloudera.org/browse/IMPALA-4442
On Mon, Oct 10, 2016 at 5:57 PM, Alex Behm <[email protected]> wrote: > I still think it has to do with libfesupport.so. The stack is pretty clear. > We are trying to call into native code from the FE and it's failing to find > the native library (of which there is only libfesupport.so). > > Maven picks up the path for native code from the fe/pom.xml: > > <backend.library.path>${env.IMPALA_HOME}/be/build/debug/service:${env.IMPALA_HOME}/be/build/release/service</backend.library.path> > > Maybe you can manually specify the path to libfesupport when running the > tests through mvn? > > mvn -Dbackend.library.path=/your/path/goes/here > > > > > > > > On Mon, Oct 10, 2016 at 5:40 PM, Lars Volker <[email protected]> wrote: > >> No change, still the same error. I tried cleaning the repo, building from >> scratch, new terminal. >> >> Running org.apache.impala.analysis.ParserTest >> Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.447 sec >> <<< FAILURE! - in org.apache.impala.analysis.ParserTest >> TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time elapsed: 0.007 >> sec <<< ERROR! >> java.lang.UnsatisfiedLinkError: >> org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B >> at >> org.apache.impala.service.FeSupport.NativeGetStartupOptions(Native Method) >> at >> org.apache.impala.service.FeSupport.GetStartupOptions(FeSupport.java:268) >> at org.apache.impala.common.RuntimeEnv.<init>(RuntimeEnv.java:47) >> at org.apache.impala.common.RuntimeEnv.<clinit>( >> RuntimeEnv.java:34) >> at >> org.apache.impala.testutil.TestUtils.assumeKuduIsSupported( >> TestUtils.java:288) >> at >> org.apache.impala.analysis.ParserTest.TestKuduUpdate(ParserTest.java:1632) >> >> On Tue, Oct 11, 2016 at 2:33 AM, Alex Behm <[email protected]> wrote: >> >> > Maybe try running "mvn dependency:copy-dependencies" from the testdata >> > directory? >> > >> > On Mon, Oct 10, 2016 at 5:04 PM, Lars Volker <[email protected]> wrote: >> > >> > > Thanks for helping me, Alex. Apparently the .jar dependencies get >> > > downloaded to fe/target/dependency, and bin/set-classpath.sh tries >> both, >> > > that location and testdata/target/dependency, and using zsh the latter >> > > throws a (maybe insignificant) error. The problem still persists >> though. >> > > >> > > I should have libfesupport.so in my LD_LIBRARY_PATH: >> > > >> > > ✔ ~/i2(i2) ✗$ echo $LD_LIBRARY_PATH >> > > :/usr/lib/jvm/java-8-oracle/jre/lib/amd64:/usr/lib/jvm/ >> > > java-8-oracle/jre/lib/amd64/server:/usr/lib/jvm/java-8- >> > > oracle/jre/lib/amd64/server:/opt/Impala-Toolchain/cdh_ >> > > components/hadoop-2.6.0-cdh5.10.0-SNAPSHOT//lib/native: >> > > */home/lv/i2/be/build/debug/service* >> > > :/opt/Impala-Toolchain/snappy-1.1.3/lib:/home/lv/i2/../ >> > > Impala-lzo/build:/opt/Impala-Toolchain/gcc-4.9.2/lib64 >> > > ✔ ~/i2(i2) ✗$ ls /home/lv/i2/be/build/debug/service >> > > impalad libfesupport.so libService.a >> > > >> > > >> > > >> > > On Tue, Oct 11, 2016 at 1:36 AM, Alex Behm <[email protected]> >> > wrote: >> > > >> > > > This looks more like it could not find libfesupport.so. Do you have >> it >> > on >> > > > your LD_LIBRARY_PATH? >> > > > >> > > > Regarding the dependency stuff. As part of "mvn package" we execute >> the >> > > > "copy-dependencies" plugin which populates target/dependency. >> > > > You can manually run that step only with "mvn >> > > dependency:copy-dependencies" >> > > > from the fe dir. >> > > > >> > > > >> > > > On Mon, Oct 10, 2016 at 4:25 PM, Lars Volker <[email protected]> >> wrote: >> > > > >> > > > > I'm trying to run the ParserTest but cannot get it to work. >> > > > > >> > > > > Running org.apache.impala.analysis.ParserTest >> > > > > > Tests run: 80, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: >> > > 0.856 >> > > > > sec >> > > > > > <<< FAILURE! - in org.apache.impala.analysis.ParserTest >> > > > > > TestKuduUpdate(org.apache.impala.analysis.ParserTest) Time >> > elapsed: >> > > > > 0.011 >> > > > > > sec <<< ERROR! >> > > > > > java.lang.UnsatisfiedLinkError: >> > > > > > org.apache.impala.service.FeSupport.NativeGetStartupOptions()[B >> > > > > > at >> > > > > > org.apache.impala.service.FeSupport. >> NativeGetStartupOptions(Native >> > > > > Method) >> > > > > > at >> > > > > > org.apache.impala.service.FeSupport.GetStartupOptions( >> > > > > FeSupport.java:268) >> > > > > > at org.apache.impala.common. >> RuntimeEnv.<init>(RuntimeEnv. >> > > > > java:47) >> > > > > > at org.apache.impala.common.RuntimeEnv.<clinit>( >> > > > > RuntimeEnv.java:34) >> > > > > > at >> > > > > > org.apache.impala.testutil.TestUtils.assumeKuduIsSupported( >> > > > > TestUtils.java:288) >> > > > > > at >> > > > > > org.apache.impala.analysis.ParserTest.TestKuduUpdate( >> > > > > ParserTest.java:1632) >> > > > > > >> > > > > > Results : >> > > > > > >> > > > > > Tests in error: >> > > > > > ParserTest.TestKuduUpdate:1632 » UnsatisfiedLink >> > > > > > org.apache.impala.service.FeS... >> > > > > >> > > > > >> > > > > >> > > > > My working copy does not seem to have the necessary dependencies >> > > > > in testdata/target/dependency/. I suspect this causes my issue. >> > > > > >> > > > > $ source bin/set-classpath.sh >> > > > > > bin/set-classpath.sh:40: no matches found: >> > > > > > /home/lv/i2/testdata/target/dependency/*.jar >> > > > > >> > > > > >> > > > > Where do those files come from and how can I get them? >> > > > > >> > > > > Thanks for the help, Lars >> > > > > >> > > > >> > > >> > >>
