sunchao commented on pull request #1635:
URL: https://github.com/apache/hive/pull/1635#issuecomment-723352605
Sure, the stack trace is:
```
java.lang.NoClassDefFoundError: org/xerial/snappy/SnappyInputStream
at
org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskSchedulerService$TestTaskSchedulerServiceWrapper.<init>(TestLlapTaskSchedulerService.java:2008)
at
org.apache.hadoop.hive.llap.tezplugins.TestLlapTaskSchedulerService.testHostPreferenceMissesConsistentPartialAlive(TestLlapTaskSchedulerService.java:1077)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:288)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:282)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException:
org.xerial.snappy.SnappyInputStream
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
... 14 more
```
seems all the failures are from `org.apache.hadoop.hive.llap.tezplugins`
module.
> Yes exactly, but this can happen in the context of an union too, both
parquet_map_null.q and avro_deserialize_map_null.q refer to map_null_val.avro
so this seem to be the case.
Ah I see. Great. I guess we haven't seen test failure related to this yet?
> I have a branch with everything on it Avro, Hive and Parquet updates in
case you want to take a look, it fully compiles however I have not been able to
run the full set of Spark tests locally yet because of unrelated errors on
Kinesis (and lack of familiarity with the Spark test suite). I would like to
test it with the full CI, but to do that I would need to have the Hive
SNAPSHOTs somewhere, it is a pity Hive does not publish them for older
versions, or are they published somewhere (that way i will update things there
first)?
Awesome! do you see any compile error without the Avro API fix? I don't
think the snapshot jars are published anywhere so it could be hard to test this
in Spark CI... However, we also plan to test this combination out in our
internal Spark CI.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
