srowen commented on issue #24057: [SPARK-26839][SQL] Work around classloader changes in Java 9 for Hive isolation URL: https://github.com/apache/spark/pull/24057#issuecomment-472556428 @squito OK good to know. If you were to _revert_ the commit https://github.com/apache/spark/pull/24057/commits/3ad22b66220a9c3353931fe6b46bf87195869db3 here and run on Java 11, you'd see the error at https://github.com/apache/spark/pull/24057#issuecomment-471676707 Of course, this may mean that we just can't support Hive older than X on Java 11. This particular failure, as I understand, is from testing against 'builtin' Hive, at 1.2.1. It feels like we'd have to update the built-in Hive version (which really ought to happen for 3.0 anyway), and if we need to test against older ones, just disable them for Java 11. I don't know which Hive version works, so any confirmation you have that later versions work would be a great data point. (Aside: we still have REPL-related problems in Java 11 which may be hard to resolve as it depends on Scala compile-time support for Java 9+. This may not be the last kind of blocker. Right now seeing if I can get this one in and then move ahead to fix the YARN failure I saw.)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
