Github user liufengdb commented on the issue:
https://github.com/apache/spark/pull/18666
Maybe I missed something, but it seems Spark has its own class loader right
now, which can load the class from the given URL:
https://github.com/apache/spark/blob/master/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala#L211.
I doubt it needs to download the jar to the hive configured temp directory. In
other words, this line of code is not necessary:
https://github.com/apache/spark/blob/master/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L837.
This can be verified very easily: Remove
https://github.com/apache/spark/blob/master/sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala#L837
and run `add jar` and see whether it works.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
