Kris Mok created SPARK-26633:
--------------------------------
Summary: Add ExecutorClassLoader.getResourceAsStream
Key: SPARK-26633
URL: https://issues.apache.org/jira/browse/SPARK-26633
Project: Spark
Issue Type: Improvement
Components: Spark Shell
Affects Versions: 3.0.0
Reporter: Kris Mok
{{ExecutorClassLoader}} is capable of loading dynamically generated classes
from the REPL via either RPC or HDFS, but right now it always delegates
resource loading to the parent class loader. That makes the dynamically
generated classes unavailable to uses other than class loading.
Such need may arise, for example, when json4s wants to parse the Class file to
extract parameter name information. Internally it'd call the class loader's
{{getResourceAsStream}} to obtain the Class file content as an {{InputStream}}.
This ticket tracks an improvement to the {{ExecutorClassLoader}} to allow
fetching dynamically generated Class files from the REPL as resource streams.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
