Marcelo Vanzin created SPARK-25546:
--------------------------------------
Summary: RDDInfo uses SparkEnv before it may have been initialized
Key: SPARK-25546
URL: https://issues.apache.org/jira/browse/SPARK-25546
Project: Spark
Issue Type: Bug
Components: Spark Core, Tests
Affects Versions: 2.4.0
Reporter: Marcelo Vanzin
This code:
{code}
private[spark] object RDDInfo {
private val callsiteLongForm =
SparkEnv.get.conf.get(EVENT_LOG_CALLSITE_LONG_FORM)
{code}
Has two problems:
- it keeps that value across different SparkEnv instances. So e.g. if you have
two tests that rely on different values for that config, one of them will break.
- it assumes tests always initialize a SparkEnv. e.g. if you run "core/testOnly
*.AppStatusListenerSuite", it will fail because {{SparkEnv.get}} returns null.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
