Florian Kaspar created SPARK-24494:
--------------------------------------
Summary: Give users possibility to skip own classes in
SparkContext.getCallSite()
Key: SPARK-24494
URL: https://issues.apache.org/jira/browse/SPARK-24494
Project: Spark
Issue Type: Wish
Components: Spark Core
Affects Versions: 2.2.0
Environment: any (currently using Spark 2.2.0 in both local mode and
with YARN)
Reporter: Florian Kaspar
org.apache.spark.SparkContext.getCallSite() uses
org.apache.spark.util.Utils.getCallSite() which by default skips Spark and
Scala classes.
It would be nice to be able to add user-defined classes/patterns to skip here
as well.
We have one central class that acts as some kind of proxy for RDD
transformations and is used by many other classes.
In the SparkUI we would like to see the real origin of a transformation being
not the proxy but its caller. This would make the UI even more useful to us.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
