[
https://issues.apache.org/jira/browse/SPARK-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or closed SPARK-7468.
----------------------------
Resolution: Won't Fix
It's hard to apply a general rule that decides whether an operation should be
marked "withScope". Even an action may be marked as such in case we make it use
an operation internally in the future (e.g. if we change `take` implementation
to use a random `map` or `filter` somewhere).
Closing as won't fix because in the worst case we show a higher level
construct, which is familiar to the user, rather than a low level operation
used internally (e.g. otherwise `map` shows up on the UI even though the user
didn't explicitly call `map`).
> DAG visualization: certain action operators should not be scopes
> ----------------------------------------------------------------
>
> Key: SPARK-7468
> URL: https://issues.apache.org/jira/browse/SPARK-7468
> Project: Spark
> Issue Type: Sub-task
> Components: Web UI
> Affects Versions: 1.4.0
> Reporter: Andrew Or
> Assignee: Andrew Or
>
> What does it mean to have a "take" scope and an RDD in it? This is somewhat
> confusing. Low hanging fruit.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
