GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/6034
[SPARK-7501] [Streaming] DAG visualization: show DStream operations
This is similar to #5999, but for streaming.
One thing to note here is that we already do some kind of scoping thing for
call sites, so this patch adds the new RDD operation scoping logic in the same
place. Also, this patch adds a `try finally` block to set the relevant
variables in a safer way.
@tdas
------------------------
**Before**
(Note: These screenshots are taken after applying #6004)
--------------------------
**After**
(Note: we will fix the operation name bleeding beyond the box separately in
SPARK-7500)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark dag-viz-streaming
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6034.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6034
----
commit a0d32630c7ebf026b38ea65874a005c9ff6e9537
Author: Andrew Or <[email protected]>
Date: 2015-05-09T19:10:31Z
Scope streaming operations instead of RDD operations
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
