GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/2464
[SPARK-1853] Show Streaming application code context (file, line number) in
Spark Stages UI
This is a refactored version of the original PR
https://github.com/apache/spark/pull/1723 my @mubarak
Please take a look @andrewor14, @mubarak
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark streaming-callsite
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2464.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2464
----
commit d466d75341bf246bf57341ca6b9ea3ed11679040
Author: Mubarak Seyed <[email protected]>
Date: 2014-07-18T01:15:05Z
Changes for spark streaming UI
commit 9d38d3cecedc37775cb5bd70c661c3acd2dd7f43
Author: Mubarak Seyed <[email protected]>
Date: 2014-07-18T01:30:46Z
[SPARK-1853] Show Streaming application code context (file, line number) in
Spark Stages UI
commit 1500deb44c7c484fae725144c288240b5b477fdb
Author: Mubarak Seyed <[email protected]>
Date: 2014-07-18T15:11:58Z
Changes in Spark Streaming UI
commit 70f494fc01d112d81371d77d6d54d10a9b54eeca
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-10T11:11:26Z
Changes for SPARK-1853
commit 5f3105a8ac96de9d8b30a5abc72571e170e815d7
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-11T01:37:58Z
Merge remote-tracking branch 'upstream/master'
Conflicts:
core/src/main/scala/org/apache/spark/rdd/RDD.scala
streaming/src/main/scala/org/apache/spark/streaming/dstream/ReducedWindowedDStream.scala
commit 1d90cc31d1f55d35e4806639d667e2c1ac52e012
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-11T01:57:49Z
Changes for SPARK-1853
commit 2a09ad6620e380efb0a0bbc7daac0340ea6e497a
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-11T02:04:01Z
Changes in Utils.scala for SPARK-1853
commit ccde038f664c46f2c48e1f073bcfc6d8917ecef1
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-11T02:10:54Z
Removing Utils import from MappedDStream
commit a207eb7ba14e4f51011dea7d2ba0651c5466f218
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-18T03:45:06Z
Fixing code review comments
commit 5051c58c9fce1e6821a35b5ffe7cb670a07912ed
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-18T04:20:56Z
Getting return value of compute() into variable and call
setCallSite(prevCallSite) only once. Adding return for other code paths (for
None)
commit f51fd9f62ed25611c7cd078ed5207f8c5392e60a
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-19T07:11:52Z
Fixing scalastyle, Regex for Utils.getCallSite, and changing method names
in DStream
commit c26d933ea28cf4bd834a27ec74019d0f58dfa455
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-20T07:00:14Z
Merge remote-tracking branch 'upstream/master'
commit 33a72952caa31cb218b2dc3e0ecf188ee0ccdfb5
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-20T08:00:29Z
Fixing review comments: Merging both setCallSite methods
commit 491a1eb23aa94919a9a06a84a9cf3cab118fa628
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-20T08:07:05Z
Removing streaming visibility from getRDDCreationCallSite in DStream
commit 196121b978998175f96a2f8189a85f91bf4c6992
Author: Mubarak Seyed <[email protected]>
Date: 2014-08-21T05:30:13Z
Merge remote-tracking branch 'upstream/master'
commit 8c5d443a69351faefbeb66016ce58bd0a62e73ee
Author: Mubarak Seyed <[email protected]>
Date: 2014-09-05T09:52:08Z
Merge remote-tracking branch 'upstream/master'
Conflicts:
core/src/main/scala/org/apache/spark/util/Utils.scala
commit ceb43daeb0947acab5629031c6e35d29f96f6376
Author: Mubarak Seyed <[email protected]>
Date: 2014-09-05T10:00:38Z
Changing default regex function name
commit c461cf40c0bc052484f96a6232537475b86294a1
Author: Mubarak Seyed <[email protected]>
Date: 2014-09-06T02:41:34Z
Merge remote-tracking branch 'upstream/master'
commit b9ed945863806a657af31febbf63c53e57828b4f
Author: Mubarak Seyed <[email protected]>
Date: 2014-09-06T03:48:16Z
Adding streaming utils
commit 7baa4275af6621747fbbfb0d2a4e79f895d340e0
Author: Tathagata Das <[email protected]>
Date: 2014-09-19T21:16:47Z
Refactored getCallSite and setCallSite to make it simpler. Also added unit
test for DStream creation site.
commit 904cd925665f3a69f30fcb844348badb1ac7df79
Author: Tathagata Das <[email protected]>
Date: 2014-09-19T21:30:11Z
Merge remote-tracking branch 'apache-github/master' into streaming-callsite
Conflicts:
streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala
streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
