GitHub user davies opened a pull request:
https://github.com/apache/spark/pull/3901
[SPARK-4387][PySpark] Refactoring python profiling code to make it
extensible
This PR is based on #3255 , fix conflict and code style.
Closes #3255.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/davies/spark refactor-python-profile-code
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3901.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3901
----
commit 9bda3ecbe89d03a064c8cf7c604294878fd103a2
Author: Yandu Oppacher <[email protected]>
Date: 2014-11-13T21:02:33Z
Refactor profiler code
commit 8739affbe9d64d252fb1a32d32239b6281f75bab
Author: Yandu Oppacher <[email protected]>
Date: 2014-11-14T03:22:26Z
Code review fixes
commit 9ace076444e03598cab0b4bb955e7bd25b17a192
Author: Yandu Oppacher <[email protected]>
Date: 2014-11-14T16:15:36Z
Refactor of profiler, and moved tests around
commit 9eefc365a815c3a0dbaee34d5cf4bbad61570d97
Author: Yandu Oppacher <[email protected]>
Date: 2014-11-14T16:18:25Z
Fix doc
commit 76a6c37cc68f6ef036f3a7fe868112db5dcc2514
Author: Yandu Oppacher <[email protected]>
Date: 2014-11-14T18:48:40Z
Added a profile collector to accumulate the profilers per stage
commit 0864b5d7edc420eff882dfb36f657cb8c286f358
Author: Yandu Oppacher <[email protected]>
Date: 2014-11-14T20:34:11Z
Remove unused method
commit 31bf6b6e1c06408dc6d0d986e79ce56139b1382a
Author: Davies Liu <[email protected]>
Date: 2015-01-05T18:49:09Z
fix code style
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
