GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/15307
[SPARK-17731][SQL][STREAMING] Metrics for structured streaming
## What changes were proposed in this pull request?
Metrics are needed for monitoring structured streaming apps. Here is the
design doc for implementing the necessary metrics.
https://docs.google.com/document/d/1NIdcGuR1B3WIe8t7VxLrt58TJB4DtipWEbj5I_mzJys/edit?usp=sharing
## How was this patch tested?
Units tests, old and new.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark SPARK-17731
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15307.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15307
----
commit deb9a3fc1dde122691dc3d309cbb737cb4e0f9b9
Author: Tathagata Das <[email protected]>
Date: 2016-09-30T03:22:19Z
Added metrics
commit f3c5dcb2d247ae92c2e05e776c46dcbc0df367c5
Author: Tathagata Das <[email protected]>
Date: 2016-09-30T03:31:33Z
Merge remote-tracking branch 'apache-github/master' into HEAD
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
