GitHub user nickbp opened a pull request:
https://github.com/apache/spark/pull/21516
[SPARK-24501][MESOS] Add Dispatcher and Driver metrics
Adds metrics for the Mesos Dispatcher:
- Counters: The total number of times that submissions have entered states
- Timers: The duration from submit or launch until a submission entered a
given state
- Histogram: The retry counts at time of retry
Also adds metrics for the Mesos coarse-grained driver implementation. The
deprecated fine-grained driver is left as-is.
The driver metrics include e.g. frequency of RPCs to/from Mesos, the
internal state tracking of tasks/agents, and durations for bringing up the
tasks.
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nickbp/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21516.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21516
----
commit 17c4c755703019ebe835404a626f2298fd9e0171
Author: Nicholas Parker <nick@...>
Date: 2018-05-04T17:11:23Z
[SPARK-24501][MESOS] Add Dispatcher and Driver metrics
Adds metrics for the Mesos Dispatcher:
- Counters: The total number of times that submissions have entered states
- Timers: The duration from submit or launch until a submission entered a
given state
- Histogram: The retry counts at time of retry
Also adds metrics for the Mesos coarse-grained driver implementation. The
deprecated fine-grained driver is left as-is.
The driver metrics include e.g. frequency of RPCs to/from Mesos, the
internal state tracking of tasks/agents, and durations for bringing up the
tasks.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
