Jacek Lewandowski created SPARK-5630:
----------------------------------------
Summary: Open a little bit metrics API
Key: SPARK-5630
URL: https://issues.apache.org/jira/browse/SPARK-5630
Project: Spark
Issue Type: Wish
Components: Input/Output, Spark Core
Reporter: Jacek Lewandowski
For the input and output metrics in {{TaskMetrics}} there very few data types
available (memory, disk, hadoop and network for reading and only hadoop for
writing). They are defined as enums and they are used mostly to present the
value in the UI. As there are many custom inputs and outputs wouldn't it be
useful to open these sets so that the method is defined as just a {{String}}?
The other useful thing would be to make the {{Source}} interface public, so
that it can be implemented by custom components which then could get registered
in the Spark metrics system.
Is it reasonable enough to start work on this?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
