milenkovicm opened a new issue, #16945:
URL: https://github.com/apache/datafusion/issues/16945
### Is your feature request related to a problem or challenge?
Datafusion 49 brings `MetricValue::Custom { name: Cow<'static, str>, value:
Arc<dyn CustomMetricValue>,}` which can be used to extend metric handling. With
datafusion ballista shipping execution metrics from executors to scheduler
question it is not clear how can custom value can be encoded/decoded more
details about metric serialisation can be found at [1] ? At the moment with
the effort to bring datafusion 49 support to ballista [2] we would throw error
in case of custom metrics value.
[1]:
https://github.com/milenkovicm/arrow-ballista/blob/e1e9f6ca423fd558664a7f2fb3b1bc3ed07d7db8/ballista/core/src/serde/scheduler/to_proto.rs#L121
[2]: https://github.com/apache/datafusion-ballista/pull/1285
### Describe the solution you'd like
We need to provide a clean path to support encoding/decoding of
`MetricValue::Custom`
### Describe alternatives you've considered
Alternative approach would be current approach where custom metrics value
would trigger error or to be ignored (somehow)
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
