viirya commented on code in PR #37205:
URL: https://github.com/apache/spark/pull/37205#discussion_r926318144
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2ScanExecBase.scala:
##########
@@ -168,6 +168,18 @@ trait DataSourceV2ScanExecBase extends LeafExecNode {
}
}
+ protected def postDriverMetrics(): Unit = {
+ val driveSQLMetrics = scan.reportCustomDriverMetrics().map(
customTaskMetric => {
+ val metric = metrics(customTaskMetric.name())
Review Comment:
Yea, I think so. Considering this is implemented by the developers for DS v2
data sources and not from end-users, I don't think this would happen. Otherwise
it is caught during development.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
