[
https://issues.apache.org/jira/browse/SPARK-57471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18089492#comment-18089492
]
Anupam Yadav commented on SPARK-57471:
--------------------------------------
Opened https://github.com/apache/spark/pull/56550 for this. Thanks again for
handing it over, [~tibicraiu], and for attaching your verified patch. I
implemented it on the Spark side (estimating row size in JdbcUtils, covering
both the read and write paths for v1 and v2) and credited you in the PR
description for the report and handoff. If you would like to be added as a
Co-authored-by on the commit, let me know the name/email you would like used.
> Populate input/output size metrics for JDBC reads and writes
> ------------------------------------------------------------
>
> Key: SPARK-57471
> URL: https://issues.apache.org/jira/browse/SPARK-57471
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Craiu Constantin-Tiberiu
> Priority: Minor
> Labels: pull-request-available
> Attachments: estimate-bytes.patch
>
>
> At the moment, only number of records read/written is populated and not
> bytes.
> Estimate can be made based on size on Spark side to avoid reporting 0.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
