ulysses you created SPARK-34355:
-----------------------------------
Summary: Add log and time cost for commit job
Key: SPARK-34355
URL: https://issues.apache.org/jira/browse/SPARK-34355
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: ulysses you
Th commit job is a heavy option and we have seen many times Spark block at this
code place due to the slow rpc with namenode or other.
It's better to record the time that commit job cost.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]