ulysses you created SPARK-34355: ----------------------------------- Summary: Add log and time cost for commit job Key: SPARK-34355 URL: https://issues.apache.org/jira/browse/SPARK-34355 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 3.2.0 Reporter: ulysses you
Th commit job is a heavy option and we have seen many times Spark block at this code place due to the slow rpc with namenode or other. It's better to record the time that commit job cost. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org