Su Qilong created SPARK-33839:
---------------------------------
Summary: Add updated partition path list interface into
DataWritingCommand for dynamic partition insertion
Key: SPARK-33839
URL: https://issues.apache.org/jira/browse/SPARK-33839
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.1, 2.4.3
Reporter: Su Qilong
FileFormatWriter.write method actually returns the set of all partition paths
that were updated during this write job, but is ignored in DataWritingCommand's
implementations. This makes user who want to analyze query execution metrics
via QueryExecutionListener difficult to get these information.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
