Salil Surendran created SPARK-18120:
---------------------------------------
Summary: QueryExecutionListener method doesnt' get executed for
DataFrameWriter methods
Key: SPARK-18120
URL: https://issues.apache.org/jira/browse/SPARK-18120
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.1
Reporter: Salil Surendran
QueryExecutionListener is a class that has methods named onSuccess() and
onFailure() that gets called when a query is executed. Each of those methods
takes a QueryExecution object as a parameter which can be used for metrics
analysis. It gets called for several of the DataSet methods like take, head,
first, collect etc. but doesn't get called for any of hte DataFrameWriter
methods like saveAsTable, save etc.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
