Burak Yavuz created SPARK-17754:
-----------------------------------
Summary: DataFrame reader and writer don't show Input/Output
metrics in Spark UI
Key: SPARK-17754
URL: https://issues.apache.org/jira/browse/SPARK-17754
Project: Spark
Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Burak Yavuz
The Spark UI shows metrics such as Input Size, Output Size, Shuffle Read/Write,
etc.
The input and output fields are blank for DataFrames even though I'm reading or
writing data. The input field was not empty back in 1.6.2, so this has been a
regression.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
