Cheng Lian created SPARK-15983:
----------------------------------
Summary: Remove FileFormat.prepareRead
Key: SPARK-15983
URL: https://issues.apache.org/jira/browse/SPARK-15983
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.0
Reporter: Cheng Lian
Assignee: Cheng Lian
Interface method {{FileFormat.prepareRead()}} was added in [PR
#12088|https://github.com/apache/spark/pull/12088] to handle a special case in
the LibSVM data source.
However, the semantics of this interface method isn't intuitive: it returns a
modified version of the data source options map. Considering that the LibSVM
case can be easily handled using schema metadata inside inferSchema, we can
remove this interface method to keep the FileFormat interface clean.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
