Ruifeng Zheng created SPARK-60972:
-------------------------------------

             Summary: Simplify DataFrameReader plan construction
                 Key: SPARK-60972
                 URL: https://issues.apache.org/jira/browse/SPARK-60972
             Project: Spark
          Issue Type: Improvement
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Ruifeng Zheng


DataFrameReader repeats the same data-source plan construction in json, csv, 
parquet, orc, text, and xml. Its consuming methods also clone owned format, 
schema, and options values before discarding the reader.

Delegate the six format helpers to format(...).load(...) and move owned fields 
into the load, table, changes, and JDBC plans. Preserve the public signatures 
and generated plans.




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to