Wenning Ding created HUDI-1451:
----------------------------------

             Summary: Support bulk insert v2 with Spark 3
                 Key: HUDI-1451
                 URL: https://issues.apache.org/jira/browse/HUDI-1451
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Wenning Ding


Recently, we made Hudi support Spark 3.0.0: 
https://github.com/apache/hudi/pull/2208. However, there was a large refactor 
done to Spark datasource V2 API interfaces from version 2.4.4 → 3.0.0. So 
currently our bulk insert v2(https://issues.apache.org/jira/browse/HUDI-1013) 
feature is marked as unsupported with Spark3.

We need to redesign the bulk insert v2 part with datasource v2 api in Spark 
3.0.0.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to