dongjoon-hyun commented on PR #53173: URL: https://github.com/apache/spark/pull/53173#issuecomment-3573594928
Thank you for all your feedback. AFAIK, we have 5 ways to move forward so far. 1. @juliuszsompolski 's this PR and [Delta PR](https://github.com/delta-io/delta/pull/5560): "if (source == "delta") { extraOptions + ("isDataFrameWriterV1" -> "true") }" 2. @juliuszsompolski 's suggestion: "interface RequiresDataFrameWriterV1WriteOption extends TableProvider" 3. @cloud-fan 's idea: "add a new bool flag in TableProvider, something like boolean indicateV1SaveAsTableWithOption" 4. Release the AS-IS Spark and ask `Delta` community to implement V2 correctly like Apache Iceberg community. 5. Revert Spark 4.1 improvements (SPARK-52451 and SPARK-53097) For 1 ~ 4, Delta community needs to change their code in any way. Is it okay for them? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
