combinatorist commented on PR #26275: URL: https://github.com/apache/spark/pull/26275#issuecomment-1779837319
It's not just verifying before insert that columns are aligned. Ideally, the method would allow you to insert _even when you already know the columns are not aligned_. You can easily get the same columns out of order when you use `withColumn` / `dropColumn` / `withColumnRenamed` type transformations. Also, if spark supports unionByName, then why not insertByName (or insert with byName option). If it's not useful at insert, should we simplify the methods for union as well? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
