HyukjinKwon commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-659464261
@tgravescs, I think he wanted to know the plan and how we will merge these into one codebase with DSv2 in the end. Looks valid concern to me and I guess this is his main concern and why he asked SPIP. I don't have or know the exact plan or I haven't used the new codes by myself before. Maybe I am remembering wrongly but I thought we addressed the comments from @BryanCutler by leaving these as a future work IIRC. The Arrow one is actually still in the comments: https://github.com/apache/spark/blob/a4382f7fe1c36a51c64f460c6cb91e93470e0825/sql/core/src/main/scala/org/apache/spark/sql/execution/Columnar.scala#L56-L58 I am willing to help this too but would like to ask the plan or at least file the corresponding JIRAs to track as well. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
