ajantha-bhat commented on pull request #3375: URL: https://github.com/apache/iceberg/pull/3375#issuecomment-981129564
@RussellSpitzer : As I have mentioned above, I couldn't avoid custom parser for sort order as brining existing parser will cause circular dependency. Also moving procedure to spark extension module is also not possible due to dependency on it on spark-3.2 module. So, today I thought why not move some part of parser code to spark-3.2 and handle the same. So, I found a hack to do it. It is not clean, But it helps avoiding custom sort order parser as you suggested. I just have to move `SetWriteDistributionAndOrdering` from spark-3.2-extensions to spark-3.2 and append a prefix of "ALTER TABLE temp WRITE ORDERED BY" internally to parse as plan to collect sort order. I have pushed as a separate commit, please have a look. I think this method can avoid custom sort order parser. cc: @rymurr , @rdblue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
