cloud-fan commented on PR #47186: URL: https://github.com/apache/spark/pull/47186#issuecomment-2221936907
@dongjoon-hyun The parser extension is known to be cumbersome. We need to provide a fully functional ANTLR parser which will be run before Spark's own parser and fallback to Spark's parser if the extension parser can't parse. It usually means copy-paste many lexer/parser rules from the Spark codebase. It will be even harder to use once we have SQL scripting (which needs to parse things recursively). The extension parser basically needs to fork Spark's entire ANTLR parser and add its own syntax. If we agree to have this syntax in Spark, we should add it directly. @srielau oh `?::` is a good idea! It can be applied to all operators that need a try version. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
