supermem613 commented on PR #3682: URL: https://github.com/apache/incubator-gluten/pull/3682#issuecomment-2059110628
> > @PHILO-HE, quick question: why was from_json marked as black-list with this PR? From a cursory glance it seems to run without issue. Are there any issues associated that made it be turned off? > > @supermem613, it looks from_json is still not supported in velox. Did you confirm the operator is really offloaded to velox (e.g. by checking DAG in Spark UI)? Gluten has a fallback mechanism, for unsupported function, the relevant operator can fall back to vanilla Spark to still make the query run successfully. Ah, you are right. I made the mistake of running it with a purely in-memory expression and it didn't fallback as it didn't really activate Gluten. Sorry. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
