alamb commented on issue #1035: URL: https://github.com/apache/datafusion-comet/issues/1035#issuecomment-2434935790
> The scan code is not developed by me. I guess that may not work as the CometBuffer internally doesn't use pointer like Arc. It is very low-level raw pointer manipulation. That's why I said the into_mutable may not be suitable. Makes sense -- thus it sounds like removing this assumption is likely a non trivial effort What I personally hope / plan to do is to is work with people make the `ParquetExec` reader in DataFusion so utterly compelling in terms of performance that Comet can consider using that instead of CometBuffer. Current obsession is making pushdown predicates even faster with @XiangpengHao and @tustvold: https://github.com/apache/arrow-rs/issues/5523 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
