flaming-archer commented on issue #7048: URL: https://github.com/apache/gravitino/issues/7048#issuecomment-3400361976
At present, our optimization has achieved a reading data rate of approximately 66% for ORC and 80%+ for Parquet compared to native Spark. We have made the following optimizations: 1. ORC Pusheddown filter. https://github.com/apache/kyuubi/issues/7122 2. Parquet Pusheddown filter. https://github.com/apache/kyuubi/issues/7129 3. ORC Dynamic Partition Pruning. https://github.com/apache/spark/pull/52009 4. Parquet Dynamic Partition Pruning. https://github.com/apache/spark/pull/52180 5. Fix kyuubi spark connector connot cached. https://github.com/apache/kyuubi/pull/7191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
