zhouyuan commented on PR #12388: URL: https://github.com/apache/gluten/pull/12388#issuecomment-5131363212
@philo-he @felipepessoto > Could we use Apache Stash to cache the native lib so it can be shared across workflows? +1. We could upload the native lib artifact and share download it in the new delta pipeline. Should also add a fallback native build in case there is a cache miss. Is there a easy way to cover multiple Spark versions for these delta tests? The delta community has moved to spark-4.x but for Gluten many are still on Spark-3.5. The other issue is the 4 shard based job is taking 2 hours for each, it's better to split into 8 shard so it can be a faster -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
