dongjoon-hyun edited a comment on pull request #35830: URL: https://github.com/apache/spark/pull/35830#issuecomment-1066031136
@Yikun . Fine tuning is just to aim to launch the tests, not for guaranteeing the stability. The minimum requirement of CI is stability. As you see, we are already hitting many flakiness issues in GitHub Action due to the memory issues and the committers are manually mitigating them by re-triggering . Unless we can get a bigger VM machine, this addition will add another complexity and instability to Apache Spark GitHub Action. > Kubernetes is using 0.85 CPU 0.25G memeory, so only 1.15 CPU left, we can give 0.5 for driver, 0.2 for others executor (3 is max limited). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
