SemanticBeeng commented on pull request #24748: URL: https://github.com/apache/spark/pull/24748#issuecomment-830809011
@cloudflow @RayRoestenburg @yuchaoran2011 : can latest `cloudflow` work with latest `Spark operator` for 3.1.1 ? On https://cloudflow.io/docs/dev/administration/installing-spark-operator.html it says > The only Cloudflow compatible Spark operator is a fork maintained by Lightbend. See Backported Fix for Spark 2.4.5 for more details. Is it still the case that the `spark` 2.4 fork is required ? If so then please advise what needs to be done to make `cloudflow` run with `spark` 3.1.1. **Resources** 1. https://github.com/lightbend/cloudflow/issues/511#issuecomment-646649359 2. https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/pull/924#issue-422359697 3. https://github.com/lightbend/cloudflow/pull/578#issue-448527120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
