alexandrutofan opened a new pull request, #37016:
URL: https://github.com/apache/spark/pull/37016

   
   
   ### What changes were proposed in this pull request?
   
   Hello, according to this 
[problem](https://issues.apache.org/jira/browse/SPARK-39617 ) raised also by 
me, and highlighted by two other persons on Stack Overflow 
([this](https://stackoverflow.com/questions/71691292/driver-cores-must-be-a-positive-number)
 and 
[this](https://stackoverflow.com/questions/72473151/exception-in-thread-main-org-apache-spark-sparkexception-driver-cores-must-be))
 and thanks to this 
[feature](https://issues.apache.org/jira/browse/SPARK-35013) we are currently 
unable to run Spark 3.2.x with Mesos in Cluster Mode.
   
   From what I saw, it happends because of the **_MesosClusterDispatcher_** and 
its components which treat the driverCores variable as a Double and in the end 
it's passed to SparkSubmit as a double and this makes the check by 
**_SparkSubmitArguments_** to fail.
   
   I'm proposing this quick fix because I think it's a quick & safe way to go 
with.
   
   ### Why are the changes needed?
   To be able to run Spark 3.2.x in Cluster Mode with Mesos
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   It's a very small change, basically the Cast from String to Int is safe now.
   
   Thank you!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to