In my situation each slave has 8 GB memory. I want to use the maximum memory that I can: .set("spark.executor.memory", "?g") How can I determine the amount of memory I should set ? It fails when I set it to 8GB.
- spark setting maximum available memory İbrahim Rıza HALLAÇ
- Re: spark setting maximum available memory Andrew Or
- Re: spark setting maximum available memory Mayur Rustagi