Mich, You are “helping” someone by giving them configs that don’t exist. And this is the second time <https://lists.apache.org/thread/6hmfmz6owy3jb5y0zx9j307bc38wj54f> that I am aware of that you are doing this.
Both times you have done this and I have asked you to explain where you are getting these non-existent configs from, you have declined to share. To me it looks like you are posting ChatGPT/genAI gibberish without vetting it and confirming it is correct information. And you do this to the detriment of everyone on the list. It actively harms newcomers looking for help by sending them on wild goose chases. And it insults the intelligence of the contributors and committers who expect a high signal to noise ratio on this list. Please STOP posting genAI nonsense to the list. If you do not have direct knowledge of the subject being discussed in a thread, don’t participate in the thread. It’s that simple. If you want to use genAI to help craft a response, carefully vet the information before you post it as your own. Dev list admins, Could the list admins please chime in with an “official” take on this behavior? I hate to be the one to start this discussion, but I do it because a) it’s the second time it has happened (that I am personally aware of), and b) it’s very counterproductive and lowers the quality of the discussions on the list. Nick > On Oct 9, 2024, at 6:51 PM, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > > Do you have a better recommendation? > > Or trying to waste time as usual. > > It is far easier to throw than catch. > > Do your homework and stop throwing spanners at work. > > Mich Talebzadeh, > > Architect | Data Engineer | Data Science | Financial Crime > PhD <https://en.wikipedia.org/wiki/Doctor_of_Philosophy> Imperial College > London <https://en.wikipedia.org/wiki/Imperial_College_London> > London, United Kingdom > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > https://en.everybodywiki.com/Mich_Talebzadeh > > > Disclaimer: The information provided is correct to the best of my knowledge > but of course cannot be guaranteed . It is essential to note that, as with > any advice, quote "one test result is worth one-thousand expert opinions > (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun > <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". > > > On Wed, 9 Oct 2024 at 16:43, Nicholas Chammas <nicholas.cham...@gmail.com > <mailto:nicholas.cham...@gmail.com>> wrote: >> Mich, >> >> Can you please share with the list where exactly you are citing these >> configs from? >> >> As far as I can tell, these two configs don’t exist and have never existed >> in the Spark codebase: >> >> spark.executor.decommission.enabled=true >> spark.executor.decommission.gracefulShutdown=true >> >> Where exactly are you getting this information from (and then posting it to >> the list as advice)? Please be clear and provide specific references. >> >> Nick >> >> >>> On Oct 9, 2024, at 1:20 PM, Mich Talebzadeh <mich.talebza...@gmail.com >>> <mailto:mich.talebza...@gmail.com>> wrote: >>> >>> Before responding, what configuration parameters are you using to make this >>> work? >>> >>> spark.executor.decommission.enabled=true >>> spark.executor.decommission.gracefulShutdown=true >>> spark.executor.decommission.forceKillTimeout=100s >>> >>> HTH >>> >>> Mich Talebzadeh, >>> >>> Architect | Data Engineer | Data Science | Financial Crime >>> PhD <https://en.wikipedia.org/wiki/Doctor_of_Philosophy> Imperial College >>> London <https://en.wikipedia.org/wiki/Imperial_College_London> >>> London, United Kingdom >>> >>> view my Linkedin profile >>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >>> >>> https://en.everybodywiki.com/Mich_Talebzadeh >>> >>> >>> Disclaimer: The information provided is correct to the best of my knowledge >>> but of course cannot be guaranteed . It is essential to note that, as with >>> any advice, quote "one test result is worth one-thousand expert opinions >>> (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >>> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >>> >>> >>> On Wed, 9 Oct 2024 at 11:05, Jay Han <tunyu...@gmail.com >>> <mailto:tunyu...@gmail.com>> wrote: >>>> Hi spark community, >>>> I have such a question: Why driver doesn't shutdown executors >>>> gracefully on k8s. For instance, >>>> kubernetesClient.pods().withGracePeriod(100).delete(). >>>> >>>> >>>> -- >>>> Best, >>>> Jay >>
