FWIW - Mich - I've often found your responses "gpt" like and can often be a distraction. Now I don't know if that's your actual writing style or you were indeed using genai tools to generate the responses on your behalf. I don't think we should sanction you if that's your writing style. But if you are indeed leveraging some genai tool to chime in on topics that you have very little familiarity with, it'd be best for you to refrain from doing so in the future.
On Wed, Oct 9, 2024 at 9:13 AM Nicholas Chammas <nicholas.cham...@gmail.com> wrote: > Mich, > > You are “helping” someone by giving them configs that don’t exist. And > this is the second time > <https://lists.apache.org/thread/6hmfmz6owy3jb5y0zx9j307bc38wj54f> that I > am aware of that you are doing this. > > Both times you have done this and I have asked you to explain where you > are getting these non-existent configs from, you have declined to share. > > To me it looks like you are posting ChatGPT/genAI gibberish without > vetting it and confirming it is correct information. And you do this to the > detriment of everyone on the list. It actively harms newcomers looking for > help by sending them on wild goose chases. And it insults the intelligence > of the contributors and committers who expect a high signal to noise ratio > on this list. > > Please STOP posting genAI nonsense to the list. If you do not have direct > knowledge of the subject being discussed in a thread, don’t participate in > the thread. It’s that simple. If you want to use genAI to help craft a > response, carefully vet the information before you post it as your own. > > Dev list admins, > > Could the list admins please chime in with an “official” take on this > behavior? I hate to be the one to start this discussion, but I do it > because a) it’s the second time it has happened (that I am personally aware > of), and b) it’s very counterproductive and lowers the quality of the > discussions on the list. > > Nick > > > On Oct 9, 2024, at 6:51 PM, Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > > Do you have a better recommendation? > > Or trying to waste time as usual. > > It is far easier to throw than catch. > > Do your homework and stop throwing spanners at work. > > Mich Talebzadeh, > > Architect | Data Engineer | Data Science | Financial Crime > PhD <https://en.wikipedia.org/wiki/Doctor_of_Philosophy> Imperial College > London <https://en.wikipedia.org/wiki/Imperial_College_London> > London, United Kingdom > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* The information provided is correct to the best of my > knowledge but of course cannot be guaranteed . It is essential to note > that, as with any advice, quote "one test result is worth one-thousand > expert opinions (Werner <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von > Braun <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". > > > On Wed, 9 Oct 2024 at 16:43, Nicholas Chammas <nicholas.cham...@gmail.com> > wrote: > >> Mich, >> >> Can you please share with the list where *exactly* you are citing these >> configs from? >> >> As far as I can tell, these two configs don’t exist and have never >> existed in the Spark codebase: >> >> spark.executor.decommission.enabled=true >> spark.executor.decommission.gracefulShutdown=true >> >> Where exactly are you getting this information from (and then posting it >> to the list as advice)? Please be clear and provide specific references. >> >> Nick >> >> >> On Oct 9, 2024, at 1:20 PM, Mich Talebzadeh <mich.talebza...@gmail.com> >> wrote: >> >> Before responding, what configuration parameters are you using to make >> this work? >> >> spark.executor.decommission.enabled=true >> spark.executor.decommission.gracefulShutdown=true >> spark.executor.decommission.forceKillTimeout=100s >> >> HTH >> >> Mich Talebzadeh, >> >> Architect | Data Engineer | Data Science | Financial Crime >> PhD <https://en.wikipedia.org/wiki/Doctor_of_Philosophy> Imperial >> College London <https://en.wikipedia.org/wiki/Imperial_College_London> >> London, United Kingdom >> >> view my Linkedin profile >> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >> >> >> https://en.everybodywiki.com/Mich_Talebzadeh >> >> >> >> *Disclaimer:* The information provided is correct to the best of my >> knowledge but of course cannot be guaranteed . It is essential to note >> that, as with any advice, quote "one test result is worth one-thousand >> expert opinions (Werner >> <https://en.wikipedia.org/wiki/Wernher_von_Braun>Von Braun >> <https://en.wikipedia.org/wiki/Wernher_von_Braun>)". >> >> >> On Wed, 9 Oct 2024 at 11:05, Jay Han <tunyu...@gmail.com> wrote: >> >>> Hi spark community, >>> I have such a question: Why driver doesn't shutdown executors >>> gracefully on k8s. For instance, >>> kubernetesClient.pods().withGracePeriod(100).delete(). >>> >>> >>> -- >>> Best, >>> Jay >>> >> >> >
