Thanks to the committers and PMC members who chimed in on this thread. > On Oct 10, 2024, at 3:27 AM, Jungtaek Lim <kabhwan.opensou...@gmail.com> > wrote: > > I'd ask people to quote the part you got from GPT and explicitly call out the > part as "GPT-generated" so that people would consider that there is > hallucination.
On October 9, 2024, Mich posted <https://lists.apache.org/thread/48msqsjzwkdk8lmvtl7vrqv7bc7zlxff> the following two configs: spark.executor.decommission.enabled spark.executor.decommission.gracefulShutdown In a separate thread from December 11, 2023, Mich <https://lists.apache.org/thread/b18rc6n9z5twrzgyblfo0o0sv260q14y> posted at length on the following config: spark.sql.cbo.strategy If you have a local checkout of the Spark repo, you can easily do a global search of the repo for these three configs and see that they do not exist anywhere. I have even tried checking out older versions of Spark to see if, perhaps, they used to exist but were removed. They do not. They never existed. They seem like they would be real configs, however, which is why I am confident they are generative AI hallucinations. I trust it is obvious to everyone how pernicious posts like this are. They waste everyone's time and actively mislead people. When I first heard about `spark.sql.cbo.strategy` back in December, I spent almost 30 minutes digging into the documentation and code trying to figure out how I missed such a key config before I realized that I was reading AI gibberish. Unfortunately, given his latest post <https://lists.apache.org/thread/1wzj22ncfbr4sdj4x999vbsswhhjbvp6>, it seems Mich is totally unrepentant about his behavior. I hope that, if this behavior continues, the admins will take corrective action. Nick
