Hi all, I’d like to propose adding llms.txt files to the Spark documentation.
As more users rely on AI-assisted tools and LLMs to learn, write Spark code, and troubleshoot issues, it’s increasingly important that these tools point back to the up-to-date official documentation. This will help improve code generation quality and make new Spark features easier to discover. The emerging llms.txt convention <https://llmstxt.org/> provides a lightweight way to curate LLM-friendly manifests of key documentation links. Would love to hear your feedback! SPIP: https://docs.google.com/document/d/1tRYdNTrIs8-JTgDthQ-7kcxEG7S91mNUVmUOfevW-cE/edit?tab=t.0#heading=h.wq8o4rl94dvr JIRA: https://issues.apache.org/jira/browse/SPARK-53528 Thanks, Allison
