deepakpanda93 opened a new pull request, #14023: URL: https://github.com/apache/hudi/pull/14023
### Describe the issue this Pull Request addresses This PR adds initial support for running Apache Hudi with PySpark inside Jupyter notebooks. While Hudi already supports PySpark, notebook environments like Jupyter require additional handling for: - Spark session setup with Hudi-specific JARs - Common pitfalls when using Hudi SQL procedures from spark.sql() in Python notebooks This improvement aims to make it easier for developers to experiment with Hudi inside Jupyter notebooks ### Summary and Changelog - Adds utility functions for initializing Hudi within Jupyter notebooks - Clarifies the usage of Hudi's SQL procedures inside notebook cells ### Impact This change improves the developer experience for PySpark and Jupyter users who work with Apache Hudi. There is no change to core APIs or storage format, and no impact on runtime behavior. ### Risk Level none ### Documentation Update - Yes. It is in plan to add Jupyter-compatible examples and usage notes - Will submit follow-up PR to `asf-site` under the "Getting Started" or "How-To Guides" section ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Enough context is provided in the sections above - [ ] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
