Hi, In https://spark.apache.org/spark-connect/ - at the bottom it says:
Check out the guide on migrating from Spark JVM to Spark Connect to learn more about how to write code that works with Spark Connect. Also, check out how to build Spark Connect custom extensions to learn how to use specialized logic. I think there should be links to those guides - I couldn't find such guides. I did find some quick start that shows how to write in python/ Scala - but not a migration guide (maybe I just didn't find it) - but more importantly - I couldn't find anything about "how to build Spark Connect custom extensions to learn how to use specialized logic". Is there such a guide? If so - what are the cases where one would need it? On a side note - there is a small documentation bug here <https://spark.apache.org/docs/latest/spark-connect-overview.html#what-is-supported-in-spark-34> - it states Spark 3.4 although we are already 3.5 and soon 4.0. Thanks! Nimrod