xinrong-meng commented on PR #40388: URL: https://github.com/apache/spark/pull/40388#issuecomment-1467510024
I see your concern on `PYSPARK_NO_NAMESPACE_SHARE`, it should have affected the imports of `pandas_udf`, that is, if it is set, `sql.functions.pandas_udf` points to `sql.connect.functions.pandas_udf`. Unfortunately in our case, there is no `sql.connect.functions.pandas_udf` at all. Considering`PYSPARK_NO_NAMESPACE_SHARE` is not a heavily-used user-facing config, shall we merge this change first for clarity(otherwise users may think pandas_udf is not implemented yet)? I will work on a follow-up to support ``sql.connect.functions.pandas_udf` with `PYSPARK_NO_NAMESPACE_SHARE` support. CC @ueshin -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
