zhengruifeng commented on code in PR #40617:
URL: https://github.com/apache/spark/pull/40617#discussion_r1175974399
##########
python/pyspark/errors/error_classes.py:
##########
@@ -79,11 +114,26 @@
"returnType can not be specified when `<arg_name>` is a user-defined
function, but got <return_type>."
]
},
+ "CANNOT_UNPERSIST_BROADCAST": {
+ "message": [
+ "Broadcast can only be unpersisted in driver."
+ ]
+ },
"COLUMN_IN_LIST": {
"message": [
"`<func_name>` does not allow a Column in a list."
]
},
+ "CONTEXT_ONLY_VALID_ON_DRIVER" : {
+ "message" : [
+ "It appears that you are attempting to reference SparkContext from a
broadcast variable, action, or transformation. SparkContext can only be used on
the driver, not in code that it run on workers. For more information, see
SPARK-5063."
+ ]
+ },
+ "CONTEXT_UNAVAILABLE_FOR_REMOTE_CLIENT" : {
+ "message" : [
+ "Remote client cannot create a SparkContext. Create SparkSession
instead."
Review Comment:
NVM, I feel it says that `Remote client cannot create a SparkContext. So
the SparkConnect Python Client create a session instead`, while it actually
raise a error and fails.
Not a big deal.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]