itholic commented on code in PR #40617:
URL: https://github.com/apache/spark/pull/40617#discussion_r1175958890
##########
python/pyspark/errors/error_classes.py:
##########
@@ -79,11 +114,26 @@
"returnType can not be specified when `<arg_name>` is a user-defined
function, but got <return_type>."
]
},
+ "CANNOT_UNPERSIST_BROADCAST": {
+ "message": [
+ "Broadcast can only be unpersisted in driver."
+ ]
+ },
"COLUMN_IN_LIST": {
"message": [
"`<func_name>` does not allow a Column in a list."
]
},
+ "CONTEXT_ONLY_VALID_ON_DRIVER" : {
+ "message" : [
+ "It appears that you are attempting to reference SparkContext from a
broadcast variable, action, or transformation. SparkContext can only be used on
the driver, not in code that it run on workers. For more information, see
SPARK-5063."
+ ]
+ },
+ "CONTEXT_UNAVAILABLE_FOR_REMOTE_CLIENT" : {
+ "message" : [
+ "Remote client cannot create a SparkContext. Create SparkSession
instead."
Review Comment:
Sorry, I didn't catch the point. The message suggests using a Spark session
because it is not possible to create a SparkContext in a remote session. Do you
have any proposed suggestion?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
