zhengruifeng commented on code in PR #40617:
URL: https://github.com/apache/spark/pull/40617#discussion_r1175926004
##########
python/pyspark/errors/error_classes.py:
##########
@@ -79,11 +114,26 @@
"returnType can not be specified when `<arg_name>` is a user-defined
function, but got <return_type>."
]
},
+ "CANNOT_UNPERSIST_BROADCAST": {
Review Comment:
is it possible to combine `CANNOT_UNPERSIST_BROADCAST`
`CANNOT_REDUCE_BROADCAST` and `CANNOT_DESTROY_BROADCAST` to a single
`INVALID_BROADCAST_OPERATION` with parameter `operation`
##########
python/pyspark/errors/error_classes.py:
##########
@@ -29,6 +34,21 @@
"Attribute `<attr_name>` in provided object `<obj_name>` is not
callable."
]
},
+ "BARRIER_TASK_CONTEXT_NOT_INITIALIZE": {
+ "message": [
+ "Not supported to call `<func_name>` before initialize
BarrierTaskContext."
+ ]
+ },
+ "BROADCAST_VARIABLE_NOT_LOADED": {
+ "message": [
+ "Broadcast variable `<variable>` not loaded."
+ ]
+ },
+ "CALL_BEFORE_SESSION_INITIALIZE" : {
Review Comment:
what about combine `BARRIER_TASK_CONTEXT_NOT_INITIALIZE` and
`CALL_BEFORE_SESSION_INITIALIZE` to a general `CALL_BEFORE_INITIALIZE` with an
extra parameter `object`?
##########
python/pyspark/errors/error_classes.py:
##########
@@ -79,11 +114,26 @@
"returnType can not be specified when `<arg_name>` is a user-defined
function, but got <return_type>."
]
},
+ "CANNOT_UNPERSIST_BROADCAST": {
+ "message": [
+ "Broadcast can only be unpersisted in driver."
+ ]
+ },
"COLUMN_IN_LIST": {
"message": [
"`<func_name>` does not allow a Column in a list."
]
},
+ "CONTEXT_ONLY_VALID_ON_DRIVER" : {
+ "message" : [
+ "It appears that you are attempting to reference SparkContext from a
broadcast variable, action, or transformation. SparkContext can only be used on
the driver, not in code that it run on workers. For more information, see
SPARK-5063."
+ ]
+ },
+ "CONTEXT_UNAVAILABLE_FOR_REMOTE_CLIENT" : {
+ "message" : [
+ "Remote client cannot create a SparkContext. Create SparkSession
instead."
Review Comment:
I think the message is misleading, it implies a `SparkSession` was created.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
