Hyukjin Kwon created SPARK-60961:
------------------------------------
Summary: Raise SparkConnectGrpcException for gRPC errors without
server details in Spark Connect Rust as PySpark does
Key: SPARK-60961
URL: https://issues.apache.org/jira/browse/SPARK-60961
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
In PySpark Connect, a gRPC error that carries no error details of the server,
such as {{UNAVAILABLE}} from an unreachable server after its retries,
{{UNAUTHENTICATED}} or {{PERMISSION_DENIED}} from a proxy,
{{DEADLINE_EXCEEDED}} or {{RESOURCE_EXHAUSTED}}, raises
{{SparkConnectGrpcException}} with {{getGrpcStatusCode()}}
({{_handle_rpc_error}}). The Rust-backed Python client raises
{{PySparkRuntimeError}}, which is not a {{SparkConnectGrpcException}}, so
{{except SparkConnectGrpcException}} no longer catches these errors, as it did
while that class was an alias. Raise {{SparkConnectGrpcException}} with the
status code as PySpark does.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
