[
https://issues.apache.org/jira/browse/SPARK-61234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-61234:
---------------------------------
Fix Version/s: connect-rust-4.3.0
> Apply the gRPC keepalive of the connection string to the channel, as PySpark
> does, and redact the token in the Debug of ChannelBuilder
> --------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-61234
> URL: https://issues.apache.org/jira/browse/SPARK-61234
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
> Fix For: connect-rust-4.3.0
>
>
> The Rust client parses grpc_keepalive_enabled, grpc_keepalive_time_ms,
> grpc_keepalive_timeout_ms and grpc_keepalive_without_calls
> (ChannelBuilder::keepalive_*) but never applies them: its tonic channel has
> only a connect timeout. PySpark 4.3.0 (SPARK-58094) applies them by default
> (a PING after 60 s, 20 s for its acknowledgement, also without calls in
> flight), so a connection that a NAT gateway or load balancer drops silently
> fails with UNAVAILABLE and is retried or reattached; the Rust client waits on
> it forever.
> Also, the derived Debug of the public ChannelBuilder prints the token of the
> connection string (params: {"token": "..."}).
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
