Jon LaFlamme created SPARK-36212:
------------------------------------
Summary: Add exception for Kafka readstream when decryption fails
Key: SPARK-36212
URL: https://issues.apache.org/jira/browse/SPARK-36212
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 3.0.0
Environment: Spark 3.0.0
Reporter: Jon LaFlamme
Fix For: 3.1.0
A silent failure is possible when reading from a Kafka broker under the
following circumstances:
SDF.isStreaming = True
SDF.printSchema() => returns expected schema
Query results are empty.
Issue: Tsl Decryption has failed, but there is no exception or warning.
Request: Add a warning throw an exception when decryption fails, such that
developers can efficiently diagnose the readstream problem.
This is my first ticket submitted. Please notify me if I should change anything
in this ticket to make it more conformant to community standards. I'm still a
beginner with Spark.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]