Huanli Wang created SPARK-40466:
-----------------------------------
Summary: Improve the error message if the DSv2 source is disabled
but DSv1 streaming source is not available
Key: SPARK-40466
URL: https://issues.apache.org/jira/browse/SPARK-40466
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.4.0
Reporter: Huanli Wang
Fix For: 3.4.0
If the V2 data source is disabled, current behavior will fallback to use V1
data source. But it will throw error when the DSv1 is not available. Update the
error message to indicate what config variable
(spark.sql.streaming.disabledV2MicroBatchReaders) needs to be modified in order
to enable the V2 data source.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
