Eric Marnadi created SPARK-55104:
------------------------------------
Summary: Add Spark Connect support for DataStreamReader.name()
Key: SPARK-55104
URL: https://issues.apache.org/jira/browse/SPARK-55104
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Eric Marnadi
Add Spark Connect support for the {{DataStreamReader.name()}} method, which
allows users to specify a name for streaming sources. The implementation
includes:
# {*}Protobuf changes{*}: Added {{source_name}} field to the {{DataSource}}
message
# {*}Scala Connect{*}: Added {{name()}} method with validation to Connect
{{DataStreamReader}}
# {*}Python Connect{*}: Added {{name()}} method to Python Connect
{{DataStreamReader}}
# {*}Server-side planner{*}: Updated {{SparkConnectPlanner}} to extract and
pass source names
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
