sam elamin created SPARK-19414:
----------------------------------
Summary: Inferring schema in a structured streaming source
Key: SPARK-19414
URL: https://issues.apache.org/jira/browse/SPARK-19414
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Reporter: sam elamin
Hi All
I am writing a connector to BigQuery that uses structured streaming, my
question is about schemas
I would like to be able to infer the schema from BQ rather than pass it in, is
there any way to overwrite the source schema in anything that extends
org.apache.spark.sql.execution.streaming.Source
Overriding the schema method doesnt seem to work
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
