[
https://issues.apache.org/jira/browse/SPARK-19414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847602#comment-15847602
]
sam elamin commented on SPARK-19414:
------------------------------------
[~zsxwing] most probably yes. ah ok i think i understand what you might mean
in the source schema provider I can call bq to get the schema and override it
at that layer?
> Inferring schema in a structured streaming source
> -------------------------------------------------
>
> Key: SPARK-19414
> URL: https://issues.apache.org/jira/browse/SPARK-19414
> Project: Spark
> Issue Type: Question
> Components: Structured Streaming
> Reporter: sam elamin
>
> Hi All
> I am writing a connector to BigQuery that uses structured streaming, my
> question is about schemas
> I would like to be able to infer the schema from BQ rather than pass it in,
> is there any way to overwrite the source schema in anything that extends
> org.apache.spark.sql.execution.streaming.Source
> Overriding the schema method doesnt seem to work
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
