[
https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brian Hulette updated BEAM-8560:
--------------------------------
Description:
`BigQueryIO.write` should be able to validate the schema of the input
PCollection against the schema for this table (either retrieved from
DataCatalog, or from BQ metadata). Then we can fail at pipeline construction
time rather than waiting until execution.
At the very least this should work when writing Beam Rows.
was:
`BigQueryIO.write` should be able to validate the schema of the input
PCollection against the schema for this table in Data Catalog. Then we can fail
at pipeline construction time rather than waiting until execution.
At the very least this should work when writing Beam Rows.
> Construction time schema Validation for writing to BQ
> -----------------------------------------------------
>
> Key: BEAM-8560
> URL: https://issues.apache.org/jira/browse/BEAM-8560
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Labels: stale-assigned
>
> `BigQueryIO.write` should be able to validate the schema of the input
> PCollection against the schema for this table (either retrieved from
> DataCatalog, or from BQ metadata). Then we can fail at pipeline construction
> time rather than waiting until execution.
> At the very least this should work when writing Beam Rows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
