[jira] [Commented] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-02 Thread Brian Hulette (Jira)


[ 
https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124055#comment-17124055
 ] 

Brian Hulette commented on BEAM-8560:
-

Went ahead and unassigned myself since I don't have time for this. Downgrading 
to P3 as well

> Construction time schema Validation for writing to BQ
> -
>
> Key: BEAM-8560
> URL: https://issues.apache.org/jira/browse/BEAM-8560
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Brian Hulette
>Priority: P2
>
> `BigQueryIO.write` should be able to validate the schema of the input 
> PCollection against the schema for this table (either retrieved from 
> DataCatalog, or from BQ metadata). Then we can fail at pipeline construction 
> time rather than waiting until execution.
> At the very least this should work when writing Beam Rows.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (BEAM-8560) Construction time schema Validation for writing to BQ

2020-06-01 Thread Kenneth Knowles (Jira)


[ 
https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121823#comment-17121823
 ] 

Kenneth Knowles commented on BEAM-8560:
---

This issue is assigned but has not received an update in 30 days so it has been 
labeled "stale-assigned". If you are still working on the issue, please give an 
update and remove the label. If you are no longer working on the issue, please 
unassign so someone else may work on it. In 7 days the issue will be 
automatically unassigned.

> Construction time schema Validation for writing to BQ
> -
>
> Key: BEAM-8560
> URL: https://issues.apache.org/jira/browse/BEAM-8560
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Brian Hulette
>Assignee: Brian Hulette
>Priority: P2
>  Labels: stale-assigned
>
> `BigQueryIO.write` should be able to validate the schema of the input 
> PCollection against the schema for this table in Data Catalog. Then we can 
> fail at pipeline construction time rather than waiting until execution.
> At the very least this should work when writing Beam Rows.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)