[
https://issues.apache.org/jira/browse/BEAM-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958138#comment-16958138
]
Kenneth Knowles commented on BEAM-8393:
---------------------------------------
Was discussed at
https://lists.apache.org/thread.html/7a1d91a7a0c388d28df024bd03846ca936395278d1079166bb28f170@%3Cdev.beam.apache.org%3E
but never put onto the website. I think I'll open that PR today...
> Java BigQueryIO clustering support breaks on multiple partitions
> ----------------------------------------------------------------
>
> Key: BEAM-8393
> URL: https://issues.apache.org/jira/browse/BEAM-8393
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.15.0, 2.16.0
> Reporter: Jeff Klukas
> Assignee: Jeff Klukas
> Priority: Critical
> Fix For: 2.17.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Support for writing to clustered tables in BigQuery was added in 2.15, which
> involved adding a new optional clustering field to TableDestination.
> Clustering support is working for most cases, but fails with errors about
> incompatible partitioning specifications for any data that is handled by the
> MultiplePartitions branch of BigQueryIO logic.
> There is a case in that code path where we provide a modified
> TableDestination and neglect to copy the clustering definition, so the final
> load job does not include any clustering columns.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
