[
https://issues.apache.org/jira/browse/BEAM-13161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kenneth Knowles updated BEAM-13161:
-----------------------------------
This Jira ticket has a pull request attached to it, but is still open. Did the
pull request resolve the issue? If so, could you please mark it resolved? This
will help the project have a clear view of its open issues.
> BatchLoads setting wrong sideinput
> -----------------------------------
>
> Key: BEAM-13161
> URL: https://issues.apache.org/jira/browse/BEAM-13161
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Reporter: Hector Lagos
> Priority: P2
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> BigQueryIO failing to load data for multi partitions. Bug introduced in
> [https://github.com/apache/beam/commit/69822e417fe4b582a73c45c5780f4ff69841d5db#diff-8ec245029a6375b2ab19e1aff5e4ed4ee33a4a2e46a9caffb3452cbc8af8fee3.
>
> |https://github.com/apache/beam/commit/69822e417fe4b582a73c45c5780f4ff69841d5db#diff-8ec245029a6375b2ab19e1aff5e4ed4ee33a4a2e46a9caffb3452cbc8af8fee3,]missing
> setting correct sideinput (withSideInputs(copyJobIdPrefixView)).
>
> Getting this error in DF job
> {code}
> Error message from worker: java.lang.IllegalArgumentException: calling
> sideInput() with unknown view
> org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.sideInput(SimpleDoFnRunner.java:265)
>
> org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner.access$1200(SimpleDoFnRunner.java:84)
>
> org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.sideInput(SimpleDoFnRunner.java:395)
>
> org.apache.beam.sdk.io.gcp.bigquery.WriteRename.startWriteRename(WriteRename.java:207)
>
> org.apache.beam.sdk.io.gcp.bigquery.WriteRename.processElement(WriteRename.java:139)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
