[
https://issues.apache.org/jira/browse/BEAM-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke Cwik resolved BEAM-5782.
-----------------------------
Resolution: Fixed
Fix Version/s: 2.9.0
> BigQuery TableRows not cloneable when using Dataflow
> ----------------------------------------------------
>
> Key: BEAM-5782
> URL: https://issues.apache.org/jira/browse/BEAM-5782
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Reporter: Luke Cwik
> Assignee: Luke Cwik
> Priority: Minor
> Fix For: 2.9.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> TableRows are expected to be cloneable.
> BigQueryAvroUtils converts repeated records using an ImmutableList which is
> not cloneable.
>
> Reproduction steps:
> 1. Clone the code
> [https://github.com/nahuellofeudo/row-clone-poc.git|https://www.google.com/url?q=https://github.com/nahuellofeudo/row-clone-poc.git&sa=D&usg=AFQjCNGkT0bYzhAoozGTQ4vsizxtphxj-g]
> 2. Run on Dataflow:
> mvn clean compile exec:java
> -Dexec.mainClass=org.apache.beam.examples.RowClonePoc \
> -Dexec.args="--runner=DataflowRunner
> --gcpTempLocation=gs://<GCS_TEMP_FOLDER> \
> --tempLocation=gs://<GCS_TEMP_FOLDER> --project=<PROJECT_ID>"
> -Pdataflow-runner
> 3. Run locally:
> mvn clean compile exec:java
> -Dexec.mainClass=org.apache.beam.examples.RowClonePoc \
> -Dexec.args="--tempLocation=gs://<GCS_TEMP_FOLDER>
> --project=<PROJECT_ID>"
> 4. Job execution on step 2 will fail [1].
> 5. Job execution on step 3 will success [2].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
