[
https://issues.apache.org/jira/browse/BEAM-13391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kenneth Knowles updated BEAM-13391:
-----------------------------------
Fix Version/s: 2.37.0
Resolution: Fixed
Status: Resolved (was: Open)
> The Apache Avro library failed to parse the header with the following error:
> EOF reached
> ----------------------------------------------------------------------------------------
>
> Key: BEAM-13391
> URL: https://issues.apache.org/jira/browse/BEAM-13391
> Project: Beam
> Issue Type: Bug
> Components: io-py-gcp
> Affects Versions: 2.34.0
> Reporter: Sayat Satybaldiyev
> Assignee: Sayat Satybaldiyev
> Priority: P2
> Fix For: 2.37.0
>
> Original Estimate: 48h
> Time Spent: 5h 10m
> Remaining Estimate: 42h 50m
>
> When WriteToBigQuery is done with AVRO file loads, and the load is triggering
> a schema [modification
> job|https://github.com/apache/beam/blob/ad56edbf1fa2e6c19fea23555ecfad015f67174d/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py#L323-L340],
> then following error is triggered:
> {code:java}
> E RuntimeError: BigQuery job
> beam_bq_job_LOAD_AUTOMATIC_JOB_NAME_SCHEMA_MOD_STEP_171_736013176f6ea340cfd22b9f5b575c81_643a0ee608c04300bfbe67c8db85b2b0
> failed. Error Result: <ErrorProto
> E message: 'Error while reading data, error message: The Apache Avro
> library failed to parse the header with the following error: EOF reached'
> E reason: 'invalid'> [while running
> 'WriteToBigQuery/BigQueryBatchFileLoads/WaitForSchemaModJobs']
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
