This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 3d501ee9dc2 Update releases 2.33.0 and 2.34.0 to include broken BQ
copy jobs in batch as a known issue (#27563)
3d501ee9dc2 is described below
commit 3d501ee9dc208af2efef009daa98c49819b73ddc
Author: Ahmed Abualsaud <[email protected]>
AuthorDate: Thu Jul 20 14:45:34 2023 +0000
Update releases 2.33.0 and 2.34.0 to include broken BQ copy jobs in batch
as a known issue (#27563)
* update release docs
* add error description and workaround
* update
* add java
* fix whitespace
---
website/www/site/content/en/blog/beam-2.33.0.md | 3 +++
website/www/site/content/en/blog/beam-2.34.0.md | 6 ++++++
2 files changed, 9 insertions(+)
diff --git a/website/www/site/content/en/blog/beam-2.33.0.md
b/website/www/site/content/en/blog/beam-2.33.0.md
index 8e7237591d1..d2afd7a79bc 100644
--- a/website/www/site/content/en/blog/beam-2.33.0.md
+++ b/website/www/site/content/en/blog/beam-2.33.0.md
@@ -79,6 +79,9 @@
notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527
* Spark 2.x users will need to update Spark's Jackson runtime dependencies
(`spark.jackson.version`) to at least version 2.9.2, due to Beam updating its
dependencies.
* See a full list of open [issues that
affect](https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20affectedVersion%20%3D%202.33.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC)
this version.
* Go SDK jobs may produce "Failed to deduce Step from MonitoringInfo" messages
following successful job execution. The messages are benign and don't indicate
job failure. These are due to not yet handling PCollection metrics.
+* Large Java BigQueryIO writes with the FILE_LOADS method will fail in batch
mode (specifically, when copy jobs are used).
+ This results in the error message: `IllegalArgumentException: Attempting to
access unknown side input`.
+ Please upgrade to a newer version (> 2.34.0) or use another write method
(e.g. `STORAGE_WRITE_API`).
## List of Contributors
diff --git a/website/www/site/content/en/blog/beam-2.34.0.md
b/website/www/site/content/en/blog/beam-2.34.0.md
index 2f335a86fd8..288496aaa80 100644
--- a/website/www/site/content/en/blog/beam-2.34.0.md
+++ b/website/www/site/content/en/blog/beam-2.34.0.md
@@ -61,6 +61,12 @@
notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527
* Fixed error when importing the DataFrame API with pandas 1.0.x installed
([BEAM-12945](https://issues.apache.org/jira/browse/BEAM-12945)).
* Fixed top.SmallestPerKey implementation in the Go SDK
([BEAM-12946](https://issues.apache.org/jira/browse/BEAM-12946)).
+### Known Issues
+
+* Large Java BigQueryIO writes with the FILE_LOADS method will fail in batch
mode (specifically, when copy jobs are used).
+ This results in the error message: `IllegalArgumentException: Attempting to
access unknown side input`.
+ Please upgrade to a newer version (> 2.34.0) or use another write method
(e.g. `STORAGE_WRITE_API`).
+
## List of Contributors
According to git shortlog, the following people contributed to the 2.34.0
release. Thank you to all contributors!
