GitHub user reuvenlax opened a pull request:
[BEAM-2023] Support dynamic schemas
The final step in this series of changes to BigQueryIO.
Now that we support dynamic, value-dependent tables, also add support for
per-table schemas. These can be set via a user-defined function mapping table
to schema. This function can access side inputs, so it's also possible to set
the per-table schemas using a map-valued PCollectionView.
This PR also removes direct references to BigQueryIO.Write from the public
PTransforms, as those transforms are meant to be usable without having an
instance of BigQueryIO.Write
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/reuvenlax/incubator-beam per_table_schemas
Alternatively you can review and apply these changes as the patch at:
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2609
Author: Reuven Lax <re...@google.com>
Support dynamic schemas and remove Write reference from nexted classes.
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket