dybyte opened a new pull request, #11577:
URL: https://github.com/apache/seatunnel/pull/11577
## Purpose of this pull request
Add opt-in `ADD COLUMN` schema evolution support to the BigQuery sink. The
sink applies idempotent DDL, validates column compatibility, and refreshes the
writer schema after changes.
## Does this PR introduce any user-facing change?
Yes. It adds:
- `schema_evolution_enabled`, default `false`
- `schema_evolution_relax_not_null`, default `false`
Nullable arrays are rejected because BigQuery `REPEATED` fields cannot
preserve nullable-array semantics.
## How was this patch tested?
- Added tests for nullable, repeated, and multi-column `ADD COLUMN` events
- Covered idempotent application and existing-column type/mode conflicts
- Covered rejection and optional relaxation of non-null columns
- Covered unsupported schema changes and data types
- Verified writer schema refresh and sequence-column index updates
- Verified that schema evolution is opt-in and exposes only `ADD COLUMN`
### Check list
* [ ] If any new Jar binary package adding in your PR, please add License
Notice according
[New License
Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/developer/new-license.md)
* [x] If necessary, please update the documentation to describe the new
feature. https://github.com/apache/seatunnel/tree/dev/docs
* [ ] If necessary, please update `incompatible-changes.md` to describe the
incompatibility caused by this PR.
* [ ] If you are contributing the connector code, please check that the
following files are updated:
1. Update
[plugin-mapping.properties](https://github.com/apache/seatunnel/blob/dev/plugin-mapping.properties)
and add new connector information in it
2. Update the pom file of
[seatunnel-dist](https://github.com/apache/seatunnel/blob/dev/seatunnel-dist/pom.xml)
3. Add ci label in
[label-scope-conf](https://github.com/apache/seatunnel/blob/dev/.github/workflows/labeler/label-scope-conf.yml)
4. Add e2e testcase in
[seatunnel-e2e](https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/)
5. Update connector
[plugin_config](https://github.com/apache/seatunnel/blob/dev/config/plugin_config)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
