mxtymoshyk commented on issue #27040: URL: https://github.com/apache/beam/issues/27040#issuecomment-6398122249
I couldn't reproduce this on current master, either in CI or locally. ### CI history I checked every `beam_PreCommit_Java_GCP_IO_Direct` run from **2026-07-27 to 2026-10-25**. That goes back about as far as GitHub keeps logs. | Window | Successful runs | Failed runs | Failed-run logs searched | Failures of these tests | |---|---|---|---|---| | 2026-09-16 to 2026-10-25 | 395 | 124 | 124 | **0** | | 2026-07-27 to 2026-09-15 | 362 | 67 | 67 | **0** | | **Total** | **757** | **191** | **191** | **0** | Neither `testWriteFileSchemaUpdateOptionAllowFieldAddition` nor `testWriteFileSchemaUpdateOptionAllowFieldRelaxation` failed in any of these runs. The failed runs broke on integration tests and compile errors, plus a few other `BigQueryIOWriteTest` cases. ### Local runs I ran the full `BigQueryIOWriteTest` class **5 times** on `a16836191dd`: ``` ./gradlew :sdks:java:io:google-cloud-platform:test --tests 'org.apache.beam.sdk.io.gcp.bigquery.BigQueryIOWriteTest' --rerun ``` There were **no failures in any run**, and both of these tests passed in the batch and streaming variants every time. ### Suggestion I'd **close this as not reproducible**. It can be reopened if it comes back. <details> <summary>Likely cause and a defensive fix, if it does come back</summary> `schemaUpdateOptionsTest` calls this on every job returned by `fakeJobService.getAllJobs()`, with no null check: ```java JobConfigurationLoad configuration = job.getConfiguration().getLoad(); assertEquals(expectedOptions, configuration.getSchemaUpdateOptions()); ``` `FakeJobService.allJobs` is **static**. A non-load job in that list, such as a copy job, would make `getLoad()` return `null` and throw the NPE from the original report. The fix would be to: - skip jobs where `getLoad()` is `null` - only assert on jobs whose destination is `project-id:dataset-id.table-id` I haven't opened a PR for this because nothing shows the test failing now. </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
