See <https://ci-beam.apache.org/job/beam_PostCommit_Python39/461/display/redirect?page=changes>
Changes: [vachan] Fix for increased FAILED_PRECONDITION errors in BQ Read API. [vachan] Adding comments. [noreply] Bump google.golang.org/api from 0.81.0 to 0.83.0 in /sdks (#21743) ------------------------------------------ [...truncated 36.27 MB...] apache_beam/io/gcp/bigquery.py:2522 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2522: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 apache_beam/io/gcp/bigquery.py:2524 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2524: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 apache_beam/io/gcp/bigquery.py:2548 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2548: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported pipeline_options=pcoll.pipeline.options, apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 apache_beam/io/gcp/bigquery.py:2197 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2197: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.table_reference.projectId = pcoll.pipeline.options.view_as( apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 apache_beam/io/gcp/bigquery_file_loads.py:1128 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1128: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = p.options.view_as(GoogleCloudOptions).temp_location apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 apache_beam/io/gcp/bigquery_file_loads.py:1130 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1130: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME') apache_beam/io/gcp/tests/utils.py:100 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/dataframe/io.py:629 apache_beam/dataframe/io.py:629 apache_beam/dataframe/io.py:629 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental. return pcoll | fileio.WriteToFiles( apache_beam/io/fileio.py:554 apache_beam/io/fileio.py:554 apache_beam/io/fileio.py:554 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).temp_location or apache_beam/examples/dataframe/flight_delays.py:47 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction. return airline_df[at_top_airports].mean() apache_beam/io/gcp/bigquery_test.py:1644 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1644: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported streaming = self.test_pipeline.options.view_as(StandardOptions).streaming apache_beam/io/gcp/bigquery_read_it_test.py:169 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:169: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 apache_beam/io/gcp/bigquery.py:2566 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2566: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 apache_beam/io/gcp/bigquery.py:2587 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2587: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported pipeline_options=pcoll.pipeline.options, apache_beam/io/gcp/big_query_query_to_table_pipeline.py:81 apache_beam/io/gcp/big_query_query_to_table_pipeline.py:81 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:81: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource( apache_beam/runners/dataflow/ptransform_overrides.py:316 apache_beam/runners/dataflow/ptransform_overrides.py:316 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/dataflow/ptransform_overrides.py>:316: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. io.BigQuerySink( apache_beam/ml/gcp/cloud_dlp_it_test.py:74 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:74: FutureWarning: MaskDetectedDetails is experimental. | MaskDetectedDetails( apache_beam/ml/gcp/cloud_dlp_it_test.py:85 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:85: FutureWarning: InspectForDetails is experimental. | InspectForDetails( apache_beam/io/gcp/bigquery_read_it_test.py:566 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:566: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) apache_beam/io/gcp/bigquery_read_it_test.py:680 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:680: FutureWarning: ReadAllFromBigQuery is experimental. | beam.io.ReadAllFromBigQuery()) apache_beam/io/gcp/bigquery.py:2696 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2696: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/io/gcp/bigquery.py:2697 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2697: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project apache_beam/io/gcp/bigquery.py:2710 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2710: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options=pcoll.pipeline.options, -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/pytest_postCommitIT-df-py39.xml> - [31m[1m======= 1 failed, 76 passed, 8 skipped, 207 warnings in 6751.47 seconds ========[0m > Task :sdks:python:test-suites:dataflow:py39:postCommitIT FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 314 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py39:postCommitPy39IT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 121 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1h 56m 39s 221 actionable tasks: 161 executed, 54 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/jwbwbieuv63ps Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
