See <https://ci-beam.apache.org/job/beam_PostCommit_Python39/2760/display/redirect?page=changes>
Changes: [noreply] Merge pull request #29916 [YAML] Replace pipeline_spec with ------------------------------------------ [...truncated 12.07 MB...] apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_impersonation_it [gw0] [32mPASSED[0m apache_beam/io/gcp/bigquery_io_read_it_test.py::BigqueryIOReadIT::test_bigquery_read_custom_1M_python apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_batch_copy_and_delete [gw0] [32mPASSED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_batch_copy_and_delete apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy [gw0] [32mPASSED[0m apache_beam/io/gcp/gcsio_integration_test.py::GcsIOIntegrationTest::test_copy apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it [gw1] [32mPASSED[0m apache_beam/dataframe/io_it_test.py::ReadUsingReadGbqTests::test_ReadGbq_with_computation apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_data_only [gw4] [32mPASSED[0m apache_beam/io/gcp/bigquery_write_it_test.py::BigQueryWriteIntegrationTests::test_big_query_write_without_schema apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification [gw0] [31mFAILED[0m apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it apache_beam/examples/complete/autocomplete_test.py::AutocompleteTest::test_autocomplete_it [gw5] [32mPASSED[0m apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts [gw3] [32mPASSED[0m apache_beam/ml/inference/sklearn_inference_it_test.py::SklearnInference::test_sklearn_regression apache_beam/io/gcp/healthcare/dicomio_integration_test.py::DICOMIoIntegrationTest::test_dicom_search_instances [gw6] [32mPASSED[0m apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich [gw7] [32mPASSED[0m apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_impersonation_it apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection [gw4] [32mPASSED[0m apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection [gw0] [32mPASSED[0m apache_beam/examples/complete/autocomplete_test.py::AutocompleteTest::test_autocomplete_it apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it [gw3] [32mPASSED[0m apache_beam/io/gcp/healthcare/dicomio_integration_test.py::DICOMIoIntegrationTest::test_dicom_search_instances apache_beam/io/gcp/healthcare/dicomio_integration_test.py::DICOMIoIntegrationTest::test_dicom_store_instance_from_gcs [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction [gw4] [32mPASSED[0m apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it [gw7] [32mPASSED[0m apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it apache_beam/examples/streaming_wordcount_debugging_it_test.py::StreamingWordcountDebuggingIT::test_streaming_wordcount_debugging_it [gw7] [33mSKIPPED[0m apache_beam/examples/streaming_wordcount_debugging_it_test.py::StreamingWordcountDebuggingIT::test_streaming_wordcount_debugging_it apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays [gw1] [32mPASSED[0m apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_data_only apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_with_attributes [gw3] [32mPASSED[0m apache_beam/io/gcp/healthcare/dicomio_integration_test.py::DICOMIoIntegrationTest::test_dicom_store_instance_from_gcs apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction_rows [gw7] [32mPASSED[0m apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/ml/gcp/naturallanguageml_test_it.py::NaturalLanguageMlTestIT::test_analyzing_syntax [gw7] [33mSKIPPED[0m apache_beam/ml/gcp/naturallanguageml_test_it.py::NaturalLanguageMlTestIT::test_analyzing_syntax apache_beam/ml/gcp/videointelligenceml_test_it.py::VideoIntelligenceMlTestIT::test_label_detection_with_video_context [gw7] [33mSKIPPED[0m apache_beam/ml/gcp/videointelligenceml_test_it.py::VideoIntelligenceMlTestIT::test_label_detection_with_video_context apache_beam/ml/inference/onnx_inference_it_test.py::OnnxInference::test_onnx_run_inference_roberta_sentiment_classification [gw7] [33mSKIPPED[0m apache_beam/ml/inference/onnx_inference_it_test.py::OnnxInference::test_onnx_run_inference_roberta_sentiment_classification apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_it [gw7] [33mSKIPPED[0m apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_it apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it [gw3] [32mPASSED[0m apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/io/parquetio_it_test.py::TestParquetIT::test_parquetio_it [gw5] [32mPASSED[0m apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts apache_beam/io/gcp/bigquery_test.py::BigQueryFileLoadsIntegrationTests::test_avro_file_load [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_column_selection_and_row_restriction_rows apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime [gw0] [32mPASSED[0m apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_user_score_it [gw7] [32mPASSED[0m apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it apache_beam/transforms/periodicsequence_it_test.py::PeriodicSequenceIT::test_periodicsequence_outputs_valid_watermarks_it [gw7] [33mSKIPPED[0m apache_beam/transforms/periodicsequence_it_test.py::PeriodicSequenceIT::test_periodicsequence_outputs_valid_watermarks_it [gw1] [32mPASSED[0m apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_with_attributes apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it [gw4] [32mPASSED[0m apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it apache_beam/examples/inference/tfx_bsl/tfx_bsl_inference_it_test.py::TFXRunInferenceTests::test_tfx_run_inference_mobilenetv2 [gw4] [33mSKIPPED[0m apache_beam/examples/inference/tfx_bsl/tfx_bsl_inference_it_test.py::TFXRunInferenceTests::test_tfx_run_inference_mobilenetv2 apache_beam/io/gcp/datastore/v1new/datastore_write_it_test.py::DatastoreWriteIT::test_datastore_write_limit [gw3] [32mPASSED[0m apache_beam/io/parquetio_it_test.py::TestParquetIT::test_parquetio_it apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming [gw3] [33mSKIPPED[0m apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming [gw6] [32mPASSED[0m apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich apache_beam/examples/fastavro_it_test.py::FastavroIT::test_avro_it [gw5] [32mPASSED[0m apache_beam/io/gcp/bigquery_test.py::BigQueryFileLoadsIntegrationTests::test_avro_file_load apache_beam/examples/complete/juliaset/juliaset/juliaset_test_it.py::JuliaSetTestIT::test_run_example_with_setup_file <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/-1734967050/bin/python3.9>: No module named build warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md warning: check: missing required meta-data: url warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_native_datetime apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters [gw5] [32mPASSED[0m apache_beam/examples/complete/juliaset/juliaset/juliaset_test_it.py::JuliaSetTestIT::test_run_example_with_setup_file [gw0] [32mPASSED[0m apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_user_score_it apache_beam/io/fileio_test.py::MatchIntegrationTest::test_transform_on_gcs [gw1] [32mPASSED[0m apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it apache_beam/ml/gcp/visionml_test_it.py::VisionMlTestIT::test_text_detection_with_language_hint [gw6] [32mPASSED[0m apache_beam/examples/fastavro_it_test.py::FastavroIT::test_avro_it apache_beam/examples/cookbook/datastore_wordcount_it_test.py::DatastoreWordCountIT::test_datastore_wordcount_it [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_query_and_filters apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction [gw0] [32mPASSED[0m apache_beam/io/fileio_test.py::MatchIntegrationTest::test_transform_on_gcs [gw1] [32mPASSED[0m apache_beam/ml/gcp/visionml_test_it.py::VisionMlTestIT::test_text_detection_with_language_hint [gw6] [32mPASSED[0m apache_beam/examples/cookbook/datastore_wordcount_it_test.py::DatastoreWordCountIT::test_datastore_wordcount_it [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_row_restriction apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source [gw4] [32mPASSED[0m apache_beam/io/gcp/datastore/v1new/datastore_write_it_test.py::DatastoreWriteIT::test_datastore_write_limit [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_iobase_source apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries apache_beam/io/gcp/bigquery_read_it_test.py::ReadInteractiveRunnerTests::test_read_in_interactive_runner [gw2] [32mPASSED[0m apache_beam/io/gcp/bigquery_read_it_test.py::ReadInteractiveRunnerTests::test_read_in_interactive_runner =================================== FAILURES =================================== [31m[1m_______________ StreamingWordCountIT.test_streaming_wordcount_it _______________[0m [gw0] linux -- Python 3.9.10 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/-1734967050/bin/python3.9> self = <apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT testMethod=test_streaming_wordcount_it> def setUp(self): self.test_pipeline = TestPipeline(is_integration_test=True) self.project = self.test_pipeline.get_option('project') self.uuid = str(uuid.uuid4()) # Set up PubSub environment. from google.cloud import pubsub self.pub_client = pubsub.PublisherClient() self.input_topic = self.pub_client.create_topic( name=self.pub_client.topic_path(self.project, INPUT_TOPIC + self.uuid)) self.output_topic = self.pub_client.create_topic( name=self.pub_client.topic_path(self.project, OUTPUT_TOPIC + self.uuid)) self.sub_client = pubsub.SubscriberClient() > self.input_sub = self.sub_client.create_subscription( name=self.sub_client.subscription_path( self.project, INPUT_SUB + self.uuid), topic=self.input_topic.name) [1m[31mapache_beam/examples/streaming_wordcount_it_test.py[0m:60: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/pubsub_v1/services/subscriber/client.py[0m:680: in create_subscription response = rpc( [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/gapic_v1/method.py[0m:131: in __call__ return wrapped_func(*args, **kwargs) [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry/retry_unary.py[0m:293: in retry_wrapped_func return retry_target( [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry/retry_unary.py[0m:153: in retry_target _retry_error_helper( [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry/retry_base.py[0m:212: in _retry_error_helper raise final_exc from source_exc [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry/retry_unary.py[0m:144: in retry_target result = target() [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/timeout.py[0m:120: in func_with_timeout return func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = (name: "projects/apache-beam-testing/subscriptions/wc_subscription_inputffcc53f8-6777-4e5c-b7c6-51a9d00c5688" topic: "projects/apache-beam-testing/topics/wc_topic_inputffcc53f8-6777-4e5c-b7c6-51a9d00c5688" ,) kwargs = {'metadata': [('x-goog-request-params', 'name=projects/apache-beam-testing/subscriptions/wc_subscription_inputffcc53f8...b7c6-51a9d00c5688'), ('x-goog-api-client', 'gl-python/3.9.10 grpc/1.60.0 gax/2.16.0rc0 gccl/2.19.0')], 'timeout': 60.0} @functools.wraps(callable_) def error_remapped_callable(*args, **kwargs): try: return callable_(*args, **kwargs) except grpc.RpcError as exc: > raise exceptions.from_grpc_error(exc) from exc [1m[31mE google.api_core.exceptions.DeadlineExceeded: 504 Deadline Exceeded[0m [1m[31m../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py[0m:81: DeadlineExceeded [33m=============================== warnings summary ===============================[0m apache_beam/io/gcp/bigquery.py:2603 <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2603: DeprecationWarning: invalid escape sequence \# """Read data from BigQuery. apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:706: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/pytest_postCommitIT-df-py39.xml> - [36m[1m=========================== short test summary info ============================[0m [31mFAILED[0m apache_beam/examples/streaming_wordcount_it_test.py::[1mStreamingWordCountIT::test_streaming_wordcount_it[0m - google.api_core.exceptions.DeadlineExceeded: 504 Deadline Exceeded [31m====== [31m[1m1 failed[0m, [32m82 passed[0m, [33m49 skipped[0m, [33m9 warnings[0m[31m in 5876.64s (1:37:56)[0m[31m =======[0m > Task :sdks:python:test-suites:dataflow:py39:postCommitIT FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 52 * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:py39:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 139 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. ============================================================================== Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 1h 44m 35s 222 actionable tasks: 157 executed, 61 from cache, 4 up-to-date Publishing build scan... https://ge.apache.org/s/nerzw2univuzy Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
