See <https://ci-beam.apache.org/job/beam_PostCommit_Python38/2979/display/redirect>
Changes: ------------------------------------------ [...truncated 818.80 KB...] [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:41:57.379Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+m_out [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:41:57.436Z: JOB_MESSAGE_DEBUG: Executing success step success17 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:41:57.503Z: JOB_MESSAGE_DETAILED: Cleaning up. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:41:57.548Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:41:57.581Z: JOB_MESSAGE_BASIC: Stopping worker pool... [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:42:30.712Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:42:30.751Z: JOB_MESSAGE_BASIC: Worker pool stopped. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-08T03:42:30.786Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:197 Job 2022-08-07_20_35_08-11422647325157376628 is in state JOB_STATE_DONE [33m=============================== warnings summary ===============================[0m ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings apache_beam/io/gcp/bigquery_test.py: 6 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2288: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported is_streaming_pipeline = p.options.view_as(StandardOptions).streaming apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings apache_beam/io/gcp/bigquery_test.py: 6 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2294: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_test.py: 3 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = p.options.view_as(GoogleCloudOptions).temp_location apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_test.py: 3 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME') apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2778: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2780: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2804: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported pipeline_options=pcoll.pipeline.options, apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings apache_beam/io/gcp/big_query_query_to_table_it_test.py: 6 warnings apache_beam/io/gcp/bigquery_test.py: 2 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2284: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.table_reference.projectId = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental. return pcoll | fileio.WriteToFiles( apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/fileio.py>:581: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).temp_location or apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction. return airline_df[at_top_airports].mean() apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2822: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2843: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported pipeline_options=pcoll.pipeline.options, apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:171: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1846: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported streaming = self.test_pipeline.options.view_as(StandardOptions).streaming apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_deidentification <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:74: FutureWarning: MaskDetectedDetails is experimental. | MaskDetectedDetails( apache_beam/io/gcp/big_query_query_to_table_it_test.py::BigQueryQueryToTableIT::test_big_query_new_types_native apache_beam/io/gcp/big_query_query_to_table_it_test.py::BigQueryQueryToTableIT::test_big_query_standard_sql_kms_key_native <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:81: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource( apache_beam/io/gcp/big_query_query_to_table_it_test.py::BigQueryQueryToTableIT::test_big_query_new_types_native apache_beam/io/gcp/big_query_query_to_table_it_test.py::BigQueryQueryToTableIT::test_big_query_standard_sql_kms_key_native <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/runners/dataflow/ptransform_overrides.py>:316: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. io.BigQuerySink( apache_beam/ml/gcp/cloud_dlp_it_test.py::CloudDLPIT::test_inspection <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/ml/gcp/cloud_dlp_it_test.py>:85: FutureWarning: InspectForDetails is experimental. | InspectForDetails( apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:646: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead. beam.io.BigQuerySource(query=self.query, use_standard_sql=True))) apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:761: FutureWarning: ReadAllFromBigQuery is experimental. | beam.io.ReadAllFromBigQuery()) apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2953: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2954: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2967: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options=pcoll.pipeline.options, -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/pytest_postCommitIT-df-py38.xml> - =========================== short test summary info ============================ FAILED apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_it [31m===== [31m[1m1 failed[0m, [32m82 passed[0m, [33m11 skipped[0m, [33m224 warnings[0m[31m in 9019.59s (2:30:19)[0m[31m ======[0m > Task :sdks:python:test-suites:dataflow:py38:postCommitIT FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:container:pullLicenses'. > Process 'command './license_scripts/license_script.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python38/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 121 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 2h 31m 53s 216 actionable tasks: 146 executed, 64 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/d63hoon6tevxc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
