See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/2495/display/redirect>
Changes: ------------------------------------------ [...truncated 757.77 KB...] INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function populate_data_channel_coders at 0x7f74a388cb80> ==================== INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f74d324ea60> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'') INFO apache_beam.io.fileio:fileio.py:706 Moving temporary files <map object at 0x7f74d0dbec10> to dir: gs://temp-storage-for-end-to-end-tests/temp-it as ['b30ae7ee-ddc8-4ce6-9858-a599b761e36f.result-00000-of-00001'] INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.04057168960571289 seconds. PASSED [100%] =============================== warnings summary =============================== apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning. return airline_df[at_top_airports].mean() -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py38.xml> - === 23 passed, 19 skipped, 7182 deselected, 49 warnings in 794.48s (0:13:14) === > Task :sdks:python:test-suites:direct:py310:examples INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03913307189941406 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.040686607360839844 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 3 files in 0.036424875259399414 seconds. PASSED [ 95%] apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics -------------------------------- live log call --------------------------------- INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_139652682078224], ComputedExpression[set_index_DataFrame_139652690529200], ComputedExpression[pre_combine_sum_DataFrame_139652688416336]]:139652688421856]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139653554870336]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_139652682078224], ComputedExpression[set_index_DataFrame_139652690529200], ComputedExpression[pre_combine_sum_DataFrame_139652688416336]], outputs={PlaceholderExpression[placeholder_DataFrame_139653554870336], ComputedExpression[pre_combine_sum_DataFrame_139652688416336]}] INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_139652688415856]]:139652689676944]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_139652688416336]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_139652688415856]], outputs={ComputedExpression[post_combine_sum_DataFrame_139652688415856]}] INFO apache_beam.io.fileio:fileio.py:610 Added temporary directory gs://temp-storage-for-end-to-end-tests/temp-it/.tempebd0db4c-10e3-46e3-9ba7-565fa127616b WARNING apache_beam.options.pipeline_options:pipeline_options.py:367 Discarding unparseable args: ['--sleep_secs=20', '--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test'] INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function annotate_downstream_side_inputs at 0x7f039fe72b90> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function fix_side_input_pcoll_coders at 0x7f039fe72cb0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f039fe731c0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f039fe73250> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_sdf at 0x7f039fe73400> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_gbk at 0x7f039fe73490> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sink_flattens at 0x7f039fe735b0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function greedily_fuse at 0x7f039fe73640> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function read_to_impulse at 0x7f039fe736d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function impulse_to_input at 0x7f039fe73760> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f039fe739a0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function add_impulse_to_dangling_transforms at 0x7f039fe73ac0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function setup_timer_mapping at 0x7f039fe73910> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function populate_data_channel_coders at 0x7f039fe73a30> ==================== INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f036cfc5450> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'') > Task :sdks:python:test-suites:direct:py39:examples INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function annotate_downstream_side_inputs at 0x7feca1133280> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function fix_side_input_pcoll_coders at 0x7feca11333a0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feca11338b0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feca1133940> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_sdf at 0x7feca1133af0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_gbk at 0x7feca1133b80> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sink_flattens at 0x7feca1133ca0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function greedily_fuse at 0x7feca1133d30> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function read_to_impulse at 0x7feca1133dc0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function impulse_to_input at 0x7feca1133e50> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feca11350d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function add_impulse_to_dangling_transforms at 0x7feca11351f0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function setup_timer_mapping at 0x7feca1135040> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function populate_data_channel_coders at 0x7feca1135160> ==================== INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7fec962f8ca0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'') INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03736686706542969 seconds. INFO apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1 INFO apache_beam.io.filebasedsink:filebasedsink.py:357 Renamed 1 shards in 0.33 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03708648681640625 seconds. INFO apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1 INFO apache_beam.io.filebasedsink:filebasedsink.py:357 Renamed 1 shards in 0.38 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03694915771484375 seconds. INFO apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1 INFO apache_beam.io.filebasedsink:filebasedsink.py:357 Renamed 1 shards in 0.34 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03566122055053711 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.035598039627075195 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.041695594787597656 seconds. PASSED [ 91%] apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays -------------------------------- live log call --------------------------------- INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[move_grouped_columns_to_index_DataFrame_140653355460496]]:140653274487920]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140654109130224]}, partitioning=Arbitrary, ops=[ComputedExpression[move_grouped_columns_to_index_DataFrame_140653355460496]], outputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_140653355460496], PlaceholderExpression[placeholder_DataFrame_140654109130224]}] INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[apply_DataFrame_140653273983392]]:140653274486192]> for Stage[inputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_140653355460496]}, partitioning=Index['airline'], ops=[ComputedExpression[apply_DataFrame_140653273983392]], outputs={ComputedExpression[apply_DataFrame_140653273983392]}] INFO apache_beam.io.fileio:fileio.py:610 Added temporary directory gs://temp-storage-for-end-to-end-tests/temp-it/.temp846c80ae-c36a-4656-bdea-bba1889a811a WARNING apache_beam.options.pipeline_options:pipeline_options.py:367 Discarding unparseable args: ['--sleep_secs=20', '--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test'] INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function annotate_downstream_side_inputs at 0x7feca1133280> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function fix_side_input_pcoll_coders at 0x7feca11333a0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feca11338b0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feca1133940> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_sdf at 0x7feca1133af0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_gbk at 0x7feca1133b80> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sink_flattens at 0x7feca1133ca0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function greedily_fuse at 0x7feca1133d30> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function read_to_impulse at 0x7feca1133dc0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function impulse_to_input at 0x7feca1133e50> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feca11350d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function add_impulse_to_dangling_transforms at 0x7feca11351f0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function setup_timer_mapping at 0x7feca1135040> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function populate_data_channel_coders at 0x7feca1135160> ==================== INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7fec6973e820> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'') INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:575 Started BigQuery job: <JobReference location: 'US' projectId: 'apache-beam-testing'> bq show -j --format=prettyjson --project_id=apache-beam-testing None INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:459 Using location 'US' from table <TableReference datasetId: 'airline_ontime_data' projectId: 'apache-beam-testing' tableId: 'flights'> referenced by query SELECT FlightDate AS date, IATA_CODE_Reporting_Airline AS airline, Origin AS departure_airport, Dest AS arrival_airport, DepDelay AS departure_delay, ArrDelay AS arrival_delay FROM `apache-beam-testing.airline_ontime_data.flights` WHERE FlightDate >= '2012-12-23' AND FlightDate <= '2012-12-25' AND DepDelay IS NOT NULL AND ArrDelay IS NOT NULL INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:812 Dataset apache-beam-testing:beam_temp_dataset_9e76f154b1ed4e7b94cd448ec4743bd0 does not exist so we will create it as temporary with location=US INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:575 Started BigQuery job: <JobReference jobId: 'beam_bq_job_QUERY_BQ_EXPORT_JOB_2cc8513b-6_1698216135_271' location: 'US' projectId: 'apache-beam-testing'> bq show -j --format=prettyjson --project_id=apache-beam-testing beam_bq_job_QUERY_BQ_EXPORT_JOB_2cc8513b-6_1698216135_271 INFO root:bigquery_tools.py:648 Job apache-beam-testing:US.beam_bq_job_QUERY_BQ_EXPORT_JOB_2cc8513b-6_1698216135_271 status: RUNNING INFO root:bigquery_tools.py:648 Job apache-beam-testing:US.beam_bq_job_QUERY_BQ_EXPORT_JOB_2cc8513b-6_1698216135_271 status: DONE INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:575 Started BigQuery job: <JobReference jobId: 'beam_bq_job_EXPORT_BQ_EXPORT_JOB_2cc8513b-6_1698216140_537' location: 'US' projectId: 'apache-beam-testing'> bq show -j --format=prettyjson --project_id=apache-beam-testing beam_bq_job_EXPORT_BQ_EXPORT_JOB_2cc8513b-6_1698216140_537 INFO root:bigquery_tools.py:648 Job apache-beam-testing:US.beam_bq_job_EXPORT_BQ_EXPORT_JOB_2cc8513b-6_1698216140_537 status: RUNNING INFO root:bigquery_tools.py:648 Job apache-beam-testing:US.beam_bq_job_EXPORT_BQ_EXPORT_JOB_2cc8513b-6_1698216140_537 status: DONE INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.0352330207824707 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03950643539428711 seconds. INFO apache_beam.io.fileio:fileio.py:706 Moving temporary files <map object at 0x7fec691bfb20> to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-3880c1f1-fe5c-4ff7-a92e-ac6348969aa3 as ['output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00000-of-00001'] INFO apache_beam.io.fileio:fileio.py:706 Moving temporary files <map object at 0x7fec691bf640> to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-3880c1f1-fe5c-4ff7-a92e-ac6348969aa3 as ['output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00000-of-00001'] INFO apache_beam.io.fileio:fileio.py:706 Moving temporary files <map object at 0x7fec691bff40> to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-3880c1f1-fe5c-4ff7-a92e-ac6348969aa3 as ['output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00000-of-00001'] INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.04031944274902344 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.04585146903991699 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03615403175354004 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 3 files in 0.0400998592376709 seconds. PASSED [ 95%] apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics -------------------------------- live log call --------------------------------- INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_140653355146016], ComputedExpression[set_index_DataFrame_140653355144864], ComputedExpression[pre_combine_sum_DataFrame_140653355312176]]:140653354443392]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140653353491472]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_140653355146016], ComputedExpression[set_index_DataFrame_140653355144864], ComputedExpression[pre_combine_sum_DataFrame_140653355312176]], outputs={PlaceholderExpression[placeholder_DataFrame_140653353491472], ComputedExpression[pre_combine_sum_DataFrame_140653355312176]}] INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_140653355313760]]:140653354443968]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_140653355312176]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_140653355313760]], outputs={ComputedExpression[post_combine_sum_DataFrame_140653355313760]}] INFO apache_beam.io.fileio:fileio.py:610 Added temporary directory gs://temp-storage-for-end-to-end-tests/temp-it/.temp5bf0f5dc-7e19-40f5-8891-981bf9fc3123 WARNING apache_beam.options.pipeline_options:pipeline_options.py:367 Discarding unparseable args: ['--sleep_secs=20', '--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test'] INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function annotate_downstream_side_inputs at 0x7feca1133280> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function fix_side_input_pcoll_coders at 0x7feca11333a0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7feca11338b0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7feca1133940> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_sdf at 0x7feca1133af0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function expand_gbk at 0x7feca1133b80> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sink_flattens at 0x7feca1133ca0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function greedily_fuse at 0x7feca1133d30> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function read_to_impulse at 0x7feca1133dc0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function impulse_to_input at 0x7feca1133e50> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7feca11350d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function add_impulse_to_dangling_transforms at 0x7feca11351f0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function setup_timer_mapping at 0x7feca1135040> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function populate_data_channel_coders at 0x7feca1135160> ==================== INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600 INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7fec69050a30> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'') INFO apache_beam.io.fileio:fileio.py:706 Moving temporary files <map object at 0x7fec960788e0> to dir: gs://temp-storage-for-end-to-end-tests/temp-it as ['fd7c78e8-339b-4420-8bec-a9cb691ff0bf.result-00000-of-00001'] INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03982996940612793 seconds. PASSED [100%] =============================== warnings summary =============================== apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning. return airline_df[at_top_airports].mean() -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py39.xml> - === 23 passed, 19 skipped, 7182 deselected, 49 warnings in 805.58s (0:13:25) === > Task :sdks:python:test-suites:direct:py310:examples INFO apache_beam.io.fileio:fileio.py:706 Moving temporary files <map object at 0x7f035c56e200> to dir: gs://temp-storage-for-end-to-end-tests/temp-it as ['4b072d19-5772-4b76-aba3-d790281a1aa8.result-00000-of-00001'] INFO apache_beam.io.gcp.gcsio:gcsio.py:645 Finished listing 1 files in 0.03977680206298828 seconds. PASSED [100%] =============================== warnings summary =============================== ../../build/gradleenv/417525523/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives from distutils import util apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning. return airline_df[at_top_airports].mean() -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py310.xml> - === 23 passed, 19 skipped, 7182 deselected, 50 warnings in 812.55s (0:13:32) === FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 93 * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:py311:examples'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 20m 11s 18 actionable tasks: 17 executed, 1 from cache Publishing build scan... https://ge.apache.org/s/2uihsvmleba5w Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
