See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/1100/display/redirect?page=changes>
Changes:
[Moritz Mack] [Spark Dataset runner] Enable projection pushdown for Spark
dataset
[noreply] Fix dependency mismatch in Playground Java runner (#24059)
[noreply] added comments for tensorflow notebook (#23726)
[noreply] Convert initialisms to all caps (#24061)
------------------------------------------
[...truncated 581.00 KB...]
INFO root:transforms.py:182 Computing dataframe stage
<ComputeStage(PTransform)
label=[[ComputedExpression[move_grouped_columns_to_index_DataFrame_139795874599344]]:139795819835504]>
for
Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139795819830080]},
partitioning=Arbitrary,
ops=[ComputedExpression[move_grouped_columns_to_index_DataFrame_139795874599344]],
outputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_139795874599344],
PlaceholderExpression[placeholder_DataFrame_139795819830080]}]
INFO root:transforms.py:182 Computing dataframe stage
<ComputeStage(PTransform)
label=[[ComputedExpression[apply_DataFrame_139795874605536]]:139795819110480]>
for
Stage[inputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_139795874599344]},
partitioning=Index['airline'],
ops=[ComputedExpression[apply_DataFrame_139795874605536]],
outputs={ComputedExpression[apply_DataFrame_139795874605536]}]
INFO apache_beam.io.fileio:fileio.py:595 Added temporary directory
gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6
WARNING apache_beam.options.pipeline_options:pipeline_options.py:351
Discarding unparseable args: ['--sleep_secs=20',
'--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test']
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.10_sdk:2.44.0.dev
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function annotate_downstream_side_inputs at
0x7f250d78dc60> ====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function fix_side_input_pcoll_coders at 0x7f250d78dd80>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f250d78e290>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f250d78e320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function expand_sdf at 0x7f250d78e4d0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function expand_gbk at 0x7f250d78e560>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sink_flattens at 0x7f250d78e680>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function greedily_fuse at 0x7f250d78e710>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function read_to_impulse at 0x7f250d78e7a0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function impulse_to_input at 0x7f250d78e830>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f250d78ea70>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function add_impulse_to_dangling_transforms at
0x7f250d78eb90> ====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function setup_timer_mapping at 0x7f250d78e9e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function populate_data_channel_coders at 0x7f250d78eb00>
====================
INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state
cache with size 104857600
INFO
apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903
Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler
object at 0x7f24d1b31930> for environment
ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:562 Started
BigQuery job: <JobReference
location: 'US'
projectId: 'apache-beam-testing'>
bq show -j --format=prettyjson --project_id=apache-beam-testing None
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:446 Using location
'US' from table <TableReference
datasetId: 'airline_ontime_data'
projectId: 'apache-beam-testing'
tableId: 'flights'> referenced by query
SELECT
FlightDate AS date,
IATA_CODE_Reporting_Airline AS airline,
Origin AS departure_airport,
Dest AS arrival_airport,
DepDelay AS departure_delay,
ArrDelay AS arrival_delay
FROM `apache-beam-testing.airline_ontime_data.flights`
WHERE
FlightDate >= '2012-12-23' AND FlightDate <= '2012-12-25' AND
DepDelay IS NOT NULL AND ArrDelay IS NOT NULL
WARNING apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:889 Dataset
apache-beam-testing:beam_temp_dataset_f4ae08e9ae9b4db5b0b4cb4df3800108 does not
exist so we will create it as temporary with location=US
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:562 Started
BigQuery job: <JobReference
jobId: 'beam_bq_job_QUERY_BQ_EXPORT_JOB_ebafbc52-9_1668018520_785'
location: 'US'
projectId: 'apache-beam-testing'>
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_QUERY_BQ_EXPORT_JOB_ebafbc52-9_1668018520_785
INFO root:bigquery_tools.py:635 Job status: RUNNING
INFO root:bigquery_tools.py:635 Job status: DONE
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:562 Started
BigQuery job: <JobReference
jobId: 'beam_bq_job_EXPORT_BQ_EXPORT_JOB_ebafbc52-9_1668018525_129'
location: 'US'
projectId: 'apache-beam-testing'>
bq show -j --format=prettyjson --project_id=apache-beam-testing
beam_bq_job_EXPORT_BQ_EXPORT_JOB_ebafbc52-9_1668018525_129
INFO root:bigquery_tools.py:635 Job status: RUNNING
INFO root:bigquery_tools.py:635 Job status: DONE
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 1 files in
0.04321146011352539 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 1 files in
0.05510687828063965 seconds.
INFO apache_beam.io.fileio:fileio.py:677 Moving temporary file
gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6/3200345999222847701_6ea7c062-2995-4281-a0d5-3770e2f45d0f
to dir:
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-fd51fef5-4d7e-4cb4-935b-0eed4b90baa6
as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00000-of-00001. Res:
FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6/3200345999222847701_6ea7c062-2995-4281-a0d5-3770e2f45d0f',
shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0),
pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:677 Moving temporary file
gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6/7323878040347606067_dce504f0-77a4-44f0-8066-0de16aabff51
to dir:
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-fd51fef5-4d7e-4cb4-935b-0eed4b90baa6
as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00000-of-00001. Res:
FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6/7323878040347606067_dce504f0-77a4-44f0-8066-0de16aabff51',
shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0),
pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:677 Moving temporary file
gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6/2076650397649838997_7050a31a-5121-440a-8a7e-f1511117245c
to dir:
gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-fd51fef5-4d7e-4cb4-935b-0eed4b90baa6
as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00000-of-00001. Res:
FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp5a2e8b94-b6d6-423a-8d5e-d887b91a83e6/2076650397649838997_7050a31a-5121-440a-8a7e-f1511117245c',
shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0),
pane=None, destination=None)
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 1 files in
0.029694557189941406 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 1 files in
0.03764915466308594 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 1 files in
0.03391718864440918 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 3 files in
0.03414630889892578 seconds.
PASSED [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
-------------------------------- live log call ---------------------------------
INFO root:transforms.py:182 Computing dataframe stage
<ComputeStage(PTransform)
label=[[ComputedExpression[set_column_DataFrame_139796102590528],
ComputedExpression[set_index_DataFrame_139796102589760],
ComputedExpression[pre_combine_sum_DataFrame_139796103779072]]:139796103788048]>
for
Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139796110738240]},
partitioning=Arbitrary,
ops=[ComputedExpression[set_column_DataFrame_139796102590528],
ComputedExpression[set_index_DataFrame_139796102589760],
ComputedExpression[pre_combine_sum_DataFrame_139796103779072]],
outputs={ComputedExpression[pre_combine_sum_DataFrame_139796103779072],
PlaceholderExpression[placeholder_DataFrame_139796110738240]}]
INFO root:transforms.py:182 Computing dataframe stage
<ComputeStage(PTransform)
label=[[ComputedExpression[post_combine_sum_DataFrame_139796103776240]]:139796103790496]>
for
Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_139796103779072]},
partitioning=Index,
ops=[ComputedExpression[post_combine_sum_DataFrame_139796103776240]],
outputs={ComputedExpression[post_combine_sum_DataFrame_139796103776240]}]
INFO apache_beam.io.fileio:fileio.py:595 Added temporary directory
gs://temp-storage-for-end-to-end-tests/temp-it/.temp53034ac6-5718-4912-bb90-30d508cdf5a5
WARNING apache_beam.options.pipeline_options:pipeline_options.py:351
Discarding unparseable args: ['--sleep_secs=20',
'--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test']
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.10_sdk:2.44.0.dev
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function annotate_downstream_side_inputs at
0x7f250d78dc60> ====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function fix_side_input_pcoll_coders at 0x7f250d78dd80>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f250d78e290>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f250d78e320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function expand_sdf at 0x7f250d78e4d0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function expand_gbk at 0x7f250d78e560>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sink_flattens at 0x7f250d78e680>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function greedily_fuse at 0x7f250d78e710>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function read_to_impulse at 0x7f250d78e7a0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function impulse_to_input at 0x7f250d78e830>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f250d78ea70>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function add_impulse_to_dangling_transforms at
0x7f250d78eb90> ====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function setup_timer_mapping at 0x7f250d78e9e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function populate_data_channel_coders at 0x7f250d78eb00>
====================
INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state
cache with size 104857600
INFO
apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903
Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler
object at 0x7f24d17c15d0> for environment
ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO apache_beam.io.fileio:fileio.py:677 Moving temporary file
gs://temp-storage-for-end-to-end-tests/temp-it/.temp53034ac6-5718-4912-bb90-30d508cdf5a5/3214331697874397690_6a092104-77e7-4918-a910-e6e6118048e9
to dir: gs://temp-storage-for-end-to-end-tests/temp-it as
bdc6fd30-b537-4629-840b-ce1bdd2a139f.result-00000-of-00001. Res:
FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp53034ac6-5718-4912-bb90-30d508cdf5a5/3214331697874397690_6a092104-77e7-4918-a910-e6e6118048e9',
shard_index=-1, total_shards=0, window=GlobalWindow, pane=None,
destination=None)
INFO apache_beam.io.gcp.gcsio:gcsio.py:615 Finished listing 1 files in
0.04337716102600098 seconds.
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/417525523/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/417525523/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/417525523/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:66
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:89
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/examples/wordcount_debugging_test.py: 17 warnings
apache_beam/examples/wordcount_minimal_test.py: 17 warnings
apache_beam/examples/wordcount_test.py: 17 warnings
apache_beam/examples/complete/autocomplete_it_test.py: 17 warnings
apache_beam/examples/complete/distribopt_test.py: 17 warnings
apache_beam/examples/complete/estimate_pi_it_test.py: 9 warnings
apache_beam/examples/complete/tfidf_it_test.py: 34 warnings
apache_beam/examples/complete/top_wikipedia_sessions_it_test.py: 17 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 12 warnings
apache_beam/examples/complete/game/user_score_it_test.py: 19 warnings
apache_beam/examples/cookbook/bigquery_side_input_it_test.py: 25 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 11 warnings
apache_beam/examples/cookbook/coders_it_test.py: 17 warnings
apache_beam/examples/cookbook/custom_ptransform_it_test.py: 51 warnings
apache_beam/examples/cookbook/filters_test.py: 11 warnings
apache_beam/examples/cookbook/group_with_coder_test.py: 25 warnings
apache_beam/examples/cookbook/mergecontacts_test.py: 33 warnings
apache_beam/examples/cookbook/multiple_output_pardo_test.py: 35 warnings
apache_beam/examples/dataframe/flight_delays_it_test.py: 28 warnings
apache_beam/examples/dataframe/wordcount_test.py: 14 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/httplib2/__init__.py>:147:
DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/dataframe/io.py>:659:
FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/fileio.py>:590:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py310.xml>
-
=== 22 passed, 6 skipped, 6702 deselected, 516 warnings in 220.29s (0:03:40) ===
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/test-suites/direct/common.gradle'>
line: 92
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py37:examples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 37s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/t4jbmwr3fhkxa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
