See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5975/display/redirect?page=changes>
Changes: [shivam] Add example for `Distinct` PTransform [noreply] Minor: Clean up an assertion in schemas_test (#22613) [noreply] Exclude testWithShardedKeyInGlobalWindow on streaming runner v1 (#22593) [noreply] Pub/Sub Schema Transform Read Provider (#22145) [noreply] Update BigQuery URI validation to allow more valid URIs through (#22452) ------------------------------------------ [...truncated 1.76 MB...] INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:914 Submitted job: 2022-08-08_18_43_36-9763111047433796658 INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:920 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-08-08_18_43_36-9763111047433796658?project=apache-beam-testing INFO apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58 Console log: INFO apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 https://console.cloud.google.com/dataflow/jobs/us-central1/2022-08-08_18_43_36-9763111047433796658?project=apache-beam-testing INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:197 Job 2022-08-08_18_43_36-9763111047433796658 is in state JOB_STATE_RUNNING INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:37.090Z: JOB_MESSAGE_WARNING: Autoscaling is enabled for Dataflow Streaming Engine. Workers will scale between 1 and 100 unless maxNumWorkers is specified. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:37.315Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2022-08-08_18_43_36-9763111047433796658. The number of workers will be between 1 and 100. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:37.361Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2022-08-08_18_43_36-9763111047433796658. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:41.407Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-a. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.194Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.234Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.293Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.331Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.365Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.395Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.463Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.516Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.551Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.568Z: JOB_MESSAGE_DETAILED: Fusing consumer decode into ReadFromPubSub/Read INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.592Z: JOB_MESSAGE_DETAILED: Fusing consumer split into decode INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.618Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.645Z: JOB_MESSAGE_DETAILED: Fusing consumer WindowInto(WindowIntoFn) into pair_with_one INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.678Z: JOB_MESSAGE_DETAILED: Fusing consumer group/WriteStream into WindowInto(WindowIntoFn) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.711Z: JOB_MESSAGE_DETAILED: Fusing consumer group/MergeBuckets into group/ReadStream INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.745Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/MergeBuckets INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.798Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.849Z: JOB_MESSAGE_DETAILED: Fusing consumer encode into format INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.876Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToPubSub/ToProtobuf into encode INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.905Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteToPubSub/Write into WriteToPubSub/ToProtobuf INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.946Z: JOB_MESSAGE_BASIC: Running job using Streaming Engine INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:42.974Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:43.008Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:43.070Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:43.088Z: JOB_MESSAGE_DEBUG: Assigning stage ids. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:43.137Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:43.164Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:43:43.188Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a... INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:44:09.190Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:44:19.291Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 so that the pipeline can catch up with its backlog and keep up with its input rate. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-08-09T01:44:55.445Z: JOB_MESSAGE_DETAILED: Workers have started successfully. WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:256 Timing out on waiting for job 2022-08-08_18_43_36-9763111047433796658 after 360 seconds ERROR apache_beam.io.gcp.tests.pubsub_matcher:pubsub_matcher.py:171 Timeout after 400 sec. Received 0 messages from projects/apache-beam-testing/subscriptions/wc_subscription_output02ef821e-9771-4f96-841d-99377c0a939b. =============================== warnings summary =============================== ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/pytest_preCommitIT-df-py37.xml> - =========================== short test summary info ============================ FAILED apache_beam/examples/streaming_wordcount_it_test.py::StreamingWordCountIT::test_streaming_wordcount_it ================== 1 failed, 3 warnings in 994.08s (0:16:34) =================== > Task :sdks:python:test-suites:dataflow:py37:preCommitIT_streaming_V2 FAILED > Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 [1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.42.0.dev0.zip> [0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.42.0.dev0.zip,attrs==22.1.0,cachetools==4.2.4,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.4,fasteners==0.17.3,freezegun==1.2.1,google-api-core==2.8.1,google-apitools==0.5.31,google-auth==2.10.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==2.3.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.8.0,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.4,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.7.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.4,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.47.0,grpcio-gcp==0.2.2,grpcio-status==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.11,overrides==6.2.0,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==1.0.0,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.2,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,regex==2022.7.25,requests==2.28.1,requests-mock==1.9.3,rsa==4.9,scikit-learn==1.1.2,scipy==1.9.0,six==1.16.0,SQLAlchemy==1.4.40,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,tomli==2.0.1,torch==1.10.2,typing_extensions==4.3.0,urllib3==1.26.11,websocket-client==1.3.3,wrapt==1.14.1,zstandard==0.18.0> [0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='2438657382' [0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version [0mPython 3.8.10 [1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version [0mpip 22.2.1 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8) [1mpy38-pytorch-110 run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch' [0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.42.0.dev0.zip> torch==1.10.2 [1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch [0m============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0 cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> configfile: pytest.ini plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] ss.s........... [100%] =============================== warnings summary =============================== target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferenceTest::test_inference_runner_inference_args <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/ml/inference/pytorch_inference_test.py>:244: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. inference_runner = TestPytorchModelHandlerKeyedTensorForInferenceOnly( apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferenceTest::test_run_inference_keyed <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/ml/inference/pytorch_inference_test.py>:219: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. inference_runner = TestPytorchModelHandlerKeyedTensorForInferenceOnly( apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferencePipelineTest::test_pipeline_local_model_extra_inference_args <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/ml/inference/pytorch_inference_test.py>:309: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. model_handler = PytorchModelHandlerKeyedTensor( apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferencePipelineTest::test_pipeline_local_model_extra_inference_args <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/dill/_dill.py>:472: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. obj = StockUnpickler.load(self) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> - ================= 12 passed, 3 skipped, 17 warnings in 12.87s ================== [1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [32m py38-pytorch-110: commands succeeded [0m[32m congratulations :) [0m > Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 [1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py> [0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19> [0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0 [0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.42.0.dev0.zip> [0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.42.0.dev0.zip,attrs==22.1.0,cachetools==4.2.4,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.4,fasteners==0.17.3,freezegun==1.2.1,google-api-core==2.8.1,google-apitools==0.5.31,google-auth==2.10.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==2.3.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.8.0,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.4,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.7.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.4,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.47.0,grpcio-gcp==0.2.2,grpcio-status==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.11,overrides==6.2.0,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==1.0.0,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.2,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,regex==2022.7.25,requests==2.28.1,requests-mock==1.9.3,rsa==4.9,scikit-learn==1.1.2,scipy==1.9.0,six==1.16.0,SQLAlchemy==1.4.40,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,tomli==2.0.1,torch==1.9.1,typing_extensions==4.3.0,urllib3==1.26.11,websocket-client==1.3.3,wrapt==1.14.1,zstandard==0.18.0> [0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='3147311324' [0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version [0mPython 3.8.10 [1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version [0mpip 22.2.1 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8) [1mpy38-pytorch-19 run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch' [0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.42.0.dev0.zip> torch==1.9.1 [1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch [0m============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0 cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> configfile: pytest.ini plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I gw0 [15] / gw1 [15] / gw2 [15] / gw3 [15] / gw4 [15] / gw5 [15] ss.s........... [100%] =============================== warnings summary =============================== target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42 target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferenceTest::test_inference_runner_inference_args <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/ml/inference/pytorch_inference_test.py>:244: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. inference_runner = TestPytorchModelHandlerKeyedTensorForInferenceOnly( apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferenceTest::test_run_inference_keyed <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/ml/inference/pytorch_inference_test.py>:219: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. inference_runner = TestPytorchModelHandlerKeyedTensorForInferenceOnly( apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferencePipelineTest::test_pipeline_local_model_extra_inference_args <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/ml/inference/pytorch_inference_test.py>:309: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. model_handler = PytorchModelHandlerKeyedTensor( apache_beam/ml/inference/pytorch_inference_test.py::PytorchRunInferencePipelineTest::test_pipeline_local_model_extra_inference_args <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/dill/_dill.py>:472: FutureWarning: PytorchModelHandlerKeyedTensor is experimental. No backwards-compatibility guarantees. obj = StockUnpickler.load(self) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> - ================= 12 passed, 3 skipped, 17 warnings in 13.23s ================== [1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [32m py38-pytorch-19: commands succeeded [0m[32m congratulations :) [0m > Task :sdks:python:test-suites:tox:py38:preCommitPy38 FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:tox:py39:testPy39Cython'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 81 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py37:preCommitIT_streaming_V2'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 2m 59s 124 actionable tasks: 91 executed, 31 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/qvwqoqf5acwlk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
