See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1895/display/redirect>
Changes: ------------------------------------------ [...truncated 1.39 MB...] INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.129Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_odd/Group/CoGroupByKeyImpl/Tag[1] INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.193Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.229Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.263Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.295Z: JOB_MESSAGE_DEBUG: Assigning stage ids. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.473Z: JOB_MESSAGE_DEBUG: Executing wait step start39 INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.535Z: JOB_MESSAGE_BASIC: Executing operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.581Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.612Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-c... INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.916Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:00.995Z: JOB_MESSAGE_DEBUG: Value "Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:01.098Z: JOB_MESSAGE_BASIC: Executing operation Create/Impulse+Create/FlatMap(<lambda at core.py:3634>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:14.244Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:44:38.938Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:45:34.957Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:45:59.368Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:46:56.799Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:47:29.626Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:48:25.418Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:48:50.011Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:49:49.153Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:50:13.911Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:51:09.786Z: JOB_MESSAGE_WARNING: A worker was unable to start up. Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:51:09.818Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:51:09.890Z: JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at core.py:3634>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:51:09.971Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:51:10.043Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:51:10.073Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:53:12.858Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:53:12.907Z: JOB_MESSAGE_BASIC: Worker pool stopped. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-17T23:53:12.939Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:193 Job 2023-05-17_16_43_53-3974197748767821951 is in state JOB_STATE_FAILED ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:1562 Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-05-17_16_43_53-3974197748767821951?project=<ProjectId> =============================== warnings summary =============================== ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:121 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870: 162 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870: 117 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2349: 36 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2349: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(parent) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages pkg_resources.declare_namespace(__name__) ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 ../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives from distutils import util apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. }).set_index(pd.Int64Index(range(123, 223), name='an_index')), apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(123, 223), name='an_index'), apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(475, 575), name='another_index'), -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========================== short test summary info ============================ FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 not found: manifest unknown: Failed to fetch "20230517232228" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230517232228".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. ====== 9 failed, 1 passed, 9 skipped, 392 warnings in 1246.71s (0:20:46) ======= > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517232228 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:64f8038bac27b11219947918e7277d621c508be159a7e5c46c4db69e3babcc32 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517232228] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:64f8038bac27b11219947918e7277d621c508be159a7e5c46c4db69e3babcc32] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230517232228] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:64f8038bac27b11219947918e7277d621c508be159a7e5c46c4db69e3babcc32])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:64f8038bac27b11219947918e7277d621c508be159a7e5c46c4db69e3babcc32 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:64f8038bac27b11219947918e7277d621c508be159a7e5c46c4db69e3babcc32 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:64f8038bac27b11219947918e7277d621c508be159a7e5c46c4db69e3babcc32]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Error: No such image: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228 ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230517232228] > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 18475. Stopping expansion service pid: 18476. FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 302 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 32m 27s 146 actionable tasks: 25 executed, 121 up-to-date Publishing build scan... https://ge.apache.org/s/sbndvvutnxxd2 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
