See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1980/display/redirect>
Changes: ------------------------------------------ [...truncated 939.15 KB...] INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:734 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0608050236-998482-zxz6xnth.1686200556.998857/dataflow_python_sdk.tar... INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:753 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0608050236-998482-zxz6xnth.1686200556.998857/dataflow_python_sdk.tar in 0 seconds. INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:734 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0608050236-998482-zxz6xnth.1686200556.998857/pipeline.pb... INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:753 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0608050236-998482-zxz6xnth.1686200556.998857/pipeline.pb in 0 seconds. INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:909 Create job: <Job clientRequestId: '20230608050236999797-5768' createTime: '2023-06-08T05:02:46.281289Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2023-06-07_22_02_45-2777539006405263818' location: 'us-central1' name: 'beamapp-jenkins-0608050236-998482-zxz6xnth' projectId: 'apache-beam-testing' stageStates: [] startTime: '2023-06-08T05:02:46.281289Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:911 Created job with id: [2023-06-07_22_02_45-2777539006405263818] INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:912 Submitted job: 2023-06-07_22_02_45-2777539006405263818 INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:918 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-06-07_22_02_45-2777539006405263818?project=apache-beam-testing INFO apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58 Console log: INFO apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 https://console.cloud.google.com/dataflow/jobs/us-central1/2023-06-07_22_02_45-2777539006405263818?project=apache-beam-testing INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:193 Job 2023-06-07_22_02_45-2777539006405263818 is in state JOB_STATE_RUNNING INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:46.890Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2023-06-07_22_02_45-2777539006405263818. The number of workers will be between 1 and 1000. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:47.042Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2023-06-07_22_02_45-2777539006405263818. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:49.045Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-f. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.179Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.207Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.248Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.272Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step assert_that/Group/CoGroupByKeyImpl/GroupByKey: GroupByKey not followed by a combiner. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.302Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step ExternalTransform(beam:transforms:xlang:test:gbk): GroupByKey not followed by a combiner. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.327Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.355Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.384Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.409Z: JOB_MESSAGE_DEBUG: Inserted coder converter after flatten ref_AppliedPTransform_assert_that-Group-CoGroupByKeyImpl-Flatten_21 INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.440Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_assert_that-Group-CoGroupByKeyImpl-Flatten_21 for input ref_AppliedPTransform_assert_that-Group-CoGroupByKeyImpl-Tag-0-_19.None INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.461Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/CoGroupByKeyImpl/Flatten/OutputIdentity, through flatten assert_that/Group/CoGroupByKeyImpl/Flatten, into producer assert_that/Group/CoGroupByKeyImpl/Tag[0] INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.482Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values) into assert_that/Group/CoGroupByKeyImpl/GroupByKey/Read INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.503Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/RestoreTags into assert_that/Group/CoGroupByKeyImpl/MapTuple(collect_values) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.525Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/RestoreTags INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.545Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.576Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_assert_that-Group-CoGroupByKeyImpl-Flatten_21-u16 for input ref_AppliedPTransform_assert_that-Group-CoGroupByKeyImpl-Flatten_21.None-c14 INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.598Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten assert_that/Group/CoGroupByKeyImpl/Flatten/Unzipped-1, into producer assert_that/Group/CoGroupByKeyImpl/Flatten/OutputIdentity INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.619Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Flatten/OutputIdentity into assert_that/Group/CoGroupByKeyImpl/Tag[1] INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.651Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write into assert_that/Group/CoGroupByKeyImpl/Flatten/OutputIdentity INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.673Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/FlatMap(<lambda at core.py:3634>) into Create/Impulse INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.705Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/Map(decode) into Create/FlatMap(<lambda at core.py:3634>) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.737Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:gbk)/Write into Create/Map(decode) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.768Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at validate_runner_xlang_test.py:140>) into ExternalTransform(beam:transforms:xlang:test:gbk)/Read INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.800Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into Map(<lambda at validate_runner_xlang_test.py:140>) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.832Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/FlatMap(<lambda at core.py:3634>) into assert_that/Create/Impulse INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.874Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/Map(decode) into assert_that/Create/FlatMap(<lambda at core.py:3634>) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.894Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Tag[0] into assert_that/Create/Map(decode) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.916Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn) INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.937Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/CoGroupByKeyImpl/Tag[1] into assert_that/ToVoidKey INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.973Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:50.999Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.029Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.050Z: JOB_MESSAGE_DEBUG: Assigning stage ids. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.154Z: JOB_MESSAGE_DEBUG: Executing wait step start25 INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.197Z: JOB_MESSAGE_BASIC: Executing operation ExternalTransform(beam:transforms:xlang:test:gbk)/Create INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.232Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.260Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f... INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.675Z: JOB_MESSAGE_BASIC: Finished operation ExternalTransform(beam:transforms:xlang:test:gbk)/Create INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.736Z: JOB_MESSAGE_DEBUG: Value "ExternalTransform(beam:transforms:xlang:test:gbk)/Session" materialized. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:02:51.788Z: JOB_MESSAGE_BASIC: Executing operation Create/Impulse+Create/FlatMap(<lambda at core.py:3634>)+Create/Map(decode)+ExternalTransform(beam:transforms:xlang:test:gbk)/Write INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:03:15.541Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:03:35.190Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s). INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T05:04:07.963Z: JOB_MESSAGE_DETAILED: Workers have started successfully. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T06:17:31.565Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2023-06-07_22_02_45-2777539006405263818. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T06:17:31.588Z: JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at core.py:3634>)+Create/Map(decode)+ExternalTransform(beam:transforms:xlang:test:gbk)/Write INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T06:17:31.739Z: JOB_MESSAGE_DETAILED: Cleaning up. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T06:17:31.790Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-06-08T06:17:31.810Z: JOB_MESSAGE_BASIC: Stopping worker pool... INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:193 Job 2023-06-07_22_02_45-2777539006405263818 is in state JOB_STATE_CANCELLING =============================== warnings summary =============================== ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870: 162 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870: 117 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2349: 36 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2349: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(parent) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages pkg_resources.declare_namespace(__name__) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========================== short test summary info ============================ FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: Job appears to be stuck. Several workers have failed to start up in a row, and no worker has successfully started up for this job. Last error reported: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 not found: manifest unknown: Failed to fetch "20230608045235" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20230608045235".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.. FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key - Failed: Timeout >4500.0s =========== 10 failed, 9 skipped, 360 warnings in 4704.71s (1:18:24) =========== > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230608045235 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:31bf54f7284faf1e6677e37d3ccd7858ca02515fe19a975644adc66210005b3a WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230608045235] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:31bf54f7284faf1e6677e37d3ccd7858ca02515fe19a975644adc66210005b3a] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230608045235] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:31bf54f7284faf1e6677e37d3ccd7858ca02515fe19a975644adc66210005b3a])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:31bf54f7284faf1e6677e37d3ccd7858ca02515fe19a975644adc66210005b3a Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:31bf54f7284faf1e6677e37d3ccd7858ca02515fe19a975644adc66210005b3a Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:31bf54f7284faf1e6677e37d3ccd7858ca02515fe19a975644adc66210005b3a]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1a28e8b57e67ad39ab0cb813c28f515ffcc375be8c55c5a1dfcbad8154c9a1bc ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230608045235] > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 3469441. Stopping expansion service pid: 3469442. FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 302 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1h 28m 34s 156 actionable tasks: 105 executed, 45 from cache, 6 up-to-date Publishing build scan... https://ge.apache.org/s/dkgaj64xvbdtw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
