See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/899/display/redirect?page=changes>
Changes:
[daria.malkova] [BEAM-12456] Add reading jdbc by partitions
------------------------------------------
[...truncated 1.02 MB...]
apache_beam/runners/dataflow/test_dataflow_runner.py:65: in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <DataflowPipelineResult <Job
createTime: '2021-07-02T12:19:18.568756Z'
currentState: CurrentStateValueValuesEnum(JOB...021-07-02T12:19:18.568756Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f0ed5a485f8>
duration = None
def wait_until_finish(self, duration=None):
if not self.is_in_terminal_state():
if not self.has_job:
raise IOError('Failed to get the Dataflow job id.')
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
time.sleep(5.0)
# TODO: Merge the termination code in poll_for_job_completion and
# is_in_terminal_state.
terminated = self.is_in_terminal_state()
assert duration or terminated, (
'Job did not reach to a terminal state after waiting indefinitely.')
if terminated and self.state != PipelineState.DONE:
# TODO(BEAM-1290): Consider converting this to an error log based on
# theresolution of the issue.
raise DataflowRuntimeException(
'Dataflow pipeline failed. State: %s, Error:\n%s' %
(self.state, getattr(self._runner, 'last_error_msg', None)),
> self)
E
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow
pipeline failed. State: FAILED, Error:
E The Dataflow job appears to be stuck because no worker activity has
been seen in the last 1h. Please check the worker logs in Stackdriver Logging.
You can also get help with Cloud Dataflow at
https://cloud.google.com/dataflow/support.
apache_beam/runners/dataflow/dataflow_runner.py:1629: DataflowRuntimeException
------------------------------ Captured log call -------------------------------
INFO apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz";>
to staging location.
WARNING root:environments.py:374 Make sure that locally built Python SDK
docker image has Python 3.6 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.6_sdk:2.32.0.dev
INFO root:environments.py:296 Using provided Python SDK container image:
gcr.io/cloud-dataflow/v1beta3/python36-fnapi:beam-master-20210622
INFO root:environments.py:304 Python SDK container image set to
"gcr.io/cloud-dataflow/v1beta3/python36-fnapi:beam-master-20210622" for Docker
environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function pack_combiners at 0x7f0e414602f0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function sort_stages at 0x7f0e41460a60>
====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:452
Defaulting to the temp_location as staging_location:
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/beam-sdks-java-testing-expansion-service-testExpansionService-2.32.0-SNAPSHOT-ZT9zQr9hnji2ceV38BjcdHy7WPkuvC-9n-6Is924pdk.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/beam-sdks-java-testing-expansion-service-testExpansionService-2.32.0-SNAPSHOT-ZT9zQr9hnji2ceV38BjcdHy7WPkuvC-9n-6Is924pdk.jar
in 6 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/dataflow_python_sdk.tar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/dataflow_python_sdk.tar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:632
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:651
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0702121909-362126.1625228349.362750/pipeline.pb
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:798
Create job: <Job
createTime: '2021-07-02T12:19:18.568756Z'
currentStateTime: '1970-01-01T00:00:00Z'
id:
'2021-07-02_05_19_16-16443243929392757460'
location: 'us-central1'
name: 'beamapp-jenkins-0702121909-362126'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2021-07-02T12:19:18.568756Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:800
Created job with id: [2021-07-02_05_19_16-16443243929392757460]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:801
Submitted job: 2021-07-02_05_19_16-16443243929392757460
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:807 To
access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-07-02_05_19_16-16443243929392757460?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191
Job 2021-07-02_05_19_16-16443243929392757460 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:28.534Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job
2021-07-02_05_19_16-16443243929392757460. The number of workers will be between
1 and 1000.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:28.793Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically
enabled for job 2021-07-02_05_19_16-16443243929392757460.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:30.973Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-1 in us-central1-f.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:31.762Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo
operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:31.788Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton
operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:31.859Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey
operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:31.893Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step
assert_that/Group/_CoGBKImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:31.927Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step
CheckSide/Group/_CoGBKImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:31.998Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations
into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.055Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner
information.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.096Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read,
Write, and Flatten operations
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.127Z: JOB_MESSAGE_DEBUG: Inserted coder converter before
flatten ref_AppliedPTransform_CheckSide-Group-_CoGBKImpl-Flatten_48
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.173Z: JOB_MESSAGE_DEBUG: Inserted coder converter before
flatten ref_AppliedPTransform_CheckSide-Group-_CoGBKImpl-Flatten_48
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.224Z: JOB_MESSAGE_DEBUG: Inserted coder converter before
flatten ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_30
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.260Z: JOB_MESSAGE_DEBUG: Inserted coder converter before
flatten ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_30
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.292Z: JOB_MESSAGE_DETAILED: Unzipping flatten
ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Flatten_30 for input
ref_AppliedPTransform_assert_that-Group-_CoGBKImpl-Tag-0-_28.None-post30
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.316Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of
assert_that/Group/_CoGBKImpl/GroupByKey/Write, through flatten
assert_that/Group/_CoGBKImpl/Flatten, into producer
assert_that/Group/_CoGBKImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.355Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/_CoGBKImpl/MapTuple(collect_values) into
assert_that/Group/_CoGBKImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.381Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/RestoreTags into
assert_that/Group/_CoGBKImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.402Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Unkey into assert_that/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.441Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Match into assert_that/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.477Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/_CoGBKImpl/GroupByKey/Write into
assert_that/Group/_CoGBKImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.513Z: JOB_MESSAGE_DETAILED: Unzipping flatten
external_1ExternalTransform-beam-transforms-xlang-test-multi--Flatten-PCollections
for input ref_AppliedPTransform_Main1-Map-decode-_6.None
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.538Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of
ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous),
through flatten
ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections, into
producer Main1/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.566Z: JOB_MESSAGE_DETAILED: Unzipping flatten
ref_AppliedPTransform_CheckSide-Group-_CoGBKImpl-Flatten_48 for input
ref_AppliedPTransform_CheckSide-Group-_CoGBKImpl-Tag-0-_46.None-post26
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.599Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of
CheckSide/Group/_CoGBKImpl/GroupByKey/Write, through flatten
CheckSide/Group/_CoGBKImpl/Flatten, into producer
CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.636Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/_CoGBKImpl/MapTuple(collect_values) into
CheckSide/Group/_CoGBKImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.665Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/RestoreTags into
CheckSide/Group/_CoGBKImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.698Z: JOB_MESSAGE_DETAILED: Fusing consumer CheckSide/Unkey
into CheckSide/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.736Z: JOB_MESSAGE_DETAILED: Fusing consumer CheckSide/Match
into CheckSide/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.786Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.824Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/_CoGBKImpl/Tag[1] into assert_that/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.851Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/_CoGBKImpl/Flatten/InputIdentity into
assert_that/Group/_CoGBKImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.880Z: JOB_MESSAGE_DETAILED: Unzipping flatten
external_1ExternalTransform-beam-transforms-xlang-test-multi--Flatten-PCollections-u38
for input
external_1ExternalTransform-beam-transforms-xlang-test-multi--ParDo-Anonymous--ParMultiDo-Anonymous-.output-c36
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.916Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of
assert_that/WindowInto(WindowIntoFn), through flatten
ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections/Unzipped-1,
into producer
ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.948Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous)
into Side/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:32.984Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
into Side/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.024Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous)
into Main2/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.052Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/_CoGBKImpl/GroupByKey/Write into
CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.077Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/WindowInto(WindowIntoFn) into
ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.115Z: JOB_MESSAGE_DETAILED: Fusing consumer
Side/FlatMap(<lambda at core.py:2972>) into Side/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.146Z: JOB_MESSAGE_DETAILED: Fusing consumer
Side/Map(decode) into Side/FlatMap(<lambda at core.py:2972>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.180Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.211Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Write
into
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.246Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues
into
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.283Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.319Z: JOB_MESSAGE_DETAILED: Fusing consumer
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous)
into
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.347Z: JOB_MESSAGE_DETAILED: Fusing consumer
Main1/FlatMap(<lambda at core.py:2972>) into Main1/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.379Z: JOB_MESSAGE_DETAILED: Fusing consumer
Main1/Map(decode) into Main1/FlatMap(<lambda at core.py:2972>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.405Z: JOB_MESSAGE_DETAILED: Fusing consumer
Main2/FlatMap(<lambda at core.py:2972>) into Main2/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.438Z: JOB_MESSAGE_DETAILED: Fusing consumer
Main2/Map(decode) into Main2/FlatMap(<lambda at core.py:2972>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.466Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/WindowInto(WindowIntoFn) into
ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.493Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Create/FlatMap(<lambda at core.py:2972>) into CheckSide/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.537Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Create/Map(decode) into CheckSide/Create/FlatMap(<lambda at
core.py:2972>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.562Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/_CoGBKImpl/Tag[0] into CheckSide/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.596Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity into
CheckSide/Group/_CoGBKImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.632Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/ToVoidKey into CheckSide/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.668Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/_CoGBKImpl/Tag[1] into CheckSide/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.699Z: JOB_MESSAGE_DETAILED: Fusing consumer
CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity into
CheckSide/Group/_CoGBKImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.737Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Create/FlatMap(<lambda at core.py:2972>) into
assert_that/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.788Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Create/Map(decode) into assert_that/Create/FlatMap(<lambda at
core.py:2972>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.813Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/_CoGBKImpl/Tag[0] into assert_that/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.856Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/_CoGBKImpl/Flatten/InputIdentity into
assert_that/Group/_CoGBKImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.899Z: JOB_MESSAGE_DEBUG: Workflow config is missing a
default resource spec.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.922Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and
teardown to workflow graph.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.956Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop
steps.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:33.982Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.132Z: JOB_MESSAGE_DEBUG: Executing wait step start61
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.191Z: JOB_MESSAGE_BASIC: Executing operation
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.212Z: JOB_MESSAGE_BASIC: Executing operation
CheckSide/Group/_CoGBKImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.245Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Group/_CoGBKImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.248Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.277Z: JOB_MESSAGE_BASIC: Starting 1 workers in
us-central1-f...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.320Z: JOB_MESSAGE_BASIC: Finished operation
ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.333Z: JOB_MESSAGE_BASIC: Finished operation
CheckSide/Group/_CoGBKImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.333Z: JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/_CoGBKImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.377Z: JOB_MESSAGE_DEBUG: Value
"ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Session"
materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.415Z: JOB_MESSAGE_DEBUG: Value
"assert_that/Group/_CoGBKImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.451Z: JOB_MESSAGE_DEBUG: Value
"CheckSide/Group/_CoGBKImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.495Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2972>)+assert_that/Create/Map(decode)+assert_that/Group/_CoGBKImpl/Tag[0]+assert_that/Group/_CoGBKImpl/Flatten/InputIdentity+assert_that/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.541Z: JOB_MESSAGE_BASIC: Executing operation
Side/Impulse+Side/FlatMap(<lambda at
core.py:2972>)+Side/Map(decode)+ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous)+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Write+CheckSide/WindowInto(WindowIntoFn)+CheckSide/ToVoidKey+CheckSide/Group/_CoGBKImpl/Tag[1]+CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity+CheckSide/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:34.574Z: JOB_MESSAGE_BASIC: Executing operation
CheckSide/Create/Impulse+CheckSide/Create/FlatMap(<lambda at
core.py:2972>)+CheckSide/Create/Map(decode)+CheckSide/Group/_CoGBKImpl/Tag[0]+CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity+CheckSide/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:19:56.302Z: JOB_MESSAGE_BASIC: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:20:46.150Z: JOB_MESSAGE_DETAILED: Workers have started
successfully.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T12:20:46.185Z: JOB_MESSAGE_DETAILED: Workers have started
successfully.
INFO oauth2client.transport:transport.py:185 Refreshing due to a 401
(attempt 1/2)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:34.643Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: The
Dataflow job appears to be stuck because no worker activity has been seen in
the last 1h. Please check the worker logs in Stackdriver Logging. You can also
get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:34.729Z: JOB_MESSAGE_BASIC: Cancel request is committed for
workflow job: 2021-07-02_05_19_16-16443243929392757460.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:34.751Z: JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:2972>)+assert_that/Create/Map(decode)+assert_that/Group/_CoGBKImpl/Tag[0]+assert_that/Group/_CoGBKImpl/Flatten/InputIdentity+assert_that/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:34.751Z: JOB_MESSAGE_BASIC: Finished operation
Side/Impulse+Side/FlatMap(<lambda at
core.py:2972>)+Side/Map(decode)+ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous)+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/GroupByKey/Write+CheckSide/WindowInto(WindowIntoFn)+CheckSide/ToVoidKey+CheckSide/Group/_CoGBKImpl/Tag[1]+CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity+CheckSide/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:34.751Z: JOB_MESSAGE_BASIC: Finished operation
CheckSide/Create/Impulse+CheckSide/Create/FlatMap(<lambda at
core.py:2972>)+CheckSide/Create/Map(decode)+CheckSide/Group/_CoGBKImpl/Tag[0]+CheckSide/Group/_CoGBKImpl/Flatten/InputIdentity+CheckSide/Group/_CoGBKImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:34.971Z: JOB_MESSAGE_ERROR: The Dataflow job appears to be
stuck because no worker activity has been seen in the last 1h. Please check the
worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow
at https://cloud.google.com/dataflow/support.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:35.282Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:35.346Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:19:35.381Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:20:29.782Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236
2021-07-02T13:20:29.812Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191
Job 2021-07-02_05_19_16-16443243929392757460 is in state JOB_STATE_FAILED
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54:
DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint:
disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62:
DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), #
pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml>
-
============== 7 failed, 1 passed, 2 warnings in 3732.93 seconds ===============
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 25831.
Stopping expansion service pid: 25834.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210702120055
ERROR: (gcloud.container.images.delete)
[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210702120055] is not a
valid name. Expected tag in the form "base:tag" or "tag" or digest in the form
"sha256:<digest>"
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 279
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 20m 16s
113 actionable tasks: 84 executed, 25 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/2bbkp6zjpg7os
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
