See
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/276/display/redirect>
Changes:
------------------------------------------
[...truncated 6.17 MB...]
timestamp {
seconds: 1686395151
nanos: 51298379
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\',
\'--pipeline_type_check\']"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 53423881
}
message: "Pipeline_options: {\'gcp_oauth_scopes\':
[\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\',
\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\'], \'experiments\':
[\'beam_fn_api\'], \'requirements_file\':
\'/tmp/tmp77ow8ipb/requirements.txt\', \'save_main_session\': True,
\'sdk_location\': \'container\', \'job_endpoint\': \'embed\',
\'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\',
\'environment_cache_millis\': \'0\'}"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 57071447
}
message: "Creating state cache with size 0"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 57316780
}
message: "Creating insecure control channel for localhost:44279."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 71574926
}
message: "Control channel established."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 72166204
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 74998855
}
message: "Python sdk harness starting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 78214645
}
message: "Creating insecure state channel for localhost:44387."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 78522920
}
message: "State channel established."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 79828977
}
message: "Creating client data channel for localhost:35691"
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 133888483
}
message: "No more requests from control plane"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 134006977
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 134064912
}
message: "Closing all cached grpc data channels."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 134117364
}
message: "Closing all cached gRPC state handlers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 134990692
}
message: "Done consuming work."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686395151
nanos: 135082721
}
message: "Python sdk harness exiting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in
31.929874897003174 seconds with state DONE.
INFO:root:Completed job in 31.929874897003174 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or
(maintainer and maintainer_email) should be supplied
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~ Stack of Thread-33 (poll_for_job_completion) (140638922184448) ~~~~~~~~
File "/usr/lib/python3.11/threading.py", line 995, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 214, in poll_for_job_completion
time.sleep(sleep_secs)
~~~~~~~~~~~~~~~~~~~~~ Stack of <unknown> (140642406328064) ~~~~~~~~~~~~~~~~~~~~~
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 285, in _perform_spawn
reply.run()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 220, in run
self._result = func(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 967, in _thread_receiver
msg = Message.from_io(io)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 432, in from_io
header = io.read(9) # type 1, channel 4, payload 4
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 400, in read
data = self._read(numbytes - len(buf))
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/direct/common.gradle'>
line: 186
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:py311:hdfsIntegrationTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 326
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py311:postCommitPy311IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 141
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 37m 10s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/bvkmmzmfmvidy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
