See
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/295/display/redirect>
Changes:
------------------------------------------
[...truncated 9.60 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
control server on port 46027
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
data server on port 44453
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
state server on port 33337
INFO:root:starting control server on port 46027
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
logging server on port 36591
INFO:root:starting data server on port 44453
INFO:root:starting state server on port 33337
INFO:root:starting logging server on port 36591
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created
Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f26a7a93b90> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f26a7a93b90> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting
to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev
not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if
it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev,
defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for
docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker
container is running. container_id =
b'82e472ecea10f4a5097738a90bcc6372477307521c78a42a3bb0f5c7db6710c7', worker_id
= worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id =
b'82e472ecea10f4a5097738a90bcc6372477307521c78a42a3bb0f5c7db6710c7', worker_id
= worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 646191596
}
message: "semi_persistent_directory: /tmp"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1686805535
nanos: 651179790
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\',
\'--pipeline_type_check\']"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 653275728
}
message: "Pipeline_options: {\'gcp_oauth_scopes\':
[\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\',
\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\'], \'experiments\':
[\'beam_fn_api\'], \'requirements_file\':
\'/tmp/tmpm9ecyp50/requirements.txt\', \'save_main_session\': True,
\'sdk_location\': \'container\', \'job_endpoint\': \'embed\',
\'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\',
\'environment_cache_millis\': \'0\'}"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 656768321
}
message: "Creating state cache with size 0"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 657061100
}
message: "Creating insecure control channel for localhost:46027."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 670673847
}
message: "Control channel established."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 671376466
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 674429178
}
message: "Python sdk harness starting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 677896022
}
message: "Creating insecure state channel for localhost:33337."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 678181886
}
message: "State channel established."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 679619073
}
message: "Creating client data channel for localhost:44453"
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742129802
}
message: "No more requests from control plane"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742273569
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742345571
}
message: "Closing all cached grpc data channels."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742396116
}
message: "Closing all cached gRPC state handlers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 743447303
}
message: "Done consuming work."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 743542194
}
message: "Python sdk harness exiting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in
31.94184112548828 seconds with state DONE.
INFO:root:Completed job in 31.94184112548828 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py311:postCommitPy311
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or
(maintainer and maintainer_email) should be supplied
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~ Stack of Thread-12 (poll_for_job_completion) (140712725182208) ~~~~~~~~
File "/usr/lib/python3.11/threading.py", line 995, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 214, in poll_for_job_completion
time.sleep(sleep_secs)
~~~~~~~~~~~~~~~~~~~~~ Stack of <unknown> (140714647496448) ~~~~~~~~~~~~~~~~~~~~~
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 285, in _perform_spawn
reply.run()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 220, in run
self._result = func(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 967, in _thread_receiver
msg = Message.from_io(io)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 432, in from_io
header = io.read(9) # type 1, channel 4, payload 4
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 400, in read
data = self._read(numbytes - len(buf))
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 141
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 46m 48s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/cnfyex45j3nam
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
