See
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/300/display/redirect>
Changes:
------------------------------------------
[...truncated 10.35 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
control server on port 41397
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
data server on port 45073
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
state server on port 40321
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
logging server on port 38393
INFO:root:starting control server on port 41397
INFO:root:starting data server on port 45073
INFO:root:starting state server on port 40321
INFO:root:starting logging server on port 38393
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created
Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f856c2f4090> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f856c2f4090> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting
to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev
not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if
it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev,
defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for
docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker
container is running. container_id =
b'b89e21afd24a71d71ef5a87fec9e63be15f9982de4c8341c260a9ab871c0480b', worker_id
= worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id =
b'b89e21afd24a71d71ef5a87fec9e63be15f9982de4c8341c260a9ab871c0480b', worker_id
= worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 362205743
}
message: "semi_persistent_directory: /tmp"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1686913583
nanos: 368169784
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\',
\'--pipeline_type_check\']"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 370357751
}
message: "Pipeline_options: {\'gcp_oauth_scopes\':
[\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\',
\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\'], \'experiments\':
[\'beam_fn_api\'], \'requirements_file\':
\'/tmp/tmpojnyjz08/requirements.txt\', \'save_main_session\': True,
\'sdk_location\': \'container\', \'job_endpoint\': \'embed\',
\'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\',
\'environment_cache_millis\': \'0\'}"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 374371528
}
message: "Creating state cache with size 0"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 374687433
}
message: "Creating insecure control channel for localhost:41397."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 390871286
}
message: "Control channel established."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 391610383
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 394366502
}
message: "Python sdk harness starting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 397412776
}
message: "Creating insecure state channel for localhost:40321."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 397681236
}
message: "State channel established."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 398979663
}
message: "Creating client data channel for localhost:45073"
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454201698
}
message: "No more requests from control plane"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454344511
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454406738
}
message: "Closing all cached grpc data channels."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454459428
}
message: "Closing all cached gRPC state handlers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 455412626
}
message: "Done consuming work."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 455506324
}
message: "Python sdk harness exiting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in
32.11256980895996 seconds with state DONE.
INFO:root:Completed job in 32.11256980895996 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py311:postCommitPy311
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or
(maintainer and maintainer_email) should be supplied
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~ Stack of Thread-7 (poll_for_job_completion) (140438127146752) ~~~~~~~~~
File "/usr/lib/python3.11/threading.py", line 995, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 214, in poll_for_job_completion
time.sleep(sleep_secs)
~~~~~~~~~~~~~~~~~~~~~ Stack of <unknown> (140439947081472) ~~~~~~~~~~~~~~~~~~~~~
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 285, in _perform_spawn
reply.run()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 220, in run
self._result = func(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 967, in _thread_receiver
msg = Message.from_io(io)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 432, in from_io
header = io.read(9) # type 1, channel 4, payload 4
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py";,>
line 400, in read
data = self._read(numbytes - len(buf))
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 141
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 37m 50s
209 actionable tasks: 147 executed, 56 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/az4t6cmlkxdbc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
