See
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/306/display/redirect>
Changes:
------------------------------------------
[...truncated 10.90 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function pack_combiners at 0x7f8defe939c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function lift_combiners at 0x7f8defe93a60> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function expand_sdf at 0x7f8defe93c40> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function expand_gbk at 0x7f8defe93ce0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sink_flattens at 0x7f8defe93e20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function greedily_fuse at 0x7f8defe93ec0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function read_to_impulse at 0x7f8defe93f60> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function impulse_to_input at 0x7f8defe98040> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sort_stages at 0x7f8defe982c0> ====================
INFO:root:==================== <function annotate_downstream_side_inputs at
0x7f8defe932e0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function add_impulse_to_dangling_transforms at 0x7f8defe98400>
====================
INFO:root:==================== <function fix_side_input_pcoll_coders at
0x7f8defe93420> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function setup_timer_mapping at 0x7f8defe98220> ====================
INFO:root:==================== <function pack_combiners at 0x7f8defe939c0>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function populate_data_channel_coders at 0x7f8defe98360> ====================
INFO:root:==================== <function lift_combiners at 0x7f8defe93a60>
====================
INFO:root:==================== <function expand_sdf at 0x7f8defe93c40>
====================
INFO:root:==================== <function expand_gbk at 0x7f8defe93ce0>
====================
INFO:root:==================== <function sink_flattens at 0x7f8defe93e20>
====================
INFO:root:==================== <function greedily_fuse at 0x7f8defe93ec0>
====================
INFO:root:==================== <function read_to_impulse at 0x7f8defe93f60>
====================
INFO:root:==================== <function impulse_to_input at 0x7f8defe98040>
====================
INFO:root:==================== <function sort_stages at 0x7f8defe982c0>
====================
INFO:root:==================== <function add_impulse_to_dangling_transforms at
0x7f8defe98400> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f8defe98220>
====================
INFO:root:==================== <function populate_data_channel_coders at
0x7f8defe98360> ====================
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
control server on port 34797
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
data server on port 33267
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
state server on port 38349
INFO:root:starting control server on port 34797
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
logging server on port 39341
INFO:root:starting data server on port 33267
INFO:root:starting state server on port 38349
INFO:root:starting logging server on port 39341
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created
Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f8defc060d0> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f8defc060d0> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting
to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev
not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if
it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev,
defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for
docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker
container is running. container_id =
b'bec22dcfcbcd4b38b25f5e539fa3c6945e072c43e7e7ccde1f2c4c1149c67157', worker_id
= worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id =
b'bec22dcfcbcd4b38b25f5e539fa3c6945e072c43e7e7ccde1f2c4c1149c67157', worker_id
= worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 581717967
}
message: "semi_persistent_directory: /tmp"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1687043005
nanos: 586860179
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\',
\'--pipeline_type_check\']"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 589106082
}
message: "Pipeline_options: {\'gcp_oauth_scopes\':
[\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\',
\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\'], \'experiments\':
[\'beam_fn_api\'], \'requirements_file\':
\'/tmp/tmp9h_k2_gc/requirements.txt\', \'save_main_session\': True,
\'sdk_location\': \'container\', \'job_endpoint\': \'embed\',
\'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\',
\'environment_cache_millis\': \'0\'}"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 593440532
}
message: "Creating state cache with size 0"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 593788623
}
message: "Creating insecure control channel for localhost:34797."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 608934640
}
message: "Control channel established."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 609611749
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 612847328
}
message: "Python sdk harness starting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 616389274
}
message: "Creating insecure state channel for localhost:38349."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 616679668
}
message: "State channel established."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 617987155
}
message: "Creating client data channel for localhost:33267"
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 672720670
}
message: "No more requests from control plane"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 672841072
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 672899723
}
message: "Closing all cached grpc data channels."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 672955751
}
message: "Closing all cached gRPC state handlers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 673671960
}
message: "Done consuming work."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1687043005
nanos: 673776626
}
message: "Python sdk harness exiting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in
42.52401614189148 seconds with state DONE.
INFO:root:Completed job in 42.52401614189148 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py311:postCommitPy311
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or
(maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 141
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 55m 22s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/rqp4mwkqzifxw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
