See
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/209/display/redirect?page=changes>
Changes:
[noreply] Push transform service containers with rest of containers (#26869)
------------------------------------------
[...truncated 13.13 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function expand_sdf at 0x7f66e3e253a0> ====================
INFO:root:Default Python SDK image for environment is
apache/beam_python3.11_sdk:2.49.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function expand_gbk at 0x7f66e3e25440> ====================
INFO:root:==================== <function annotate_downstream_side_inputs at
0x7f66e3e24a40> ====================
INFO:root:==================== <function fix_side_input_pcoll_coders at
0x7f66e3e24b80> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sink_flattens at 0x7f66e3e25580> ====================
INFO:root:==================== <function pack_combiners at 0x7f66e3e25120>
====================
INFO:root:==================== <function lift_combiners at 0x7f66e3e251c0>
====================
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to
RUNNING
INFO:root:==================== <function expand_sdf at 0x7f66e3e253a0>
====================
INFO:root:==================== <function expand_gbk at 0x7f66e3e25440>
====================
INFO:root:==================== <function sink_flattens at 0x7f66e3e25580>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function greedily_fuse at 0x7f66e3e25620> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function read_to_impulse at 0x7f66e3e256c0> ====================
INFO:root:==================== <function greedily_fuse at 0x7f66e3e25620>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function impulse_to_input at 0x7f66e3e25760> ====================
INFO:root:==================== <function read_to_impulse at 0x7f66e3e256c0>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sort_stages at 0x7f66e3e259e0> ====================
INFO:root:==================== <function impulse_to_input at 0x7f66e3e25760>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function add_impulse_to_dangling_transforms at 0x7f66e3e25b20>
====================
INFO:root:==================== <function sort_stages at 0x7f66e3e259e0>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function setup_timer_mapping at 0x7f66e3e25940> ====================
INFO:root:==================== <function add_impulse_to_dangling_transforms at
0x7f66e3e25b20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function populate_data_channel_coders at 0x7f66e3e25a80> ====================
INFO:root:==================== <function setup_timer_mapping at 0x7f66e3e25940>
====================
INFO:root:==================== <function populate_data_channel_coders at
0x7f66e3e25a80> ====================
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
control server on port 40429
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
data server on port 39385
INFO:root:starting control server on port 40429
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
state server on port 45213
INFO:root:starting data server on port 39385
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
logging server on port 44211
INFO:root:starting state server on port 45213
INFO:root:starting logging server on port 44211
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created
Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f66e3c7f010> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting
to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f66e3c7f010> for environment
ref_Environment_default_environment_1 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev
not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if
it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev,
defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for
docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker
container is running. container_id =
b'f9cc50bd12cad3adbf6e50f96be87d3a63eba899712a4a95e344fcd58151ccc4', worker_id
= worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id =
b'f9cc50bd12cad3adbf6e50f96be87d3a63eba899712a4a95e344fcd58151ccc4', worker_id
= worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 912729501
}
message: "semi_persistent_directory: /tmp"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1684948778
nanos: 919908523
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\',
\'--pipeline_type_check\']"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 922471761
}
message: "Pipeline_options: {\'gcp_oauth_scopes\':
[\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\',
\'https://www.googleapis.com/auth/bigquery\',
\'https://www.googleapis.com/auth/cloud-platform\',
\'https://www.googleapis.com/auth/devstorage.full_control\',
\'https://www.googleapis.com/auth/userinfo.email\',
\'https://www.googleapis.com/auth/datastore\',
\'https://www.googleapis.com/auth/spanner.admin\',
\'https://www.googleapis.com/auth/spanner.data\'], \'experiments\':
[\'beam_fn_api\'], \'requirements_file\':
\'/tmp/tmpzz3peihe/requirements.txt\', \'save_main_session\': True,
\'sdk_location\': \'container\', \'job_endpoint\': \'embed\',
\'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\',
\'environment_cache_millis\': \'0\'}"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 928007364
}
message: "Creating state cache with size 0"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 928476572
}
message: "Creating insecure control channel for localhost:40429."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 964499711
}
message: "Control channel established."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 968593358
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 972197771
}
message: "Python sdk harness starting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 984477043
}
message: "Creating insecure state channel for localhost:45213."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-12"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 984963178
}
message: "State channel established."
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-12"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 987982988
}
message: "Default Python SDK image for environment is
apache/beam_python3.11_sdk:2.49.0.dev"
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/transforms/environments.py:376"
thread: "Thread-12"
INFO:root:severity: INFO
timestamp {
seconds: 1684948778
nanos: 988204717
}
message: "Creating client data channel for localhost:39385"
instruction_id: "bundle_1"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-12"
INFO:root:severity: INFO
timestamp {
seconds: 1684948779
nanos: 90944290
}
message: "No more requests from control plane"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948779
nanos: 91123104
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948779
nanos: 91205835
}
message: "Closing all cached grpc data channels."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948779
nanos: 91283082
}
message: "Closing all cached gRPC state handlers."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948779
nanos: 92295408
}
message: "Done consuming work."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1684948779
nanos: 92436075
}
message: "Python sdk harness exiting."
log_location:
"/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in
39.11992049217224 seconds with state DONE.
INFO:root:Completed job in 39.11992049217224 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 326
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py311:postCommitPy311IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 29m 29s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/qqrka5fu2lkvi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
