See
<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/230/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-12247] Reduce memory/string creations in
InMemoryTimerInternals
[Ismaël Mejía] [BEAM-12248] Reduce ArrayList allocation in Row/RowUtils
[heejong] Moving to 2.31.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 445.59 KB...]
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'run', '-d',
'--network=host', 'apache/beam_java8_sdk:2.31.0.dev', '--id=worker_25',
'--logging_endpoint=localhost:42153', '--control_endpoint=localhost:38749',
'--artifact_endpoint=localhost:38749', '--provision_endpoint=localhost:38749']'
returned non-zero exit status 125.
Exception in thread Thread-375:
Traceback (most recent call last):
File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/local_job_service.py";,>
line 272, in _run_job
result = fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 200, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 364, in run_stages
stage_results = self._run_stage(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 512, in _run_stage
bundle_context_manager.extract_bundle_inputs_and_outputs())
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 861, in extract_bundle_inputs_and_outputs
data_api_service_descriptor = self.data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 779, in data_api_service_descriptor
return self.worker_handlers[0].data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 771, in worker_handlers
self.execution_context.worker_handler_manager.get_worker_handlers(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 898, in get_worker_handlers
worker_handler.start_worker()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 758, in start_worker
self._container_id = subprocess.check_output([
File "/usr/lib/python3.8/subprocess.py", line 411, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/lib/python3.8/subprocess.py", line 512, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'run', '-d',
'--network=host', 'apache/beam_java8_sdk:2.31.0.dev', '--id=worker_25',
'--logging_endpoint=localhost:42153', '--control_endpoint=localhost:38749',
'--artifact_endpoint=localhost:38749', '--provision_endpoint=localhost:38749']'
returned non-zero exit status 125.
Apr 29, 2021 12:17:47 PM org.apache.beam.sdk.expansion.service.ExpansionService
expand
INFO: Expanding 'External' with URN 'beam:transforms:xlang:test:partition'
Apr 29, 2021 12:17:47 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
WARNING: Configuration class
'org.apache.beam.sdk.testing.expansion.TestExpansionService$TestTransformRegistrar$EmptyConfiguration'
has no schema registered. Attempting to construct with setter approach.
INFO:apache_beam.runners.portability.abstract_job_service:Running job
'go-job-7-1619698669351607039-db155171-a7b7-4c1e-8d8c-ed6bc5dd5b26'
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function annotate_downstream_side_inputs at 0x7f139f1c6c10>
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function fix_side_input_pcoll_coders at 0x7f139f1c6d30> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function pack_combiners at 0x7f139f1c71f0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function lift_combiners at 0x7f139f1c7310> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function expand_sdf at 0x7f139f1c74c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function expand_gbk at 0x7f139f1c7550> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sink_flattens at 0x7f139f1c7670> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function greedily_fuse at 0x7f139f1c7700> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function read_to_impulse at 0x7f139f1c7790> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function impulse_to_input at 0x7f139f1c7820> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function sort_stages at 0x7f139f1c7a60> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function setup_timer_mapping at 0x7f139f1c79d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
<function populate_data_channel_coders at 0x7f139f1c7af0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
control server on port 46409
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
data server on port 44857
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
state server on port 35397
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting
logging server on port 43241
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created
Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f13cb471b20> for environment go (beam:env:docker:v1,
b'\n\x16apache/beam_go_sdk:dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting
to pull image apache/beam_go_sdk:dev
Error response from daemon: manifest for apache/beam_go_sdk:dev not found
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for
docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker
container is running. container_id =
b'20a3920a957c820e0d7f3c50ba3e7d076073ef6a408ee61a5f9a642d75a9e71c', worker_id
= worker_26
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 12197677
}
message: "Connecting via grpc @ localhost:46409 ..."
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504"
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 12344027
}
message: "Connecting via grpc @ localhost:43241 ..."
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504"
INFO:apache_beam.runners.portability.fn_api_runner.fn_runner:Running
(((e6)+(e7))+(e9_keyed2))+(n8_keyede9_2/Write)
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 915113363
}
message: "Connecting via grpc @ localhost:44857 ..."
instruction_id: "bundle_78"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504"
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 917842249
}
message: "DataSource: 1 elements in 2730864 ns"
instruction_id: "bundle_78"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 917894416
}
message: "DataSink: 3 elements in 1362744 ns"
instruction_id: "bundle_78"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84"
INFO:apache_beam.runners.portability.fn_api_runner.fn_runner:Running
((e1)+(e2))+(n2/Write)
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 926713634
}
message: "DataSource: 1 elements in 22761 ns"
instruction_id: "bundle_79"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232"
INFO:root:severity: INFO
timestamp {
seconds: 1619698676
nanos: 926734873
}
message: "DataSink: 6 elements in 43398 ns"
instruction_id: "bundle_79"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84"
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created
Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f13cb46de50> for environment byjwIamndSbeam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting
to pull image apache/beam_java8_sdk:2.31.0.dev
Error response from daemon: manifest for apache/beam_java8_sdk:2.31.0.dev not
found
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it
exists
Unable to find image 'apache/beam_java8_sdk:2.31.0.dev' locally
docker: Error response from daemon: manifest for
apache/beam_java8_sdk:2.31.0.dev not found.
See 'docker run --help'.
WARNING:root:severity: WARN
timestamp {
seconds: 1619698680
nanos: 840167111
}
message: "forcing DataChannel[localhost:44857] reconnection on port
{localhost:44857} due to EOF"
instruction_id: "bundle_78"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:118"
WARNING:root:severity: WARN
timestamp {
seconds: 1619698680
nanos: 840185460
}
message: "DataChannel.read localhost:44857 closed"
instruction_id: "bundle_78"
log_location:
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:258"
ERROR:apache_beam.runners.portability.local_job_service:Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/local_job_service.py";,>
line 272, in _run_job
result = fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 200, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 364, in run_stages
stage_results = self._run_stage(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 512, in _run_stage
bundle_context_manager.extract_bundle_inputs_and_outputs())
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 861, in extract_bundle_inputs_and_outputs
data_api_service_descriptor = self.data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 779, in data_api_service_descriptor
return self.worker_handlers[0].data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 771, in worker_handlers
self.execution_context.worker_handler_manager.get_worker_handlers(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 898, in get_worker_handlers
worker_handler.start_worker()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 758, in start_worker
self._container_id = subprocess.check_output([
File "/usr/lib/python3.8/subprocess.py", line 411, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/lib/python3.8/subprocess.py", line 512, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'run', '-d',
'--network=host', 'apache/beam_java8_sdk:2.31.0.dev', '--id=worker_27',
'--logging_endpoint=localhost:43241', '--control_endpoint=localhost:46409',
'--artifact_endpoint=localhost:46409', '--provision_endpoint=localhost:46409']'
returned non-zero exit status 125.
Exception in thread Thread-399:
Traceback (most recent call last):
File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
File "/usr/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/local_job_service.py";,>
line 272, in _run_job
result = fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 200, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 364, in run_stages
stage_results = self._run_stage(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 512, in _run_stage
bundle_context_manager.extract_bundle_inputs_and_outputs())
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 861, in extract_bundle_inputs_and_outputs
data_api_service_descriptor = self.data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 779, in data_api_service_descriptor
return self.worker_handlers[0].data_api_service_descriptor()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 771, in worker_handlers
self.execution_context.worker_handler_manager.get_worker_handlers(
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 898, in get_worker_handlers
worker_handler.start_worker()
File
"<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
line 758, in start_worker
self._container_id = subprocess.check_output([
File "/usr/lib/python3.8/subprocess.py", line 411, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/lib/python3.8/subprocess.py", line 512, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['docker', 'run', '-d',
'--network=host', 'apache/beam_java8_sdk:2.31.0.dev', '--id=worker_27',
'--logging_endpoint=localhost:43241', '--control_endpoint=localhost:46409',
'--artifact_endpoint=localhost:46409', '--provision_endpoint=localhost:46409']'
returned non-zero exit status 125.
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:ulrValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'>
line: 148
* What went wrong:
Execution failed for task ':sdks:go:test:ulrValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 4s
110 actionable tasks: 83 executed, 23 from cache, 4 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/i7smcjukpo376
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
