See
<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/4616/display/redirect?page=changes>
Changes:
[noreply] Bump google.golang.org/api from 0.109.0 to 0.110.0 in /sdks (#25619)
------------------------------------------
[...truncated 143.80 KB...]
File "apache_beam/runners/common.py", line 625, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 757, in process
self._flush()
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 763, in _flush
sink.write(self.batch)
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "/usr/local/lib/python3.7/site-packages/pymongo/collection.py", line
508, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "/usr/local/lib/python3.7/site-packages/pymongo/bulk.py", line 533, in
execute
return self.execute_command(generator, write_concern, session)
File "/usr/local/lib/python3.7/site-packages/pymongo/bulk.py", line 363, in
execute_command
self.is_retryable, retryable_bulk, s, self)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1438, in _retry_with_session
return self._retry_internal(retryable, func, session, bulk)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1462, in _retry_internal
with self._get_socket(server, session) as sock_info:
File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1309, in _get_socket
self.__all_credentials, handler=err_handler) as sock_info:
File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1331, in
get_socket
sock_info = self._get_socket(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1397, in
_get_socket
sock_info = self.connect(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1297, in
connect
sock_info.check_auth(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 820, in
check_auth
self.authenticate(credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 837, in
authenticate
auth.authenticate(credentials, self)
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 672, in
authenticate
auth_func(credentials, sock_info)
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 590, in
_authenticate_default
return _authenticate_scram(credentials, sock_info, 'SCRAM-SHA-1')
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 295, in
_authenticate_scram
res = sock_info.command(source, cmd)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 721, in
command
exhaust_allowed=exhaust_allowed)
File "/usr/local/lib/python3.7/site-packages/pymongo/network.py", line 163,
in command
parse_write_concern_error=parse_write_concern_error)
File "/usr/local/lib/python3.7/site-packages/pymongo/helpers.py", line 167,
in _check_command_response
raise OperationFailure(errmsg, code, response, max_wire_version)
pymongo.errors.OperationFailure: Authentication failed., full error: {'ok':
0.0, 'errmsg': 'Authentication failed.', 'code': 18, 'codeName':
'AuthenticationFailed'} [while running
'WriteToMongoDB/ParDo(_WriteMongoFn)-ptransform-35']
Worker ID: beamapp-jenkins-022420452-02241245-785c-harness-423c
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-02-24T20:54:39.536Z:
JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-02-24T20:54:39.587Z:
JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-02-24T20:54:39.623Z:
JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-02-24T20:56:49.125Z:
JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-02-24T20:56:49.169Z:
JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-02-24T20:56:49.265Z:
JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2023-02-24_12_45_21-11616463555317542745 is in state JOB_STATE_FAILED
ERROR:apache_beam.runners.dataflow.dataflow_runner:Console URL:
https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-02-24_12_45_21-11616463555317542745?project=<ProjectId>
Traceback (most recent call last):
File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.7/runpy.py", line 85, in _run_code
exec(code, run_globals)
File
"<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/io/mongodbio_it_test.py";,>
line 170, in <module>
run()
File
"<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/io/mongodbio_it_test.py";,>
line 80, in run
known_args.batch_size))
File
"<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/pipeline.py";,>
line 600, in __exit__
self.result = self.run()
File
"<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/testing/test_pipeline.py";,>
line 116, in run
state = result.wait_until_finish()
File
"<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/build/gradleenv/-1734967052/lib/python3.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 1558, in wait_until_finish
self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow
pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1394, in
_get_socket
sock_info = self.sockets.popleft()
IndexError: pop from an empty deque
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1418, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 757, in process
self._flush()
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 763, in _flush
sink.write(self.batch)
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "/usr/local/lib/python3.7/site-packages/pymongo/collection.py", line
508, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "/usr/local/lib/python3.7/site-packages/pymongo/bulk.py", line 533, in
execute
return self.execute_command(generator, write_concern, session)
File "/usr/local/lib/python3.7/site-packages/pymongo/bulk.py", line 363, in
execute_command
self.is_retryable, retryable_bulk, s, self)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1438, in _retry_with_session
return self._retry_internal(retryable, func, session, bulk)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1462, in _retry_internal
with self._get_socket(server, session) as sock_info:
File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1309, in _get_socket
self.__all_credentials, handler=err_handler) as sock_info:
File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1331, in
get_socket
sock_info = self._get_socket(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1397, in
_get_socket
sock_info = self.connect(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1297, in
connect
sock_info.check_auth(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 820, in
check_auth
self.authenticate(credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 837, in
authenticate
auth.authenticate(credentials, self)
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 672, in
authenticate
auth_func(credentials, sock_info)
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 590, in
_authenticate_default
return _authenticate_scram(credentials, sock_info, 'SCRAM-SHA-1')
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 295, in
_authenticate_scram
res = sock_info.command(source, cmd)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 721, in
command
exhaust_allowed=exhaust_allowed)
File "/usr/local/lib/python3.7/site-packages/pymongo/network.py", line 163,
in command
parse_write_concern_error=parse_write_concern_error)
File "/usr/local/lib/python3.7/site-packages/pymongo/helpers.py", line 167,
in _check_command_response
raise OperationFailure(errmsg, code, response, max_wire_version)
pymongo.errors.OperationFailure: Authentication failed., full error: {'ok':
0.0, 'errmsg': 'Authentication failed.', 'code': 18, 'codeName':
'AuthenticationFailed'}
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 292, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 365, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 625, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 662, in process_bundle
bundle_processor.process_bundle(instruction_id))
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1063, in process_bundle
element.data)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 232, in process_encoded
self.output(decoded_value)
File "apache_beam/runners/worker/operations.py", line 526, in
apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 528, in
apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 237, in
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 240, in
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in
apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in
apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1420, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1492, in
apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1418, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 624, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1582, in
apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1695, in
apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 240, in
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in
apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in
apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1420, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1492, in
apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1418, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 624, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1582, in
apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1695, in
apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 240, in
apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 907, in
apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 908, in
apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1420, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1508, in
apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1418, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 757, in process
self._flush()
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 763, in _flush
sink.write(self.batch)
File "/usr/local/lib/python3.7/site-packages/apache_beam/io/mongodbio.py",
line 796, in write
resp = self.client[self.db][self.coll].bulk_write(requests)
File "/usr/local/lib/python3.7/site-packages/pymongo/collection.py", line
508, in bulk_write
bulk_api_result = blk.execute(write_concern, session)
File "/usr/local/lib/python3.7/site-packages/pymongo/bulk.py", line 533, in
execute
return self.execute_command(generator, write_concern, session)
File "/usr/local/lib/python3.7/site-packages/pymongo/bulk.py", line 363, in
execute_command
self.is_retryable, retryable_bulk, s, self)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1438, in _retry_with_session
return self._retry_internal(retryable, func, session, bulk)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1462, in _retry_internal
with self._get_socket(server, session) as sock_info:
File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line
1309, in _get_socket
self.__all_credentials, handler=err_handler) as sock_info:
File "/usr/local/lib/python3.7/contextlib.py", line 112, in __enter__
return next(self.gen)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1331, in
get_socket
sock_info = self._get_socket(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1397, in
_get_socket
sock_info = self.connect(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 1297, in
connect
sock_info.check_auth(all_credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 820, in
check_auth
self.authenticate(credentials)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 837, in
authenticate
auth.authenticate(credentials, self)
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 672, in
authenticate
auth_func(credentials, sock_info)
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 590, in
_authenticate_default
return _authenticate_scram(credentials, sock_info, 'SCRAM-SHA-1')
File "/usr/local/lib/python3.7/site-packages/pymongo/auth.py", line 295, in
_authenticate_scram
res = sock_info.command(source, cmd)
File "/usr/local/lib/python3.7/site-packages/pymongo/pool.py", line 721, in
command
exhaust_allowed=exhaust_allowed)
File "/usr/local/lib/python3.7/site-packages/pymongo/network.py", line 163,
in command
parse_write_concern_error=parse_write_concern_error)
File "/usr/local/lib/python3.7/site-packages/pymongo/helpers.py", line 167,
in _check_command_response
raise OperationFailure(errmsg, code, response, max_wire_version)
pymongo.errors.OperationFailure: Authentication failed., full error: {'ok':
0.0, 'errmsg': 'Authentication failed.', 'code': 18, 'codeName':
'AuthenticationFailed'} [while running
'WriteToMongoDB/ParDo(_WriteMongoFn)-ptransform-35']
> Task :sdks:python:test-suites:dataflow:py37:mongodbioIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_python_mongoio_load_test/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 288
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 1s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3pa5jqo5w6jae
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
