See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/6871/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Better batching for higher fixed costs.

[Robert Bradshaw] Add an option to get the old behavior.

[Robert Bradshaw] lint

[noreply] [BEAM-12164] Enforced only positive state transitions from CREATED ->

[noreply] Added Role-based access control integration tests for Spanner Change

[noreply] Fail the pipeline when a mismatched Python or Beam version is 
detected.


------------------------------------------
[...truncated 17.77 KB...]
  Using cached exceptiongroup-1.1.0-py3-none-any.whl (14 kB)
Collecting attrs>=19.2.0
  Using cached attrs-22.2.0-py3-none-any.whl (60 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0
  Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting pbr>=0.11
  Using cached pbr-5.11.1-py2.py3-none-any.whl (112 kB)
Collecting tomli>=1.0.0
  Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Requirement already satisfied: packaging in 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages>
 (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (23.0)
Collecting iniconfig
  Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages>
 (from pytest<8.0,>=7.1.2->apache-beam==2.46.0.dev0) (1.0.0)
Collecting execnet>=1.1
  Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting pytest-forked
  Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.14-py2.py3-none-any.whl (140 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting charset-normalizer<4,>=2
  Using cached 
charset_normalizer-3.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 (198 kB)
Collecting scipy>=1.3.2
  Using cached 
scipy-1.10.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.4 
MB)
Collecting threadpoolctl>=2.0.0
  Using cached threadpoolctl-3.1.0-py3-none-any.whl (14 kB)
Collecting greenlet!=0.4.17
  Using cached 
greenlet-2.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (613 
kB)
Collecting deprecation
  Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting docker>=4.0.0
  Using cached docker-6.0.1-py3-none-any.whl (147 kB)
Collecting wrapt
  Using cached 
wrapt-1.14.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 (77 kB)
Collecting pymysql
  Using cached PyMySQL-1.0.2-py3-none-any.whl (43 kB)
Collecting pycparser
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0
  Using cached websocket_client-1.5.1-py3-none-any.whl (55 kB)
Requirement already satisfied: py in 
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages>
 (from pytest-forked->pytest-xdist<3,>=2.5.0->apache-beam==2.46.0.dev0) (1.11.0)
Installing collected packages: sortedcontainers, pytz, parameterized, docopt, 
crcmod, charset-normalizer, zstandard, wrapt, websocket-client, urllib3, 
typing-extensions, tomli, threadpoolctl, tenacity, scipy, regex, pyyaml, 
python-dateutil, pyparsing, pymysql, pymongo, pyhamcrest, pycparser, pyarrow, 
psycopg2-binary, proto-plus, pbr, orjson, objsize, joblib, iniconfig, idna, 
greenlet, fasteners, fastavro, execnet, exceptiongroup, dill, deprecation, 
cloudpickle, certifi, attrs, sqlalchemy, scikit-learn, requests, pytest, pydot, 
pandas, mock, hypothesis, httplib2, freezegun, cffi, requests_mock, 
pytest-timeout, pytest-forked, hdfs, docker, cryptography, testcontainers, 
pytest-xdist, apache-beam
  Running setup.py develop for apache-beam
Successfully installed apache-beam-2.46.0.dev0 attrs-22.2.0 certifi-2022.12.7 
cffi-1.15.1 charset-normalizer-3.0.1 cloudpickle-2.2.1 crcmod-1.7 
cryptography-39.0.1 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.1 docopt-0.6.2 
exceptiongroup-1.1.0 execnet-1.9.0 fastavro-1.7.1 fasteners-0.18 
freezegun-1.2.2 greenlet-2.0.2 hdfs-2.7.0 httplib2-0.21.0 hypothesis-6.67.1 
idna-3.4 iniconfig-2.0.0 joblib-1.2.0 mock-2.0.0 objsize-0.6.1 orjson-3.8.5 
pandas-1.5.3 parameterized-0.8.1 pbr-5.11.1 proto-plus-1.22.2 
psycopg2-binary-2.9.5 pyarrow-9.0.0 pycparser-2.21 pydot-1.4.2 
pyhamcrest-1.10.1 pymongo-3.13.0 pymysql-1.0.2 pyparsing-3.0.9 pytest-7.2.1 
pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 
python-dateutil-2.8.2 pytz-2022.7.1 pyyaml-6.0 regex-2022.10.31 requests-2.28.2 
requests_mock-1.10.0 scikit-learn-1.2.1 scipy-1.10.0 sortedcontainers-2.4.0 
sqlalchemy-1.4.46 tenacity-5.1.5 testcontainers-3.7.1 threadpoolctl-3.1.0 
tomli-2.0.1 typing-extensions-4.4.0 urllib3-1.26.14 websocket-client-1.5.1 
wrapt-1.14.1 zstandard-0.19.0
INFO:root:Missing pipeline option (runner). Executing pipeline using the 
default runner: DirectRunner.
INFO:__main__:Writing 100000 documents to mongodb
<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py>:76:
 FutureWarning: WriteToMongoDB is experimental.
  | 'WriteToMongoDB' >> beam.io.WriteToMongoDB(
INFO:root:Default Python SDK image for environment is 
apache/beam_python3.10_sdk:2.46.0.dev
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function annotate_downstream_side_inputs at 0x7f163439b0a0> 
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function fix_side_input_pcoll_coders at 0x7f163439b1c0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function pack_combiners at 0x7f163439b6d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function lift_combiners at 0x7f163439b760> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function expand_sdf at 0x7f163439b910> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function expand_gbk at 0x7f163439b9a0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function sink_flattens at 0x7f163439bac0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function greedily_fuse at 0x7f163439bb50> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function read_to_impulse at 0x7f163439bbe0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function impulse_to_input at 0x7f163439bc70> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function sort_stages at 0x7f163439beb0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function add_impulse_to_dangling_transforms at 0x7f163441c040> 
====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function setup_timer_mapping at 0x7f163439be20> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:====================
 <function populate_data_channel_coders at 0x7f163439bf40> ====================
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 
104857600
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created 
Worker handler 
<apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler
 object at 0x7f163438d060> for environment 
ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO:root:Default Python SDK image for environment is 
apache/beam_python3.10_sdk:2.46.0.dev
INFO:root:Default Python SDK image for environment is 
apache/beam_python3.10_sdk:2.46.0.dev
Traceback (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py";,>
 line 757, in process
    self._flush()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py";,>
 line 763, in _flush
    sink.write(self.batch)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py";,>
 line 796, in write
    resp = self.client[self.db][self.coll].bulk_write(requests)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py";,>
 line 527, in bulk_write
    bulk_api_result = blk.execute(write_concern, session)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py";,>
 line 557, in execute
    return self.execute_command(generator, write_concern, session)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py";,>
 line 366, in execute_command
    with client._tmp_session(session) as s:
  File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 2040, in _tmp_session
    s = self._ensure_session(session)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 2027, in _ensure_session
    return self.__start_session(True, causal_consistency=False)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 1976, in __start_session
    server_session = self._get_server_session()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 2013, in _get_server_session
    return self._topology.get_server_session()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py";,>
 line 525, in get_server_session
    session_timeout = self._check_session_support()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py";,>
 line 507, in _check_session_support
    self._select_servers_loop(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py";,>
 line 226, in _select_servers_loop
    raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27858: [Errno 111] 
Connection refused, Timeout: 30s, Topology Description: <TopologyDescription 
id: 63e2efcd4998e17970aaa83d, topology_type: Single, servers: 
[<ServerDescription ('localhost', 27858) server_type: Unknown, rtt: None, 
error=AutoReconnect('localhost:27858: [Errno 111] Connection refused')>]>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py";,>
 line 170, in <module>
    run()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio_it_test.py";,>
 line 69, in run
    with TestPipeline(options=PipelineOptions(pipeline_args)) as p:
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py";,>
 line 600, in __exit__
    self.result = self.run()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,>
 line 112, in run
    result = super().run(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py";,>
 line 553, in run
    self._options).run(False)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/pipeline.py";,>
 line 577, in run
    return self.runner.run_pipeline(self, self._options)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py";,>
 line 131, in run_pipeline
    return runner.run_pipeline(pipeline, options)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
 line 201, in run_pipeline
    self._latest_run_result = self.run_via_runner_api(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
 line 222, in run_via_runner_api
    return self.run_stages(stage_context, stages)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
 line 453, in run_stages
    bundle_results = self._execute_bundle(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
 line 781, in _execute_bundle
    self._run_bundle(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
 line 1010, in _run_bundle
    result, splits = bundle_manager.process_bundle(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
 line 1346, in process_bundle
    result_future = self._worker_handler.control_conn.push(process_bundle_req)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py";,>
 line 379, in push
    response = self.worker.do_instruction(request)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
 line 596, in do_instruction
    return getattr(self, request_type)(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,>
 line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,>
 line 1026, in process_bundle
    input_op_by_transform_id[element.transform_id].process_encoded(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,>
 line 228, in process_encoded
    self.output(decoded_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 240, in receive
    self.consumer.process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1419, in process
    self._reraise_augmented(exn)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1491, in _reraise_augmented
    raise exn
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 240, in receive
    self.consumer.process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1419, in process
    self._reraise_augmented(exn)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1491, in _reraise_augmented
    raise exn
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 240, in receive
    self.consumer.process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,>
 line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1419, in process
    self._reraise_augmented(exn)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/runners/common.py";,>
 line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py";,>
 line 757, in process
    self._flush()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py";,>
 line 763, in _flush
    sink.write(self.batch)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/apache_beam/io/mongodbio.py";,>
 line 796, in write
    resp = self.client[self.db][self.coll].bulk_write(requests)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/collection.py";,>
 line 527, in bulk_write
    bulk_api_result = blk.execute(write_concern, session)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py";,>
 line 557, in execute
    return self.execute_command(generator, write_concern, session)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/bulk.py";,>
 line 366, in execute_command
    with client._tmp_session(session) as s:
  File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 2040, in _tmp_session
    s = self._ensure_session(session)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 2027, in _ensure_session
    return self.__start_session(True, causal_consistency=False)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 1976, in __start_session
    server_session = self._get_server_session()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/mongo_client.py";,>
 line 2013, in _get_server_session
    return self._topology.get_server_session()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py";,>
 line 525, in get_server_session
    session_timeout = self._check_session_support()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py";,>
 line 507, in _check_session_support
    self._select_servers_loop(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/build/gradleenv/417525523/lib/python3.10/site-packages/pymongo/topology.py";,>
 line 226, in _select_servers_loop
    raise ServerSelectionTimeoutError(
pymongo.errors.ServerSelectionTimeoutError: localhost:27858: [Errno 111] 
Connection refused, Timeout: 30s, Topology Description: <TopologyDescription 
id: 63e2efcd4998e17970aaa83d, topology_type: Single, servers: 
[<ServerDescription ('localhost', 27858) server_type: Unknown, rtt: None, 
error=AutoReconnect('localhost:27858: [Errno 111] Connection refused')>]> 
[while running 'WriteToMongoDB/ParDo(_WriteMongoFn)']

> Task :sdks:python:test-suites:direct:py310:mongodbioIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script 
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_MongoDBIO_IT/ws/src/sdks/python/test-suites/direct/common.gradle'>
 line: 120

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:mongodbioIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4mdpovtnmuha4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to