Eamon Ford created SDAP-302:
-------------------------------
Summary: Collection Manager crashes when Collections Config is
updated while actively scanning S3 dirs
Key: SDAP-302
URL: https://issues.apache.org/jira/browse/SDAP-302
Project: Apache Science Data Analytics Platform
Issue Type: Bug
Reporter: Eamon Ford
If new collections are added to the collections config while the Collection
Manager is in the middle of actively scanning S3 directories, then the
Collection Manager prints the following error:
{{ERROR:asyncio:Task exception was never retrieved}}
{{future: <Task finished name='Task-7319' coro=<S3Observer._run_periodically()
done, defined at
/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py:55>
exception=RuntimeError('Set changed size during iteration')>}}
{{Traceback (most recent call last):}}
{{ File
"/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py",
line 71, in _run_periodically}}
{{ await func(*args, **kwargs)}}
{{ File
"/usr/local/lib/python3.8/site-packages/sdap_collection_manager-1.0.0.dev0-py3.8.egg/collection_manager/services/S3Observer.py",
line 78, in _poll}}
{{ for watch in self._watches:}}
{{RuntimeError: Set changed size during iteration}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
