Maximilian Michels created BEAM-10260:
-----------------------------------------
Summary: Nested iterable in state cache exceeds Python recursion
limit
Key: BEAM-10260
URL: https://issues.apache.org/jira/browse/BEAM-10260
Project: Beam
Issue Type: Bug
Components: sdk-py-harness
Reporter: Maximilian Michels
Assignee: Maximilian Michels
With state caching enabled, the changes in BEAM-8298 lead to an unbounded
nesting of state iterables when appending to a bag state, quickly resulting in
an exception:
{noformat}
events = list(event_bag.read())
File
"/code/venvs/venv/lib/python3.6/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 488, in __iter__ for elem in self.first:
File
"/code/venvs/venv/lib/python3.6/site-packages/apache_beam/runners/worker/statecache.py",
line 186, in __iter__ for item in value:
File
"/code/venvs/venv/lib/python3.6/site-packages/apache_beam/runners/worker/statecache.py",
line 186, in __iter__ for item in value:
File
"/code/venvs/venv/lib/python3.6/site-packages/apache_beam/runners/worker/statecache.py",
line 186, in __iter__ for item in value: [Previous line repeated 977 more
times]
RecursionError: maximum recursion depth exceeded while calling a Python object
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
