Dmytro Sadovnychyi created BEAM-7917:
----------------------------------------
Summary: Python datastore v1new fails on retry
Key: BEAM-7917
URL: https://issues.apache.org/jira/browse/BEAM-7917
Project: Beam
Issue Type: Bug
Components: io-python-gcp, runner-dataflow
Affects Versions: 2.14.0
Environment: Python 3.7 on Dataflow
Reporter: Dmytro Sadovnychyi
Traceback (most recent call last):
File "apache_beam/runners/common.py", line 782, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 454, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/datastoreio.py",
line 334, in process
self._flush_batch()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/datastoreio.py",
line 349, in _flush_batch
throttle_delay=util.WRITE_BATCH_TARGET_LATENCY_MS // 1000)
File "/usr/local/lib/python3.7/site-packages/apache_beam/utils/retry.py",
line 197, in wrapper
return fun(*args, **kwargs)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/io/gcp/datastore/v1new/helper.py",
line 99, in write_mutations
batch.commit()
File
"/usr/local/lib/python3.7/site-packages/google/cloud/datastore/batch.py", line
271, in commit
raise ValueError("Batch must be in progress to commit()")
ValueError: Batch must be in progress to commit()
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
