ohaibbq commented on PR #27474:
URL: https://github.com/apache/beam/pull/27474#issuecomment-1633037751
In addition to the report in #22701, we started seeing the same failure in
our pipelines.
```python
Error message from worker: Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1417, in
apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 623, in
apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1571, in
apache_beam.runners.common._OutputHandler.handle_process_outputs
File
"/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py",
line 1454, in process
for part, size in self.restriction_provider.split_and_size(
File
"/usr/local/lib/python3.9/site-packages/apache_beam/transforms/core.py", line
331, in split_and_size
for part in self.split(element, restriction):
File "/usr/local/lib/python3.9/site-packages/apache_beam/io/iobase.py",
line 1641, in split
estimated_size = restriction.source().estimate_size()
File
"/usr/local/lib/python3.9/site-packages/apache_beam/io/gcp/bigquery.py", line
870, in estimate_size
size = int(job.statistics.totalBytesProcessed)
TypeError: int() argument must be a string, a bytes-like object or a number,
not 'NoneType'
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
