tvalentyn commented on issue #22402:
URL: https://github.com/apache/beam/issues/22402#issuecomment-1201533720
@pranavbhandari24 also reported the following error:
```
Error message from worker: Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1465, in
apache_beam.runners.common.DoFnRunner._invoke_lifecycle_method
File "apache_beam/runners/common.py", line 551, in
apache_beam.runners.common.DoFnInvoker.invoke_setup
File
"/usr/local/lib/python3.7/site-packages/apache_beam/ml/inference/base.py", line
374, in setup
self._model = self._load_model()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/ml/inference/base.py", line
369, in _load_model
return self._shared_model_handle.acquire(load)
File "/usr/local/lib/python3.7/site-packages/apache_beam/utils/shared.py",
line 305, in acquire
return _shared_map.acquire(self._key, constructor_fn, tag)
File "/usr/local/lib/python3.7/site-packages/apache_beam/utils/shared.py",
line 246, in acquire
result = control_block.acquire(constructor_fn, tag)
File "/usr/local/lib/python3.7/site-packages/apache_beam/utils/shared.py",
line 139, in acquire
result = constructor_fn()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/ml/inference/base.py", line
358, in load
model = self._model_handler.load_model()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/ml/inference/sklearn_inference.py",
line 100, in load_model
return _load_model(self._model_uri, self._model_file_type)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/ml/inference/sklearn_inference.py",
line 51, in _load_model
return pickle.load(file)
_pickle.UnpicklingError: pickle data was truncated
```
We originally thought that the model was corrupted at storage location, but
maybe we have an issue with loading the model over Beam IOs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
