zpz commented on issue #35318:
URL: https://github.com/apache/arrow/issues/35318#issuecomment-1552185807
My code does have the problem that as I loop through the hundreds of files,
previous files stay around. Now I avoided that situation, still got error after
333 files:
```
error after 0.4439328750013374 seconds
<class 'pyarrow.lib.ArrowException'>
Unknown error: google::cloud::Status(UNKNOWN: Permanent error
ReadObjectNotWrapped: WaitForHandles(): unexpected error code in curl_multi_*,
[12]=Unrecoverable error in select/poll)
('Unknown error: google::cloud::Status(UNKNOWN: Permanent error
ReadObjectNotWrapped: WaitForHandles(): unexpected error code in curl_multi_*,
[12]=Unrecoverable error in select/poll)',)
.
.
.
File "/usr/local/lib/python3.10/site-packages/biglist/_parquet.py", line
171, in __len__
return self.num_rows
File "/usr/local/lib/python3.10/site-packages/biglist/_parquet.py", line
203, in num_rows
return self.metadata.num_rows
File "/usr/local/lib/python3.10/site-packages/biglist/_parquet.py", line
199, in metadata
return self.file.metadata
File "/usr/local/lib/python3.10/site-packages/biglist/_parquet.py", line
194, in file
self._file = self.load_file(self.path, lazy=self.lazy)
File "/usr/local/lib/python3.10/site-packages/biglist/_parquet.py", line
97, in load_file
file = ParquetFile(pp, filesystem=ff)
File "/usr/local/lib/python3.10/site-packages/pyarrow/parquet/core.py",
line 334, in __init__
self.reader.open(
File "pyarrow/_parquet.pyx", line 1220, in
pyarrow._parquet.ParquetReader.open
File "pyarrow/error.pxi", line 138, in pyarrow.lib.check_status
pyarrow.lib.ArrowException: Unknown error: google::cloud::Status(UNKNOWN:
Permanent error ReadObjectNotWrapped: WaitForHandles(): unexpected error code
in curl_multi_*, [12]=Unrecoverable error in select/poll)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
