Will Jones created ARROW-17020:
----------------------------------
Summary: [Python][R] GcsFilesystem can appear to hang for non
permanent errors
Key: ARROW-17020
URL: https://issues.apache.org/jira/browse/ARROW-17020
Project: Apache Arrow
Issue Type: Bug
Components: Python, R
Affects Versions: 8.0.0
Reporter: Will Jones
GcsFileSystem will attempt to retry if it gets a non-permanent error (such as
couldn't connect to server). That's fine, except: (1) the sleep call used by
the retry doesn't seem to check for interrupts and (2) the default retry
timeout is 15 minutes!
The following snippets will hang for 15 minutes if you run them and wait about
5 seconds before trying to do a keyboard interrupt (CTRL+C):
{code:bash}
Rscript -e 'library(arrow); fs <-
GcsFileSystem$create(endpoint_override="localhost:1234", anonymous=TRUE);
fs$CreateDir("x")'
python -c 'from pyarrow.fs import GcsFileSystem; fs =
GcsFileSystem(endpoint_override="localhost:1234", anonymous=True);
fs.create_dir("x")'
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
