Carl Boettiger created ARROW-16680:
--------------------------------------
Summary: Weird R error: Error in
fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE
signal
Key: ARROW-16680
URL: https://issues.apache.org/jira/browse/ARROW-16680
Project: Apache Arrow
Issue Type: Bug
Components: R
Affects Versions: 8.0.0
Reporter: Carl Boettiger
Okay apologies, this is a bit of a weird error but is annoying the heck out of
me. The following block of all R code, when run with Rscript (or embedded into
any form of Rmd, quarto, knitr doc) produces the error below (at least most of
the time):
{code:java}
library(arrow)
library(dplyr){code}
{code:java}
Sys.setenv(AWS_EC2_METADATA_DISABLED = "TRUE")
Sys.unsetenv("AWS_ACCESS_KEY_ID")
Sys.unsetenv("AWS_SECRET_ACCESS_KEY")
Sys.unsetenv("AWS_DEFAULT_REGION")
Sys.unsetenv("AWS_S3_ENDPOINT")s3 <- arrow::s3_bucket(bucket = "scores/parquet",
endpoint_override = "data.ecoforecast.org")
ds <- arrow::open_dataset(s3, partitioning = c("theme", "year"))
ds |> dplyr::filter(theme == "phenology") |> dplyr::collect()
{code}
Gives the error
{code:java}
Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) :
ignoring SIGPIPE signal
Calls: %>% ... <Anonymous> -> fs___FileSystem__GetTargetInfos_FileSelector
{code}
But only when run as a script! When run interactively in an R console, this
code runs just fine. Even as a script the code seems to run fine, but
erroneously seems to be attempting this sigpipe I don't understand.
If the script is executed with litter
([https://dirk.eddelbuettel.com/code/littler.html)] then it runs fine, since
littler handles sigpipe but Rscripts don't. But I have no idea why the above
code throws a pipe in the first place. Worse, if I choose a different filter
for the above, like "aquatics", it (usually) works without the error.
I have no idea why `fs___FileSystem__GetTargetInfos_FileSelector` results in
this, but would really appreciate any hints on how to avoid this as it makes it
very hard to use arrow in workflows right now!
thanks for all you do!
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
