[
https://issues.apache.org/jira/browse/ARROW-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicola Crane updated ARROW-17699:
---------------------------------
Description:
The issue here comes from accidentally passing in the schema function instead
of the created schema object, but the error message isn't helpful
{code:r}
library(dplyr)
desired_schema <- schema(mpg = float64(), disp = float64(), hp = int64(), drat
= float64(),
wt = float64(), qsec = float64(), vs = int64(), am = int64(),
gear = int64(), carb = int64(), cyl = int64())
tf <- tempfile()
dir.create(tf)
write_dataset(group_by(mtcars, cyl), tf, format = "csv", hive_style = FALSE)
open_dataset(tf, format = "csv", schema = schema) %>% collect()
#> Error in `CsvFileFormat$create()`:
#> ! Values in `column_names` must match `schema` field names
#> ✖ `column_names` and `schema` field names match but are not in the same order
{code}
was:
The issue here comes from accidentally passing in the schema function instead
of the created schema object, but the error message isn't helpful
{code:r}
library(dplyr)
desired_schema <- schema(mpg = float64(), disp = float64(), hp = int64(), drat
= float64(),
wt = float64(), qsec = float64(), vs = int64(), am = int64(),
gear = int64(), carb = int64(), cyl = int64())
tf <- tempfile()
dir.create(tf)
write_dataset(group_by(mtcars, cyl), tf, format = "csv", hive_style = FALSE)
open_dataset(tf, format = "csv", schema = schema) %>% collect()
#> Error in `CsvFileFormat$create()`:
#> ! Values in `column_names` must match `schema` field names
#> ✖ `column_names` and `schema` field names match but are not in the same order
list.files(tf)
#> [1] "4" "6" "8"
{code}
> [R] Add better error message for if a non-schema passed into open_dataset()
> ---------------------------------------------------------------------------
>
> Key: ARROW-17699
> URL: https://issues.apache.org/jira/browse/ARROW-17699
> Project: Apache Arrow
> Issue Type: Bug
> Components: R
> Reporter: Nicola Crane
> Assignee: Nicola Crane
> Priority: Major
>
> The issue here comes from accidentally passing in the schema function instead
> of the created schema object, but the error message isn't helpful
> {code:r}
> library(dplyr)
> desired_schema <- schema(mpg = float64(), disp = float64(), hp = int64(),
> drat = float64(),
> wt = float64(), qsec = float64(), vs = int64(), am = int64(),
> gear = int64(), carb = int64(), cyl = int64())
> tf <- tempfile()
> dir.create(tf)
> write_dataset(group_by(mtcars, cyl), tf, format = "csv", hive_style = FALSE)
> open_dataset(tf, format = "csv", schema = schema) %>% collect()
> #> Error in `CsvFileFormat$create()`:
> #> ! Values in `column_names` must match `schema` field names
> #> ✖ `column_names` and `schema` field names match but are not in the same
> order
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
