Re: Can the R interface to write_parquet accept strings?

2019-09-09 Thread Wes McKinney
I'm referring to the arrow-devel and parquet-devel packages, which are C++ packages. If you built the R library (using install.package) against version 0.14.0 and then upgraded arrow-devel to 0.14.1 without rebuilding the R library, you could have this issue. I would recommend reinstalling the R

Re: Can the R interface to write_parquet accept strings?

2019-09-09 Thread Daniel Feenberg
On Mon, 9 Sep 2019, Wes McKinney wrote: I'm a bit confused by the error message " Error in write_parquet_file(to_arrow(table), file) : Arrow error: IOError: Metadata contains Thrift LogicalType that is not recognized. " This error comes from

Re: Can the R interface to write_parquet accept strings?

2019-09-09 Thread Wes McKinney
I'm a bit confused by the error message " Error in write_parquet_file(to_arrow(table), file) : Arrow error: IOError: Metadata contains Thrift LogicalType that is not recognized. " This error comes from https://github.com/apache/arrow/blob/master/cpp/src/parquet/types.cc#L455 This

Re: Can the R interface to write_parquet accept strings?

2019-09-09 Thread Daniel Feenberg
On Mon, 9 Sep 2019, Neal Richardson wrote: Hi Daniel, This works on my machine: library(arrow) write_parquet(data.frame(y = c("a", "b", "c"), stringsAsFactors=FALSE), file= "string.parquet") read_parquet("string.parquet") y 1 a 2 b 3 c (The function masking warnings are all from

Re: Can the R interface to write_parquet accept strings?

2019-09-09 Thread Neal Richardson
Hi Daniel, This works on my machine: > library(arrow) > write_parquet(data.frame(y = c("a", "b", "c"), stringsAsFactors=FALSE), file= > "string.parquet") > read_parquet("string.parquet") y 1 a 2 b 3 c > (The function masking warnings are all from library(tidyverse) and aren't relevant here.)

Can the R interface to write_parquet accept strings?

2019-09-08 Thread Daniel Feenberg
Can the R interface to Arrow Parquet write string data? Take the following script: library(arrow) library(tidyverse) write_parquet(table = tibble(y = c("a", "b", "c")), file = "string.parquet") I get the error message: Error in write_parquet_file(to_arrow(table), file) : Arrow