[ https://issues.apache.org/jira/browse/SPARK-32543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-32543: ------------------------------------ Assignee: (was: Apache Spark) > Remove arrow::as_tibble usage in SparkR > --------------------------------------- > > Key: SPARK-32543 > URL: https://issues.apache.org/jira/browse/SPARK-32543 > Project: Spark > Issue Type: Improvement > Components: SparkR > Affects Versions: 3.1.0 > Reporter: Hyukjin Kwon > Priority: Major > > We increased the minimal version of Arrow R version to 1.0.0 at SPARK-32452, > and Arrow R 0.14 dropped {{as_tibble}}. We can remove the usage in SparkR: > {code} > pkg/R/DataFrame.R: # Arrow drops `as_tibble` since 0.14.0, > see ARROW-5190. > pkg/R/DataFrame.R: if (exists("as_tibble", envir = > asNamespace("arrow"))) { > pkg/R/DataFrame.R: > as.data.frame(arrow::as_tibble(arrowTable), stringsAsFactors = > stringsAsFactors) > pkg/R/deserialize.R: # Arrow drops `as_tibble` since 0.14.0, see > ARROW-5190. > pkg/R/deserialize.R: useAsTibble <- exists("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: as_tibble <- get("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: lapply(batches, function(batch) > as.data.frame(as_tibble(batch))) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org