[jira] [Updated] (SPARK-32543) Remove arrow::as_tibble usage in SparkR
[ https://issues.apache.org/jira/browse/SPARK-32543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32543: - Fix Version/s: 3.0.1 > Remove arrow::as_tibble usage in SparkR > --- > > Key: SPARK-32543 > URL: https://issues.apache.org/jira/browse/SPARK-32543 > Project: Spark > Issue Type: Improvement > Components: SparkR >Affects Versions: 3.1.0 >Reporter: Hyukjin Kwon >Assignee: Hyukjin Kwon >Priority: Trivial > Fix For: 3.0.1, 3.1.0 > > > We increased the minimal version of Arrow R version to 1.0.0 at SPARK-32452, > and Arrow R 0.14 dropped {{as_tibble}}. We can remove the usage in SparkR: > {code} > pkg/R/DataFrame.R: # Arrow drops `as_tibble` since 0.14.0, > see ARROW-5190. > pkg/R/DataFrame.R: if (exists("as_tibble", envir = > asNamespace("arrow"))) { > pkg/R/DataFrame.R: > as.data.frame(arrow::as_tibble(arrowTable), stringsAsFactors = > stringsAsFactors) > pkg/R/deserialize.R:# Arrow drops `as_tibble` since 0.14.0, see > ARROW-5190. > pkg/R/deserialize.R:useAsTibble <- exists("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: as_tibble <- get("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: lapply(batches, function(batch) > as.data.frame(as_tibble(batch))) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32543) Remove arrow::as_tibble usage in SparkR
[ https://issues.apache.org/jira/browse/SPARK-32543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32543: - Priority: Trivial (was: Major) > Remove arrow::as_tibble usage in SparkR > --- > > Key: SPARK-32543 > URL: https://issues.apache.org/jira/browse/SPARK-32543 > Project: Spark > Issue Type: Improvement > Components: SparkR >Affects Versions: 3.1.0 >Reporter: Hyukjin Kwon >Priority: Trivial > > We increased the minimal version of Arrow R version to 1.0.0 at SPARK-32452, > and Arrow R 0.14 dropped {{as_tibble}}. We can remove the usage in SparkR: > {code} > pkg/R/DataFrame.R: # Arrow drops `as_tibble` since 0.14.0, > see ARROW-5190. > pkg/R/DataFrame.R: if (exists("as_tibble", envir = > asNamespace("arrow"))) { > pkg/R/DataFrame.R: > as.data.frame(arrow::as_tibble(arrowTable), stringsAsFactors = > stringsAsFactors) > pkg/R/deserialize.R:# Arrow drops `as_tibble` since 0.14.0, see > ARROW-5190. > pkg/R/deserialize.R:useAsTibble <- exists("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: as_tibble <- get("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: lapply(batches, function(batch) > as.data.frame(as_tibble(batch))) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-32543) Remove arrow::as_tibble usage in SparkR
[ https://issues.apache.org/jira/browse/SPARK-32543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32543: - Summary: Remove arrow::as_tibble usage in SparkR (was: Remove as_tibble usage in SparkR) > Remove arrow::as_tibble usage in SparkR > --- > > Key: SPARK-32543 > URL: https://issues.apache.org/jira/browse/SPARK-32543 > Project: Spark > Issue Type: Improvement > Components: SparkR >Affects Versions: 3.1.0 >Reporter: Hyukjin Kwon >Priority: Major > > We increased the minimal version of Arrow R version to 1.0.0 at SPARK-32452, > and Arrow R 0.14 dropped {{as_tibble}}. We can remove the usage in SparkR: > {code} > pkg/R/DataFrame.R: # Arrow drops `as_tibble` since 0.14.0, > see ARROW-5190. > pkg/R/DataFrame.R: if (exists("as_tibble", envir = > asNamespace("arrow"))) { > pkg/R/DataFrame.R: > as.data.frame(arrow::as_tibble(arrowTable), stringsAsFactors = > stringsAsFactors) > pkg/R/deserialize.R:# Arrow drops `as_tibble` since 0.14.0, see > ARROW-5190. > pkg/R/deserialize.R:useAsTibble <- exists("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: as_tibble <- get("as_tibble", envir = > asNamespace("arrow")) > pkg/R/deserialize.R: lapply(batches, function(batch) > as.data.frame(as_tibble(batch))) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org