[jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE

2018-09-20 Thread Apache Spark (JIRA) 


[ 
https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622710#comment-16622710
 ] 

Apache Spark commented on SPARK-24572:
--

User 'adrian555' has created a pull request for this issue:
https://github.com/apache/spark/pull/22455

> "eager execution" for R shell, IDE
> --
>
> Key: SPARK-24572
> URL: https://issues.apache.org/jira/browse/SPARK-24572
> Project: Spark
>  Issue Type: Bug
>  Components: SparkR
>Affects Versions: 2.4.0
>Reporter: Felix Cheung
>Priority: Major
>
> like python in SPARK-24215
> we could also have eager execution when SparkDataFrame is returned to the R 
> shell



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE

2018-09-18 Thread Weiqiang Zhuang (JIRA) 


[ 
https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619872#comment-16619872
 ] 

Weiqiang Zhuang commented on SPARK-24572:
-

thanks [~felixcheung], raised PR https://github.com/apache/spark/pull/22455.

> "eager execution" for R shell, IDE
> --
>
> Key: SPARK-24572
> URL: https://issues.apache.org/jira/browse/SPARK-24572
> Project: Spark
>  Issue Type: Bug
>  Components: SparkR
>Affects Versions: 2.4.0
>Reporter: Felix Cheung
>Priority: Major
>
> like python in SPARK-24215
> we could also have eager execution when SparkDataFrame is returned to the R 
> shell



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE

2018-09-17 Thread Felix Cheung (JIRA) 


[ 
https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617120#comment-16617120
 ] 

Felix Cheung commented on SPARK-24572:
--

thanks! very close -  showDF doesn't return anything so we should refactor this 
slight as 

 
{code:java}
setMethod("show", "SparkDataFrame",
  function(object) {
if (identical(sparkR.conf("spark.sql.repl.eagerEval.enabled", 
"false")[[1]], "true")) {
  showDF(object)
} else {
  cols <- lapply(dtypes(object), function(l) {
paste(l, collapse = ":")
  })
  s <- paste(cols, collapse = ", ")
  cat(paste(class(object), "[", s, "]\n", sep = ""))
}
  })

{code}
 

> "eager execution" for R shell, IDE
> --
>
> Key: SPARK-24572
> URL: https://issues.apache.org/jira/browse/SPARK-24572
> Project: Spark
>  Issue Type: Bug
>  Components: SparkR
>Affects Versions: 2.4.0
>Reporter: Felix Cheung
>Priority: Major
>
> like python in SPARK-24215
> we could also have eager execution when SparkDataFrame is returned to the R 
> shell



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE

2018-09-11 Thread Weiqiang Zhuang (JIRA) 


[ 
https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611357#comment-16611357
 ] 

Weiqiang Zhuang commented on SPARK-24572:
-

[~felixcheung] are you thinking of using the same config introduced by the 
SPARK-24215 and doing something like below in red?
{code:java}
setMethod("show", "SparkDataFrame",
  function(object) {
if (identical(sparkR.conf("spark.sql.repl.eagerEval.enabled", 
"false")[[1]], "true")) {
  return(showDF(object))
}
cols <- lapply(dtypes(object), function(l) {
  paste(l, collapse = ":")
})
s <- paste(cols, collapse = ", ")
cat(paste(class(object), "[", s, "]\n", sep = ""))
  })
{code}
 

> "eager execution" for R shell, IDE
> --
>
> Key: SPARK-24572
> URL: https://issues.apache.org/jira/browse/SPARK-24572
> Project: Spark
>  Issue Type: Bug
>  Components: SparkR
>Affects Versions: 2.4.0
>Reporter: Felix Cheung
>Priority: Major
>
> like python in SPARK-24215
> we could also have eager execution when SparkDataFrame is returned to the R 
> shell



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org