[jira] [Commented] (SPARK-17367) Cannot define value classes in REPL

2016-09-02 Thread Sean Owen (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457870#comment-15457870
 ] 

Sean Owen commented on SPARK-17367:
---

Ah, I see, so it's definitely needed. Hm. I think it's fine to have this issue 
as a pointer. Is there any possible workaround one could imagine for this that 
could be implemented in Spark? if not I am not sure what the action would be 
here. It kind of sounds like SPARK-17368 could be a different manifestation of 
the same problem anyway; it may not even be shell-specific?

> Cannot define value classes in REPL
> ---
>
> Key: SPARK-17367
> URL: https://issues.apache.org/jira/browse/SPARK-17367
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Shell
>Reporter: Jakob Odersky
>
> It is currently not possible to define a class extending `AnyVal` in the 
> REPL. The underlying reason is the {{-Yrepl-class-based}} option used by 
> Spark Shell.
> The report here is more of an FYI for anyone stumbling upon the problem, see 
> the upstream issue [https://issues.scala-lang.org/browse/SI-9910] for any 
> progress.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17367) Cannot define value classes in REPL

2016-09-02 Thread Jakob Odersky (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457862#comment-15457862
 ] 

Jakob Odersky commented on SPARK-17367:
---

You're absolutely correct, it is a Scala issue. I raised it here as well 
though, since the -Yrepl-class-based option was originally created for Spark 
(the standard object-wrapping behaviour had issues with the ClosureCleaner and 
serialization IIRC) and was contributed back to Scala.

Should I close the issue?

> Cannot define value classes in REPL
> ---
>
> Key: SPARK-17367
> URL: https://issues.apache.org/jira/browse/SPARK-17367
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Shell
>Reporter: Jakob Odersky
>
> It is currently not possible to define a class extending `AnyVal` in the 
> REPL. The underlying reason is the {{-Yrepl-class-based}} option used by 
> Spark Shell.
> The report here is more of an FYI for anyone stumbling upon the problem, see 
> the upstream issue [https://issues.scala-lang.org/browse/SI-9910] for any 
> progress.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17367) Cannot define value classes in REPL

2016-09-02 Thread Sean Owen (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457848#comment-15457848
 ] 

Sean Owen commented on SPARK-17367:
---

I doesn't work in the Scala REPL, as SI-9910 indicates. But it is definitely 
caused by -Yrepl-class-based, which the Spark shell sets. It seems like a Scala 
issue then, but, I also don't know if -Yrepl-class-based must be set for Spark 
or what it does. [~prashant_] you might know; is it possible this is just a 
hold-over from old code we don't need? if we need it though, then this isn't 
something Spark can fix unfortunately.

> Cannot define value classes in REPL
> ---
>
> Key: SPARK-17367
> URL: https://issues.apache.org/jira/browse/SPARK-17367
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Shell
>Reporter: Jakob Odersky
>
> It is currently not possible to define a class extending `AnyVal` in the 
> REPL. The underlying reason is the {{-Yrepl-class-based}} option used by 
> Spark Shell.
> The report here is more of an FYI for anyone stumbling upon the problem, see 
> the upstream issue [https://issues.scala-lang.org/browse/SI-9910] for any 
> progress.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17367) Cannot define value classes in REPL

2016-09-02 Thread Aris Vlasakakis (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457816#comment-15457816
 ] 

Aris Vlasakakis commented on SPARK-17367:
-

No, value classes work in the regular Scala REPL, just not spark-shell.

> Cannot define value classes in REPL
> ---
>
> Key: SPARK-17367
> URL: https://issues.apache.org/jira/browse/SPARK-17367
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Shell
>Reporter: Jakob Odersky
>
> It is currently not possible to define a class extending `AnyVal` in the 
> REPL. The underlying reason is the {{-Yrepl-class-based}} option used by 
> Spark Shell.
> The report here is more of an FYI for anyone stumbling upon the problem, see 
> the upstream issue [https://issues.scala-lang.org/browse/SI-9910] for any 
> progress.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-17367) Cannot define value classes in REPL

2016-09-02 Thread Sean Owen (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457802#comment-15457802
 ] 

Sean Owen commented on SPARK-17367:
---

Is this not a Scala REPL issue then?

> Cannot define value classes in REPL
> ---
>
> Key: SPARK-17367
> URL: https://issues.apache.org/jira/browse/SPARK-17367
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Shell
>Reporter: Jakob Odersky
>
> It is currently not possible to define a class extending `AnyVal` in the 
> REPL. The underlying reason is the {{-Yrepl-class-based}} option used by 
> Spark Shell.
> The report here is more of an FYI for anyone stumbling upon the problem, see 
> the upstream issue [https://issues.scala-lang.org/browse/SI-9910] for any 
> progress.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org