[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prashant Sharma updated SPARK-3200: ----------------------------------- Description: Reproducer: {noformat} val a = sc.textFile("README.md").count case class A(i: Int) { val j = a} sc.parallelize(1 to 10).map(A(_)).collect() {noformat} This will happen only in distributed mode, when one refers something that refers sc and not otherwise. There are many ways to work around this, like directly assign a constant value instead of referring the variable. was: Reproducer: {noformat} val a = sc.textFile("README.md").count case class A(i: Int) { val j = a} sc.parallelize(1 to 10).map(A(_)).collect() {noformat} This will happen, when one refers something that refers sc and not otherwise. There are many ways to work around this, like directly assign a constant value instead of referring the variable. > Class defined with reference to external variables crashes in REPL. > ------------------------------------------------------------------- > > Key: SPARK-3200 > URL: https://issues.apache.org/jira/browse/SPARK-3200 > Project: Spark > Issue Type: Bug > Components: Spark Shell > Affects Versions: 1.1.0 > Reporter: Prashant Sharma > Assignee: Prashant Sharma > > Reproducer: > {noformat} > val a = sc.textFile("README.md").count > case class A(i: Int) { val j = a} > sc.parallelize(1 to 10).map(A(_)).collect() > {noformat} > This will happen only in distributed mode, when one refers something that > refers sc and not otherwise. > There are many ways to work around this, like directly assign a constant > value instead of referring the variable. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org