[
https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Lian resolved SPARK-13540.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 11421
[https://github.com/apache/spark/pull/11421]
> Nested classes within Scala objects can't be used as Dataset element type
> -------------------------------------------------------------------------
>
> Key: SPARK-13540
> URL: https://issues.apache.org/jira/browse/SPARK-13540
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Cheng Lian
> Assignee: Cheng Lian
> Fix For: 2.0.0
>
>
> Add the following test case to {{DatasetSuite}} to reproduce this issue:
> {code}
> object OuterObject {
> case class InnerClass(a: String)
> }
> test("foo") {
> OuterScopes.addOuterScope(OuterObject)
> Seq(OuterObject.InnerClass("foo")).toDS()
> }
> {code}
> Exception thrown:
> {noformat}
> org.apache.spark.sql.AnalysisException: Unable to generate an encoder for
> inner class `org.apache.spark.sql.OuterObject$InnerClass` without access to
> the scope that this class was defined in.
> {noformat}
> The reason is that an inner class within a Scala object is translated into a
> static nested class, and no outer scope is needed. But the analyzer still
> thinks there should be an outer scope.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
