[ https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929275#comment-15929275 ]
Michael Armbrust commented on SPARK-19982: ------------------------------------------ I'm not sure if changing weak to strong references will change [anything|http://stackoverflow.com/questions/299659/what-is-the-difference-between-a-soft-reference-and-a-weak-reference-in-java]. It seems like there must be another handle to {{this}} since the test harness is actively executing it. So either way it shouldn't be available for garbage collection, or am I missing something? > JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate > an encoder for inner class" > --------------------------------------------------------------------------------------------------------- > > Key: SPARK-19982 > URL: https://issues.apache.org/jira/browse/SPARK-19982 > Project: Spark > Issue Type: Bug > Components: Tests > Affects Versions: 2.1.0 > Reporter: Jose Soltren > Labels: flaky-test > > JavaDatasetSuite.testJavaBeanEncoder fails sporadically with the error below: > Unable to generate an encoder for inner class > `test.org.apache.spark.sql.JavaDatasetSuite$SimpleJavaBean` without access to > the scope that this class was defined in. Try moving this class out of its > parent class. > From https://spark-tests.appspot.com/test-logs/35475788 > [~vanzin] looked into this back in October and reported: > I ran this test in a loop (both alone and with the rest of the spark-sql > tests) and never got a failure. I even used the same JDK as Jenkins > (1.7.0_51). > Also looked at the code and nothing seems wrong. The errors is when an entry > with the parent class name is missing from the map kept in OuterScopes.scala, > but the test populates that map in its first line. So it doesn't look like a > race nor some issue with weak references (the map uses weak values). > public void testJavaBeanEncoder() { > OuterScopes.addOuterScope(this); -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org