[
https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-3266:
------------------------------
Affects Version/s: 1.1.0
JavaRDDLike probably should be an abstract class. I think the current trait
implementation was a holdover from an earlier prototype that attempted to
achieve higher code reuse for operations like map() and filter().
I added a test case to JavaAPISuite that reproduces this issue on master, too.
The simplest solution is probably to make JavaRDDLike into a trait. I think we
can do this while maintaining source compatibility. A less invasive but
messier solution would be to just copy the implementation of max() and min()
into each Java*RDD class and remove it from the trait.
> JavaDoubleRDD doesn't contain max()
> -----------------------------------
>
> Key: SPARK-3266
> URL: https://issues.apache.org/jira/browse/SPARK-3266
> Project: Spark
> Issue Type: Bug
> Components: Java API
> Affects Versions: 1.0.1, 1.0.2, 1.1.0
> Reporter: Amey Chaugule
> Assignee: Josh Rosen
> Attachments: spark-repro-3266.tar.gz
>
>
> While I can compile my code, I see:
> Caused by: java.lang.NoSuchMethodError:
> org.apache.spark.api.java.JavaDoubleRDD.max(Ljava/util/Comparator;)Ljava/lang/Double;
> When I try to execute my Spark code. Stepping into the JavaDoubleRDD class, I
> don't notice max()
> although it is clearly listed in the documentation.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
