Hi Jakob, It seems like I’ll have to either replace the version with my custom version in all the pom.xml files in every subdirectory that has one and publish locally, or keep the version (i.e. 2.0.2) and manually remove the spark repository cache in ~/.ivy2 and ~/.m2 and publish spark locally, then compile my application with the correct version respectively to make it work. I think there has to be an elegant way to do this.
> On Dec 6, 2016, at 1:07 PM, Jakob Odersky-2 [via Apache Spark Developers > List] <ml-node+s1001551n20151...@n3.nabble.com> wrote: > > Yes, I think changing the <version> property (line 29) in spark's root > pom.xml should be sufficient. However, keep in mind that you'll also > need to publish spark locally before you can access it in your test > application. > > On Tue, Dec 6, 2016 at 2:50 AM, Teng Long <[hidden email] > <x-msg://50/user/SendEmail.jtp?type=node&node=20151&i=0>> wrote: > > > Thank you Jokob for clearing things up for me. > > > > Before, I thought my application was compiled against my local build since > > I > > can get all the logs I just added in spark-core. But it was all along using > > spark downloaded from remote maven repository, and that’s why I “cannot" > > add > > new RDD methods in. > > > > How can I specify a custom version? modify version numbers in all the > > pom.xml file? > > > > > > > > On Dec 5, 2016, at 9:12 PM, Jakob Odersky <[hidden email] > > <x-msg://50/user/SendEmail.jtp?type=node&node=20151&i=1>> wrote: > > > > m rdds in an "org.apache.spark" package as well > > > > > > --------------------------------------------------------------------- > To unsubscribe e-mail: [hidden email] > <x-msg://50/user/SendEmail.jtp?type=node&node=20151&i=2> > > > > If you reply to this email, your message will be added to the discussion > below: > http://apache-spark-developers-list.1001551.n3.nabble.com/Can-I-add-a-new-method-to-RDD-class-tp20100p20151.html > > <http://apache-spark-developers-list.1001551.n3.nabble.com/Can-I-add-a-new-method-to-RDD-class-tp20100p20151.html> > To unsubscribe from Can I add a new method to RDD class?, click here > <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=20100&code=bG9uZ3RlbmcuY3FAZ21haWwuY29tfDIwMTAwfC0xNzQ1MzUzNzE=>. > NAML > <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Can-I-add-a-new-method-to-RDD-class-tp20100p20157.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
