I've never used it, but reading the help it seems the "-am" option might help here.
On Fri, Dec 5, 2014 at 4:47 PM, Sean Owen <so...@cloudera.com> wrote: > Maven definitely compiles "what is needed", but not if you tell it to > only compile one module alone. Unless you have previously built and > installed the other local snapshot artifacts it needs, that invocation > can't proceed because you have restricted it to build one module whose > dependencies don't exist. > > On Fri, Dec 5, 2014 at 6:44 PM, Koert Kuipers <ko...@tresata.com> wrote: >> i think what changed is that core now has dependencies on other sub >> projects. ok... so i am forced to install stuff because maven cannot compile >> "what is needed". i will install >> >> On Fri, Dec 5, 2014 at 7:12 PM, Koert Kuipers <ko...@tresata.com> wrote: >>> >>> i suddenly also run into the issue that maven is trying to download >>> snapshots that dont exists for other sub projects. >>> >>> did something change in the maven build? >>> >>> does maven not have capability to smartly compile the other sub-projects >>> that a sub-project depends on? >>> >>> i rather avoid "mvn install" since this creates a local maven repo. i have >>> been stung by that before (spend a day trying to do something and got weird >>> errors because some toy version i once build was stuck in my local maven >>> repo and it somehow got priority over a real maven repo). >>> >>> On Fri, Dec 5, 2014 at 5:28 PM, Marcelo Vanzin <van...@cloudera.com> >>> wrote: >>>> >>>> You can set SPARK_PREPEND_CLASSES=1 and it should pick your new mllib >>>> classes whenever you compile them. >>>> >>>> I don't see anything similar for examples/, so if you modify example >>>> code you need to re-build the examples module ("package" or "install" >>>> - just "compile" won't work, since you need to build the new jar). >>>> >>>> On Thu, Dec 4, 2014 at 10:23 PM, MEETHU MATHEW <meethu2...@yahoo.co.in> >>>> wrote: >>>> > Hi all, >>>> > >>>> > I made some code changes in mllib project and as mentioned in the >>>> > previous >>>> > mails I did >>>> > >>>> > mvn install -pl mllib >>>> > >>>> > Now I run a program in examples using run-example, the new code is not >>>> > executing.Instead the previous code itself is running. >>>> > >>>> > But if I do an "mvn install" in the entire spark project , I can see >>>> > the >>>> > new code running.But installing the entire spark takes a lot of time >>>> > and so >>>> > its difficult to do this each time I make some changes. >>>> > >>>> > Can someone tell me how to compile mllib alone and get the changes >>>> > working? >>>> > >>>> > Thanks & Regards, >>>> > Meethu M >>>> > >>>> > >>>> > On Friday, 28 November 2014 2:39 PM, MEETHU MATHEW >>>> > <meethu2...@yahoo.co.in> >>>> > wrote: >>>> > >>>> > >>>> > Hi, >>>> > I have a similar problem.I modified the code in mllib and examples. >>>> > I did >>>> > mvn install -pl mllib >>>> > mvn install -pl examples >>>> > >>>> > But when I run the program in examples using run-example,the older >>>> > version >>>> > of mllib (before the changes were made) is getting executed. >>>> > How to get the changes made in mllib while calling it from examples >>>> > project? >>>> > >>>> > Thanks & Regards, >>>> > Meethu M >>>> > >>>> > >>>> > On Monday, 24 November 2014 3:33 PM, Yiming (John) Zhang >>>> > <sdi...@gmail.com> >>>> > wrote: >>>> > >>>> > >>>> > Thank you, Marcelo and Sean, "mvn install" is a good answer for my >>>> > demands. >>>> > >>>> > -----邮件原件----- >>>> > 发件人: Marcelo Vanzin [mailto:van...@cloudera.com] >>>> > 发送时间: 2014年11月21日 1:47 >>>> > 收件人: yiming zhang >>>> > 抄送: Sean Owen; user@spark.apache.org >>>> > 主题: Re: How to incrementally compile spark examples using mvn >>>> > >>>> > Hi Yiming, >>>> > >>>> > On Wed, Nov 19, 2014 at 5:35 PM, Yiming (John) Zhang <sdi...@gmail.com> >>>> > wrote: >>>> >> Thank you for your reply. I was wondering whether there is a method of >>>> >> reusing locally-built components without installing them? That is, if >>>> >> I have >>>> >> successfully built the spark project as a whole, how should I >>>> >> configure it >>>> >> so that I can incrementally build (only) the "spark-examples" sub >>>> >> project >>>> >> without the need of downloading or installation? >>>> > >>>> > As Sean suggest, you shouldn't need to install anything. After "mvn >>>> > install", your local repo is a working Spark installation, and you can >>>> > use >>>> > spark-submit and other tool directly within it. >>>> > >>>> > You just need to remember to rebuild the assembly/ project when >>>> > modifying >>>> > Spark code (or the examples/ project when modifying examples). >>>> > >>>> > >>>> > -- >>>> > Marcelo >>>> > >>>> > >>>> > --------------------------------------------------------------------- >>>> > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>>> > For additional commands, e-mail: user-h...@spark.apache.org >>>> > >>>> > >>>> > >>>> > >>>> >>>> >>>> >>>> -- >>>> Marcelo >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>>> For additional commands, e-mail: user-h...@spark.apache.org >>>> >>> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org