Hey- I tried it again, I don't think it eliminated any of them? Will post error log to ASF Slack channel.
On Tue, May 19, 2020 at 11:42 AM Christofer Dutz <christofer.d...@c-ware.de> wrote: > Hi All, > > I just pushed some changes to my fork ... it should eliminate most of the > ClassNotFoundExceptions. > > > Chris > > > > Am 19.05.20, 12:06 schrieb "Christofer Dutz" <christofer.d...@c-ware.de>: > > Hi all, > > sure ... if you send me the list, I can try to find out what's going > on (or not going on) > > Chris > > > > Am 19.05.20, 12:01 schrieb "Trevor Grant" <trevor.d.gr...@gmail.com>: > > Hey- sorry for not following up here. I thought I had emailed this > last > week ( I was actually just digging around to find out why no one > had > responded ... the answer was I never sent the email.) > > Built a docker container with Ubuntu 18.04 ( has java 11) > > Kept failing on > ``` > java.lang.IllegalArgumentException: Unsupported class file major > version 55 > at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:166) > ``` > > This is a known issue in Spark too, feel free to google it - but > the gist > is- we won't be able to officially support Java 11, though a > clever person > _can_ hack around this. Spark also does not support Java 11 for > same > reasons. > > Built another container with the following docker file: > ``` > FROM openjdk:8 > RUN apt update && apt install git maven -y > RUN git clone https://github.com/chrisdutz/mahout.git /mahout > RUN cd /mahout && mvn clean package > ``` > > This one fails in the old "Map Reduce" based Mahout. In the tests > there's > 1000 "NoClassDef" and Null pointed failures, which leads me to > believe > something got moved in the refactor. (I've got a text file of the > output I > can send too, but this, bc of Dockers, _should_ be very > reproducible). > > If someone else could confirm, that would be cool. > > > On Fri, May 8, 2020 at 1:20 PM Trevor Grant < > trevor.d.gr...@gmail.com> > wrote: > > > My next plan is to just make dockers of java 8/9/10 and try > building in > > there. if it works cool, if it doesn't ill let chris know. What > was your > > build result? > > > > On Fri, May 8, 2020 at 1:19 PM Trevor Grant < > trevor.d.gr...@gmail.com> > > wrote: > > > >> No one came :( > >> > >> On Fri, May 8, 2020 at 1:08 PM Andrew Musselman < > >> andrew.mussel...@gmail.com> wrote: > >> > >>> Looks like my meeting ran over top of it; any outcomes? > >>> > >>> On Fri, May 8, 2020 at 06:57 Andrew Musselman < > >>> andrew.mussel...@gmail.com> > >>> wrote: > >>> > >>> > I'll be there at quarter after > >>> > > >>> > On Fri, May 8, 2020 at 06:51 Trevor Grant < > trevor.d.gr...@gmail.com> > >>> > wrote: > >>> > > >>> >> Who can be there for this today? > >>> >> > >>> >> On Fri, Apr 24, 2020 at 8:31 AM Andrew Musselman < > >>> >> andrew.mussel...@gmail.com> > >>> >> wrote: > >>> >> > >>> >> > Alright, great; here's the link to join: > >>> >> > > >>> >> > > >>> >> > >>> > https://hangouts.google.com/hangouts/_/calendar/YW5kcmV3Lm11c3NlbG1hbkBnbWFpbC5jb20.4tg9vg3t51gjlco0ebl5siim1s > >>> >> > > >>> >> > On Fri, Apr 24, 2020 at 02:19 Christofer Dutz < > >>> >> christofer.d...@c-ware.de> > >>> >> > wrote: > >>> >> > > >>> >> > > Hi all, > >>> >> > > > >>> >> > > just found the email with the time for the call today > ... that's > >>> >> 19:00 / > >>> >> > > 7pm here ... perfect. > >>> >> > > Would just need some information on how to join. > >>> >> > > > >>> >> > > Chris > >>> >> > > > >>> >> > > > >>> >> > > Am 20.04.20, 17:31 schrieb "Andrew Musselman" < > >>> >> > andrew.mussel...@gmail.com > >>> >> > > >: > >>> >> > > > >>> >> > > Thanks Chris, will take a look at your PR. > >>> >> > > > >>> >> > > I think we would be fine upgrading anything that is > still > >>> making > >>> >> > > improvements, probably makes sense to discuss > Friday on our > >>> call > >>> >> if > >>> >> > > you can > >>> >> > > make it. > >>> >> > > > >>> >> > > Best > >>> >> > > Andrew > >>> >> > > > >>> >> > > On Mon, Apr 20, 2020 at 1:53 AM Christofer Dutz < > >>> >> > > christofer.d...@c-ware.de> > >>> >> > > wrote: > >>> >> > > > >>> >> > > > Hi Folks, > >>> >> > > > > >>> >> > > > so I've now tested the build with java 1.8, 9, 10 > and they > >>> work > >>> >> ... > >>> >> > > > 11 I'm getting errors about unsupported java > major versions > >>> >> again > >>> >> > ... > >>> >> > > > guess there's some old library version in there > somewhere. > >>> >> > > > > >>> >> > > > But at least I managed to get you out of this 1.7 > trap. > >>> >> > > > > >>> >> > > > Chris > >>> >> > > > > >>> >> > > > > >>> >> > > > Am 20.04.20, 09:46 schrieb "Christofer Dutz" < > >>> >> > > christofer.d...@c-ware.de>: > >>> >> > > > > >>> >> > > > Hi folks, > >>> >> > > > > >>> >> > > > so I was now able to build (including all > tests) with > >>> Java 8 > >>> >> > and > >>> >> > > 9 ... > >>> >> > > > currently trying 10 ... > >>> >> > > > > >>> >> > > > Are there any objection that some maven > dependencies get > >>> >> > updated > >>> >> > > to > >>> >> > > > more recent versions? I mean ... the hbase-client > you're > >>> using > >>> >> is > >>> >> > > more than > >>> >> > > > 5 years old ... > >>> >> > > > > >>> >> > > > Chris > >>> >> > > > > >>> >> > > > > >>> >> > > > Am 20.04.20, 00:29 schrieb "Andrew Musselman" > < > >>> >> > > > andrew.mussel...@gmail.com>: > >>> >> > > > > >>> >> > > > No problem; would 10:00 a.m. Pacific next > Friday the > >>> >> 24th > >>> >> > > work for > >>> >> > > > you time > >>> >> > > > zone-wise? > >>> >> > > > > >>> >> > > > On Sun, Apr 19, 2020 at 12:15 PM > Christofer Dutz < > >>> >> > > > christofer.d...@c-ware.de> > >>> >> > > > wrote: > >>> >> > > > > >>> >> > > > > Sorry ... > >>> >> > > > > > >>> >> > > > > didn't see your response ... into > Mahout too deep > >>> ;-) > >>> >> > > > > Guess we have to postpone this to > sometime over > >>> the > >>> >> week. > >>> >> > > > > > >>> >> > > > > Chris > >>> >> > > > > > >>> >> > > > > > >>> >> > > > > Am 19.04.20, 19:56 schrieb "Andrew > Musselman" < > >>> >> > > > andrew.mussel...@gmail.com > >>> >> > > > > >: > >>> >> > > > > > >>> >> > > > > *what time > >>> >> > > > > > >>> >> > > > > On Sun, Apr 19, 2020 at 10:51 Andrew > >>> Musselman < > >>> >> > > > > andrew.mussel...@gmail.com> > >>> >> > > > > wrote: > >>> >> > > > > > >>> >> > > > > > I think it's safe to move to 1.8; > yeah what > >>> >> tune is > >>> >> > > good > >>> >> > > > for you? > >>> >> > > > > I'm in > >>> >> > > > > > Pacific time zone and am flexible > this > >>> >> afternoon. > >>> >> > > > > > > >>> >> > > > > > Trevor you free? > >>> >> > > > > > > >>> >> > > > > > On Sun, Apr 19, 2020 at 09:37 > Christofer > >>> Dutz < > >>> >> > > > > christofer.d...@c-ware.de> > >>> >> > > > > > wrote: > >>> >> > > > > > > >>> >> > > > > >> Yikes! ... well guess then I > can't help you > >>> >> folks > >>> >> > > as it's > >>> >> > > > almost > >>> >> > > > > >> impossible to get my hands on a > 1.7 > >>> version. > >>> >> > > > > >> > >>> >> > > > > >> What's preventing you from going > to 1.8+? > >>> >> > > > > >> > >>> >> > > > > >> Any your build says 1.8 and > above: > >>> >> > > > > >> <requireJavaVersion> > >>> >> > > > > >> > <version>[1.8,)</version> > >>> >> > > > > >> > </requireJavaVersion> > >>> >> > > > > >> > >>> >> > > > > >> Regarding the artifacts ... > would it be ok > >>> to > >>> >> have > >>> >> > > the > >>> >> > > > maven > >>> >> > > > > artifacts > >>> >> > > > > >> using classifiers and perhaps > the files in > >>> the > >>> >> > libs > >>> >> > > and > >>> >> > > > > distribution to > >>> >> > > > > >> follow the typical scala sheme? > >>> >> > > > > >> > >>> >> > > > > >> Chris > >>> >> > > > > >> > >>> >> > > > > >> Am 19.04.20, 17:56 schrieb > "Trevor Grant" < > >>> >> > > > trevor.d.gr...@gmail.com > >>> >> > > > > >: > >>> >> > > > > >> > >>> >> > > > > >> Yea, we have a requirement > on 1.7. we > >>> need > >>> >> to > >>> >> > > get it > >>> >> > > > up to 8, > >>> >> > > > > but > >>> >> > > > > >> considered that a different > issue. > >>> >> > > > > >> > >>> >> > > > > >> Maven throws warning, sbt > breaks down > >>> >> entirely > >>> >> > > (when > >>> >> > > > importing)- > >>> >> > > > > >> hence why > >>> >> > > > > >> we were using a script to > replace 2.11 > >>> w > >>> >> 2.12 > >>> >> > > > > >> > >>> >> > > > > >> On Sun, Apr 19, 2020, 10:33 > AM > >>> Christofer > >>> >> > Dutz < > >>> >> > > > > >> christofer.d...@c-ware.de> > >>> >> > > > > >> wrote: > >>> >> > > > > >> > >>> >> > > > > >> > Well I have been compiling > with > >>> various > >>> >> jdks > >>> >> > > from 8 > >>> >> > > > to 14. > >>> >> > > > > However I > >>> >> > > > > >> > noticed that if I select a > jdk and > >>> start > >>> >> the > >>> >> > > build > >>> >> > > > that the > >>> >> > > > > Scala > >>> >> > > > > >> parts > >>> >> > > > > >> > Seefahrt to the version in > my systems > >>> >> path. > >>> >> > > Which > >>> >> > > > then > >>> >> > > > > results in > >>> >> > > > > >> all sorts > >>> >> > > > > >> > of major version problems. > >>> >> > > > > >> > > >>> >> > > > > >> > For the Scalatest plugin I > managed to > >>> >> have > >>> >> > it > >>> >> > > use > >>> >> > > > the maven > >>> >> > > > > >> java.home... > >>> >> > > > > >> > The Scala compiler is > being a little > >>> >> > trickyer. > >>> >> > > > > >> > > >>> >> > > > > >> > Will continue this > evening. Keep your > >>> >> > fingers > >>> >> > > > crossed. > >>> >> > > > > >> > > >>> >> > > > > >> > Also does maven totally > not like > >>> >> variables > >>> >> > in > >>> >> > > > artifactids. > >>> >> > > > > >> > > >>> >> > > > > >> > Chris > >>> >> > > > > >> > > ________________________________ > >>> >> > > > > >> > Von: Trevor Grant < > >>> >> trevor.d.gr...@gmail.com > >>> >> > > > >>> >> > > > > >> > Gesendet: Sonntag, 19. > April 2020 > >>> 15:41 > >>> >> > > > > >> > An: Mahout Dev List < > >>> >> dev@mahout.apache.org> > >>> >> > > > > >> > Betreff: Re: Hi ... need > some help? > >>> >> > > > > >> > > >>> >> > > > > >> > Hey Chris, > >>> >> > > > > >> > > >>> >> > > > > >> > First of all- thank you so > much for > >>> your > >>> >> > work > >>> >> > > so > >>> >> > > > far. > >>> >> > > > > >> > > >>> >> > > > > >> > The build 100% currently > works, the > >>> only > >>> >> > > issue is > >>> >> > > > with > >>> >> > > > > releasing > >>> >> > > > > >> binaries. > >>> >> > > > > >> > Are you compiling w 1.7? > Not really > >>> sure > >>> >> why > >>> >> > > > artifact IDs are > >>> >> > > > > >> changing? > >>> >> > > > > >> > That's very strange. > >>> >> > > > > >> > > >>> >> > > > > >> > To answer your question > regarding the > >>> >> > > community > >>> >> > > > block- no, it > >>> >> > > > > is > >>> >> > > > > >> not as if > >>> >> > > > > >> > there is a company that > pays us to > >>> work > >>> >> on > >>> >> > > Mahout > >>> >> > > > and the > >>> >> > > > > rest is > >>> >> > > > > >> > community. What it means > is that > >>> while we > >>> >> > > > appreciate those > >>> >> > > > > code > >>> >> > > > > >> > contributions, no one > still actively > >>> >> > involved > >>> >> > > is > >>> >> > > > maintaining > >>> >> > > > > them > >>> >> > > > > >> and we > >>> >> > > > > >> > advise people to use at > their own > >>> risk. > >>> >> The > >>> >> > > > refactor to a > >>> >> > > > > >> `community` > >>> >> > > > > >> > folder was meant to > reflect the > >>> reality > >>> >> of > >>> >> > the > >>> >> > > > situation. > >>> >> > > > > >> > > >>> >> > > > > >> > The only test issues I was > aware of > >>> were > >>> >> > with > >>> >> > > > Javadocs when > >>> >> > > > > trying > >>> >> > > > > >> to do a > >>> >> > > > > >> > release with Java 1.8+ > those would > >>> fail > >>> >> due > >>> >> > to > >>> >> > > > formatting. > >>> >> > > > > >> > > >>> >> > > > > >> > I feel like you're hitting > some > >>> unique > >>> >> > > issues, and > >>> >> > > > maybe we > >>> >> > > > > could > >>> >> > > > > >> help you > >>> >> > > > > >> > out / there may exist > simple > >>> solutions. > >>> >> > > > > >> > > >>> >> > > > > >> > Thank you again for your > help! > >>> >> > > > > >> > > >>> >> > > > > >> > tg > >>> >> > > > > >> > > >>> >> > > > > >> > > >>> >> > > > > >> > > >>> >> > > > > >> > > >>> >> > > > > >> > On Sun, Apr 19, 2020 at > 2:17 AM > >>> >> Christofer > >>> >> > > Dutz < > >>> >> > > > > >> christofer.d...@c-ware.de > >>> >> > > > > >> > > > >>> >> > > > > >> > wrote: > >>> >> > > > > >> > > >>> >> > > > > >> > > Hi folks, > >>> >> > > > > >> > > > >>> >> > > > > >> > > So yesterday I invested > several > >>> hours > >>> >> in > >>> >> > > cleaning > >>> >> > > > up your > >>> >> > > > > build. > >>> >> > > > > >> I got > >>> >> > > > > >> > > quite far, currently > trying to get > >>> the > >>> >> > > tests to > >>> >> > > > pass. For > >>> >> > > > > some > >>> >> > > > > >> > > Scala-Java-major-version > problems, > >>> but > >>> >> > > working on > >>> >> > > > fixing > >>> >> > > > > them. > >>> >> > > > > >> > > > >>> >> > > > > >> > > However sind things will > be > >>> different. > >>> >> I > >>> >> > > hope > >>> >> > > > that's OK. > >>> >> > > > > >> Especially with > >>> >> > > > > >> > > the artifact ids. > >>> >> > > > > >> > > > >>> >> > > > > >> > > Just as a question: does > the build > >>> >> > > currently work > >>> >> > > > at all? > >>> >> > > > > >> Especially in > >>> >> > > > > >> > > the community block I > had to fix > >>> quite > >>> >> a > >>> >> > > few API > >>> >> > > > changes > >>> >> > > > > where > >>> >> > > > > >> the code > >>> >> > > > > >> > in > >>> >> > > > > >> > > the blocks were for > older versions > >>> of > >>> >> > > libraries. > >>> >> > > > > >> > > > >>> >> > > > > >> > > I hope I get some more > tests to > >>> pass > >>> >> > today. > >>> >> > > > > >> > > > >>> >> > > > > >> > > Chris > >>> >> > > > > >> > > > ________________________________ > >>> >> > > > > >> > > Von: Andrew Musselman < > >>> a...@apache.org> > >>> >> > > > > >> > > Gesendet: Donnerstag, > 16. April > >>> 2020 > >>> >> 20:35 > >>> >> > > > > >> > > An: Mahout Dev List < > >>> >> > dev@mahout.apache.org> > >>> >> > > > > >> > > Betreff: Re: Hi ... need > some help? > >>> >> > > > > >> > > > >>> >> > > > > >> > > Looking forward to > working on this > >>> with > >>> >> > you; > >>> >> > > > thanks again! > >>> >> > > > > >> > > > >>> >> > > > > >> > > On Thu, Apr 16, 2020 at > 11:09 AM > >>> >> > Christofer > >>> >> > > Dutz < > >>> >> > > > > >> > > > christofer.d...@c-ware.de> > >>> >> > > > > >> > > wrote: > >>> >> > > > > >> > > > >>> >> > > > > >> > > > Hi Andrew, > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > guess I'll start with > the fork > >>> and > >>> >> > > contact you > >>> >> > > > folks on > >>> >> > > > > slack. > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > Chris > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > Am 16.04.20, 19:43 > schrieb > >>> "Andrew > >>> >> > > Musselman" < > >>> >> > > > > a...@apache.org>: > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > Chris, thank you > for your > >>> help.. > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > Yeah if you fork > what's in > >>> master > >>> >> > you > >>> >> > > can > >>> >> > > > see what > >>> >> > > > > state > >>> >> > > > > >> it's in; > >>> >> > > > > >> > we > >>> >> > > > > >> > > > are in > >>> >> > > > > >> > > > the #mahout > channel in > >>> tge-asf > >>> >> slack > >>> >> > > and > >>> >> > > > this is also > >>> >> > > > > a > >>> >> > > > > >> fine way to > >>> >> > > > > >> > > > keep > >>> >> > > > > >> > > > track of > discussion. > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > We could file a > JIRA ticket > >>> as > >>> >> well, > >>> >> > > > however you > >>> >> > > > > prefer to > >>> >> > > > > >> work. > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > Best > >>> >> > > > > >> > > > Andrew > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > On Thu, Apr 16, > 2020 at 06:59 > >>> >> > > Christofer > >>> >> > > > Dutz < > >>> >> > > > > >> > > > > christofer.d...@c-ware.de> > >>> >> > > > > >> > > > wrote: > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > > Hi Trevor, > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > ok ... first of > all ... the > >>> >> Mahout > >>> >> > > PMC is > >>> >> > > > defining a > >>> >> > > > > >> "community > >>> >> > > > > >> > > > > maintained" > library which > >>> is > >>> >> not > >>> >> > > > maintained by the > >>> >> > > > > mahout > >>> >> > > > > >> PMC?!?! > >>> >> > > > > >> > > > > I thought at > Apache > >>> everything > >>> >> is > >>> >> > > about > >>> >> > > > Community > >>> >> > > > > over > >>> >> > > > > >> code. So > >>> >> > > > > >> > is > >>> >> > > > > >> > > a > >>> >> > > > > >> > > > > company driving > the > >>> >> non-community > >>> >> > > stuff? > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > But back to your > build > >>> issues: > >>> >> > > > > >> > > > > I had a look and > I too > >>> >> encountered > >>> >> > > these > >>> >> > > > comments > >>> >> > > > > and > >>> >> > > > > >> remarks and > >>> >> > > > > >> > > > > sometimes > patterns I > >>> recognized > >>> >> > and > >>> >> > > could > >>> >> > > > imagine > >>> >> > > > > why > >>> >> > > > > >> they were > >>> >> > > > > >> > > > created. > >>> >> > > > > >> > > > > Yes quite a bit > of the > >>> build > >>> >> could > >>> >> > > be > >>> >> > > > cleaned up and > >>> >> > > > > >> simplified a > >>> >> > > > > >> > > > lot. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > So how about I > create a > >>> fork > >>> >> and > >>> >> > > try to > >>> >> > > > do a > >>> >> > > > > cleanup of > >>> >> > > > > >> the > >>> >> > > > > >> > build. > >>> >> > > > > >> > > > > Usually I also > leave > >>> comments > >>> >> > about > >>> >> > > what > >>> >> > > > I do as I > >>> >> > > > > hope > >>> >> > > > > >> I'll not > >>> >> > > > > >> > be > >>> >> > > > > >> > > > the > >>> >> > > > > >> > > > > only one > maintaining a > >>> build > >>> >> and > >>> >> > > > documenting things > >>> >> > > > > helps > >>> >> > > > > >> people > >>> >> > > > > >> > > > feel more > >>> >> > > > > >> > > > > confident. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > However in some > cases I > >>> will > >>> >> have > >>> >> > > > questions ... so > >>> >> > > > > would > >>> >> > > > > >> someone > >>> >> > > > > >> > be > >>> >> > > > > >> > > > > available on > Slack for > >>> quick > >>> >> > > questions? > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Usually > switching to > >>> another > >>> >> build > >>> >> > > system > >>> >> > > > does > >>> >> > > > > solve some > >>> >> > > > > >> > problems > >>> >> > > > > >> > > > ... > >>> >> > > > > >> > > > > mostly the > reason to > >>> switch is > >>> >> > that > >>> >> > > it > >>> >> > > > solved the > >>> >> > > > > main > >>> >> > > > > >> problem > >>> >> > > > > >> > that > >>> >> > > > > >> > > > you are > >>> >> > > > > >> > > > > having with the > old. > >>> >> > > > > >> > > > > However you > usually notice > >>> too > >>> >> > late > >>> >> > > that > >>> >> > > > you get > >>> >> > > > > yourself > >>> >> > > > > >> a lot > >>> >> > > > > >> > of > >>> >> > > > > >> > > > new > >>> >> > > > > >> > > > > problems. I > remember doing > >>> some > >>> >> > > contract > >>> >> > > > work for an > >>> >> > > > > >> insurance > >>> >> > > > > >> > > > company and > >>> >> > > > > >> > > > > they were > totally down > >>> >> Maven-road > >>> >> > > but > >>> >> > > > then had to > >>> >> > > > > build > >>> >> > > > > >> something > >>> >> > > > > >> > > > with SBT > >>> >> > > > > >> > > > > ... in the end I > compiled > >>> the > >>> >> > thing > >>> >> > > on my > >>> >> > > > laptop, > >>> >> > > > > copied > >>> >> > > > > >> it to a > >>> >> > > > > >> > > USB > >>> >> > > > > >> > > > stick > >>> >> > > > > >> > > > > and told the > people what > >>> was on > >>> >> > the > >>> >> > > stick > >>> >> > > > and that > >>> >> > > > > I'll be > >>> >> > > > > >> > having a > >>> >> > > > > >> > > > coffee > >>> >> > > > > >> > > > > and will be back > in 30 > >>> minutes. > >>> >> > > When I > >>> >> > > > came back > >>> >> > > > > the sick > >>> >> > > > > >> wasn't > >>> >> > > > > >> > at > >>> >> > > > > >> > > > the > >>> >> > > > > >> > > > > same place and > the build > >>> >> problem > >>> >> > was > >>> >> > > > "solved" ;-) > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > So I think it's > quite good > >>> to > >>> >> > stick > >>> >> > > to > >>> >> > > > maven ... > >>> >> > > > > that is > >>> >> > > > > >> very > >>> >> > > > > >> > > > mature, you > >>> >> > > > > >> > > > > can do almost > everything > >>> you > >>> >> want > >>> >> > > with it > >>> >> > > > and it > >>> >> > > > > >> integrates > >>> >> > > > > >> > > > perfectly into > >>> >> > > > > >> > > > > the Apache > infrastructure. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > But that's just > my opinion. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > So if you want > me to help, > >>> >> I'll be > >>> >> > > happy > >>> >> > > > to be of > >>> >> > > > > >> assistance. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Chris > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Am 16.04.20, > 15:28 schrieb > >>> >> "Trevor > >>> >> > > Grant" > >>> >> > > > < > >>> >> > > > > >> > > trevor.d.gr...@gmail.com > >>> >> > > > > >> > > > >: > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Hey > Christopher, > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > I would > agree with what > >>> >> Stevo > >>> >> > > > outlined but add > >>> >> > > > > some > >>> >> > > > > >> more > >>> >> > > > > >> > > context > >>> >> > > > > >> > > > and a > >>> >> > > > > >> > > > > couple > related JIRA > >>> issues. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > For 0.14.0 > We did a big > >>> >> > > refactor and > >>> >> > > > finally > >>> >> > > > > moved the > >>> >> > > > > >> > > MapReduce > >>> >> > > > > >> > > > based > >>> >> > > > > >> > > > > Mahout all > into what we > >>> >> called > >>> >> > > > "community/" > >>> >> > > > > that is > >>> >> > > > > >> community > >>> >> > > > > >> > > > > maintained, > >>> >> > > > > >> > > > > which is to > say, we're > >>> not > >>> >> > > > maintaining it > >>> >> > > > > anymore > >>> >> > > > > >> (sunset > >>> >> > > > > >> > > began I > >>> >> > > > > >> > > > > think in > >>> >> > > > > >> > > > > 2015). > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > But all of > our POMs > >>> were so > >>> >> > > huge and > >>> >> > > > fat because > >>> >> > > > > >> they'd been > >>> >> > > > > >> > > > layered up > >>> >> > > > > >> > > > > over the > years by > >>> people > >>> >> > coming > >>> >> > > and > >>> >> > > > going and > >>> >> > > > > >> dropping in > >>> >> > > > > >> > > code. I > >>> >> > > > > >> > > > > wouldn't > >>> >> > > > > >> > > > > call these > drive- bys, > >>> its > >>> >> > just > >>> >> > > been > >>> >> > > > over 10 > >>> >> > > > > years > >>> >> > > > > >> and people > >>> >> > > > > >> > > > come and > >>> >> > > > > >> > > > > go. > >>> >> > > > > >> > > > > Such is the > life of > >>> Apache > >>> >> > > Projects. > >>> >> > > > So we had a > >>> >> > > > > >> situation > >>> >> > > > > >> > > where > >>> >> > > > > >> > > > a lot > >>> >> > > > > >> > > > > of > >>> >> > > > > >> > > > > the old Map > Reduce > >>> stuff > >>> >> and > >>> >> > > the POMs > >>> >> > > > were > >>> >> > > > > considered > >>> >> > > > > >> > > > "old-magic" no > >>> >> > > > > >> > > > > one > >>> >> > > > > >> > > > > really knew > how it was > >>> all > >>> >> > tied > >>> >> > > > together, but we > >>> >> > > > > >> didn't want > >>> >> > > > > >> > to > >>> >> > > > > >> > > > mess > >>> >> > > > > >> > > > > with > >>> >> > > > > >> > > > > it for fear > of breaking > >>> >> > > something in > >>> >> > > > the "new" > >>> >> > > > > Mahout > >>> >> > > > > >> (aka > >>> >> > > > > >> > > > Samsar) > >>> >> > > > > >> > > > > which is > >>> >> > > > > >> > > > > the > Scala/Spark based > >>> >> library > >>> >> > > that it > >>> >> > > > is now* > >>> >> > > > > (to > >>> >> > > > > >> others in > >>> >> > > > > >> > the > >>> >> > > > > >> > > > > community: > >>> >> > > > > >> > > > > I know it > runs on other > >>> >> > > engines, but > >>> >> > > > for > >>> >> > > > > simplicity, > >>> >> > > > > >> I'm just > >>> >> > > > > >> > > > calling > >>> >> > > > > >> > > > > it > >>> >> > > > > >> > > > > > "runs-on-spark"). > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > For 0.14.0 > We decided > >>> to > >>> >> trim > >>> >> > > out as > >>> >> > > > much of > >>> >> > > > > that > >>> >> > > > > >> which was > >>> >> > > > > >> > > > possible. > >>> >> > > > > >> > > > > We > >>> >> > > > > >> > > > > did some > major > >>> liposuction > >>> >> on > >>> >> > > POMs, > >>> >> > > > re organized > >>> >> > > > > >> things, etc. > >>> >> > > > > >> > > > This was > >>> >> > > > > >> > > > > done > >>> >> > > > > >> > > > > by > commenting out a > >>> >> section, > >>> >> > > then > >>> >> > > > seeing if it > >>> >> > > > > would > >>> >> > > > > >> still > >>> >> > > > > >> > > > build. So > >>> >> > > > > >> > > > > the > >>> >> > > > > >> > > > > current > release > >>> >> > > > > >> > > > > _does_ > build. And > >>> aside for > >>> >> > > some CLI > >>> >> > > > driver > >>> >> > > > > issues > >>> >> > > > > >> which are > >>> >> > > > > >> > > > outlined > >>> >> > > > > >> > > > > in > >>> >> > > > > >> > > > > [1], the > project runs > >>> >> fairly > >>> >> > > smooth. > >>> >> > > > (An SBT > >>> >> > > > > would > >>> >> > > > > >> probably > >>> >> > > > > >> > > > solve [1], > >>> >> > > > > >> > > > > I > >>> >> > > > > >> > > > > believe Pat > Ferrel has > >>> made > >>> >> > his > >>> >> > > own > >>> >> > > > SBT script > >>> >> > > > > to > >>> >> > > > > >> compile > >>> >> > > > > >> > > > Mahout, which > >>> >> > > > > >> > > > > solved that > problem for > >>> >> them). > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > The issue we > ran into > >>> with > >>> >> the > >>> >> > > > releases (and the > >>> >> > > > > >> reason I > >>> >> > > > > >> > think > >>> >> > > > > >> > > > you're > >>> >> > > > > >> > > > > here), is > that we also > >>> >> > somewhere > >>> >> > > > along the line > >>> >> > > > > >> commented out > >>> >> > > > > >> > > > something > >>> >> > > > > >> > > > > that was > important to > >>> the > >>> >> > > release > >>> >> > > > process. > >>> >> > > > > Hence why > >>> >> > > > > >> 0.14.0 > >>> >> > > > > >> > > > released > >>> >> > > > > >> > > > > source > >>> >> > > > > >> > > > > only. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Since 2008, > there has > >>> been > >>> >> a > >>> >> > > lot of > >>> >> > > > great work > >>> >> > > > > on > >>> >> > > > > >> generating > >>> >> > > > > >> > > > plugins > >>> >> > > > > >> > > > > for > >>> >> > > > > >> > > > > doing Apache > releases. > >>> >> Instead > >>> >> > > of the > >>> >> > > > awkward > >>> >> > > > > hacks > >>> >> > > > > >> that made > >>> >> > > > > >> > > up > >>> >> > > > > >> > > > the > >>> >> > > > > >> > > > > old > >>> >> > > > > >> > > > > poms > (literally > >>> comments > >>> >> that > >>> >> > > said, > >>> >> > > > "this is a > >>> >> > > > > hack, > >>> >> > > > > >> there's > >>> >> > > > > >> > > > supposedly > >>> >> > > > > >> > > > > something > better coming > >>> >> from > >>> >> > > ..." > >>> >> > > > dated like > >>> >> > > > > 2012), > >>> >> > > > > >> we would > >>> >> > > > > >> > > > like to > >>> >> > > > > >> > > > > do it > >>> >> > > > > >> > > > > the "right > way" and > >>> >> > incorporate > >>> >> > > the > >>> >> > > > appropriate > >>> >> > > > > >> plugins. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Refactoring > to SBT was > >>> >> _one_ > >>> >> > > proposed > >>> >> > > > solution. > >>> >> > > > > We're > >>> >> > > > > >> also OK > >>> >> > > > > >> > > > > continuing to > >>> >> > > > > >> > > > > use Maven, > and I agree > >>> with > >>> >> > > what you > >>> >> > > > said about > >>> >> > > > > the > >>> >> > > > > >> cross > >>> >> > > > > >> > > > compiling. We > >>> >> > > > > >> > > > > actually > have a script > >>> that > >>> >> > just > >>> >> > > > changes the > >>> >> > > > > scala > >>> >> > > > > >> version. > >>> >> > > > > >> > We > >>> >> > > > > >> > > > tried > >>> >> > > > > >> > > > > using > >>> >> > > > > >> > > > > the > classifiers but > >>> there > >>> >> were > >>> >> > > issues > >>> >> > > > in SBT, > >>> >> > > > > but the > >>> >> > > > > >> way > >>> >> > > > > >> > > you're > >>> >> > > > > >> > > > > proposing > >>> >> > > > > >> > > > > sounds a lot > more pro > >>> than > >>> >> the > >>> >> > > route > >>> >> > > > we were > >>> >> > > > > trying > >>> >> > > > > >> for. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > That said- > we'd be OK > >>> just > >>> >> > > releasing > >>> >> > > > one > >>> >> > > > > scala/spark > >>> >> > > > > >> version > >>> >> > > > > >> > at > >>> >> > > > > >> > > > a time. > >>> >> > > > > >> > > > > But getting > the > >>> convenience > >>> >> > > binaries > >>> >> > > > to > >>> >> > > > > >> release/publish would > >>> >> > > > > >> > > be > >>> >> > > > > >> > > > a > >>> >> > > > > >> > > > > major > >>> >> > > > > >> > > > > first step. > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > Also, we > really > >>> appreciate > >>> >> the > >>> >> > > help, > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > tg > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > [1] > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > >>> >> > > > > >> > > > >>> >> > > > > >> > > >>> >> > > > > >> > >>> >> > > > > > >>> >> > > > > >>> >> > > > >>> >> > > >>> >> > >>> > https://issues.apache.org/jira/projects/MAHOUT/issues/MAHOUT-2093?filter=allopenissues > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > On Thu, Apr > 16, 2020 at > >>> >> 4:50 > >>> >> > AM > >>> >> > > > Christofer Dutz > >>> >> > > > > < > >>> >> > > > > >> > > > > > christofer.d...@c-ware.de> > >>> >> > > > > >> > > > > wrote: > >>> >> > > > > >> > > > > > >>> >> > > > > >> > > > > > Hi Stevo, > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > so let me > summarize > >>> what > >>> >> I > >>> >> > > > understood: > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > - There > are some > >>> modules > >>> >> in > >>> >> > > mahout > >>> >> > > > that are > >>> >> > > > > built > >>> >> > > > > >> with > >>> >> > > > > >> > Scala, > >>> >> > > > > >> > > > some > >>> >> > > > > >> > > > > with > >>> >> > > > > >> > > > > > java and > some with > >>> both > >>> >> (At > >>> >> > > least > >>> >> > > > that's what > >>> >> > > > > I see > >>> >> > > > > >> when > >>> >> > > > > >> > > > checking > >>> >> > > > > >> > > > > out the > >>> >> > > > > >> > > > > > project) > >>> >> > > > > >> > > > > > - The > current build > >>> uses > >>> >> > > Scala 2.11 > >>> >> > > > to build > >>> >> > > > > the > >>> >> > > > > >> Scala > >>> >> > > > > >> > code. > >>> >> > > > > >> > > > > > - The > resulting > >>> libraries > >>> >> > are > >>> >> > > only > >>> >> > > > compatible > >>> >> > > > > with > >>> >> > > > > >> Scala > >>> >> > > > > >> > 2.11 > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > Now you > want to also > >>> >> publish > >>> >> > > > versions > >>> >> > > > > compatible > >>> >> > > > > >> with Scala > >>> >> > > > > >> > > > 2.12? > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > If that's > the case I > >>> >> think > >>> >> > > Maven > >>> >> > > > could easily > >>> >> > > > > add > >>> >> > > > > >> multiple > >>> >> > > > > >> > > > executions > >>> >> > > > > >> > > > > > where each > compile > >>> >> compiles > >>> >> > to > >>> >> > > > different > >>> >> > > > > output > >>> >> > > > > >> > directories: > >>> >> > > > > >> > > > > > - Java --> > >>> target/classes > >>> >> > > > > >> > > > > > - Scala > 2.11 --> > >>> >> > > target/classes-2.11 > >>> >> > > > > >> > > > > > - Scala > 2.12 --> > >>> >> > > target/classes-2.12 > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > Then the > packaging > >>> would > >>> >> > also > >>> >> > > need > >>> >> > > > a second > >>> >> > > > > >> execution ... > >>> >> > > > > >> > > each > >>> >> > > > > >> > > > of the > >>> >> > > > > >> > > > > > executions > bundling > >>> the > >>> >> > > classes and > >>> >> > > > the > >>> >> > > > > >> corresponding scala > >>> >> > > > > >> > > > output. > >>> >> > > > > >> > > > > > Ideally I > would > >>> probably > >>> >> use > >>> >> > > maven > >>> >> > > > > classifiers to > >>> >> > > > > >> > distinguish > >>> >> > > > > >> > > > the > >>> >> > > > > >> > > > > > artifacts. > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > > <dependency> > >>> >> > > > > >> > > > > > > >>> >> > > > <groupId>org.apache.mahout</groupId> > >>> >> > > > > >> > > > > > > >>> >> > > > <artifactId>mahout-spark</artifactId> > >>> >> > > > > >> > > > > > > >>> >> > > <version>14.1-SNAPSHOT</version> > >>> >> > > > > >> > > > > > > >>> >> > > <classifier>2.11</classifier> > >>> >> > > > > >> > > > > > > </dependency> > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > Then it > should all > >>> work > >>> >> in a > >>> >> > > normal > >>> >> > > > maven > >>> >> > > > > build. In > >>> >> > > > > >> the > >>> >> > > > > >> > > > > distributions you > >>> >> > > > > >> > > > > > could also > filter the > >>> >> > versions > >>> >> > > > according to > >>> >> > > > > their > >>> >> > > > > >> > > classifiers. > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > So if this > is the > >>> case, I > >>> >> > > could > >>> >> > > > help you with > >>> >> > > > > this. > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > Chris > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > Am > 16.04.20, 09:39 > >>> >> schrieb > >>> >> > > "Stevo > >>> >> > > > Slavić" < > >>> >> > > > > >> > ssla...@gmail.com > >>> >> > > > > >> > > >: > >>> >> > > > > >> > > > > > > >>> >> > > > > >> > > > > > > Disclaimer: I'm > >>> not > >>> >> > active > >>> >> > > > Mahout > >>> >> > > > > maintainer > >>> >> > > > > >> for quite > >>> >> > > > > >> > a > >>> >> > > > > >> > > > while, > >>> >> > > > > >> > > > > have > >>> >> > > > > >> > > > > > some > >>> >> > > > > >> > > > > > > historical > >>> >> perspective, > >>> >> > > take it > >>> >> > > > with a > >>> >> > > > > grain of > >>> >> > > > > >> salt, > >>> >> > > > > >> > > > could be > >>> >> > > > > >> > > > > I'm > >>> >> > > > > >> > > > > >>> > > >>> > > >>> > >> > > >
