was able to finally get past the final hurdle and get the docker resource manager tested with hadoop montecarlo pi estimate. please let me know if there are specific aspects you would like me to test.
On Fri, Dec 4, 2015 at 2:03 PM, Prabhu Inbarajan <inbarajan.pra...@gmail.com > wrote: > Thanks Brandon, I adjusted the docker file under MYRIAD_HOME/docker this > morning and generated a docker build for hadoop-2.7.1 , I wasnt sure if > they are identical. but I will use this. > Thanks so much. > > > Thanks > prabhu > > > On Fri, Dec 4, 2015 at 2:00 PM, Brandon Gulla <gulla.bran...@gmail.com> > wrote: > >> Good News Prabhu, the updated docker image is pushed and ready to be >> tested. >> >> Notes: >> - be sure to pull the most recent image: 'docker pull bgulla/myriad ' >> - You will need to provide an alternative hadoop archive to be used with >> myriad. >> - docker run --net=host -t -v <path-to-confs>:/myriad-conf -e >> "ALTERNATE_HADOOP_URL= >> https://www.apache.org/dist/hadoop/core/hadoop-2.7.1/hadoop-2.7.1.tar.gz"; >> bgulla/myriad >> >> Again, 2.7.1 is not officially supported by Myriad yet, but good luck! >> >> Brandon >> >> On Fri, Dec 4, 2015 at 3:55 PM, Brandon Gulla <gulla.bran...@gmail.com> >> wrote: >> >> > Hey Prabhu! Thanks for the interest in testing the resource manager >> > docker. Myriad currently only supports officially supports hadoop-2.7.0 >> due >> > to some API changes in hadoop-2.7.1. I currently have some features >> baked >> > into the docker image where you can specify an alternative hadoop >> archive >> > URL to use but I need to test a few things before I test that out. >> > >> > So feel free to try it with hadoop-2.7.0 or wait until next week when we >> > can try some experiments. >> > >> > Thanks. >> > >> > >> > On Fri, Dec 4, 2015 at 1:54 PM, Prabhu Inbarajan < >> > inbarajan.pra...@gmail.com> wrote: >> > >> >> I am running hadoop 2.7.1 , would be happy to test the resource manager >> >> container as well.. >> >> >> >> Thanks >> >> Prabhu >> >> >> >> On Fri, Dec 4, 2015 at 8:44 AM, Sarjeet Singh < >> sarjeetsi...@maprtech.com> >> >> wrote: >> >> >> >> > Nice, Brandon!! >> >> > >> >> > I can give it a try today, probably. Send me any more details if >> >> required >> >> > or necessary, or I'll PM you if I run into any issues. Hope this is >> ok >> >> to >> >> > PM you directly (Don't want to spam myriad mailing list). >> >> > >> >> > -Sarjeet >> >> > >> >> > On Fri, Dec 4, 2015 at 7:17 AM, Brandon Gulla < >> gulla.bran...@gmail.com> >> >> > wrote: >> >> > >> >> > > I have built a new ResourceManager Docker that needs some testing >> >> love. >> >> > > Please test it out and let me know what bugs you may find. This is >> >> built >> >> > > for Apache Hadoop 2.7.0 and has not been tested with MapR >> >> distributions. >> >> > > You no longer have to do anything fancy, just mount the directory >> with >> >> > your >> >> > > yarn-site.xml and myriad-config and you should be good to go. Once >> we >> >> > feel >> >> > > good about it I can push it to the official mesos docker repo >> (Thanks >> >> > again >> >> > > Ken). >> >> > > >> >> > > https://hub.docker.com/r/bgulla/myriad/ >> >> > > >> >> > > Also, I hooked the docker build into gradle for future building >> >> goodness >> >> > > but will wait to submit that PR until after we cut a release. >> >> > > >> >> > > Thanks! >> >> > > >> >> > > >> >> > > -- >> >> > > Brandon >> >> > > >> >> > >> >> >> > >> > >> > >> > -- >> > Brandon >> > >> >> >> >> -- >> Brandon >> > >
