Re: [TESTERS NEEDED] ResourceManager Docker

2015-12-04 Thread Sarjeet Singh
Nice, Brandon!! I can give it a try today, probably. Send me any more details if required or necessary, or I'll PM you if I run into any issues. Hope this is ok to PM you directly (Don't want to spam myriad mailing list). -Sarjeet On Fri, Dec 4, 2015 at 7:17 AM, Brandon Gulla

Re: [TESTERS NEEDED] ResourceManager Docker

2015-12-04 Thread Brandon Gulla
Hey Prabhu! Thanks for the interest in testing the resource manager docker. Myriad currently only supports officially supports hadoop-2.7.0 due to some API changes in hadoop-2.7.1. I currently have some features baked into the docker image where you can specify an alternative hadoop archive URL to

Re: [TESTERS NEEDED] ResourceManager Docker

2015-12-04 Thread Prabhu Inbarajan
Thanks Brandon, I adjusted the docker file under MYRIAD_HOME/docker this morning and generated a docker build for hadoop-2.7.1 , I wasnt sure if they are identical. but I will use this. Thanks so much. Thanks prabhu On Fri, Dec 4, 2015 at 2:00 PM, Brandon Gulla

Re: Introduction

2015-12-04 Thread Santosh Marella
Hi Prabhu.. Welcome to the Myriad community! FYI, we now also have a website (http://myriad.incubator.apache.org/) that has links to all the other online resources for Myriad to learn more about the project. Feel free to check it out. We also do a bi-weekly hangouts at 9AM PDT every other Wed

[jira] [Commented] (MYRIAD-153) Placeholder tasks yarn_container_* is not cleaned after yarn job is complete.

2015-12-04 Thread Santosh Marella (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042257#comment-15042257 ] Santosh Marella commented on MYRIAD-153: Thanks [~darinj]! Please go ahead. > Placeholder tasks

Re: [TESTERS NEEDED] ResourceManager Docker

2015-12-04 Thread Prabhu Inbarajan
was able to finally get past the final hurdle and get the docker resource manager tested with hadoop montecarlo pi estimate. please let me know if there are specific aspects you would like me to test. On Fri, Dec 4, 2015 at 2:03 PM, Prabhu Inbarajan wrote: > Thanks

Introduction

2015-12-04 Thread Prabhu Inbarajan
Hello Everyone, My name is Prabhu Inbarajan. I work at Blackhawk Networks. We are heavily invested on both public and private clouds and focused on docker and mesos. I recently started researching on Myriad and its seems to be a perfect fit for our usecases. I was hoping to introduce myself and

Re: Help !! - Myriad mesos subprocess erroring with Argument list too long

2015-12-04 Thread Prabhu Inbarajan
seems ok to me. But I wasnt really clear on frameworkUser , and frameworkSuperUser - both have necessary permissions. I am also trying out the dockerizerd resource manager from Brandon. Apologies for the verbosity... myriad-config-default.xml mesosMaster: 192.168.1.110:5050 checkpoint: false

Help !! - Myriad mesos subprocess erroring with Argument list too long

2015-12-04 Thread Prabhu Inbarajan
I followed the myriad setup instructions , and was able to get resource manager invoke the myriad scheduler and talk to the mesos master. But I see the following error in the mesos slave logs and my yarn submissions are stuck. My setup is as follows: 1. Hadoop 2.7.1 2. Jdk8 3. Mesos Version:

Re: [TESTERS NEEDED] ResourceManager Docker

2015-12-04 Thread Prabhu Inbarajan
I am running hadoop 2.7.1 , would be happy to test the resource manager container as well.. Thanks Prabhu On Fri, Dec 4, 2015 at 8:44 AM, Sarjeet Singh wrote: > Nice, Brandon!! > > I can give it a try today, probably. Send me any more details if required > or

Re: Help !! - Myriad mesos subprocess erroring with Argument list too long

2015-12-04 Thread Sarjeet Singh
Prabhu, Can you paste/send your mesos-slave, mesos-master log file, if this is OK? P.S., We might have seen this when frameworkUser was not set correctly in myriad-config-default.yml. Can you double check if all configuration are correct and the permissions are OK as well? -Sarjeet On Fri, Dec