Hi Ben, Similarly, what's the recommended combination of mesos/spark? Will there be problem using Head of mesos (0.15.0) and spark (0.8.0-SNAPSHOT)? I am trying to figure out how to do mvn install on mesos HEAD so that it can be used to build spark. Any hint would help.
Thanks Du From: Benjamin Hindman <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Friday, September 27, 2013 4:57 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: mesos/hadoop Hey Paul, Feel free to share your build issues, we'd love to help. In the mean time, I suggest trying the git tag 0.14.0-rc4 with the mesos/hadoop project on Github. Ben. On Fri, Sep 27, 2013 at 4:55 PM, Paul Mackles <[email protected]<mailto:[email protected]>> wrote: Hi - Going by what is currently in the apache git repository, what is the "recommended" combination of mesos and mesos-hadoop to use? I originally tried the 0.13.0 tarball which appears to include some version of mesos-hadoop. While I was able to build it and run some jobs, the task tracker processes launched by mesos keep on running even after my job completes. Based on the job-tracker logs, there task-trackers are not sending the job-tracker any heartbeats so the job-tracker doesn't try to stop them (even though it reuses them on subsequent jobs). Based on my interpretation of https://issues.apache.org/jira/browse/MESOS-618, it sounds like I should be using the mesos/hadoop project on github. I managed to get that built from trunk but I am not having nearly as much luck getting mesos built from the trunk. So what combination of mesos and mesos-hadoop is working for folks? -- Thanks, Paul
