Hey everyone,
I've been working on a potential extension to Hadoop on Mesos which allows
the framework to potentially release allocated (but idle) TaskTracker slots
if they are doing nothing. This helps release resources hadoop is allocated
but not using, to increase overall cluster utilisation
Hi,
I ran a map-only job on hadoop. But on every tasktracker, it had only 7 map
slots running. How to let it be 8 map slots?
Hi,
I ran a map-only job on hadoop. Every node has 8 cores, but on every
tasktracker, it had only 7 map slots running. How to let tasktracker run 8 map
slots on every node?
Thank you
Another question,
The tasktracker can not stop after the hadoop job is done. Why?
-原始邮件-
发件人: HUO Jing huoj...@ihep.ac.cn
发送时间: 2014年1月27日 星期一
收件人: dev@mesos.apache.org
抄送: Brenden Matthews bren...@diddyinc.com
主题: Re: question about hadoop on mesos
Hi,
I ran a map-only job
I have some questions about running hadoop on top of Mesos, please help me.
1. when a tasktracker is launched, if n cpu core are allocated to it, it
can only launch n-1 map tasks. Could someone tell me why? And, if I want to
run map-only job, what should I do to run n map tasks on a n cpu
On Mon, Jan 27, 2014 at 10:07 AM, HUO Jing huoj...@ihep.ac.cn wrote:
So, at the very beginning, if all the resource are assigned to hadoop, and
after that, there are always enough jobs in jobtracker, is that meanning
that the other framework will never get resource?
Is it fair to do so ?
Just bumping this thread, and cc'ing Brenden Matthews who is the
most-active maintainer of Hadoop on Mesos.
On Fri, Jan 17, 2014 at 10:09 AM, HUO Jing huoj...@ihep.ac.cn wrote:
Hi,
I am trying to run Hadoop on Mesos, but the stderr shows:
Exception in thread main
dev@mesos.apache.org
主题: Re: Fw: Re: Problems with Hadoop on Mesos
Did you follow the instructions here?: https://github.com/mesos/hadoop#build
It looks like the `hadoop-mesos` jar is not in the class path.
On Thu, Jan 23, 2014 at 8:54 PM, HUO Jing huoj...@ihep.ac.cn wrote:
-原始邮件-
发件
Hi,
I am trying to run Hadoop on Mesos, but the stderr shows:
Exception in thread main java.lang.NoClassDefFoundError:
org/apache/hadoop/mapred/MesosExecutor
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.mapred.MesosExecutor
at java.net.URLClassLoader$1.run
Hi,
I download hadoop-mesos from here:
https://github.com/mesos/hadoop
I changed mesos.version to mesos.version0.14.2/mesos.version in the
pom.xml, then build successful.
then I download mesos-0.14.2, and build successfully, I can start mesos
cluster successfully with 3 nodes. I can see all
[
https://issues.apache.org/jira/browse/MESOS-618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dave Lester resolved MESOS-618.
---
Resolution: Fixed
Remove Hadoop on Mesos from repository in favor of external repository
Benjamin Hindman created MESOS-618:
--
Summary: Remove Hadoop on Mesos from repository in favor of
external repository
Key: MESOS-618
URL: https://issues.apache.org/jira/browse/MESOS-618
Project
, Brenden Matthews, and Vinod Kone.
Bugs: MESOS-618
https://issues.apache.org/jira/browse/MESOS-618
Repository: mesos-git
Description
---
First part of cleaning up Hadoop on Mesos. Ultimatly we'd like to get this out
of the repository all together. Note that the only code change here
://reviews.apache.org/r/13226
https://reviews.apache.org/r/13231
https://reviews.apache.org/r/13245
Remove Hadoop on Mesos from repository in favor of external repository
--
Key: MESOS-618
.
Repository: mesos-git
Description
---
First part of cleaning up Hadoop on Mesos. Ultimatly we'd like to get this out
of the repository all together. Note that the only code change here was
directly invoking 'bin/hadoop org.apache.hadoop.mapred.MesosExecutor' rather
than 'mesos-executor' (which
On Aug. 2, 2013, 5:08 p.m., Vinod Kone wrote:
hadoop/mesos/src/java/org/apache/hadoop/mapred/MesosScheduler.java, line 641
https://reviews.apache.org/r/13225/diff/2/?file=334398#file334398line641
did this path work out? iirc, we had to do the canonical path thingy
because bin
16 matches
Mail list logo
