You can submit multiple MR jobs on same cluster . It's better to submit all jobs either from external machine which can be used as a gateway to upload data to HDFS and submit MR jobs or from machine where NN/JT is running . There is no problem running MR jobs from other nodes in cluster ( datanode/tt ) but the best practice is to use external machine if available or NN/JT .
- Ravi On 7/24/09 11:40 AM, "Hrishikesh Agashe" <[email protected]> wrote: Hi, If I have one cluster with around 20 machines, can I submit different MR jobs from different machines in cluster? Are there any precautions to be taken? (I want to start Nutch crawl as one job and Katta indexing as another job) --Hrishi DISCLAIMER ========== This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails. Ravi --
