Adding new service to an existing cluster via Cloudera Manger

Hi Is it possible to add a new service like HBase to an existing cluster via Cloudera Manger? Thanks Shalish.

Re: NFS HDFS gateway w/ kerberos

Thank you Jing! Ryan On 1/31/14, 5:49 PM, Jing Zhao j...@hortonworks.com wrote: HDFS-5804 (https://issues.apache.org/jira/browse/HDFS-5804) allows the NFS gateway to communicate with a secured Hadoop cluster using Kerberos. HDFS-5086 will add RPCSEC_GSS authentication support to NFS gateway.

Re: Invalide URI in job start

Hello, first thanks for your reply and sorry for my late answer. The JobClient prints the following URL after I added a system.out statement: port: -1 file: /tmp/hadoop-yarn/staging/lkairies/.staging/job_1391433848658_0001/job.jar (for all job files, i.e. also for the job.xml,...). So

AUTO: Jose Luis Mujeriego Gomez is out of the office. (returning 10/02/2014)

I am out of the office until 10/02/2014. I will be out of the office with limited access to my email. I will try to answer your email as soon as I can. Expect delays on my answers. For any urgent matter please contact Dittmar Haegele (dittmar.haeg...@de.ibm.com) or Tadhg Murphy

Re: what happens to a client attempting to get a new app when the resource manager is already down

Thank you very much.  One last question: Do you think those parameters setting require restarting the cluster? Thanks  Reyane OUKPEDJO On Sunday, February 2, 2014 11:06 AM, Jian He j...@hortonworks.com wrote: Hi  All entities including NM and client etc. use the same RMProxy to talk with

Re: what happens to a client attempting to get a new app when the resource manager is already down

For NMs talking with RM, you need to restart the NMs to take the configs into effect. For the client talking with RM, you don't need to restart the RM. Jian On Mon, Feb 3, 2014 at 10:52 PM, REYANE OUKPEDJO r.oukpe...@yahoo.comwrote: Thank you very much. One last question: Do you think those

HDFS - 0.20/1 or 2.0

All, We're developing an HDFS application and want to make sure we target the largest current installation base. Are more users on HDFS v1 (old 0.20 branch) or on HDFS v2? Thanks, Brian

Re: shifting sequenceFileOutput format to Avro format

Can anyone please suggest on how to resolve this issue? Thanks Regards, B Anil Kumar. On Mon, Feb 3, 2014 at 9:34 AM, AnilKumar B akumarb2...@gmail.com wrote: Hi Yong, I followed your 2nd suggestion. My data format is is nested(list of map), So I created .avsc as below. {namespace:

Re: Backup NameNode metadata in HA configuration

Does anybody can comment 'copying NN metadata directory' vs 'hdfs dfsadmin -fetch', using NN HA configuration? On Fri, Jan 31, 2014 at 8:26 PM, Ivan Tretyakov itretya...@griddynamics.com wrote: Hi! We are using following version of Hadoop software: 2.0.0-cdh4.1.1. HDFS HA configuration is

Re: Backup NameNode metadata in HA configuration

Hi, You'll ideally just need the latest fsimage file, which includes the whole check pointed namespace, so hdfs dfsadmin -fetch is appropriate. On Tue, Feb 4, 2014 at 3:02 AM, Ivan Tretyakov itretya...@griddynamics.com wrote: Does anybody can comment 'copying NN metadata directory' vs 'hdfs

what's counterpart for org.apache.hadoop.mapred.TaskTrackerMetricsInst in YARN

Hi, I'm migrating my application from MR v.1 to YARN, I do not know how to convert my class which extends org.apache.hadoop.mapred.TaskTrackerMetricsInst, I want this class to run as TaskTracker starts up, if I migrate to YARN, I want it to run as NodeManager starts up, so how can I make this

Re: kerberos principals per node necessary?

interesting! thanks for that information, very helpful On Mon, Feb 3, 2014 at 6:04 PM, Benoy Antony bant...@gmail.com wrote: Its a bad idea, Koert. When multiple nodes are using the same principal (in this case all the datanodes ) , it will result in server assuming that its a replay attack

Re: Backup NameNode metadata in HA configuration

Thank you Harsh! But I would like to know if just copying NN data directory (dfs.name.dir, dfs.namenode.name.dir) is appropriate or not? On Tue, Feb 4, 2014 at 6:00 AM, Harsh J ha...@cloudera.com wrote: Hi, You'll ideally just need the latest fsimage file, which includes the whole check

Re: Backup NameNode metadata in HA configuration

Nothing wrong in copying it - except it would come with a bunch of redundant information (extra retained edit logs already merged into one of the recent fsimages). On Tue, Feb 4, 2014 at 12:07 PM, Ivan Tretyakov itretya...@griddynamics.com wrote: Thank you Harsh! But I would like to know if