So that means I need to create a HDFS ( Not an OS physical directory ) directory under Hadoop that need to be used in the Hive config file for this property. Right?
________________________________ From: Dean Wampler <deanwamp...@gmail.com> To: Raj Hadoop <hadoop...@yahoo.com> Cc: Sanjay Subramanian <sanjay.subraman...@wizecommerce.com>; "user@hive.apache.org" <user@hive.apache.org>; User <u...@hadoop.apache.org> Sent: Tuesday, May 21, 2013 2:06 PM Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical directory No, you only need a directory in HDFS, which will be "virtually located" somewhere in your cluster automatically by HDFS. Also there's a typo in your hive.xml: <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value> Should be <value>/correct/path/in/hdfs/to/your/warehouse/directory</value> On Tue, May 21, 2013 at 1:04 PM, Raj Hadoop <hadoop...@yahoo.com> wrote: Thanks Sanjay. > >My environment is like this. > >$ echo $HADOOP_HOME >/software/home/hadoop/hadoop/hadoop-1.1.2 > >$ echo $HIVE_HOME >/software/home/hadoop/hive/hive-0.9.0 > >$ id >uid=50052(hadoop) gid=600(apps) groups=600(apps) > > >So can i do like this: > >$pwd >/software/home/hadoop/hive/hive-0.9.0 > >$mkdir warehouse > >$cd /software/home/hadoop/hive/hive-0.9.0/warehouse > >$ in hive-site.xml<property> > <name>hive.metastore.warehouse.dir</name> > <value/software/home/hadoop/hive/hive-0.9.0/warehouse</value> > <description>location of default database for the warehouse</description> ></property> > >Where should I create the HDFS directory ? > > >From: Sanjay Subramanian <sanjay.subraman...@wizecommerce.com> >To: "user@hive.apache.org" <user@hive.apache.org>; Raj Hadoop ><hadoop...@yahoo.com>; Dean Wampler <deanwamp...@gmail.com> >Cc: User <u...@hadoop.apache.org> >Sent: Tuesday, May 21, 2013 1:53 PM > >Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical >directory > > > >Notes below > >From: Raj Hadoop <hadoop...@yahoo.com> >Reply-To: "user@hive.apache.org" <user@hive.apache.org>, Raj Hadoop ><hadoop...@yahoo.com> >Date: Tuesday, May 21, 2013 10:49 AM >To: Dean Wampler <deanwamp...@gmail.com>, "user@hive.apache.org" ><user@hive.apache.org> >Cc: User <u...@hadoop.apache.org> >Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical >directory > > > >Ok.I got it. My questions - > >1) Should a local physical directory be created before using this property? >I created a directory in HDFS during Hive installation >/user/hive/warehouse > > >My hive-site.xml has the following property defined > > ><property> > <name>hive.metastore.warehouse.dir</name> > <value>/user/hive/warehouse</value> > <description>location of default database for the warehouse</description> ></property> > >2) Should a HDFS file directory be created from Hadoop before using this >property? >hdfs dfs -mkdir /user/hive/warehouse >Change the owner:group to hive:hive > > > >From: Dean Wampler <deanwamp...@gmail.com> >To: user@hive.apache.org; Raj Hadoop <hadoop...@yahoo.com> >Cc: User <u...@hadoop.apache.org> >Sent: Tuesday, May 21, 2013 1:44 PM >Subject: Re: hive.metastore.warehouse.dir - Should it point to a physical >directory > > > >The name is misleading; this is the directory within HDFS where Hive stores >the data, by default. (External tables can go elsewhere). It doesn't really >have anything to do with the metastore. > > >dean > > >On Tue, May 21, 2013 at 12:42 PM, Raj Hadoop <hadoop...@yahoo.com> wrote: > >Can some one help me on this ? I am stuck installing and configuring Hive with >Oracle. Your timely help is really aprreciated. >> >> >> >>From: Raj Hadoop <hadoop...@yahoo.com> >>To: Hive <user@hive.apache.org>; User <u...@hadoop.apache.org> >>Sent: Tuesday, May 21, 2013 1:08 PM >>Subject: hive.metastore.warehouse.dir - Should it point to a physical >>directory >> >> >> >>Hi, >> >>I am configurinig Hive. I ahve a question on the property >>hive.metastore.warehouse.dir. >> >>Should this point to a physical directory. I am guessing it is a logical >>directory under Hadoop fs.default.name. Please advise whether I need to >>create any directory for the variable hive.metastore.warehouse.dir >> >>Thanks, >>Raj >> >> > > > >-- >Dean Wampler, Ph.D. >@deanwampler >http://polyglotprogramming.com/ > > > >CONFIDENTIALITY NOTICE >====================== >This email message and any attachments are for the exclusive use of the >intended recipient(s) and may contain confidential and privileged information. >Any unauthorized review, use, disclosure or distribution is prohibited. If you >are not the intended recipient, please contact the sender by reply email and >destroy all copies of the original message along with any attachments, from >your computer system. If you are the intended recipient, please be advised >that the content of this message is subject to access, review and disclosure >by the sender's Email System Administrator. > > > -- Dean Wampler, Ph.D. @deanwampler http://polyglotprogramming.com/
