once we are done with the configuration, we need to format the file system..use this command to do that- bin/hadoop namenode -format
after this, hadoop daemon processes should be started using following commands - bin/start-dfs.sh (it'll start NN & DN) bin/start-mapred.sh (it'll start JT & TT) after this use jps to check if everything is alright or point your browser to localhost:50070..if you further find any problem provide us with the error logs..:) Regards, Mohammad Tariq On Wed, Jun 6, 2012 at 11:22 PM, Babak Bastan <[email protected]> wrote: > were you able to format hdfs properly??? > I did'nt get your question,Do you mean HADOOP_HOME? or where did I install > Hadoop? > > On Wed, Jun 6, 2012 at 7:49 PM, Mohammad Tariq <[email protected]> wrote: >> >> if you are getting only this, it means your hadoop is not >> running..were you able to format hdfs properly??? >> >> Regards, >> Mohammad Tariq >> >> >> On Wed, Jun 6, 2012 at 11:17 PM, Babak Bastan <[email protected]> wrote: >> > Hi MohammadmI irun jps in my shel I can see this result: >> > 2213 Jps >> > >> > >> > On Wed, Jun 6, 2012 at 7:44 PM, Mohammad Tariq <[email protected]> >> > wrote: >> >> >> >> you can also use "jps" command at your shell to see whether Hadoop >> >> processes are running or not. >> >> >> >> Regards, >> >> Mohammad Tariq >> >> >> >> >> >> On Wed, Jun 6, 2012 at 11:12 PM, Mohammad Tariq <[email protected]> >> >> wrote: >> >> > Hi Babak, >> >> > >> >> > You have to type it in you web browser..Hadoop provides us a web GUI >> >> > that not only allows us to browse through the file system, but to >> >> > download the files as well..Apart from that it also provides a web >> >> > GUI >> >> > that can be used to see the status of Jobtracker and >> >> > Tasktracker..When >> >> > you run a Hive or Pig job or a Mapreduce job, you can point your >> >> > browser to http://localhost:50030 to see the status and logs of your >> >> > job. >> >> > >> >> > Regards, >> >> > Mohammad Tariq >> >> > >> >> > >> >> > On Wed, Jun 6, 2012 at 8:28 PM, Babak Bastan <[email protected]> >> >> > wrote: >> >> >> Thank you shashwat for the answer, >> >> >> where should I type http://localhost:50070? >> >> >> I typed here: hive>http://localhost:50070 but nothing as result >> >> >> >> >> >> >> >> >> On Wed, Jun 6, 2012 at 3:32 PM, shashwat shriparv >> >> >> <[email protected]> wrote: >> >> >>> >> >> >>> first type http://localhost:50070 whether this is opening or not >> >> >>> and >> >> >>> check >> >> >>> how many nodes are available, check some of the hadoop shell >> >> >>> commands >> >> >>> from http://hadoop.apache.org/common/docs/r0.18.3/hdfs_shell.html >> >> >>> run >> >> >>> example mapreduce task on hadoop take example from here >> >> >>> >> >> >>> >> >> >>> : http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ >> >> >>> >> >> >>> if all the above you can do sucessfully means hadoop is configured >> >> >>> correctly >> >> >>> >> >> >>> Regards >> >> >>> Shashwat >> >> >>> >> >> >>> >> >> >>> On Wed, Jun 6, 2012 at 1:30 AM, Babak Bastan <[email protected]> >> >> >>> wrote: >> >> >>>> >> >> >>>> no I'm not working on CDH.Is there a way to test if my Hadoop >> >> >>>> works >> >> >>>> fine >> >> >>>> or not? >> >> >>>> >> >> >>>> >> >> >>>> On Tue, Jun 5, 2012 at 9:55 PM, Bejoy KS <[email protected]> >> >> >>>> wrote: >> >> >>>>> >> >> >>>>> Hi Babak >> >> >>>>> >> >> >>>>> You gotta follow those instructions in the apace site to set up >> >> >>>>> hadoop >> >> >>>>> from scratch and ensure that hdfs is working first. You should be >> >> >>>>> able to >> >> >>>>> read and write files to hdfs before you do your next steps. >> >> >>>>> >> >> >>>>> Are you on CDH or apache distribution of hadoop? If it is CDH >> >> >>>>> there >> >> >>>>> are >> >> >>>>> detailed instructions on Cloudera web site. >> >> >>>>> >> >> >>>>> Regards >> >> >>>>> Bejoy KS >> >> >>>>> >> >> >>>>> Sent from handheld, please excuse typos. >> >> >>>>> ________________________________ >> >> >>>>> From: Babak Bastan <[email protected]> >> >> >>>>> Date: Tue, 5 Jun 2012 21:30:22 +0200 >> >> >>>>> To: <[email protected]> >> >> >>>>> ReplyTo: [email protected] >> >> >>>>> Subject: Re: Error while Creating Table in Hive >> >> >>>>> >> >> >>>>> @Bejoy: I set the fs.default.name in the core-site.xml and I did >> >> >>>>> all >> >> >>>>> of >> >> >>>>> thing that was mentioned in the reference but no effect >> >> >>>>> >> >> >>>>> On Tue, Jun 5, 2012 at 8:43 PM, Babak Bastan <[email protected]> >> >> >>>>> wrote: >> >> >>>>>> >> >> >>>>>> Ok sorry but that was my Mistake .I thought it works but no. >> >> >>>>>> I wrote the command without ; and then I think It works but with >> >> >>>>>> ; >> >> >>>>>> at >> >> >>>>>> the end of command >> >> >>>>>> >> >> >>>>>> CREATE TABLE pokes (foo INT, bar STRING); >> >> >>>>>> >> >> >>>>>> does'nt work >> >> >>>>>> >> >> >>>>>> >> >> >>>>>> On Tue, Jun 5, 2012 at 8:34 PM, shashwat shriparv >> >> >>>>>> <[email protected]> wrote: >> >> >>>>>>> >> >> >>>>>>> inside configuration. all properties will be inside the >> >> >>>>>>> configuration >> >> >>>>>>> tags >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> On Tue, Jun 5, 2012 at 11:53 PM, Babak Bastan >> >> >>>>>>> <[email protected]> >> >> >>>>>>> wrote: >> >> >>>>>>>> >> >> >>>>>>>> Thank you so much my friend your idee works fine(no error) you >> >> >>>>>>>> are >> >> >>>>>>>> the best :) >> >> >>>>>>>> >> >> >>>>>>>> >> >> >>>>>>>> On Tue, Jun 5, 2012 at 8:20 PM, Babak Bastan >> >> >>>>>>>> <[email protected]> >> >> >>>>>>>> wrote: >> >> >>>>>>>>> >> >> >>>>>>>>> It must be inside the <configuration></configuration> or >> >> >>>>>>>>> outside >> >> >>>>>>>>> this? >> >> >>>>>>>>> >> >> >>>>>>>>> >> >> >>>>>>>>> On Tue, Jun 5, 2012 at 8:15 PM, shashwat shriparv >> >> >>>>>>>>> <[email protected]> wrote: >> >> >>>>>>>>>> >> >> >>>>>>>>>> It will be inside hive/conf >> >> >>>>>>>>>> >> >> >>>>>>>>>> >> >> >>>>>>>>>> On Tue, Jun 5, 2012 at 11:43 PM, Babak Bastan >> >> >>>>>>>>>> <[email protected]> >> >> >>>>>>>>>> wrote: >> >> >>>>>>>>>>> >> >> >>>>>>>>>>> Thanks sShashwat, and where is this hive-site.xml >> >> >>>>>>>>>>> >> >> >>>>>>>>>>> On Tue, Jun 5, 2012 at 8:02 PM, shashwat shriparv >> >> >>>>>>>>>>> <[email protected]> wrote: >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> set >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> hive.metastore.warehouse.dir in hive-site.xml >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> <property> >> >> >>>>>>>>>>>> <name>hive.metastore.local</name> >> >> >>>>>>>>>>>> <value>true</value> >> >> >>>>>>>>>>>> </property> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> <name>hive.metastore.warehouse.dir</name> >> >> >>>>>>>>>>>> <value>/home/<your >> >> >>>>>>>>>>>> username>/hivefolder</value> >> >> >>>>>>>>>>>> <description>location of default database >> >> >>>>>>>>>>>> for >> >> >>>>>>>>>>>> the >> >> >>>>>>>>>>>> warehouse</description> >> >> >>>>>>>>>>>> </property> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> On Tue, Jun 5, 2012 at 10:43 PM, Babak Bastan >> >> >>>>>>>>>>>> <[email protected]> wrote: >> >> >>>>>>>>>>>>> >> >> >>>>>>>>>>>>> Hello Experts , >> >> >>>>>>>>>>>>> >> >> >>>>>>>>>>>>> I'm new in Hive .When try to create a test Table in Hive >> >> >>>>>>>>>>>>> I >> >> >>>>>>>>>>>>> get >> >> >>>>>>>>>>>>> an error.I want to run this command: >> >> >>>>>>>>>>>>> CREATE TABLE Test (DateT STRING, Url STRING, Content >> >> >>>>>>>>>>>>> STRING); >> >> >>>>>>>>>>>>> but this error occured: >> >> >>>>>>>>>>>>> FAILED: Error in metadata: MetaException(message:Got >> >> >>>>>>>>>>>>> exception: >> >> >>>>>>>>>>>>> java.io.FileNotFoundException File >> >> >>>>>>>>>>>>> file:/user/hive/warehouse/test does not >> >> >>>>>>>>>>>>> exist.) >> >> >>>>>>>>>>>>> FAILED: Execution Error, return code 1 from >> >> >>>>>>>>>>>>> org.apache.hadoop.hive.ql.exec.DDLTask >> >> >>>>>>>>>>>>> How can I solve this Problem? >> >> >>>>>>>>>>>>> Thank you so much >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> -- >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> ∞ >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> Shashwat Shriparv >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>>> >> >> >>>>>>>>>>> >> >> >>>>>>>>>> >> >> >>>>>>>>>> >> >> >>>>>>>>>> >> >> >>>>>>>>>> -- >> >> >>>>>>>>>> >> >> >>>>>>>>>> >> >> >>>>>>>>>> ∞ >> >> >>>>>>>>>> >> >> >>>>>>>>>> Shashwat Shriparv >> >> >>>>>>>>>> >> >> >>>>>>>>>> >> >> >>>>>>>>> >> >> >>>>>>>> >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> -- >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>>> ∞ >> >> >>>>>>> >> >> >>>>>>> Shashwat Shriparv >> >> >>>>>>> >> >> >>>>>>> >> >> >>>>>> >> >> >>>>> >> >> >>>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> -- >> >> >>> >> >> >>> >> >> >>> ∞ >> >> >>> >> >> >>> Shashwat Shriparv >> >> >>> >> >> >>> >> >> >> >> > >> > > >
