Hi Ivo, I’m also working, to start with, on a pseudo distributed node. I’ve got a CentOS 6.x Amazon EC2 instance and using FreeNX for the remote desktop. So far there seems to be several services that aren’t started after the BigTop install. Here’s the output of ‘service —status-all'
Flume NG agent is running [ OK ] Hadoop datanode is running [ OK ] Hadoop journalnode is running [ OK ] Hadoop namenode is running [ OK ] Hadoop secondarynamenode is running [ OK ] Hadoop zkfc is dead and pid file exists [FAILED] Hadoop httpfs is running [ OK ] Hadoop historyserver is dead and pid file exists [FAILED] Hadoop nodemanager is dead and pid file exists [FAILED] Hadoop proxyserver is dead and pid file exists [FAILED] Hadoop resourcemanager is running [ OK ] hald (pid 1031) is running... HBase master daemon is dead and pid file exists [FAILED] hbase-regionserver is not running. HBase rest daemon is running [ OK ] HBase thrift daemon is running [ OK ] HCatalog server is running [ OK ] Hive Metastore is dead and pid file exists [FAILED] Hive Server is running [ OK ] Hive Server2 is dead and pid file exists [FAILED] WEBHCat server is running [ OK ] … Spark master is not running [FAILED] Spark worker is not running [FAILED] spice-vdagentd is stopped Sqoop Server is running [ OK ] Am I correct in assuming that all of these services should be working properly after a BigTop install? As far as the individual components go, I’ve been working through the Running various Bigtop components<https://cwiki.apache.org/confluence/display/BIGTOP/Running+various+Bigtop+components> wiki page. Pig and HBase are working so far, but Hive fails: hive> create table doh(id int); FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask This is after changing permissions to be world writable on: * /tmp * /user/hive/warehouse (actually, BigTop set that permission correctly) * /var/lib/hive/metastore/metastore_db/ (CentOS filesystem) Any ideas? I notice that Hive Server 2 'is dead and pid file exists’; looks like a good place to start. Regards, - Steve -- Illation Pty Ltd 8/350 Collins Street Melbourne 3000 T: +61 3 8399 9442 x100 M: +61 4 0096 4240 From: ivaylo frankov <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Thursday, 21 November 2013 3:04 To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: Getting Started Guide? (and some installation issues) Hi Steve, Can you send me your private email and I will be able to send you my configuration up to now. HBase , partly Hive , partly Pig (not much but still something ;)) I think that experienced specialist needs some hours to configure bigtop (at max) Newbee like me needs some days at least ;). I want to start pseudo distributed node with hbase pig giraph solr mahout and hue. Flume is also interesting. What is your desire ? Best regards, Ivo P.S: if you want spark be very carefully by installing it : You have to give repository or you may be receive some Spark language at least that was the case in ubuntu. Am Mittwoch, 20. November 2013 schrieb i.frankov : Hi Stive, I am not at home I will send you my status tonight Cheers, Ivo Von Samsung Mobile gesendet
