Eric,
Got sidetracked for a day there. So I was able to start a tsd but the mkmetric
command gets a zookeeper NoNodeException. I know that my zookeeper is
accessible because tsd can talk to it fine. Any clues?
Thanks,
Ameet
[hadoop build]$ ./tsdb mkmetric proc.loadavg.1min --instance=foo --zkquorum=foo
--auser=foo --apass=foo
2012-04-17 16:55:56,222 ERROR [main] UniqueId: WTF? Unexpected exception type
when assigning an ID, ICV on row=[0] column='id:metrics'
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /tsdb/maxId
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:275)
~[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.assign(UidManager.java:286)
[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175)
[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.main(UidManager.java:141)
[tsdb-1.1.0.jar:]
2012-04-17 16:55:56,236 ERROR [main] UniqueId: WTF? Unexpected exception type
when assigning an ID, ICV on row=[0] column='id:metrics'
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /tsdb/maxId
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:275)
~[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.assign(UidManager.java:286)
[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175)
[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.main(UidManager.java:141)
[tsdb-1.1.0.jar:]
2012-04-17 16:55:56,247 ERROR [main] UniqueId: WTF? Unexpected exception type
when assigning an ID, ICV on row=[0] column='id:metrics'
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /tsdb/maxId
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
~[zookeeper-3.3.4.jar:3.3.3-1203054]
at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:275)
~[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.assign(UidManager.java:286)
[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175)
[tsdb-1.1.0.jar:]
at net.opentsdb.tools.UidManager.main(UidManager.java:141)
[tsdb-1.1.0.jar:]
Exception in thread "main" java.lang.IllegalStateException: Should never happen!
at net.opentsdb.uid.UniqueId.getOrCreateId(UniqueId.java:362)
at net.opentsdb.tools.UidManager.assign(UidManager.java:286)
at net.opentsdb.tools.UidManager.runCommand(UidManager.java:175)
at net.opentsdb.tools.UidManager.main(UidManager.java:141)
-Ameet Kini
From: Eric Newton [mailto:[email protected]]
Sent: Monday, April 16, 2012 12:35 PM
To: [email protected]
Subject: Re: monitoring
Yes, you have to create the tables:
shell> createtable tsdb
shell> createtable tsdb_uid
I didn't update their script because the creation of the tables is trivial in
accumulo. You have to specify your instance when you run tsd:
$ ./build/tsdb tsd --port=4242 --staticroot=build/staticroot
--cachedir="$tsdtmp" --instance myinstance
-Eric
On Mon, Apr 16, 2012 at 11:53 AM, Kini, Ameet M.
<[email protected]<mailto:[email protected]>> wrote:
Adam/Eric, thanks for your helpful responses.
Eric, I'm looking at your openTSDB port. With it and the tcollector changes, if
I understand correctly, I can use an existing Accumulo backend to store the
metrics ? I wasn't sure because src/create_table.sh still refers to HBase.
Also, if there are any special setup instructions instead or in addition to
http://opentsdb.net/getting-started.html, would be good to know.
-Ameet Kini
From: Eric Newton [mailto:[email protected]<mailto:[email protected]>]
Sent: Friday, April 13, 2012 5:31 PM
To: [email protected]<mailto:[email protected]>
Subject: Re: monitoring
Oops... premature send. Also check out:
http://github.com/ericnewton/tcollector
-Eric
On Fri, Apr 13, 2012 at 5:29 PM, Eric Newton
<[email protected]<mailto:[email protected]>> wrote:
We have used hobbit, and ganglia... which explains why the master monitoring
page shows so much information.
I am going to continue to work on opentsdb support. Maybe this weekend I'll
get around to teasing apart the hbase/accumulo back-ends and see if they will
accept the patches.
Check out:
http://github.com/ericnewton/opentsdb
On Fri, Apr 13, 2012 at 4:05 PM, Kini, Ameet M.
<[email protected]<mailto:[email protected]>> wrote:
What are folks using to monitor Accumulo - the master status page, Ganglia,
openTSDB, anything else?
I was looking into Ganglia but wasn't sure how/if Accumulo works with it. Would
the Accumulo daemons send metrics directly to the gmond, would the metrics be
dumped to a file and then read back, some other indirect way? Any online
pointers would also be useful.
Thanks,
-Ameet Kini