Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-13 Thread Steffen W Sørensen
On 13/05/2015, at 11.23, Steffen W Sørensen ste...@me.com wrote: On 13/05/2015, at 04.08, Gregory Meno gm...@redhat.com mailto:gm...@redhat.com wrote: Ideally I would like everything in /var/log/calmari be sure to set calamari.conf like so: [shadow_man@vpm107 ~]$ grep DEBUG

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-13 Thread Steffen W Sørensen
On 13/05/2015, at 04.08, Gregory Meno gm...@redhat.com wrote: Ideally I would like everything in /var/log/calmari be sure to set calamari.conf like so: [shadow_man@vpm107 ~]$ grep DEBUG /etc/calamari/calamari.conf log_level = DEBUG db_log_level = DEBUG log_level = DEBUG then

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-13 Thread Bruce McFarland
In my never ending saga of calamari with minions on a big endian architecture I've brought up another server from a clean install of Ubuntu 14.04. The calamari master is now essperf13. I was able to figure out how to rebuild salt-minion with zmq 3.0.5 which got salt working so the 'salt \*

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-13 Thread Gregory Meno
Wow, That must be a record. I didn’t realize that. It turns out that you’ll have the best experience if the versions of master and minion are in sync. We test and use 2014.1.5 and are still evaluating 2014.7.Z. Glad to hear things are working better. regards, Gregory On May 13, 2015, at

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-12 Thread Bruce McFarland
/var/log/salt/minion doesn't really look very interesting after that sequence. I issues salt oceton109 ceph.get_heartbeats from the master. The logs are much more interesting when clear calamari and stop salt-minion. Looking at the endpoints from http://essperf2/api/v2/cluster doesn't show

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-12 Thread Gregory Meno
Ideally I would like everything in /var/log/calmari be sure to set calamari.conf like so: [shadow_man@vpm107 ~]$ grep DEBUG /etc/calamari/calamari.conf log_level = DEBUG db_log_level = DEBUG log_level = DEBUG then restart cthulhu and apache visit http://essperf3/api/v2/cluster and

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-12 Thread Gregory Meno
All that looks fine. There must be some state where the cluster is known to calamari and it is failing to actually show it. If you have time to debug I would love to see the logs at debug level. If you don’t we could try cleaning out calamari’s state. sudo supervisorctl shutdown sudo service

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-12 Thread Bruce McFarland
Which logs? I'm assuming /var/log/salt/minon since the rest on the minions are relatively empty. Possibly Cthulhu from the master? I'm running on Ubuntu 14.04 and don't have an httpd service. I had been start/stopping apache2. Likewise there is no supervisord service and I've been using

Re: [ceph-users] [ceph-calamari] Does anyone understand Calamari??

2015-05-12 Thread Gregory Meno
Bruce, It is great to hear that salt is reporting status from all the nodes in the cluster. Let me see if I understand your question: You want to know what conditions cause us to recognize a working cluster? see