[Freeipa-users] Error Starting IPA after crash
Hello, I had a crash due to full disks. I cleared the offending directory (backups and such). But I cannot start IPA. I drilled it down to the DirSrv not starting. Isolating the error I tried just starting the dirsrv service dirsrv start But I'm seeing this in the logs [30/Jan/2013:13:51:40 -0800] - 389-Directory/1.2.10.2 B2012.194.51 starting up [30/Jan/2013:13:51:40 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:06:06 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:06:06 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:08:15 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:08:15 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:14:05 -0800] - 389-Directory/1.2.10.2 B2012.194.51 starting up [30/Jan/2013:14:14:05 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:14:05 -0800] - libdb: unable to join the environment I have a replica that is running; so the heat is off - but is there any way to get this started? Thank you, Christian Hernandez ___ Freeipa-users mailing list Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users
Re: [Freeipa-users] Error Starting IPA after crash
On 01/30/2013 03:41 PM, Christian Hernandez wrote: Hello, I had a crash due to full disks. I cleared the offending directory (backups and such). But I cannot start IPA. I drilled it down to the DirSrv not starting. Isolating the error I tried just starting the dirsrv service dirsrv start But I'm seeing this in the logs [30/Jan/2013:13:51:40 -0800] - 389-Directory/1.2.10.2 http://1.2.10.2 B2012.194.51 starting up [30/Jan/2013:13:51:40 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:06:06 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:06:06 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:08:15 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:08:15 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:14:05 -0800] - 389-Directory/1.2.10.2 http://1.2.10.2 B2012.194.51 starting up [30/Jan/2013:14:14:05 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:14:05 -0800] - libdb: unable to join the environment I have a replica that is running; so the heat is off - but is there any way to get this started? I'm assuming you are running on EL6.3? ps -ef|grep slapd ls -al /var/lib/dirsrv/slapd-INST/db Thank you, Christian Hernandez ___ Freeipa-users mailing list Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users ___ Freeipa-users mailing list Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users
Re: [Freeipa-users] Error Starting IPA after crash
Rich, Correct, running 6.3 [r...@ipa1.gln.4over.com db]# ps -ef|grep slapd dirsrv4899 1 7 14:25 ?00:05:34 /usr/sbin/ns-slapd -D /etc/dirsrv/slapd-4OVER-COM -i /var/run/dirsrv/slapd-4OVER-COM.pid -w /var/run/dirsrv/slapd-4OVER-COM.startpid root 30545 3522 0 15:41 pts/100:00:00 grep slapd The output of the ls command is HUGE with...here is a suppresed output [r...@ipa1.gln.4over.com db]# ls -al /var/lib/dirsrv/slapd-4OVER-COM/db/ | head -25 total 1465384 drwxrwx--- 3 dirsrv dirsrv73728 Jan 30 15:44 . drwxrwx--- 6 dirsrv dirsrv 4096 Jan 14 16:52 .. -rw--- 1 dirsrv dirsrv24576 Jan 30 15:42 __db.001 -rw--- 1 dirsrv dirsrv 1728512 Jan 30 15:44 __db.002 -rw--- 1 dirsrv dirsrv 10002432 Jan 30 15:44 __db.003 -rw--- 1 dirsrv dirsrv 1081344 Jan 30 15:44 __db.004 -rw--- 1 dirsrv dirsrv 8126464 Jan 30 15:44 __db.005 -rw--- 1 dirsrv dirsrv90112 Jan 30 15:44 __db.006 -rw--- 1 dirsrv dirsrv 49 Jan 30 15:42 DBVERSION -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309284 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309285 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309286 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309287 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309288 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309289 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309290 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309291 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309292 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309293 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309294 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309295 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309296 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309297 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309298 I increased the timeout in the /etc/init.d/dirsrv to about 6 to see if it will try and recover. Is there hope to recover this? Or should I just re-install the server and make it a replica (this used to be my master i.e. it was the first IPA server installed in our 3 server setup)? Thank you, Christian Hernandez 1225 Los Angeles Street Glendale, CA 91204 Phone: 877-782-2737 ext. 4566 Fax: 818-265-3152 christi...@4over.com mailto:christi...@4over.com www.4over.com http://www.4over.com On Wed, Jan 30, 2013 at 3:36 PM, Rich Megginson rmegg...@redhat.com wrote: On 01/30/2013 03:41 PM, Christian Hernandez wrote: Hello, I had a crash due to full disks. I cleared the offending directory (backups and such). But I cannot start IPA. I drilled it down to the DirSrv not starting. Isolating the error I tried just starting the dirsrv service dirsrv start But I'm seeing this in the logs [30/Jan/2013:13:51:40 -0800] - 389-Directory/1.2.10.2 B2012.194.51 starting up [30/Jan/2013:13:51:40 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:06:06 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:06:06 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:08:15 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:08:15 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:14:05 -0800] - 389-Directory/1.2.10.2 B2012.194.51 starting up [30/Jan/2013:14:14:05 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:14:05 -0800] - libdb: unable to join the environment I have a replica that is running; so the heat is off - but is there any way to get this started? I'm assuming you are running on EL6.3? ps -ef|grep slapd ls -al /var/lib/dirsrv/slapd-INST/db Thank you, Christian Hernandez ___ Freeipa-users mailing listFreeipa-users@redhat.comhttps://www.redhat.com/mailman/listinfo/freeipa-users ___ Freeipa-users mailing list Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users
Re: [Freeipa-users] Error Starting IPA after crash
On 01/30/2013 04:46 PM, Christian Hernandez wrote: Rich, Correct, running 6.3 [r...@ipa1.gln.4over.com mailto:r...@ipa1.gln.4over.com db]# ps -ef|grep slapd dirsrv4899 1 7 14:25 ?00:05:34 /usr/sbin/ns-slapd -D /etc/dirsrv/slapd-4OVER-COM -i /var/run/dirsrv/slapd-4OVER-COM.pid -w /var/run/dirsrv/slapd-4OVER-COM.startpid root 30545 3522 0 15:41 pts/100:00:00 grep slapd The output of the ls command is HUGE with...here is a suppresed output [r...@ipa1.gln.4over.com mailto:r...@ipa1.gln.4over.com db]# ls -al /var/lib/dirsrv/slapd-4OVER-COM/db/ | head -25 total 1465384 drwxrwx--- 3 dirsrv dirsrv73728 Jan 30 15:44 . drwxrwx--- 6 dirsrv dirsrv 4096 Jan 14 16:52 .. -rw--- 1 dirsrv dirsrv24576 Jan 30 15:42 __db.001 -rw--- 1 dirsrv dirsrv 1728512 Jan 30 15:44 __db.002 -rw--- 1 dirsrv dirsrv 10002432 Jan 30 15:44 __db.003 -rw--- 1 dirsrv dirsrv 1081344 Jan 30 15:44 __db.004 -rw--- 1 dirsrv dirsrv 8126464 Jan 30 15:44 __db.005 -rw--- 1 dirsrv dirsrv90112 Jan 30 15:44 __db.006 -rw--- 1 dirsrv dirsrv 49 Jan 30 15:42 DBVERSION -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309284 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309285 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309286 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309287 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309288 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309289 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309290 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309291 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309292 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309293 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309294 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309295 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309296 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309297 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309298 I increased the timeout in the /etc/init.d/dirsrv to about 6 to see if it will try and recover. Sounds good. If you have that many log files, it may take a while to recover. Is there hope to recover this? Or should I just re-install the server and make it a replica (this used to be my master i.e. it was the first IPA server installed in our 3 server setup)? Try the increased timeout. Thank you, Christian Hernandez 1225 Los Angeles Street Glendale, CA 91204 Phone: 877-782-2737 ext. 4566 Fax: 818-265-3152 christi...@4over.com mailto:christi...@4over.com mailto:christi...@4over.com mailto:christi...@4over.com www.4over.com http://www.4over.com/ http://www.4over.com http://www.4over.com/ On Wed, Jan 30, 2013 at 3:36 PM, Rich Megginson rmegg...@redhat.com mailto:rmegg...@redhat.com wrote: On 01/30/2013 03:41 PM, Christian Hernandez wrote: Hello, I had a crash due to full disks. I cleared the offending directory (backups and such). But I cannot start IPA. I drilled it down to the DirSrv not starting. Isolating the error I tried just starting the dirsrv service dirsrv start But I'm seeing this in the logs [30/Jan/2013:13:51:40 -0800] - 389-Directory/1.2.10.2 http://1.2.10.2 B2012.194.51 starting up [30/Jan/2013:13:51:40 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:06:06 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:06:06 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:08:15 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:08:15 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:14:05 -0800] - 389-Directory/1.2.10.2 http://1.2.10.2 B2012.194.51 starting up [30/Jan/2013:14:14:05 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:14:05 -0800] - libdb: unable to join the environment I have a replica that is running; so the heat is off - but is there any way to get this started? I'm assuming you are running on EL6.3? ps -ef|grep slapd ls -al /var/lib/dirsrv/slapd-INST/db Thank you, Christian Hernandez ___ Freeipa-users mailing list Freeipa-users@redhat.com mailto:Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users ___ Freeipa-users mailing list Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users
Re: [Freeipa-users] Error Starting IPA after crash
Just to update... I let the logs be read and now I can start IPA without a problem! Thanks for the help! :) Thank you, Christian Hernandez 1225 Los Angeles Street Glendale, CA 91204 Phone: 877-782-2737 ext. 4566 Fax: 818-265-3152 christi...@4over.com mailto:christi...@4over.com www.4over.com http://www.4over.com On Wed, Jan 30, 2013 at 4:01 PM, Rich Megginson rmegg...@redhat.com wrote: On 01/30/2013 04:46 PM, Christian Hernandez wrote: Rich, Correct, running 6.3 [r...@ipa1.gln.4over.com db]# ps -ef|grep slapd dirsrv4899 1 7 14:25 ?00:05:34 /usr/sbin/ns-slapd -D /etc/dirsrv/slapd-4OVER-COM -i /var/run/dirsrv/slapd-4OVER-COM.pid -w /var/run/dirsrv/slapd-4OVER-COM.startpid root 30545 3522 0 15:41 pts/100:00:00 grep slapd The output of the ls command is HUGE with...here is a suppresed output [r...@ipa1.gln.4over.com db]# ls -al /var/lib/dirsrv/slapd-4OVER-COM/db/ | head -25 total 1465384 drwxrwx--- 3 dirsrv dirsrv73728 Jan 30 15:44 . drwxrwx--- 6 dirsrv dirsrv 4096 Jan 14 16:52 .. -rw--- 1 dirsrv dirsrv24576 Jan 30 15:42 __db.001 -rw--- 1 dirsrv dirsrv 1728512 Jan 30 15:44 __db.002 -rw--- 1 dirsrv dirsrv 10002432 Jan 30 15:44 __db.003 -rw--- 1 dirsrv dirsrv 1081344 Jan 30 15:44 __db.004 -rw--- 1 dirsrv dirsrv 8126464 Jan 30 15:44 __db.005 -rw--- 1 dirsrv dirsrv90112 Jan 30 15:44 __db.006 -rw--- 1 dirsrv dirsrv 49 Jan 30 15:42 DBVERSION -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309284 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309285 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309286 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309287 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309288 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309289 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309290 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309291 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309292 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309293 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309294 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309295 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309296 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309297 -rw--- 1 dirsrv dirsrv 10485760 Jan 30 15:43 log.309298 I increased the timeout in the /etc/init.d/dirsrv to about 6 to see if it will try and recover. Sounds good. If you have that many log files, it may take a while to recover. Is there hope to recover this? Or should I just re-install the server and make it a replica (this used to be my master i.e. it was the first IPA server installed in our 3 server setup)? Try the increased timeout. Thank you, Christian Hernandez 1225 Los Angeles Street Glendale, CA 91204 Phone: 877-782-2737 ext. 4566 Fax: 818-265-3152 christi...@4over.com mailto:christi...@4over.com www.4over.com http://www.4over.com On Wed, Jan 30, 2013 at 3:36 PM, Rich Megginson rmegg...@redhat.comwrote: On 01/30/2013 03:41 PM, Christian Hernandez wrote: Hello, I had a crash due to full disks. I cleared the offending directory (backups and such). But I cannot start IPA. I drilled it down to the DirSrv not starting. Isolating the error I tried just starting the dirsrv service dirsrv start But I'm seeing this in the logs [30/Jan/2013:13:51:40 -0800] - 389-Directory/1.2.10.2 B2012.194.51 starting up [30/Jan/2013:13:51:40 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:06:06 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:06:06 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:08:15 -0800] - Unable to start slapd because it is already running as process 1543 [30/Jan/2013:14:08:15 -0800] - Shutting down due to possible conflicts with other slapd processes [30/Jan/2013:14:14:05 -0800] - 389-Directory/1.2.10.2 B2012.194.51 starting up [30/Jan/2013:14:14:05 -0800] - Detected Disorderly Shutdown last time Directory Server was running, recovering database. [30/Jan/2013:14:14:05 -0800] - libdb: unable to join the environment I have a replica that is running; so the heat is off - but is there any way to get this started? I'm assuming you are running on EL6.3? ps -ef|grep slapd ls -al /var/lib/dirsrv/slapd-INST/db Thank you, Christian Hernandez ___ Freeipa-users mailing listFreeipa-users@redhat.comhttps://www.redhat.com/mailman/listinfo/freeipa-users ___ Freeipa-users mailing list Freeipa-users@redhat.com https://www.redhat.com/mailman/listinfo/freeipa-users
