Hi,

there seem to be to issues here, maybe related: a hanging slapd process and the retro CL errors.


If the slapd process is not responding can we get a pstack or gdb backtrace (http://www.port389.org/docs/389ds/FAQ/faq.html#debug_crashes) of the process ? About the Retro CL messages, is it always the same changenumber which is reported ?

On 01/09/2017 02:06 PM, Troels Hansen wrote:
Hi, we have a IPA installation, which obviously needs upgrading.
Its a single server running RHEL7.1 running IPA 4.1

However, it have been running smooth untill now:

Rebooting makes everything running again, but only for a few days.

It looks like everything fails around 0:17:47 and comes up again just before 8, when the server is rebooted.

Jan 6 00:19:46 fbbidm01 winbindd[2965]: failed to bind to server ldapi://%2fvar%2frun%2fslapd-DOMAIN.LAN.socket with dn="[Anonymous bind]" Error: Local error
Jan  6 00:19:46 fbbidm01 winbindd[2965]: (unknown)
Jan 6 00:20:29 fbbidm01 winbindd[2965]: [2017/01/06 00:20:29.758332, 0] ipa_sam.c:4128(bind_callback_cleanup)

Looking at the SLAPD logs also reveals it stopped answering:

[06/Jan/2017:00:17:47 +0100] conn=40702 op=62 SRCH base="cn=radius_aura_admin,cn=groups,cn=accounts,dc=domain,dc=lan" scope=0 filter="(objectClass=*)" attrs="cn" [06/Jan/2017:00:17:47 +0100] conn=40702 op=62 RESULT err=0 tag=101 nentries=1 etime=0 [06/Jan/2017:00:17:47 +0100] conn=40702 op=63 SRCH base="cn=radius_users,cn=groups,cn=accounts,dc=domain,dc=lan" scope=0 filter="(objectClass=*)" attrs="cn" [06/Jan/2017:00:17:47 +0100] conn=40702 op=63 RESULT err=0 tag=101 nentries=1 etime=0 [06/Jan/2017:00:17:47 +0100] conn=40702 op=64 SRCH base="cn=system_radius_users,cn=groups,cn=accounts,dc=domain,dc=lan" scope=0 filter="(objectClass=*)" attrs="cn" [06/Jan/2017:00:17:47 +0100] conn=40702 op=64 RESULT err=0 tag=101 nentries=1 etime=0 [06/Jan/2017:00:17:48 +0100] conn=40702 op=65 SRCH base="cn=accounts,dc=domain,dc=lan" scope=2 filter="(uid=sys_prov_aura)" attrs=ALL [06/Jan/2017:00:17:48 +0100] conn=40702 op=65 RESULT err=0 tag=101 nentries=1 etime=0 [06/Jan/2017:00:17:48 +0100] conn=40702 op=66 BIND dn="uid=sys_prov_aura,cn=users,cn=accounts,dc=domain,dc=lan" method=128 version=3 [06/Jan/2017:00:17:48 +0100] conn=40702 op=66 RESULT err=0 tag=97 nentries=0 etime=0 dn="uid=sys_prov_aura,cn=users,cn=accounts,dc=domain,dc=lan" [06/Jan/2017:00:17:51 +0100] conn=40703 fd=158 slot=158 connection from 10.250.8.66 to 10.250.8.58 [06/Jan/2017:00:17:53 +0100] conn=40704 fd=159 slot=159 SSL connection from 10.250.8.37 to 10.250.8.58 [06/Jan/2017:00:18:02 +0100] conn=40705 fd=160 slot=160 SSL connection from 10.250.8.57 to 10.250.8.58 [06/Jan/2017:00:18:02 +0100] conn=40706 fd=161 slot=161 SSL connection from 10.250.20.102 to 10.250.8.58 [06/Jan/2017:00:18:03 +0100] conn=40707 fd=162 slot=162 SSL connection from 10.250.20.102 to 10.250.8.58 [06/Jan/2017:00:18:58 +0100] conn=40708 fd=163 slot=163 connection from 10.250.8.66 to 10.250.8.58 [06/Jan/2017:00:19:03 +0100] conn=40709 fd=164 slot=164 connection from local to /var/run/slapd-DOMAIN.LAN.socket [06/Jan/2017:00:19:35 +0100] conn=40710 fd=165 slot=165 connection from 10.250.8.58 to 10.250.8.58 [06/Jan/2017:00:19:35 +0100] conn=40711 fd=166 slot=166 connection from 10.150.27.7 to 10.250.8.58 [06/Jan/2017:00:19:43 +0100] conn=40712 fd=167 slot=167 SSL connection from 10.250.20.102 to 10.250.8.58 [06/Jan/2017:00:19:46 +0100] conn=40713 fd=168 slot=168 connection from local to /var/run/slapd-DOMAIN.LAN.socket

It looks like it just stops answering at 00:17:48

The slapd error log reveals nothing:

[06/Jan/2017:00:17:34 +0100] DSRetroclPlugin - replog: an error occured while adding change number 3875312, dn = changenumber=3875312,cn=changelog: Already exists. [06/Jan/2017:00:17:34 +0100] retrocl-plugin - retrocl_postob: operation failure [68] [06/Jan/2017:07:57:21 +0100] - slapd shutting down - signaling operation threads - op stack size 0 max work q size 735 max work q stack size 23 [06/Jan/2017:07:57:21 +0100] - slapd shutting down - waiting for 30 threads to terminate [06/Jan/2017:07:58:02 +0100] SSL Initialization - Configured SSL version range: min: TLS1.0, max: TLS1.2

However, see a gazillion of these lines in the error log:

DSRetroclPlugin - replog: an error occured while adding change number 3875312, dn = changenumber=3875312,cn=changelog: Already exists.

Anyone with some thoughts about this, other that "Just upgrade".

--

Med venlig hilsen

*Troels Hansen*

Systemkonsulent

Casalogic A/S

T  (+45) 70 20 10 63

M (+45) 22 43 71 57

<http://www.casalogic.dk/signatur/th.vcf> <http://www.linkedin.com/company/67524> <http://twitter.com/casalogic> Red Hat, SUSE, VMware, Citrix, Novell, Yellowfin BI, EnterpriseDB, Sophos og meget mere.



--
Red Hat GmbH, http://www.de.redhat.com/, Registered seat: Grasbrunn,
Commercial register: Amtsgericht Muenchen, HRB 153243,
Managing Directors: Charles Cachera, Michael Cunningham, Michael O'Neill, Eric 
Shander

-- 
Manage your subscription for the Freeipa-users mailing list:
https://www.redhat.com/mailman/listinfo/freeipa-users
Go to http://freeipa.org for more info on the project

Reply via email to