We saw another sssd crash on the weekend (well, Friday night). Centos 7, sssd 1.14.0 from COPR
Everything has worked fine for over a month until Friday. According to the log sssd_nss on the host in question: - at about 16:18, watchdog_handler killed a process for a timer overflow. - there is some flopping about as nss/sssd tries to reconnect - at 16:19:12 we see this: (Fri Sep 9 16:19:12 2016) [sssd[nss]] [sbus_dispatch] (0x0400): SBUS is reconnecting. Deferring. - Which continues until 16:20:56 (Fri Sep 9 16:20:56 2016) [sssd[nss]] [sbus_dispatch] (0x0400): SBUS is reconnecting. Deferring. Note that there are 9,573,091 lines of this, at about 80,000 msgs per second. - nss seems to stumble back to life at this point (there are no logs on the freeipa server unfortunately) - at every 15 min interval we see this (I think this might be zabbix polling sssd): (Fri Sep 9 18:30:01 2016) [sssd[nss]] [get_client_cred] (0x0020): SELINUX_getpeercon failed [-1][Unknown error -1]. (Fri Sep 9 18:30:01 2016) [sssd[nss]] [accept_fd_handler] (0x0400): Client connected! (Fri Sep 9 18:30:01 2016) [sssd[nss]] [sss_cmd_get_version] (0x0200): Received client version [1]. (Fri Sep 9 18:30:01 2016) [sssd[nss]] [sss_cmd_get_version] (0x0200): Offered version [1]. (Fri Sep 9 18:30:01 2016) [sssd[nss]] [nss_cmd_getbynam] (0x0400): Running command [38][SSS_NSS_INITGR] with input [root]. (Fri Sep 9 18:30:01 2016) [sssd[nss]] [sss_parse_name_for_domains] (0x0200): name 'root' matched without domain, user is root (Fri Sep 9 18:30:01 2016) [sssd[nss]] [nss_cmd_getbynam] (0x0100): Requesting info for [root] from [<ALL>] (Fri Sep 9 18:30:01 2016) [sssd[nss]] [nss_cmd_initgroups_search] (0x0400): User [r...@unix.petermac.org.au] does not exist in [ unix.petermac.org.au]! (negative cache) (Fri Sep 9 18:30:01 2016) [sssd[nss]] [nss_cmd_initgroups_search] (0x0080): No matching domain found for [root], fail! (Fri Sep 9 18:30:01 2016) [sssd[nss]] [client_recv] (0x0200): Client disconnected! Interspersed there is the occasional successful connection. - Then at 20:41 everything decides to fall over properly: (Fri Sep 9 20:41:07 2016) [sssd[nss]] [watchdog_handler] (0x0010): Watchdog timer overflow, killing process! (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sss_responder_ctx_destructor] (0x0400): Responder is being shut down (Fri Sep 9 20:41:07 2016) [sssd[nss]] [server_setup] (0x0400): CONFDB: /var/lib/sss/db/config.ldb (Fri Sep 9 20:41:07 2016) [sssd[nss]] [confdb_get_domain_internal] (0x0400): No enumeration for [unix.petermac.org.au]! (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sbus_init_connection] (0x0400): Adding connection 0x7f25be061590 (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.service with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/service with D-Bus connection (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:07 2016) [sssd[nss]] [monitor_common_send_id] (0x0100): Sending ID: (nss,1) (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sss_names_init_from_args] (0x0100): Using re [(((?P<domain>[^\\]+)\\(?P<name>.+$))|((?P<name>[^@]+)@(?P<domain>.+$))|(^(?P<name>[^@\\]+)$))]. (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sss_fqnames_init] (0x0100): Using fq format [%1$s@%2$s]. (Fri Sep 9 20:41:07 2016) [sssd[nss]] [check_file] (0x0400): lstat for [/var/lib/sss/pipes/private/sbus-dp_unix.petermac.org.au] failed: [2][No such file or directory]. (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sbus_client_init] (0x0020): check_file failed for [/var/lib/sss/pipes/private/ sbus-dp_unix.petermac.org.au]. (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sss_dp_init] (0x0010): Failed to connect to monitor services. (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sss_process_init] (0x0010): fatal error setting up backend connector (Fri Sep 9 20:41:07 2016) [sssd[nss]] [sss_responder_ctx_destructor] (0x0400): Responder is being shut down (Fri Sep 9 20:41:07 2016) [sssd[nss]] [nss_process_init] (0x0010): sss_process_init() failed (Fri Sep 9 20:41:09 2016) [sssd[nss]] [server_setup] (0x0400): CONFDB: /var/lib/sss/db/config.ldb (Fri Sep 9 20:41:09 2016) [sssd[nss]] [confdb_get_domain_internal] (0x0400): No enumeration for [unix.petermac.org.au]! (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sbus_init_connection] (0x0400): Adding connection 0x7fd8ac102590 (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.service with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/service with D-Bus connection (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:09 2016) [sssd[nss]] [monitor_common_send_id] (0x0100): Sending ID: (nss,1) (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sss_names_init_from_args] (0x0100): Using re [(((?P<domain>[^\\]+)\\(?P<name>.+$))|((?P<name>[^@]+)@(?P<domain>.+$))|(^(?P<name>[^@\\]+)$))]. (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sss_fqnames_init] (0x0100): Using fq format [%1$s@%2$s]. (Fri Sep 9 20:41:09 2016) [sssd[nss]] [check_file] (0x0400): lstat for [/var/lib/sss/pipes/private/sbus-dp_unix.petermac.org.au] failed: [2][No such file or directory]. (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sbus_client_init] (0x0020): check_file failed for [/var/lib/sss/pipes/private/ sbus-dp_unix.petermac.org.au]. (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sss_dp_init] (0x0010): Failed to connect to monitor services. (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sss_process_init] (0x0010): fatal error setting up backend connector (Fri Sep 9 20:41:09 2016) [sssd[nss]] [sss_responder_ctx_destructor] (0x0400): Responder is being shut down (Fri Sep 9 20:41:09 2016) [sssd[nss]] [nss_process_init] (0x0010): sss_process_init() failed (Fri Sep 9 20:41:13 2016) [sssd[nss]] [server_setup] (0x0400): CONFDB: /var/lib/sss/db/config.ldb (Fri Sep 9 20:41:13 2016) [sssd[nss]] [confdb_get_domain_internal] (0x0400): No enumeration for [unix.petermac.org.au]! (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sbus_init_connection] (0x0400): Adding connection 0x7f93f5c92590 (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.service with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/service with D-Bus connection (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/service (Fri Sep 9 20:41:13 2016) [sssd[nss]] [monitor_common_send_id] (0x0100): Sending ID: (nss,1) (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sss_names_init_from_args] (0x0100): Using re [(((?P<domain>[^\\]+)\\(?P<name>.+$))|((?P<name>[^@]+)@(?P<domain>.+$))|(^(?P<name>[^@\\]+)$))]. (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sss_fqnames_init] (0x0100): Using fq format [%1$s@%2$s]. (Fri Sep 9 20:41:13 2016) [sssd[nss]] [check_file] (0x0400): lstat for [/var/lib/sss/pipes/private/sbus-dp_unix.petermac.org.au] failed: [2][No such file or directory]. (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sbus_client_init] (0x0020): check_file failed for [/var/lib/sss/pipes/private/ sbus-dp_unix.petermac.org.au]. (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sss_dp_init] (0x0010): Failed to connect to monitor services. (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sss_process_init] (0x0010): fatal error setting up backend connector (Fri Sep 9 20:41:13 2016) [sssd[nss]] [sss_responder_ctx_destructor] (0x0400): Responder is being shut down (Fri Sep 9 20:41:13 2016) [sssd[nss]] [nss_process_init] (0x0010): sss_process_init() failed In sssd.log from the same day, we see the start at 16:18, and it repeats for 2 minutes: (Fri Sep 9 16:18:02 2016) [sssd] [svc_child_info] (0x0040): Child [4228] exited with code [1] (Fri Sep 9 16:18:02 2016) [sssd] [sbus_dispatch] (0x0080): Connection is not open for dispatching. (Fri Sep 9 16:18:03 2016) [sssd] [mt_svc_restart] (0x0400): Scheduling service nss for restart 1 (Fri Sep 9 16:18:04 2016) [sssd] [get_kill_config] (0x0100): Time between SIGTERM and SIGKILL for [nss]: [60] (Fri Sep 9 16:18:04 2016) [sssd] [start_service] (0x0100): Queueing service nss for startup (Fri Sep 9 16:18:16 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Entering. (Fri Sep 9 16:18:16 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Adding connection 0x7f3617c3aa30. (Fri Sep 9 16:18:16 2016) [sssd] [sbus_init_connection] (0x0400): Adding connection 0x7f3617c3aa30 (Fri Sep 9 16:18:16 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Got a connection (Fri Sep 9 16:18:16 2016) [sssd] [monitor_service_init] (0x0400): Initializing D-BUS Service (Fri Sep 9 16:18:16 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.monitor with path /org/freedesktop/sssd/monitor (Fri Sep 9 16:18:16 2016) [sssd] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/monitor with D-Bus connection (Fri Sep 9 16:18:16 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/monitor (Fri Sep 9 16:18:16 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/monitor (Fri Sep 9 16:18:21 2016) [sssd] [message_type] (0x0200): netlink Message type: 25 (Fri Sep 9 16:18:26 2016) [sssd] [init_timeout] (0x0040): Client timed out before Identification! (Fri Sep 9 16:18:26 2016) [sssd] [sbus_disconnect] (0x0400): Disconnecting 0x7f3617c3aa30 (Fri Sep 9 16:18:26 2016) [sssd] [connection_destructor] (0x0400): Invoking default destructor on connection 0x7f3617c3aa30 (Fri Sep 9 16:18:26 2016) [sssd] [sbus_disconnect] (0x0400): Disconnected 0x7f3617c3aa30 (Fri Sep 9 16:18:51 2016) [sssd] [message_type] (0x0200): netlink Message type: 24 After which we see this: (Fri Sep 9 16:20:21 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 16:20:51 2016) [sssd] [message_type] (0x0200): netlink Message type: 24 Which continues until everything dies: (Fri Sep 9 20:38:21 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 20:38:51 2016) [sssd] [message_type] (0x0200): netlink Message type: 24 (Fri Sep 9 20:38:51 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 20:39:21 2016) [sssd] [message_type] (0x0200): netlink Message type: 25 (Fri Sep 9 20:39:21 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 20:39:51 2016) [sssd] [message_type] (0x0200): netlink Message type: 24 (Fri Sep 9 20:39:51 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 20:40:21 2016) [sssd] [message_type] (0x0200): netlink Message type: 25 (Fri Sep 9 20:40:21 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 20:40:51 2016) [sssd] [message_type] (0x0200): netlink Message type: 24 (Fri Sep 9 20:40:51 2016) [sssd] [service_signal] (0x0020): Could not signal service [unix.petermac.org.au]. (Fri Sep 9 20:41:07 2016) [sssd] [svc_child_info] (0x0040): Child [37140] exited with code [1] (Fri Sep 9 20:41:07 2016) [sssd] [mt_svc_restart] (0x0400): Scheduling service nss for restart 1 (Fri Sep 9 20:41:07 2016) [sssd] [get_kill_config] (0x0100): Time between SIGTERM and SIGKILL for [nss]: [60] (Fri Sep 9 20:41:07 2016) [sssd] [start_service] (0x0100): Queueing service nss for startup (Fri Sep 9 20:41:07 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Entering. (Fri Sep 9 20:41:07 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Adding connection 0x7f3617c251c0. (Fri Sep 9 20:41:07 2016) [sssd] [sbus_init_connection] (0x0400): Adding connection 0x7f3617c251c0 (Fri Sep 9 20:41:07 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Got a connection (Fri Sep 9 20:41:07 2016) [sssd] [monitor_service_init] (0x0400): Initializing D-BUS Service (Fri Sep 9 20:41:07 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.monitor with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:07 2016) [sssd] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/monitor with D-Bus connection (Fri Sep 9 20:41:07 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:07 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:07 2016) [sssd] [svc_child_info] (0x0040): Child [40794] exited with code [3] (Fri Sep 9 20:41:07 2016) [sssd] [sbus_dispatch] (0x0080): Connection is not open for dispatching. (Fri Sep 9 20:41:09 2016) [sssd] [mt_svc_restart] (0x0400): Scheduling service nss for restart 2 (Fri Sep 9 20:41:09 2016) [sssd] [get_kill_config] (0x0100): Time between SIGTERM and SIGKILL for [nss]: [60] (Fri Sep 9 20:41:09 2016) [sssd] [start_service] (0x0100): Queueing service nss for startup (Fri Sep 9 20:41:09 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Entering. (Fri Sep 9 20:41:09 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Adding connection 0x7f3617c2bbd0. (Fri Sep 9 20:41:09 2016) [sssd] [sbus_init_connection] (0x0400): Adding connection 0x7f3617c2bbd0 (Fri Sep 9 20:41:09 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Got a connection (Fri Sep 9 20:41:09 2016) [sssd] [monitor_service_init] (0x0400): Initializing D-BUS Service (Fri Sep 9 20:41:09 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.monitor with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:09 2016) [sssd] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/monitor with D-Bus connection (Fri Sep 9 20:41:09 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:09 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:09 2016) [sssd] [svc_child_info] (0x0040): Child [40795] exited with code [3] (Fri Sep 9 20:41:09 2016) [sssd] [sbus_dispatch] (0x0080): Connection is not open for dispatching. (Fri Sep 9 20:41:13 2016) [sssd] [mt_svc_restart] (0x0400): Scheduling service nss for restart 3 (Fri Sep 9 20:41:13 2016) [sssd] [get_kill_config] (0x0100): Time between SIGTERM and SIGKILL for [nss]: [60] (Fri Sep 9 20:41:13 2016) [sssd] [start_service] (0x0100): Queueing service nss for startup (Fri Sep 9 20:41:13 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Entering. (Fri Sep 9 20:41:13 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Adding connection 0x7f3617c27690. (Fri Sep 9 20:41:13 2016) [sssd] [sbus_init_connection] (0x0400): Adding connection 0x7f3617c27690 (Fri Sep 9 20:41:13 2016) [sssd] [sbus_server_init_new_connection] (0x0200): Got a connection (Fri Sep 9 20:41:13 2016) [sssd] [monitor_service_init] (0x0400): Initializing D-BUS Service (Fri Sep 9 20:41:13 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.sssd.monitor with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:13 2016) [sssd] [sbus_conn_register_path] (0x0400): Registering object path /org/freedesktop/sssd/monitor with D-Bus connection (Fri Sep 9 20:41:13 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Properties with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:13 2016) [sssd] [sbus_opath_hash_add_iface] (0x0400): Registering interface org.freedesktop.DBus.Introspectable with path /org/freedesktop/sssd/monitor (Fri Sep 9 20:41:13 2016) [sssd] [svc_child_info] (0x0040): Child [40796] exited with code [3] (Fri Sep 9 20:41:13 2016) [sssd] [monitor_restart_service] (0x0010): Process [nss], definitely stopped! (Fri Sep 9 20:41:13 2016) [sssd] [monitor_quit] (0x0040): Returned with: 1 (Fri Sep 9 20:41:13 2016) [sssd] [monitor_quit] (0x0020): Terminating [ unix.petermac.org.au][37141] (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Child [ unix.petermac.org.au] terminated with a signal (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Terminating [pac][4232] (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Child [pac] exited gracefully (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Terminating [ssh][4231] (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Child [ssh] exited gracefully (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Terminating [pam][4230] (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Child [pam] exited gracefully (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Terminating [sudo][4229] (Fri Sep 9 20:41:23 2016) [sssd] [monitor_quit] (0x0020): Child [sudo] exited gracefully On the FreeIPA server we see this in messages (no sssd logging :( ). I don't know if it's significant, but it's the only error in the rough time frame (or that relates in any way to FreeIPA) Sep 9 20:35:47 vmpr-linuxidm winbindd[32689]: [2016/09/09 20:35:47.780283, 0] ipa_sam.c:4208(bind_callback_cleanup) Sep 9 20:35:47 vmpr-linuxidm winbindd[32689]: kerberos error: code=-1765328228, message=Cannot contact any KDC for realm ' UNIX.PETERMAC.ORG.AU' Sep 9 20:35:47 vmpr-linuxidm winbindd[32689]: [2016/09/09 20:35:47.780674, 0] ../source3/lib/smbldap.c:998(smbldap_connect_system) Sep 9 20:35:47 vmpr-linuxidm winbindd[32689]: failed to bind to server ldapi://%2fvar%2frun%2fslapd-UNIX-PETERMAC-ORG-AU.socket with dn="[Anonymous bind]" Error: Local error Sep 9 20:35:47 vmpr-linuxidm winbindd[32689]: #011(unknown) Sep 9 20:36:30 vmpr-linuxidm winbindd[32689]: [2016/09/09 20:36:30.799458, 0] ipa_sam.c:4208(bind_callback_cleanup) Sep 9 20:36:30 vmpr-linuxidm winbindd[32689]: kerberos error: code=-1765328228, message=Cannot contact any KDC for realm ' UNIX.PETERMAC.ORG.AU' (have found this, although it was recently closed https://bugzilla.redhat.com/show_bug.cgi?id=1071449 ) Let me know if you need any more info. Cheers L. ------ The most dangerous phrase in the language is, "We've always done it this way." - Grace Hopper
-- Manage your subscription for the Freeipa-users mailing list: https://www.redhat.com/mailman/listinfo/freeipa-users Go to http://freeipa.org for more info on the project
