On Fri, 20 Jul 2007 15:35:16 -0700
Tony Nguyen <Truong.Q.Nguyen at Sun.COM> wrote:
> Michael,
>
> Can you clarify what "go down" for svc.configd mean? If it died, it
> should have been restarted since it's in svc.startd's contract. What's
> the current state of the machine we want to recover?
houdini:src[1182]>ps -ef | grep svc
root 100004 1 0 Jul 18 ? 0:12 /lib/svc/bin/svc.startd
root 100264 1 0 Jul 18 ? 0:00 /usr/lib/netsvc/yp/ypbind
-broadcast
mh138676 252998 102912 0 16:00:28 pts/4 0:00 grep svc
houdini:src[1183]>svcs -a
svcs: Could not bind to repository server: repository server unavailable.
Exiting.
houdini:src[1184]>
mph
>
> -tony
>
> Michael Hunter wrote:
> > I had fmd and svc.configd go down while working this morning(?). I
> > have a dump[1] from fmd that I'll put in a bug. svc.configd didn't
> > dump. What is a good way to recover use of smf and hopefully get fmd
> > restarted?
> >
> > mph
> >
> > [1] stack trace for those too curious to wait...
> > core '/var/cores/core.fmd.100425' of 100425: /usr/lib/fm/fmd/fmd
> > ----------------- lwp# 1 / thread# 1 --------------------
> > ff0c9fbc __sigsuspend (ffbffe00, ffbffeff, ffffbfdf, ff118db0, feba2a00,
> > 0) + 8
> > 0002d6dc main (0, ffbffe7c, 55e98, 55fa0, ffbffe00, 0) + 3e8
> > 0001bbf8 _start (0, 0, 0, 0, 0, 0) + 108
> > ----------------- lwp# 2 / thread# 2 --------------------
> > ff0ca6f4 __door_return (0, 195700, 60, 0, 0, b) + c
> > ff0ca748 __door_return (0, 0, 0, 0, 0, 0) + 60
> > ----------------- lwp# 3 / thread# 3 --------------------
> > ff0c8fcc __lwp_park (1956f0, 195700, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1956f0, 195700, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1956f0, 195700, 0, 3a10c000, 1f1f8, 32a6d8ad) + 10
> > ff3231bc subscriber_event_handler (10ba08, 28b78, 1, 195700, 0, 0) + 34
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 4 / thread# 4 --------------------
> > ff0c9304 __nanosleep (fe7fbec8, 0, 0, 0, 0, feb61a00) + 8
> > 00036510 fmd_native_wait (c6, 48c96fe2, ff11e400, feb61a00, 364d0,
> > 3b9aca00) + 40
> > 00036a30 fmd_timerq_exec (10bc00, 6661248a, 4f71, 4eab, 1d97b4a8,
> > 7fffffff) + 1c8
> > 00035a18 fmd_thread_start (eb8f8, fe7fc000, fc000, 359d0, 43000, 36868) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 5 / thread# 5 --------------------
> > ff0c8fcc __lwp_park (1dfb88, 1dfb70, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1dfb88, 1dfb70, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1dfb88, 1dfb70, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1dfb88, 1dfb70, 1dfb70, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1dfb70, 0, ff11e400, feb62200, 1dfb88, 11a140)
> > + 190
> > 0002d868 fmd_module_start (10f6c8, 20, 0, 10f6c0, 10f6e0, 3bff80) + 160
> > 00035a18 fmd_thread_start (ea970, fe6fc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 6 / thread# 6 --------------------
> > ff0c8fcc __lwp_park (1dfb28, 1dfb10, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1dfb28, 1dfb10, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1dfb28, 1dfb10, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1dfb28, 1dfb10, 1dfb10, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1dfb10, 0, ff11e400, feb62a00, 1dfb28, 1180c0)
> > + 190
> > 0002d868 fmd_module_start (10f548, 20, 0, 10f540, 10f560, 2ae400) + 160
> > 00035a18 fmd_thread_start (ead60, fe5fc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 7 / thread# 7 --------------------
> > ff0c9cf4 __pollsys (142548, 4, 0, 0, 0, 5ebcc) + 8
> > ff07661c poll (142548, 4, ffffffff, feb63200, 0, 0) + 7c
> > ff1dc528 _svc_run_mt (4, 3, ffffff38, ffffffff, ff237090, ff2372f8) + 1a0
> > ff1dc0c4 svc_run (0, 0, ff235b08, ff22acec, 4ece8, ff11e400) + c4
> > 00035a18 fmd_thread_start (eadd0, fe47c000, fc000, 359d0, 43000, 54984) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 8 / thread# 8 --------------------
> > ff0ca6f4 __door_return (3037e0, fe37c000, fc000, 359d0, 43000, 1cc28) + c
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 10 / thread# 10 --------------------
> > ff0c8fcc __lwp_park (1df0a8, 1df090, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1df0a8, 1df090, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1df0a8, 1df090, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1df0a8, 1df090, 1df090, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1df090, 0, ff11e400, feb64200, 1df0a8, 117080)
> > + 190
> > 0002d868 fmd_module_start (10f3c8, 20, 0, 10f3c0, 10f3e0, 2ae4e0) + 160
> > 00035a18 fmd_thread_start (ead98, fe17c000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 12 / thread# 12 --------------------
> > ff0c8fcc __lwp_park (1def28, 1def10, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1def28, 1def10, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1def28, 1def10, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1def28, 1def10, 1def10, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1def10, 0, ff11e400, feb64a00, 1def28, 52b240)
> > + 190
> > 0002d868 fmd_module_start (10f248, 20, 0, 10f240, 10f260, be468) + 160
> > 00035a18 fmd_thread_start (37cef0, fdffc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 13 / thread# 13 --------------------
> > ff0c8fcc __lwp_park (1deec8, 1deeb0, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1deec8, 1deeb0, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1deec8, 1deeb0, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1deec8, 1deeb0, 1deeb0, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1deeb0, 0, ff11e400, feb65200, 1deec8, 528180)
> > + 190
> > 0002d868 fmd_module_start (10f0c8, 20, 0, 10f0c0, 10f0e0, 2af900) + 160
> > 00035a18 fmd_thread_start (25bdd0, fde7c000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 14 / thread# 14 --------------------
> > ff0c8fcc __lwp_park (1defe8, 1defd0, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1defe8, 1defd0, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1defe8, 1defd0, 0, ff000000, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1defe8, 1defd0, 1defd0, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1defd0, 0, ff11e400, feb65a00, 1defe8, 526100)
> > + 190
> > 0002d868 fmd_module_start (10edc8, 20, 0, 10edc0, 10ede0, 3bfa40) + 160
> > 00035a18 fmd_thread_start (49b6f8, fdcfc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 15 / thread# 15 --------------------
> > ff0c8fcc __lwp_park (1dee68, 1dee50, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1dee68, 1dee50, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1dee68, 1dee50, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1dee68, 1dee50, 1dee50, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1dee50, 0, ff11e400, feb66200, 1dee68, 524080)
> > + 190
> > 0002d868 fmd_module_start (10ef48, 20, 0, 10ef40, 10ef60, 3bf880) + 160
> > 00035a18 fmd_thread_start (49b5a8, fdbfc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 17 / thread# 17 --------------------
> > ff0c8fcc __lwp_park (1def88, 1def70, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1def88, 1def70, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1def88, 1def70, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1def88, 1def70, 1def70, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1def70, 0, ff11e400, feb66a00, 1def88, c242c0)
> > + 190
> > 0002d868 fmd_module_start (10ec48, 20, 0, 10ec40, 10ec60, be468) + 160
> > 00035a18 fmd_thread_start (49b538, fda7c000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 18 / thread# 18 --------------------
> > ff0c9c7c __open (ff100890, 0, ff0c9064, 749d0, ff118db0, ff0c9048) + 8
> > ff08148c walkcontext (ff0c77f8, 37050, d63be8, ff118db0, 0, 2f) + 44
> > 00037228 fmd_trace_full (d2ec48, 400, 3e88c, fd57be64, 8, feb67208) + 9c
> > 00034514 fmd_trace (400, 3e88c, c9e820, 3e654, 3718c, c9f460) + 40
> > 000235e0 fmd_case_transition (d52800, 3, 0, feb67200, 42000, 2) + 94
> > 00023d10 fmd_case_delete (d52800, 0, b8, 55c00, 6, 10fe40) + 1ac
> > 0002d848 fmd_module_start (10e948, 20, 0, 10e940, 10e960, 3bfa40) + 140
> > 00035a18 fmd_thread_start (c9f460, fd57c000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 19 / thread# 19 --------------------
> > ff0c8fcc __lwp_park (1dea48, 1dea30, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1dea48, 1dea30, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1dea48, 1dea30, 0, 60, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1dea48, 1dea30, 1dea30, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1dea30, 0, ff11e400, feb67a00, 1dea48, c1f180)
> > + 190
> > 0002d868 fmd_module_start (d7fb88, 20, 0, d7fb80, d7fba0, 3bf960) + 160
> > 00035a18 fmd_thread_start (c9f428, fd3fc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 21 / thread# 21 --------------------
> > ff0c8fcc __lwp_park (1de9e8, 1de9d0, 0, 4, 57230, ff118db0) + 14
> > ff0c1e40 cond_wait_queue (1de9e8, 1de9d0, 0, 0, 0, 0) + 28
> > ff0c23a4 cond_wait (1de9e8, 1de9d0, 0, ff000000, ff1200c4, 0) + 10
> > ff0c23e0 pthread_cond_wait (1de9e8, 1de9d0, 1de9d0, 0, 1c00, 0) + 8
> > 00029be8 fmd_eventq_delete (1de9d0, 0, ff11e400, feb68200, 1de9e8, c1e140)
> > + 190
> > 0002d868 fmd_module_start (d7fa08, 20, 0, d7fa00, d7fa20, bee78) + 160
> > 00035a18 fmd_thread_start (c9ee40, fd2fc000, fc000, 359d0, 43000, 2d708) +
> > 48
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > ----------------- lwp# 23 / thread# 23 --------------------
> > ff26071c umem_hash_rescale (a4508, 21e000, 0, 0, ff27c000, 400) + 150
> > ff26095c umem_process_updates (80000000, 80000002, 80000002, 0, a4508,
> > ff286108) + 9c
> > ff25b110 umem_update_thread (469e42cc, 469f9457, ff27c000, 1, ff27f3a8,
> > ff286140) + 78
> > ff0c8f4c _lwp_start (0, 0, 0, 0, 0, 0)
> > _______________________________________________
> > smf-discuss mailing list
> > smf-discuss at opensolaris.org
> >
>
> _______________________________________________
> smf-discuss mailing list
> smf-discuss at opensolaris.org
