Dunc wrote: > J?rgen Keil wrote: >>> Hi, >>> >>> I recently started to get huge delays when booting my opensolaris box, >>> since upgrading to 2009.06 although not for the first couple of boots >>> afterwards. Thanks to a pointer from someone in #opensolaris, I've >>> discovered it's the zpool import of my storage pool that is taking ages. >> ... >>> While this was going on, devfsadm was busy the whole time, please see >>> below some captured output from top at intervals. >> pstack `pgrep -x devfsadm` >> output might be useful. >> >> >> top shows that "fmd" (fault manager daemon) is active, >> so I guess some system faults get recorded. What is >> reported by fmdump? E.g. with fmdump -e -V ? >> >> >> Are there any error or warning messages recorded to >> /var/adm/messages? > > Hi J?rgen, thanks for getting back. > > dunc at prefect:~$ fmdump -e -V > TIME CLASS > fmdump: /var/fm/fmd/errlog is empty > dunc at prefect:~$ > > > > Nothing in the log that seems to be of any use > > dunc at prefect:~# tail -n 10 /var/adm/messages > Jul 19 05:07:25 prefect pseudo: [ID 129642 kern.info] pseudo-device: pm0 > Jul 19 05:07:25 prefect genunix: [ID 936769 kern.info] pm0 is /pseudo/pm at 0 > Jul 19 05:07:25 prefect pseudo: [ID 129642 kern.info] pseudo-device: nsmb0 > Jul 19 05:07:25 prefect genunix: [ID 936769 kern.info] nsmb0 is > /pseudo/nsmb at 0 > Jul 19 05:07:25 prefect pseudo: [ID 129642 kern.info] pseudo-device: > lx_systrace0 > Jul 19 05:07:25 prefect genunix: [ID 936769 kern.info] lx_systrace0 is > /pseudo/lx_systrace at 0 > Jul 19 05:22:54 prefect gnome-session[692]: [ID 702911 daemon.warning] > EggSMClient-WARNING: Desktop file > '/usr/share/gnome/autostart/desktop-print-management-applet.desktop' has > malformed Icon key 'print-manager.png'(should not include extension) > Jul 19 05:29:34 prefect gnome-session[692]: [ID 702911 daemon.warning] > WARNING: Could not connect to ConsoleKit: Could not get owner of name > 'org.freedesktop.ConsoleKit': no such name > Jul 19 05:46:29 prefect gnome-session[975]: [ID 702911 daemon.warning] > EggSMClient-WARNING: Desktop file > '/usr/share/gnome/autostart/desktop-print-management-applet.desktop' has > malformed Icon key 'print-manager.png'(should not include extension) > Jul 19 05:52:29 prefect gnome-session[975]: [ID 702911 daemon.warning] > WARNING: Could not connect to ConsoleKit: Could not get owner of name > 'org.freedesktop.ConsoleKit': no such name > dunc at prefect:~# > > > > I'm going to re-import it and try the pstack thing you suggested and > will post the results. > > Cheers, > > Dunc > > _______________________________________________ > opensolaris-help mailing list > opensolaris-help at opensolaris.org
Here we are, I hope this means more to some of you than it does me :-) dunc at prefect:~# pstack `pgrep -x devfsadm` 59: devfsadmd ----------------- lwp# 1 / thread# 1 -------------------- feef1667 pause () 080582c9 daemon_update (8047e20, fefc5f04, fef90018, 0, 29, fef8700c) + 305 08056613 main (1, 8047e5c, 8047e64, feffb7b4) + 3a3 0805615d _start (1, 8047efc, 0, 8047f06, 8047f16, 8047f27) + 7d ----------------- lwp# 2 / thread# 2 -------------------- feeed01b lwp_park (0, 0, 0) feee677d cond_wait_queue (807d838, 807d848, 0, feee6c46) + 60 feee6cbe __cond_wait (807d838, 807d848, fed5ef7c, feee6d03) + 86 feee6d11 cond_wait (807d838, 807d848, fed5efcc, 805c73b) + 24 0805c675 instance_flush_thread (0, fef7f000, fed5efec, feeecd1e) + 59 feeecd56 _thrp_setup (fec50200) + 7e feeecfe0 _lwp_start (fec50200, 0, 0, feeecd1e, 0, 0) ----------------- lwp# 3 / thread# 3 -------------------- feeed01b lwp_park (0, fe98ef5c, 0) feee677d cond_wait_queue (807d878, 807d860, fe98ef5c, feee6966) + 60 feee6b43 cond_wait_common (807d878, 807d860, fe98ef5c, feee6d86) + 1eb feee6e3c __cond_timedwait (807d878, 807d860, fe98efbc, feee6e70) + c4 feee6e81 cond_timedwait (807d878, 807d860, fe98efbc, 805a44a) + 27 0805a41e minor_fini_thread (0, fef7f000, fe98efec, feeecd1e) + 6e feeecd56 _thrp_setup (fec50a00) + 7e feeecfe0 _lwp_start (fec50a00, 0, 0, feeecd1e, 0, 0) ----------------- lwp# 4 / thread# 4 -------------------- feef1777 readlink (fe76d23c, fe76d63c, fe76ce38, 805a55d) + 7 0805a77d devfsadm_mklink (fe76ddac, 818c898, 81a9210, 0) + 231 fd67097a zfs (81a9210, 818c898, 80a9fa8, 81a9240) + 17e 0805964a minor_process (818c898, 81a9210, fe76e314, 805939e) + 13e 080594c3 check_minor_type (818c898, 81a9210, fe76e89c, febdbe6a) + 133 febdbf27 walk_one_minor_list (fe76e2c8, 0, 10, fe76e89c, 8059390, fef7f000) + cb febdc000 di_walk_minor (816b058, 0, 10, fe76e89c, 8059390, 807d52c) + 90 08057b89 devi_tree_walk (fe76e89c, df07, 0, 8058736) + 10d 08058749 sync_handler (0, fe76e8ec, 514, 0, 0, 80586ac) + 9d feef1ff2 __door_return () + 52 ----------------- lwp# 5 / thread# 5 -------------------- feeed01b lwp_park (0, 0, 0) feedf9c8 sema_wait (807d7f0, 807d2bc, fe66ff8c, 80587a2) + 10 080587de lock_dev (0, 8153ba0, 0, 8143be8, 0, 0) + 46 080590d7 event_handler (813da58) + 2ab fe8737de subscriber_event_handler (8084028, fef7f000, fe66ffec, feeecd1e) + 7a feeecd56 _thrp_setup (fec51a00) + 7e feeecfe0 _lwp_start (fec51a00, 0, 0, feeecd1e, 0, 0) ----------------- lwp# 6 / thread# 6 -------------------- feef1fc1 door (fe4aecfc, 4, 0, fe4aee00, f5f00, a) fe8739cd event_deliver_service (8084028, fe4aed40, c0, 0, 0, fe873830) + 19d feef1ff2 __door_return () + 52 ----------------- lwp# 7 / thread# 7 -------------------- feef1fc1 door (0, 0, 0, fd40ee00, f5f00, a) feed8d87 door_create_func (0, fef7f000, fd40efec, feeecd1e) + 2f feeecd56 _thrp_setup (fec53200) + 7e feeecfe0 _lwp_start (fec53200, 0, 0, feeecd1e, 0, 0) dunc at prefect:~# Cheers, Dunc
