Re: NFS installworld failures
In article 54320e76.3010...@pinyon.org, rcar...@pinyon.org writes: Am I the only one attempting to maintain a local cluster using a buildworld server and mounting /usr/src/ and /usr/obj/ via NFS? Nope. I intermittently run into installworld failures, usually in sys/boot/i386 but occasionally e.g. cddl/lib where the install targets are apparently out of date, and want to be rebuilt, which doesn't work with a read-only mount. I've seen errors like this on 9.3, and was somewhat concerned about 9.3's NFS implementation as a result. Never on 9.1 or 9.2. (Sorry, I don't have any 10.0 systems yet -- we'll go to 10.1 after Christmas.) I am wondering if it's at all related to my issue with bonnie++ failing when run over NFS on a 9.3 client. (I haven't tracked this down yet.) Is this a reasonable thing to expect to work, or maybe not? It's supposed to work. -GAWollman ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: NFS installworld failures
On Sun, 2014-10-05 at 20:37 -0700, Russell L. Carter wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Greetings, Am I the only one attempting to maintain a local cluster using a buildworld server and mounting /usr/src/ and /usr/obj/ via NFS? I intermittently run into installworld failures, usually in sys/boot/i386 but occasionally e.g. cddl/lib where the install targets are apparently out of date, and want to be rebuilt, which doesn't work with a read-only mount. Is this a reasonable thing to expect to work, or maybe not? Every system in the cluster has got ntpd functioning correctly. Here's today's 2nd blocker: === cddl/lib/drti (install) /usr/bin/cc -O2 -pipe - -I/usr/src/cddl/lib/drti/../../../sys/cddl/compat/opensolaris - -I/usr/src/cddl/lib/drti/../../../cddl/compat/opensolaris/include - -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/head - -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libctf/common -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common -I/usr/src/cddl/lib/drti/../../../sys/cddl/contrib/opensolaris/uts/common -DPIC -fpic -DNEED_SOLARIS_BOOLEAN -std=gnu99 -fstack-protector -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wunused-parameter -Wcast-align -Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls -Wold-style-definition -Wno-pointer-sign -Wno-unknown-pragmas -Wmissing-variable-declarations -Wthread-safety -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Qunused-arguments -c /usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common/drti.c -o drti.o error: unable to open output file 'drti.o': '' Best regards, Russell -BEGIN PGP SIGNATURE- Version: GnuPG v2 iQIcBAEBAgAGBQJUMg52AAoJEFnLrGVSDFaEwrgP+wReSDvMhWBH25l3aOkYJbpx CXl0x/a4eSSS38UOa46KIUTFnx68XKElqUFi8eHRcSXe0L0pCNq1UQw5Qrp5Uaj0 d5GaKpkm3IP/IZtTzIbh60N2oc8einYXHWP5LsDx3Au4b4y0p2CX7ApQr61H7n5G 6E8XJ8lSrS13NBI0RvWAVY54+DzuLeoubvpJqMoodb01YToY/e3HHn/K5gbmF/x8 JK5tsW1XvGsRFxT/NLDKumuaf0JQLrRHD9DjiKTELAvtLdg7k4G4yf0BmobojUrB E1RajK8HppmyP0S2UvZMisMfEZ3radl0PKPbk/cCLMLWC1kiLWyZ70OSZ/537umY 94fF0irY0TmnsHENpQmtDB7OwPFb80bn9ztuEo54PI8j2rnSuvB4FNkHNTuTtkAi JY7V3cu2yjVbuqw7ailutc5We7jEurS+5Gi72KEL9pLs22WFtmtHfAgrZuRE4Ror RudQpszK4TIljNgh9tF3g4nMMiabKwHq4Ws2BqrZ3wJCl8tgLdetR/hGHR325dTL CnLp8YdoU6gbfbTBWqQrnmV02VMOinK+ZAAy7ATufQhy9tVIwai1gz27ou4tkkmb i0vDqv+jQoP7S6/4LfGkBJQ53X1O4L+zRYJ53YCfoH7kM4g4tNbvCDBYYG/EFU3+ 2EDMkHl04WIJvg1VcaT1 =N1ME -END PGP SIGNATURE- It was mentioned in another reply, but maybe overlooked... the contents of /etc/make.conf and /etc/src.conf must be identical between the systems where you do buildworld and installworld. For example, if you buildworld using WITHOUT_CTF and installworld without using that same setting, it will try to build the missing pieces at install time. -- Ian ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: NFS installworld failures
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Ian, On 10/06/14 08:29, Ian Lepore wrote: On Sun, 2014-10-05 at 20:37 -0700, Russell L. Carter wrote: [...] I intermittently run into installworld failures, usually in sys/boot/i386 but occasionally e.g. cddl/lib where the install targets are apparently out of date, and want to be rebuilt, which doesn't work with a read-only mount. [...] It was mentioned in another reply, but maybe overlooked... the contents of /etc/make.conf and /etc/src.conf must be identical between the systems where you do buildworld and installworld. For example, if you buildworld using WITHOUT_CTF and installworld without using that same setting, it will try to build the missing pieces at install time. Ah, the make.confs differ between client and server. Ok, fix that, rm /usr/obj/usr, make -j6 buildworld buildkernel on the server. make installworld on the client: === cddl/lib/drti (install) - --- drti.o --- /usr/bin/cc -O2 -pipe - -I/usr/src/cddl/lib/drti/../../../sys/cddl/compat/opensolaris - -I/usr/src/cddl/lib/drti/../../../cddl/compat/opensolaris/include - -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/head - -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libctf/common -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common -I/usr/src/cddl/lib/drti/../../../sys/cddl/contrib/opensolaris/uts/common -DPIC -fpic -DNEED_SOLARIS_BOOLEAN -std=gnu99 -fstack-protector -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wunused-parameter -Wcast-align -Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls -Wold-style-definition -Wno-pointer-sign -Wno-unknown-pragmas -Wmissing-variable-declarations -Wthread-safety -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Qunused-arguments -c /usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common/drti.c -o drti.o error: unable to open output file 'drti.o': '' 1 error generated. Ok, make installworld on the server, which succeeds. This is reinstalling r272576M. Try again to make installworld on the client, in case the server installworld perturbed the build; same failure. Ok, kill off /usr/obj/usr again, and I restrict the buildworld to one thread, which is interminable, but whatever. make installworld then succeeds on the client. (ntpd is functioning as it should on both client and server) As I mentioned in another message, this sort of thing happened all the time in June, then for a couple of months the NFS installs were solid, and now they are flaky again. BR, Russell (The server filesystems are error-free zfs, as is the client) -- Ian -BEGIN PGP SIGNATURE- Version: GnuPG v2 iQIcBAEBAgAGBQJUMw3sAAoJEFnLrGVSDFaErSoP/jt2rd0bvTrw/XOiv5clA9ZL MDTZwK0srB93ygOr5ctihc3sjhtSKe57I+bm3hpiPpUBj4Y+epOdRFAZnEG5LECq qDLi7rWGFsnrUKhBPkmFz4YzZbXlSAqBbmqQ2VbUP921Wu1bD09+0ETPWZyJV6Bb c2+L+Gl+LclE7/cksECMYgUqFdzwsR5zi4xpKkhXmQ1CCrbZMRTfMWJDQkl77KW6 V4ZgE53jtZg1qHSMXit9ay1u+pkhrytDFPBtqM8h2ukUifiH6xP+utNfq7O3pLXk xk/N9OhPCDd/SjofyH0SSSA5l7ka/0NEfxBimTfAoOMZp/3r8T8NS1x/iPgoAw3k 2rad74BlmrlSCwAQVNe5UMDJO2BZEbJ9a90js7naAWA6NG72Wi1s8HUA5JECVTfg Kx+tkm7+SSiC7myCNU1/lGTBdAHf0ZJ9I37Y3gFYK299Ayr+lqqRcxp4ujE4FhXS WSX9DLlctGfaFf0PCtywMuWT8+5F7vMqoFhlTTBlCGbfjMu0ZkB/hiJT0ksKcjOs uasflmxewbffGqykp7XWQa8SUNcFIUj2lBgPqQRLf2I+3kBbtHe6nZW1p53/anVL l+T78Gpp9wQxuVrKyJGZ0UbKYRaxqWnT3EL515oCU9W5g9pCFnqpaS541SWxDIGX dpby6I9gcik+Xi4/kJSG =4yse -END PGP SIGNATURE- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
NFS installworld failures
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Greetings, Am I the only one attempting to maintain a local cluster using a buildworld server and mounting /usr/src/ and /usr/obj/ via NFS? I intermittently run into installworld failures, usually in sys/boot/i386 but occasionally e.g. cddl/lib where the install targets are apparently out of date, and want to be rebuilt, which doesn't work with a read-only mount. Is this a reasonable thing to expect to work, or maybe not? Every system in the cluster has got ntpd functioning correctly. Here's today's 2nd blocker: === cddl/lib/drti (install) /usr/bin/cc -O2 -pipe - -I/usr/src/cddl/lib/drti/../../../sys/cddl/compat/opensolaris - -I/usr/src/cddl/lib/drti/../../../cddl/compat/opensolaris/include - -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/head - -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libctf/common -I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common -I/usr/src/cddl/lib/drti/../../../sys/cddl/contrib/opensolaris/uts/common -DPIC -fpic -DNEED_SOLARIS_BOOLEAN -std=gnu99 -fstack-protector -Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type -Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wunused-parameter -Wcast-align -Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls -Wold-style-definition -Wno-pointer-sign -Wno-unknown-pragmas -Wmissing-variable-declarations -Wthread-safety -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Qunused-arguments -c /usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common/drti.c -o drti.o error: unable to open output file 'drti.o': '' Best regards, Russell -BEGIN PGP SIGNATURE- Version: GnuPG v2 iQIcBAEBAgAGBQJUMg52AAoJEFnLrGVSDFaEwrgP+wReSDvMhWBH25l3aOkYJbpx CXl0x/a4eSSS38UOa46KIUTFnx68XKElqUFi8eHRcSXe0L0pCNq1UQw5Qrp5Uaj0 d5GaKpkm3IP/IZtTzIbh60N2oc8einYXHWP5LsDx3Au4b4y0p2CX7ApQr61H7n5G 6E8XJ8lSrS13NBI0RvWAVY54+DzuLeoubvpJqMoodb01YToY/e3HHn/K5gbmF/x8 JK5tsW1XvGsRFxT/NLDKumuaf0JQLrRHD9DjiKTELAvtLdg7k4G4yf0BmobojUrB E1RajK8HppmyP0S2UvZMisMfEZ3radl0PKPbk/cCLMLWC1kiLWyZ70OSZ/537umY 94fF0irY0TmnsHENpQmtDB7OwPFb80bn9ztuEo54PI8j2rnSuvB4FNkHNTuTtkAi JY7V3cu2yjVbuqw7ailutc5We7jEurS+5Gi72KEL9pLs22WFtmtHfAgrZuRE4Ror RudQpszK4TIljNgh9tF3g4nMMiabKwHq4Ws2BqrZ3wJCl8tgLdetR/hGHR325dTL CnLp8YdoU6gbfbTBWqQrnmV02VMOinK+ZAAy7ATufQhy9tVIwai1gz27ou4tkkmb i0vDqv+jQoP7S6/4LfGkBJQ53X1O4L+zRYJ53YCfoH7kM4g4tNbvCDBYYG/EFU3+ 2EDMkHl04WIJvg1VcaT1 =N1ME -END PGP SIGNATURE- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: NFS installworld failures
On Sun, Oct 05, 2014 at 08:37:26PM -0700, Russell L. Carter wrote:
Greetings,
Am I the only one attempting to maintain a local cluster using
a buildworld server and mounting /usr/src/ and /usr/obj/ via NFS?
No; I do that, as well (for a couple of client machines), but they're
tracking stable/9, rather than head. (I'd switch them to stable/10, but
they run authoritative name servers, and I haven't figured out a
reasonable way to do that migration because of the way the installation
of the dns/bind99 port depends on the version of the OS at install (vs.
run) time.)
I intermittently run into installworld failures, usually
in sys/boot/i386 but occasionally e.g. cddl/lib where the
install targets are apparently out of date, and want to be
rebuilt, which doesn't work with a read-only mount.
Is this a reasonable thing to expect to work, or maybe not?
I would expect it to work -- at least, if the machines are all
reasonably closely synchronized with respect to time-of-day.
Oh -- and if the machines have compatible /etc/{make,src}.conf files.
IIRC, I also ended up needing to create a symlink or two.
Every system in the cluster has got ntpd functioning correctly.
Well, that should take care of the time-of-day (potential) issue.
Here's today's 2nd blocker:
=== cddl/lib/drti (install)
/usr/bin/cc -O2 -pipe
-I/usr/src/cddl/lib/drti/../../../sys/cddl/compat/opensolaris
-I/usr/src/cddl/lib/drti/../../../cddl/compat/opensolaris/include
-I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/head
-
-I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libctf/common
-I/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common
-I/usr/src/cddl/lib/drti/../../../sys/cddl/contrib/opensolaris/uts/common
-DPIC -fpic -DNEED_SOLARIS_BOOLEAN -std=gnu99 -fstack-protector
-Wsystem-headers -Werror -Wall -Wno-format-y2k -W -Wno-unused-parameter
-Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Wreturn-type
-Wcast-qual -Wwrite-strings -Wswitch -Wshadow -Wunused-parameter -Wcast-align
-Wchar-subscripts -Winline -Wnested-externs -Wredundant-decls
-Wold-style-definition -Wno-pointer-sign -Wno-unknown-pragmas
-Wmissing-variable-declarations -Wthread-safety -Wno-empty-body
-Wno-string-plus-int -Wno-unused-const-variable -Qunused-arguments -c
/usr/src/cddl/lib/drti/../../../cddl/contrib/opensolaris/lib/libdtrace/common/drti.c
-o drti.o
error: unable to open output file 'drti.o': ''
...
Sorry; it's been a long time since I encountered anything similar to
that, and I no longer recall what might have contributed to it. But I
do definitely do NFS installs; ref.:
FreeBSD albert.catwhisker.org 9.3-STABLE FreeBSD 9.3-STABLE #74
r272439M/272471:903504: Fri Oct 3 05:14:22 PDT 2014
r...@freebeast.catwhisker.org:/usr/obj/usr/src/sys/ALBERT i386
FreeBSD bats.catwhisker.org 9.3-STABLE FreeBSD 9.3-STABLE #74
r272439M/272471:903504: Fri Oct 3 05:17:39 PDT 2014
r...@freebeast.catwhisker.org:/usr/obj/usr/src/sys/BATS i386
(My build machine -- freebeast -- is powered off until just
before midnight.)
Peace,
david
--
David H. Wolfskill da...@catwhisker.org
Taliban: Evil cowards with guns afraid of truth from a 14-year old girl.
See http://www.catwhisker.org/~david/publickey.gpg for my public key.
pgpg56MqLTTJ1.pgp
Description: PGP signature
Re: NFS installworld failures
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/05/14 20:51, David Wolfskill wrote: On Sun, Oct 05, 2014 at 08:37:26PM -0700, Russell L. Carter wrote: Greetings, Am I the only one attempting to maintain a local cluster using a buildworld server and mounting /usr/src/ and /usr/obj/ via NFS? [...] that, and I no longer recall what might have contributed to it. But I do definitely do NFS installs; ref.: FreeBSD albert.catwhisker.org 9.3-STABLE FreeBSD 9.3-STABLE #74 r272439M/272471:903504: Fri Oct 3 05:14:22 PDT 2014 r...@freebeast.catwhisker.org:/usr/obj/usr/src/sys/ALBERT i386 FreeBSD bats.catwhisker.org 9.3-STABLE FreeBSD 9.3-STABLE #74 r272439M/272471:903504: Fri Oct 3 05:17:39 PDT 2014 r...@freebeast.catwhisker.org:/usr/obj/usr/src/sys/BATS i386 (My build machine -- freebeast -- is powered off until just before midnight.) - -current has weather: NFS installs in May Jun required write privileges on the NFS share so the local system could build what it felt was out-of-date, but then at some point root mounts lost write privileges (even though linux can mount NFS root rw no problem, I haven't bothered to track this down yet). And that is basically a GOOD THING, so I've tried hard to get my installs working that way. Through a lot of July and August this was no problem. But in September it started again. It's a timestamp issue with dependencies, I am guessing, but I'm a cmake man these days, and don't know how to debug it. Russell (and am I'm the only luser around that depends on thunderbird external editor to make my messages readable, and now that it appears to be broken I'm back to stupid land?) Peace, david -BEGIN PGP SIGNATURE- Version: GnuPG v2 iQIcBAEBAgAGBQJUMh4OAAoJEFnLrGVSDFaEWNMQAInucNxPiv2jufB9QXJzf3RC NlKzDL6HgUOLF+RBTwz0CmY2o7yejXpKjqfZVMZCzEcROQMagI4rvjJAyHc8RYmN /7Yv7SSjqGjOzJqMZNLIXTnwApZoXoQjkRK7xGStcjtNFO5eBekVmShvqtfGC6No 39HqFQ7HQGw5g8YQnvBw1lPmOv96Mawn7Yx9QYsM7EsZoy+pij4ZylPDz5Z8Ondq Teya/PNSr6vHeHR0pCsFdbt2ePZyVxjyJAkMJLwc+7WBd0+NG/Nh6YRfHZFOcpT4 reyzAbejSoWvOjOt7qeLsClB90T6Fuu8zN2dbbabjU4VSfAKAF0jG8+lTZ0wBpUD DabsiCrlur+aVwPP6Bi24sbOb7L1rHS7xBQOUYeJpcgFNbh9exDVbvIeB3ZdCDIt yxriPgR43UOYYKmUl4xnzWOv3Z0mGSmOXhXcU2CB6khqjwc9JtofnTOZtTnyuOon NL9QlVbloenDPXDi9OeaxxxRoBd7gNZteq41NcVmLxvb+iwYuy21l954y85fze0d KUMCKvydq2GjXsT81jj5BtIedMtURfPRycNV+3kPl+/MC1A/ECteqVtgXxuIP740 JeCBhUlMRJvifQgIabZezdtNW9v1A7jrmYCtjTGw2CIvvcMs/RITu4Iqu4cDQ/xS 2bXkVKiHicbxTxyEdSpe =qQFl -END PGP SIGNATURE- ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
