Re: Newer yacc needed for building world
On 24/04/2015 12:05, Garrett Cooper wrote: On Apr 24, 2015, at 3:03, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 24, 2015, at 2:59, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 23, 2015, at 2:05, Willem Jan Withagen w...@digiware.nl wrote: On 22/04/2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? # svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/stable/10 Relative URL: ^/stable/10 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 281853 Node Kind: directory Schedule: normal Last Changed Author: kib Last Changed Rev: 281849 Last Changed Date: 2015-04-22 12:59:05 +0200 (Wed, 22 Apr 2015) Then I removed /usr/obj/* to get a fresh start. Removing yacc just gets me into trouble even earlier: # make -j 32 buildworld . . . --- _bootstrap-tools-usr.bin/compile_et --- --- parse.c --- yacc -d -o parse.c /usr/src/usr.bin/compile_et/../../contrib/com_err/parse.y yacc: not found --- _bootstrap-tools-usr.sbin/bsnmpd/gensnmptree --- /usr/obj/usr/src/tmp/usr/src/usr.sbin/bsnmpd/gensnmptree created for /usr/src/usr.sbin/bsnmpd/gensnmptree --- _bootstrap-tools-usr.bin/compile_et --- *** [parse.c] Error code 127 So I have relatively little further to test. Perhaps the '-j 32' was a bit aggressive, but it gets fast where the error is. Well, that’s amusing :(. You found a new race that wasn’t present before my changes to parallelize bootstrap-tools (kerberos comes before yacc in bootstrap-tools). Do you have yacc installed on your machine? Please try out this patch. Thanks! -NGie $ svn diff Makefile.inc1 Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY It’ll also need lex too. This should be a bit more comprehensive: Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}$-usr.bin/lex ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY I’ll work out the finally kinks with how to spell lex and yacc… This is part of the reason why I think BOOTSTRAPPING needs to be kicked to the curb and everything needs to be built in parallel, but enough people haven’t complained about built failures, so the optimization remains.. Remember I moved /usr/bin/out of the path. Which would be different for using an outdated yacc. Which is where the bug originally started. This fixes the problem for a non-parallel build. But once parallel builds (with -j 5 ) are done, the .for _tool in \ loop runs into trouble when _yacc is not finished/started before config is being build. Normally this would not be a problem as long as config is not dependant on any of the new features/size in the yacc to be build. --WjW ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: Newer yacc needed for building world
On Apr 24, 2015, at 2:59, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 23, 2015, at 2:05, Willem Jan Withagen w...@digiware.nl wrote: On 22/04/2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? # svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/stable/10 Relative URL: ^/stable/10 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 281853 Node Kind: directory Schedule: normal Last Changed Author: kib Last Changed Rev: 281849 Last Changed Date: 2015-04-22 12:59:05 +0200 (Wed, 22 Apr 2015) Then I removed /usr/obj/* to get a fresh start. Removing yacc just gets me into trouble even earlier: # make -j 32 buildworld . . . --- _bootstrap-tools-usr.bin/compile_et --- --- parse.c --- yacc -d -o parse.c /usr/src/usr.bin/compile_et/../../contrib/com_err/parse.y yacc: not found --- _bootstrap-tools-usr.sbin/bsnmpd/gensnmptree --- /usr/obj/usr/src/tmp/usr/src/usr.sbin/bsnmpd/gensnmptree created for /usr/src/usr.sbin/bsnmpd/gensnmptree --- _bootstrap-tools-usr.bin/compile_et --- *** [parse.c] Error code 127 So I have relatively little further to test. Perhaps the '-j 32' was a bit aggressive, but it gets fast where the error is. Well, that’s amusing :(. You found a new race that wasn’t present before my changes to parallelize bootstrap-tools (kerberos comes before yacc in bootstrap-tools). Do you have yacc installed on your machine? Please try out this patch. Thanks! -NGie $ svn diff Makefile.inc1 Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY It’ll also need lex too. This should be a bit more comprehensive: Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}$-usr.bin/lex ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY signature.asc Description: Message signed with OpenPGP using GPGMail
Re: Newer yacc needed for building world
On Apr 23, 2015, at 2:05, Willem Jan Withagen w...@digiware.nl wrote: On 22/04/2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? # svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/stable/10 Relative URL: ^/stable/10 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 281853 Node Kind: directory Schedule: normal Last Changed Author: kib Last Changed Rev: 281849 Last Changed Date: 2015-04-22 12:59:05 +0200 (Wed, 22 Apr 2015) Then I removed /usr/obj/* to get a fresh start. Removing yacc just gets me into trouble even earlier: # make -j 32 buildworld . . . --- _bootstrap-tools-usr.bin/compile_et --- --- parse.c --- yacc -d -o parse.c /usr/src/usr.bin/compile_et/../../contrib/com_err/parse.y yacc: not found --- _bootstrap-tools-usr.sbin/bsnmpd/gensnmptree --- /usr/obj/usr/src/tmp/usr/src/usr.sbin/bsnmpd/gensnmptree created for /usr/src/usr.sbin/bsnmpd/gensnmptree --- _bootstrap-tools-usr.bin/compile_et --- *** [parse.c] Error code 127 So I have relatively little further to test. Perhaps the '-j 32' was a bit aggressive, but it gets fast where the error is. Well, that’s amusing :(. You found a new race that wasn’t present before my changes to parallelize bootstrap-tools (kerberos comes before yacc in bootstrap-tools). Do you have yacc installed on your machine? Please try out this patch. Thanks! -NGie $ svn diff Makefile.inc1 Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY signature.asc Description: Message signed with OpenPGP using GPGMail
Re: Newer yacc needed for building world
On 24/04/2015 12:05, Garrett Cooper wrote: On Apr 24, 2015, at 3:03, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 24, 2015, at 2:59, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 23, 2015, at 2:05, Willem Jan Withagen w...@digiware.nl wrote: On 22/04/2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? # svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/stable/10 Relative URL: ^/stable/10 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 281853 Node Kind: directory Schedule: normal Last Changed Author: kib Last Changed Rev: 281849 Last Changed Date: 2015-04-22 12:59:05 +0200 (Wed, 22 Apr 2015) Then I removed /usr/obj/* to get a fresh start. Removing yacc just gets me into trouble even earlier: # make -j 32 buildworld . . . --- _bootstrap-tools-usr.bin/compile_et --- --- parse.c --- yacc -d -o parse.c /usr/src/usr.bin/compile_et/../../contrib/com_err/parse.y yacc: not found --- _bootstrap-tools-usr.sbin/bsnmpd/gensnmptree --- /usr/obj/usr/src/tmp/usr/src/usr.sbin/bsnmpd/gensnmptree created for /usr/src/usr.sbin/bsnmpd/gensnmptree --- _bootstrap-tools-usr.bin/compile_et --- *** [parse.c] Error code 127 So I have relatively little further to test. Perhaps the '-j 32' was a bit aggressive, but it gets fast where the error is. Well, that’s amusing :(. You found a new race that wasn’t present before my changes to parallelize bootstrap-tools (kerberos comes before yacc in bootstrap-tools). Do you have yacc installed on your machine? Please try out this patch. Thanks! -NGie $ svn diff Makefile.inc1 Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY It’ll also need lex too. This should be a bit more comprehensive: Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}$-usr.bin/lex ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY I’ll work out the finally kinks with how to spell lex and yacc… This is part of the reason why I think BOOTSTRAPPING needs to be kicked to the curb and everything needs to be built in parallel, but enough people haven’t complained about built failures, so the optimization remains.. Well, what I did for the above test is mv /usr/bin/yacc /usr/bin/yacc.sav Mainly because I already installed a yacc version that did not run out of tablespace for roken. I'll give your patch a go. Turns out that it is even used before that when building bsnmpd. Which make me wonder why that would be a bootstrap-tool, although that is completely different question. :) Everything in Parallel would be interesting. Somebody posted a URL to an paper on this and no more recursive make because it kills the dependancy information, which I found very interesting. --WjW ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: Newer yacc needed for building world
On Apr 24, 2015, at 3:03, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 24, 2015, at 2:59, Garrett Cooper yaneurab...@gmail.com wrote: On Apr 23, 2015, at 2:05, Willem Jan Withagen w...@digiware.nl wrote: On 22/04/2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? # svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/stable/10 Relative URL: ^/stable/10 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 281853 Node Kind: directory Schedule: normal Last Changed Author: kib Last Changed Rev: 281849 Last Changed Date: 2015-04-22 12:59:05 +0200 (Wed, 22 Apr 2015) Then I removed /usr/obj/* to get a fresh start. Removing yacc just gets me into trouble even earlier: # make -j 32 buildworld . . . --- _bootstrap-tools-usr.bin/compile_et --- --- parse.c --- yacc -d -o parse.c /usr/src/usr.bin/compile_et/../../contrib/com_err/parse.y yacc: not found --- _bootstrap-tools-usr.sbin/bsnmpd/gensnmptree --- /usr/obj/usr/src/tmp/usr/src/usr.sbin/bsnmpd/gensnmptree created for /usr/src/usr.sbin/bsnmpd/gensnmptree --- _bootstrap-tools-usr.bin/compile_et --- *** [parse.c] Error code 127 So I have relatively little further to test. Perhaps the '-j 32' was a bit aggressive, but it gets fast where the error is. Well, that’s amusing :(. You found a new race that wasn’t present before my changes to parallelize bootstrap-tools (kerberos comes before yacc in bootstrap-tools). Do you have yacc installed on your machine? Please try out this patch. Thanks! -NGie $ svn diff Makefile.inc1 Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY It’ll also need lex too. This should be a bit more comprehensive: Index: Makefile.inc1 === --- Makefile.inc1 (revision 281823) +++ Makefile.inc1 (working copy) @@ -1358,6 +1358,8 @@ usr.bin/compile_et .ORDER: ${_kerberos5_bootstrap_tools:C/^/${_bt}-/g} + +${_bt}-usr.bin/compile_et: ${_bt}$-usr.bin/lex ${_bt}-usr.bin/yacc .endif bootstrap-tools: .PHONY I’ll work out the finally kinks with how to spell lex and yacc… This is part of the reason why I think BOOTSTRAPPING needs to be kicked to the curb and everything needs to be built in parallel, but enough people haven’t complained about built failures, so the optimization remains.. signature.asc Description: Message signed with OpenPGP using GPGMail
Re: Newer yacc needed for building world
On 22/04/2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? # svn info Path: . Working Copy Root Path: /usr/src URL: svn://svn.freebsd.org/base/stable/10 Relative URL: ^/stable/10 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 281853 Node Kind: directory Schedule: normal Last Changed Author: kib Last Changed Rev: 281849 Last Changed Date: 2015-04-22 12:59:05 +0200 (Wed, 22 Apr 2015) Then I removed /usr/obj/* to get a fresh start. Removing yacc just gets me into trouble even earlier: # make -j 32 buildworld . . . --- _bootstrap-tools-usr.bin/compile_et --- --- parse.c --- yacc -d -o parse.c /usr/src/usr.bin/compile_et/../../contrib/com_err/parse.y yacc: not found --- _bootstrap-tools-usr.sbin/bsnmpd/gensnmptree --- /usr/obj/usr/src/tmp/usr/src/usr.sbin/bsnmpd/gensnmptree created for /usr/src/usr.sbin/bsnmpd/gensnmptree --- _bootstrap-tools-usr.bin/compile_et --- *** [parse.c] Error code 127 So I have relatively little further to test. Perhaps the '-j 32' was a bit aggressive, but it gets fast where the error is. --WjW ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: Newer yacc needed for building world
On Wed, 22 Apr 2015, Willem Jan Withagen wrote: Hi, [I thought that I've seen talk about this before.] On a customers system I'm trying to build a new world, with a fresh tree. I've deleted lines from other tracks in parallel compilation. --- aslcompilerparse.c --- yacc -d -pAslCompiler -oaslcompilerparse.c aslcompiler.y yacc: 89 shift/reduce conflicts. yacc: f - maximum table size exceeded *** [aslcompilerparse.c] Error code 2 And I do not find yacc in the tools/tmp tree. So here the buildsystem is in a catch22. And perhaps yacc needs to be added to the buildtools? Probably I can get out of this by first cd /usr/src/usr.bin/yacc make; make install Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: Newer yacc needed for building world
On 22/04/2015 18:45, Warren Block wrote: On Wed, 22 Apr 2015, Willem Jan Withagen wrote: Hi, [I thought that I've seen talk about this before.] On a customers system I'm trying to build a new world, with a fresh tree. I've deleted lines from other tracks in parallel compilation. --- aslcompilerparse.c --- yacc -d -pAslCompiler -oaslcompilerparse.c aslcompiler.y yacc: 89 shift/reduce conflicts. yacc: f - maximum table size exceeded *** [aslcompilerparse.c] Error code 2 And I do not find yacc in the tools/tmp tree. So here the buildsystem is in a catch22. And perhaps yacc needs to be added to the buildtools? Probably I can get out of this by first cd /usr/src/usr.bin/yacc make; make install Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? --WjW ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: Newer yacc needed for building world
On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org
Re: Newer yacc needed for building world
On 22-4-2015 23:37, Ed Maste wrote: On 22 April 2015 at 15:55, Willem Jan Withagen w...@digiware.nl wrote: Yes: https://lists.freebsd.org/pipermail/freebsd-current/2015-February/054740.html But this is not enough to make yacc part of the build tools?? yacc is unconditionally built during bootstrap-tools as of r281615. What SVN rev is your tree? Can't get to the system atm, but freshly fetched this afternoon (GMT). Doing the recover trick as described above did the work. So it is hard to retest, other than to throw away /usr/bin/yacc and what comes of it. Given the fact that I found that I had more issues after my freebsd-upgrade of that system, it could be very well that this was a problem as a result of the same. Even though it was a fresh checkout. I'll do the yacc rename trick, and see if it still barks at me. If so I'll get back here. regards, --WjW ___ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org