Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-03 Thread Mark Millard
On 2017-Nov-3, at 11:31 AM, Bryan Drewery  wrote:

> On 11/3/17 1:52 AM, Mark Millard wrote:
>> I did get another problem after buildworld, buildkernel, installkernel
>> without future source code dates: the installworld got a "cc not found"
>> for the amd64 native build based on -r325351 --that also appears to be
>> set up to report:
>> 
>> ERROR-tried-to-rebuild-during-make-install
>> 
>> if cc had been found:
>> 
>> .if defined(SRCTOP)
>> # Prevent rebuilding during install to support read-only objdirs.
>> .if ${.TARGETS:M*install*} == ${.TARGETS} && empty(.MAKE.MODE:Mmeta)
>> CFLAGS+=ERROR-tried-to-rebuild-during-make-install
>> .endif 
>> .endif 
>> 
> 
> This one usually only happens if it is trying to compile at installtime,
> which usually means a file is missing (wrong OBJDIR perhaps) or the
> timestamps are off.
> 
> I'll play with this more and see what I can come up with, but I didn't
> run into anything like this myself yet.

I locally forced a -dm on the ${MAKE} command involved
and the result reported:

Examining beforeinstall...non-existentPHONY node...out-of-date.
 recheck(beforeinstall): update time from 16:00:00 Dec 31, 1969 to now
Examining machine...modified 20:13:03 Nov 03, 2017...up-to-date.
Examining x86...modified 20:13:07 Nov 03, 2017...up-to-date.
Examining autoload.c...modified  2:27:17 Nov 03, 2016...up-to-date.
Examining autoload.o...modified  0:10:12 Nov 03, 2017...modified before source 
x86...out-of-date.
cc -target x86_64-unknown-freebsd12.0 
--sysroot=/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp 
-B/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe   
-ffreestanding -Wformat -mno-mmx -mno-sse -mno-avx -msoft-float -fshort-wchar 
-mno-red-zone -mno-aes -DLOADER_UFS_SUPPORT -DLOADER_DISK_SUPPORT 
-DLOADER_GPT_SUPPORT -DLOADER_MBR_SUPPORT -DLOADER_GELI_SUPPORT 
-I/usr/src/sys/boot/libsa -I/usr/src/sys/boot/zfs -DEFI_ZFS_BOOT -fPIC 
-DTERM_EMU -I/usr/src/sys/boot/efi/loader 
-I/usr/src/sys/boot/efi/loader/arch/amd64 -I/usr/src/sys/boot/efi/include 
-I/usr/src/sys/boot/efi/include/amd64 -I/usr/src/sys/contrib/dev/acpica/include 
-I/usr/src/sys -I/usr/src/sys/boot/i386/libi386 -DNO_PCI -DEFI 
-DSMBIOS_SERIAL_NUMBERS -I/usr/src/sys/boot/common -fPIC 
-I/usr/src/sys/boot/ficl -I/usr/src/sys/boot/ficl/amd64 
-I/usr/src/sys/boot/common -DBOOT_FORTH -DBF_DICTSIZE=15000 -g  -std=gnu99 
-Wsystem-headers -Wall -Wno-format-y2k -W -Wno-unused-parameter 
-Wstrict-prototypes -Wm
 issing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign 
-Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable 
-Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality 
-Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef 
-Wno-address-of-packed-member  -Qunused-arguments  
ERROR-tried-to-rebuild-during-make-install -c 
/usr/src/sys/boot/efi/loader/autoload.c -o autoload.o
/tmp/install.intsn5IS/sh: cc: not found
*** Error code 127

So far I've not found anything with matching times for:

Examining machine...modified 20:13:03 Nov 03, 2017...up-to-date.
Examining x86...modified 20:13:07 Nov 03, 2017...up-to-date.

But the reason for rebuild is listed as:

modified before source x86...out-of-date.

I'll keep looking. The odd time (future) is in the
ball park of others from when the virtual machine
apparently had a bad time setting.

I'm not sure if the x86 is a file vs. a directory
here. A directory would seem a bit strange for
forcing a rebuild. (Similarly for machine.)

===
Mark Millard
markmi at dsl-only.net

___
freebsd-current@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-03 Thread Bryan Drewery
On 11/3/17 1:52 AM, Mark Millard wrote:
> I did get another problem after buildworld, buildkernel, installkernel
> without future source code dates: the installworld got a "cc not found"
> for the amd64 native build based on -r325351 --that also appears to be
> set up to report:
> 
> ERROR-tried-to-rebuild-during-make-install
> 
> if cc had been found:
> 
> .if defined(SRCTOP)
> # Prevent rebuilding during install to support read-only objdirs.
> .if ${.TARGETS:M*install*} == ${.TARGETS} && empty(.MAKE.MODE:Mmeta)
> CFLAGS+=ERROR-tried-to-rebuild-during-make-install
> .endif 
> .endif 
> 

This one usually only happens if it is trying to compile at installtime,
which usually means a file is missing (wrong OBJDIR perhaps) or the
timestamps are off.

I'll play with this more and see what I can come up with, but I didn't
run into anything like this myself yet.

> is involved in:
> 
> Script started on Fri Nov  3 00:52:26 2017
> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -dM 
> -j4 installworld
> . . .
> --- realinstall_subdir_sys ---
> --- autoload.o ---
> --- realinstall_subdir_secure ---
> rm -f /usr/share/openssl/man/man3/SSL_set_generate_session_id.3 
> /usr/share/openssl/man/man3/SSL_set_generate_session_id.3.gz;  install -l h  
> /usr/share/openssl/man/man3/SSL_CTX_set_generate_session_id.3.gz 
> /usr/share/openssl/man/man3/SSL_set_generate_session_id.3.gz
> --- realinstall_subdir_sys ---
> cc -target x86_64-unknown-freebsd12.0 
> --sysroot=/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp 
> -B/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe 
>   -ffreestanding -Wformat -mno-mmx -mno-sse -mno-avx -msoft-float 
> -fshort-wchar -mno-red-zone -mno-aes -DLOADER_UFS_SUPPORT 
> -DLOADER_DISK_SUPPORT -DLOADER_GPT_SUPPORT -DLOADER_MBR_SUPPORT 
> -DLOADER_GELI_SUPPORT -I/usr/src/sys/boot/libsa -I/usr/src/sys/boot/zfs 
> -DEFI_ZFS_BOOT -fPIC -DTERM_EMU -I/usr/src/sys/boot/efi/loader 
> -I/usr/src/sys/boot/efi/loader/arch/amd64 -I/usr/src/sys/boot/efi/include 
> -I/usr/src/sys/boot/efi/include/amd64 
> -I/usr/src/sys/contrib/dev/acpica/include -I/usr/src/sys 
> -I/usr/src/sys/boot/i386/libi386 -DNO_PCI -DEFI -DSMBIOS_SERIAL_NUMBERS 
> -I/usr/src/sys/boot/common -fPIC -I/usr/src/sys/boot/ficl 
> -I/usr/src/sys/boot/ficl/amd64 -I/usr/src/sys/boot/common -DBOOT_FORTH 
> -DBF_DICTSIZE=15000 -g  -std=gnu99 -Wsystem-headers -Wall -Wno-format-y2k -W 
> -Wno-unused-parameter -Wstrict-prototypes -Wmissing-prototypes 
> -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign -Wno-empty-body 
> -Wno-string-plus-int -Wno-unused-const-variable -Wno-tautological-compare 
> -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function 
> -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member  
> -Qunused-arguments  ERROR-tried-to-rebuild-during-make-install -c 
> /usr/src/sys/boot/efi/loader/autoload.c -o autoload.o
> sh: cc: not found
> --- realinstall_subdir_secure ---
> rm -f /usr/share/openssl/man/man3/SSL_CTX_get_info_callback.3 
> /usr/share/openssl/man/man3/SSL_CTX_get_info_callback.3.gz;  install -l h  
> /usr/share/openssl/man/man3/SSL_CTX_set_info_callback.3.gz 
> /usr/share/openssl/man/man3/SSL_CTX_get_info_callback.3.gz
> --- realinstall_subdir_sys ---
> *** [autoload.o] Error code 127
> 
> make[7]: stopped in /usr/src/sys/boot/efi/loader
> 1 error
> 
> make[7]: stopped in /usr/src/sys/boot/efi/loader
> *** [realinstall_subdir_sys/boot/efi/loader] Error code 2
> 
> 
> Or without -j4:
> 
> Script started on Fri Nov  3 01:38:54 2017
> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -dM 
> installworld
> . . .
> ===> sys/boot/libsa32 (install)
> ===> sys/boot/zfs (install)
> ===> sys/boot/zfs32 (install)
> ===> sys/boot/ficl32 (install)
> ===> sys/boot/efi (install)
> ===> sys/boot/efi/libefi (install)
> ===> sys/boot/efi/loader (install)
> cc -target x86_64-unknown-freebsd12.0 
> --sysroot=/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp 
> -B/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe 
>   -ffreestanding -Wformat -mno-mmx -mno-sse -mno-avx -msoft-float 
> -fshort-wchar -mno-red-zone -mno-aes -DLOADER_UFS_SUPPORT 
> -DLOADER_DISK_SUPPORT -DLOADER_GPT_SUPPORT -DLOADER_MBR_SUPPORT 
> -DLOADER_GELI_SUPPORT -I/usr/src/sys/boot/libsa -I/usr/src/sys/boot/zfs 
> -DEFI_ZFS_BOOT -fPIC -DTERM_EMU -I/usr/src/sys/boot/efi/loader 
> -I/usr/src/sys/boot/efi/loader/arch/amd64 -I/usr/src/sys/boot/efi/include 
> -I/usr/src/sys/boot/efi/include/amd64 
> -I/usr/src/sys/contrib/dev/acpica/include -I/usr/src/sys 
> -I/usr/src/sys/boot/i386/libi386 -DNO_PCI -DEFI -DSMBIOS_SERIAL_NUMBERS 
> -I/usr/src/sys/boo

Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-03 Thread Mark Millard
I did get another problem after buildworld, buildkernel, installkernel
without future source code dates: the installworld got a "cc not found"
for the amd64 native build based on -r325351 --that also appears to be
set up to report:

ERROR-tried-to-rebuild-during-make-install

if cc had been found:

.if defined(SRCTOP)
# Prevent rebuilding during install to support read-only objdirs.
.if ${.TARGETS:M*install*} == ${.TARGETS} && empty(.MAKE.MODE:Mmeta)
CFLAGS+=ERROR-tried-to-rebuild-during-make-install
.endif 
.endif 

is involved in:

Script started on Fri Nov  3 00:52:26 2017
Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -dM 
-j4 installworld
. . .
--- realinstall_subdir_sys ---
--- autoload.o ---
--- realinstall_subdir_secure ---
rm -f /usr/share/openssl/man/man3/SSL_set_generate_session_id.3 
/usr/share/openssl/man/man3/SSL_set_generate_session_id.3.gz;  install -l h  
/usr/share/openssl/man/man3/SSL_CTX_set_generate_session_id.3.gz 
/usr/share/openssl/man/man3/SSL_set_generate_session_id.3.gz
--- realinstall_subdir_sys ---
cc -target x86_64-unknown-freebsd12.0 
--sysroot=/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp 
-B/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe   
-ffreestanding -Wformat -mno-mmx -mno-sse -mno-avx -msoft-float -fshort-wchar 
-mno-red-zone -mno-aes -DLOADER_UFS_SUPPORT -DLOADER_DISK_SUPPORT 
-DLOADER_GPT_SUPPORT -DLOADER_MBR_SUPPORT -DLOADER_GELI_SUPPORT 
-I/usr/src/sys/boot/libsa -I/usr/src/sys/boot/zfs -DEFI_ZFS_BOOT -fPIC 
-DTERM_EMU -I/usr/src/sys/boot/efi/loader 
-I/usr/src/sys/boot/efi/loader/arch/amd64 -I/usr/src/sys/boot/efi/include 
-I/usr/src/sys/boot/efi/include/amd64 -I/usr/src/sys/contrib/dev/acpica/include 
-I/usr/src/sys -I/usr/src/sys/boot/i386/libi386 -DNO_PCI -DEFI 
-DSMBIOS_SERIAL_NUMBERS -I/usr/src/sys/boot/common -fPIC 
-I/usr/src/sys/boot/ficl -I/usr/src/sys/boot/ficl/amd64 
-I/usr/src/sys/boot/common -DBOOT_FORTH -DBF_DICTSIZE=15000 -g  -std=gnu99 
-Wsystem-headers -Wall -Wno-format-y2k -W -Wno-unused-parameter 
-Wstrict-prototypes -Wm
 issing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign 
-Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable 
-Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality 
-Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef 
-Wno-address-of-packed-member  -Qunused-arguments  
ERROR-tried-to-rebuild-during-make-install -c 
/usr/src/sys/boot/efi/loader/autoload.c -o autoload.o
sh: cc: not found
--- realinstall_subdir_secure ---
rm -f /usr/share/openssl/man/man3/SSL_CTX_get_info_callback.3 
/usr/share/openssl/man/man3/SSL_CTX_get_info_callback.3.gz;  install -l h  
/usr/share/openssl/man/man3/SSL_CTX_set_info_callback.3.gz 
/usr/share/openssl/man/man3/SSL_CTX_get_info_callback.3.gz
--- realinstall_subdir_sys ---
*** [autoload.o] Error code 127

make[7]: stopped in /usr/src/sys/boot/efi/loader
1 error

make[7]: stopped in /usr/src/sys/boot/efi/loader
*** [realinstall_subdir_sys/boot/efi/loader] Error code 2


Or without -j4:

Script started on Fri Nov  3 01:38:54 2017
Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -dM 
installworld
. . .
===> sys/boot/libsa32 (install)
===> sys/boot/zfs (install)
===> sys/boot/zfs32 (install)
===> sys/boot/ficl32 (install)
===> sys/boot/efi (install)
===> sys/boot/efi/libefi (install)
===> sys/boot/efi/loader (install)
cc -target x86_64-unknown-freebsd12.0 
--sysroot=/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp 
-B/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/tmp/usr/bin  -O2 -pipe   
-ffreestanding -Wformat -mno-mmx -mno-sse -mno-avx -msoft-float -fshort-wchar 
-mno-red-zone -mno-aes -DLOADER_UFS_SUPPORT -DLOADER_DISK_SUPPORT 
-DLOADER_GPT_SUPPORT -DLOADER_MBR_SUPPORT -DLOADER_GELI_SUPPORT 
-I/usr/src/sys/boot/libsa -I/usr/src/sys/boot/zfs -DEFI_ZFS_BOOT -fPIC 
-DTERM_EMU -I/usr/src/sys/boot/efi/loader 
-I/usr/src/sys/boot/efi/loader/arch/amd64 -I/usr/src/sys/boot/efi/include 
-I/usr/src/sys/boot/efi/include/amd64 -I/usr/src/sys/contrib/dev/acpica/include 
-I/usr/src/sys -I/usr/src/sys/boot/i386/libi386 -DNO_PCI -DEFI 
-DSMBIOS_SERIAL_NUMBERS -I/usr/src/sys/boot/common -fPIC 
-I/usr/src/sys/boot/ficl -I/usr/src/sys/boot/ficl/amd64 
-I/usr/src/sys/boot/common -DBOOT_FORTH -DBF_DICTSIZE=15000 -g  -std=gnu99 
-Wsystem-headers -Wall -Wno-format-y2k -W -Wno-unused-parameter 
-Wstrict-prototypes -Wm
 issing-prototypes -Wpointer-arith -Wno-uninitialized -Wno-pointer-sign 
-Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable 
-Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality 
-Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typ

Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-02 Thread Mark Millard
[The rebuilding is not your problem. . . Its a
file system time problem.]

On 2017-Nov-2, at 8:16 PM, Mark Millard  wrote:

> On 2017-Nov-2, at 8:08 PM, Bryan Drewery  wrote:
> 
>> On 11/2/2017 7:47 PM, Mark Millard wrote:
>>> [Top post as it does not flow with the prior material.]
>>> 
>>> Back-to-back repeats of the same buildworld buildkernel
>>> command are rebuilding lots of obj-lib32 *.o files and
>>> the like each time under WITH_META_MODE=yes for -r325351.
>>> 
>> 
>> I think it is expected since I had to change the objdirs for build/cross
>> tools again to fix your report.
> 
> FYI: that was after several prior builds with -r325351. It is
> not just a first-repeat example.
> 
>> I am very confused how I never hit the issue you and Matt ran into. I
>> had this commit sitting in my test branch for days.  It may just be due
>> to SYSTEM_COMPILER getting triggered.  There's so many combinations of
>> options in the early build that it's impossible to test all of them.
> 
> I had WITH_META_MODE=yes as I normally do but had done
> the rm -fr of the tree content as well (because of
> directory tree structure mismatches that would be in
> the new build).
> 
>> Anyway if it continues to happen please also pass -dM to your make as it
>> will tell us why it is rebuilding.
> 
> I'm about to try that.

It reported a more up-to-date file.

But looking the timestamp was in the future (tomorrow,
almost 24 hours away):

# ls -lT 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/tmp/usr/include/runetype.h
-rwxr-xr-x  1 root  wheel  3906 Nov  3 20:13:14 2017 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/tmp/usr/include/runetype.h

Apparently one or more of the times when I booted the
virtual machine recently it ended up with a bad time
and part of at least /usr/include has the problem with
timestamps:

# ls -lT /usr/include/runetype.h
-r--r--r--  1 root  wheel  3906 Nov  3 22:48:30 2017 /usr/include/runetype.h

(The time for the active boot is fine.)

Sorry for the noise.

>>> Script started on Thu Nov  2 18:34:57 2017
>>> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
>>> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
>>> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make 
>>> -j4 buildworld buildkernel
>>> 
>>> vs.
>>> 
>>> Script started on Thu Nov  2 18:34:57 2017
>>> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
>>> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
>>> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make 
>>> -j4 buildworld buildkernel
>>> 
>>> 
>>> # svnlite status -u -r325351 /usr/src | sort
>>>   *   320623   /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h
>>> ?/usr/src/sys/amd64/conf/GENERIC-DBG
>>> ?/usr/src/sys/amd64/conf/GENERIC-NODBG
>>> ?/usr/src/sys/arm/conf/GENERIC-DBG
>>> ?/usr/src/sys/arm/conf/GENERIC-NODBG
>>> ?/usr/src/sys/arm64/conf/GENERIC-DBG
>>> ?/usr/src/sys/arm64/conf/GENERIC-NODBG
>>> ?/usr/src/sys/powerpc/conf/GENERIC64vtsc-DBG
>>> ?/usr/src/sys/powerpc/conf/GENERIC64vtsc-NODBG
>>> ?/usr/src/sys/powerpc/conf/GENERICvtsc-DBG
>>> ?/usr/src/sys/powerpc/conf/GENERICvtsc-NODBG
>>> M   325351   
>>> /usr/src/contrib/llvm/lib/Target/PowerPC/PPCFrameLowering.cpp
>>> M   325351   /usr/src/contrib/llvm/tools/lld/ELF/Arch/PPC64.cpp
>>> M   325351   /usr/src/crypto/openssl/crypto/armcap.c
>>> M   325351   /usr/src/lib/libkvm/kvm_powerpc.c
>>> M   325351   /usr/src/lib/libkvm/kvm_private.c
>>> M   325351   /usr/src/sys/arm/allwinner/aw_usbphy.c
>>> M   325351   /usr/src/sys/arm64/arm64/identcpu.c
>>> M   325351   /usr/src/sys/boot/fdt/dts/arm/a83t.dtsi
>>> M   325351   /usr/src/sys/boot/ofw/Makefile.inc
>>> M   325351   /usr/src/sys/boot/powerpc/Makefile.inc
>>> M   325351   /usr/src/sys/boot/powerpc/boot1.chrp/Makefile
>>> M   325351   /usr/src/sys/boot/powerpc/kboot/Makefile
>>> M   325351   /usr/src/sys/boot/uboot/Makefile.inc
>>> M   325351   /usr/src/sys/conf/kmod.mk
>>> M   325351   /usr/src/sys/conf/ldscript.powerpc
>>> M   325351   /usr/src/sys/kern/subr_pcpu.c
>>> M   325351   /usr/src/sys/powerpc/aim/mmu_oea64.c
>>> M   325351   /usr/src/sys/powerpc/ofw/ofw_machdep.c
>>> M   325351   /usr/src/sys/powerpc/powerpc/interrupt.c
>>> M   325351   /usr/src/sys/powerpc/powerpc/mp_machdep.c
>>> M   325351   /usr/src/sys/powerpc/powerpc/trap.c
>>> 
>>> 
>>> --
>> stage 5.1: building lib32 shim libraries
>>> --
>>> . . .
>>> --- obj -

Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-02 Thread Mark Millard
On 2017-Nov-2, at 8:08 PM, Bryan Drewery  wrote:

> On 11/2/2017 7:47 PM, Mark Millard wrote:
>> [Top post as it does not flow with the prior material.]
>> 
>> Back-to-back repeats of the same buildworld buildkernel
>> command are rebuilding lots of obj-lib32 *.o files and
>> the like each time under WITH_META_MODE=yes for -r325351.
>> 
> 
> I think it is expected since I had to change the objdirs for build/cross
> tools again to fix your report.

FYI: that was after several prior builds with -r325351. It is
not just a first-repeat example.

> I am very confused how I never hit the issue you and Matt ran into. I
> had this commit sitting in my test branch for days.  It may just be due
> to SYSTEM_COMPILER getting triggered.  There's so many combinations of
> options in the early build that it's impossible to test all of them.

I had WITH_META_MODE=yes as I normally do but had done
the rm -fr of the tree content as well (because of
directory tree structure mismatches that would be in
the new build).

> Anyway if it continues to happen please also pass -dM to your make as it
> will tell us why it is rebuilding.

I'm about to try that.

>> Script started on Thu Nov  2 18:34:57 2017
>> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
>> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
>> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make 
>> -j4 buildworld buildkernel
>> 
>> vs.
>> 
>> Script started on Thu Nov  2 18:34:57 2017
>> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
>> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
>> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make 
>> -j4 buildworld buildkernel
>> 
>> 
>> # svnlite status -u -r325351 /usr/src | sort
>>*   320623   /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h
>> ?/usr/src/sys/amd64/conf/GENERIC-DBG
>> ?/usr/src/sys/amd64/conf/GENERIC-NODBG
>> ?/usr/src/sys/arm/conf/GENERIC-DBG
>> ?/usr/src/sys/arm/conf/GENERIC-NODBG
>> ?/usr/src/sys/arm64/conf/GENERIC-DBG
>> ?/usr/src/sys/arm64/conf/GENERIC-NODBG
>> ?/usr/src/sys/powerpc/conf/GENERIC64vtsc-DBG
>> ?/usr/src/sys/powerpc/conf/GENERIC64vtsc-NODBG
>> ?/usr/src/sys/powerpc/conf/GENERICvtsc-DBG
>> ?/usr/src/sys/powerpc/conf/GENERICvtsc-NODBG
>> M   325351   
>> /usr/src/contrib/llvm/lib/Target/PowerPC/PPCFrameLowering.cpp
>> M   325351   /usr/src/contrib/llvm/tools/lld/ELF/Arch/PPC64.cpp
>> M   325351   /usr/src/crypto/openssl/crypto/armcap.c
>> M   325351   /usr/src/lib/libkvm/kvm_powerpc.c
>> M   325351   /usr/src/lib/libkvm/kvm_private.c
>> M   325351   /usr/src/sys/arm/allwinner/aw_usbphy.c
>> M   325351   /usr/src/sys/arm64/arm64/identcpu.c
>> M   325351   /usr/src/sys/boot/fdt/dts/arm/a83t.dtsi
>> M   325351   /usr/src/sys/boot/ofw/Makefile.inc
>> M   325351   /usr/src/sys/boot/powerpc/Makefile.inc
>> M   325351   /usr/src/sys/boot/powerpc/boot1.chrp/Makefile
>> M   325351   /usr/src/sys/boot/powerpc/kboot/Makefile
>> M   325351   /usr/src/sys/boot/uboot/Makefile.inc
>> M   325351   /usr/src/sys/conf/kmod.mk
>> M   325351   /usr/src/sys/conf/ldscript.powerpc
>> M   325351   /usr/src/sys/kern/subr_pcpu.c
>> M   325351   /usr/src/sys/powerpc/aim/mmu_oea64.c
>> M   325351   /usr/src/sys/powerpc/ofw/ofw_machdep.c
>> M   325351   /usr/src/sys/powerpc/powerpc/interrupt.c
>> M   325351   /usr/src/sys/powerpc/powerpc/mp_machdep.c
>> M   325351   /usr/src/sys/powerpc/powerpc/trap.c
>> 
>> 
>> --
> stage 5.1: building lib32 shim libraries
>> --
>> . . .
>> --- obj ---
>> --- lib/libgcc_eh__PL ---
>> Building 
>> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/libunwind.o
>> --- gnu/lib/libssp/libssp_nonshared__PL ---
>> Building 
>> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/gnu/lib/libssp/libssp_nonshared/_libinstall
>> . . .
>> . . .
>> 
>> And so on.
> 
> ===
> Mark Millard
> markmi at dsl-only.net
> 
> On 2017-Nov-2, at 5:30 PM, Bryan Drewery  wrote:
> 
> On 11/2/17 3:44 PM, Mark Millard wrote:
>>> Author: bdrewery
>>> Date: Thu Nov  2 22:23:00 2017
>>> New Revision: 325347
>>> URL: 
>>> https://svnweb.freebsd.org/changeset/base/325347
>>> 
>>> 
>>> Log:
>>> Something is very wrong
>>> 
>>> Modified:
>>> head/Makefile
>>> 
>>> Modified: head/Makefile
>>> ==
>>> --- head/Makefile   Thu Nov  2 21:58:18 2017(r325346)
>>> +++ 

Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-02 Thread Bryan Drewery
On 11/2/2017 7:47 PM, Mark Millard wrote:
> [Top post as it does not flow with the prior material.]
> 
> Back-to-back repeats of the same buildworld buildkernel
> command are rebuilding lots of obj-lib32 *.o files and
> the like each time under WITH_META_MODE=yes for -r325351.
> 

I think it is expected since I had to change the objdirs for build/cross
tools again to fix your report.

I am very confused how I never hit the issue you and Matt ran into. I
had this commit sitting in my test branch for days.  It may just be due
to SYSTEM_COMPILER getting triggered.  There's so many combinations of
options in the early build that it's impossible to test all of them.

Anyway if it continues to happen please also pass -dM to your make as it
will tell us why it is rebuilding.

> Script started on Thu Nov  2 18:34:57 2017
> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -j4 
> buildworld buildkernel
> 
> vs.
> 
> Script started on Thu Nov  2 18:34:57 2017
> Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
> SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
> WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -j4 
> buildworld buildkernel
> 
> 
> # svnlite status -u -r325351 /usr/src | sort
> *   320623   /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h
> ?/usr/src/sys/amd64/conf/GENERIC-DBG
> ?/usr/src/sys/amd64/conf/GENERIC-NODBG
> ?/usr/src/sys/arm/conf/GENERIC-DBG
> ?/usr/src/sys/arm/conf/GENERIC-NODBG
> ?/usr/src/sys/arm64/conf/GENERIC-DBG
> ?/usr/src/sys/arm64/conf/GENERIC-NODBG
> ?/usr/src/sys/powerpc/conf/GENERIC64vtsc-DBG
> ?/usr/src/sys/powerpc/conf/GENERIC64vtsc-NODBG
> ?/usr/src/sys/powerpc/conf/GENERICvtsc-DBG
> ?/usr/src/sys/powerpc/conf/GENERICvtsc-NODBG
> M   325351   
> /usr/src/contrib/llvm/lib/Target/PowerPC/PPCFrameLowering.cpp
> M   325351   /usr/src/contrib/llvm/tools/lld/ELF/Arch/PPC64.cpp
> M   325351   /usr/src/crypto/openssl/crypto/armcap.c
> M   325351   /usr/src/lib/libkvm/kvm_powerpc.c
> M   325351   /usr/src/lib/libkvm/kvm_private.c
> M   325351   /usr/src/sys/arm/allwinner/aw_usbphy.c
> M   325351   /usr/src/sys/arm64/arm64/identcpu.c
> M   325351   /usr/src/sys/boot/fdt/dts/arm/a83t.dtsi
> M   325351   /usr/src/sys/boot/ofw/Makefile.inc
> M   325351   /usr/src/sys/boot/powerpc/Makefile.inc
> M   325351   /usr/src/sys/boot/powerpc/boot1.chrp/Makefile
> M   325351   /usr/src/sys/boot/powerpc/kboot/Makefile
> M   325351   /usr/src/sys/boot/uboot/Makefile.inc
> M   325351   /usr/src/sys/conf/kmod.mk
> M   325351   /usr/src/sys/conf/ldscript.powerpc
> M   325351   /usr/src/sys/kern/subr_pcpu.c
> M   325351   /usr/src/sys/powerpc/aim/mmu_oea64.c
> M   325351   /usr/src/sys/powerpc/ofw/ofw_machdep.c
> M   325351   /usr/src/sys/powerpc/powerpc/interrupt.c
> M   325351   /usr/src/sys/powerpc/powerpc/mp_machdep.c
> M   325351   /usr/src/sys/powerpc/powerpc/trap.c
> 
> 
> --
 stage 5.1: building lib32 shim libraries
> --
> . . .
> --- obj ---
> --- lib/libgcc_eh__PL ---
> Building 
> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/libunwind.o
> --- gnu/lib/libssp/libssp_nonshared__PL ---
> Building 
> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/gnu/lib/libssp/libssp_nonshared/_libinstall
> --- lib/libcompiler_rt__PL ---
> Building 
> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libcompiler_rt/_libinstall
> Building 
> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libcompiler_rt/_installlinks
> --- _installlinks ---
> /usr/lib32/libgcc.a -> libcompiler_rt.a
> --- lib/libgcc_eh__PL ---
> Building 
> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/libgcc_eh.a
> --- libgcc_eh.a ---
> building static gcc_eh library
> Building 
> /usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/_libinstall
> --- gnu/lib/csu__L ---
> --- lib/csu__L ---
> --- lib/libcompiler_rt__L ---
> --- lib/libc__L ---
> --- gnu/lib/csu__L ---
> ===> gnu/lib/csu (obj,all,install)
> --- lib/csu__L ---
> ===> lib/csu (obj,all,install)
> --- lib/libcompiler_rt__L ---
> ===> lib/libcompiler_rt (obj,all,install)
> --- lib/libc__L ---
> ===> lib/libc (obj,all,install)
> --- lib/csu__L ---
> --- obj_su

Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-02 Thread Mark Millard
[Top post as it does not flow with the prior material.]

Back-to-back repeats of the same buildworld buildkernel
command are rebuilding lots of obj-lib32 *.o files and
the like each time under WITH_META_MODE=yes for -r325351.

Script started on Thu Nov  2 18:34:57 2017
Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -j4 
buildworld buildkernel

vs.

Script started on Thu Nov  2 18:34:57 2017
Command: env __MAKE_CONF=/root/src.configs/make.conf SRCCONF=/dev/null 
SRC_ENV_CONF=/root/src.configs/src.conf.amd64-clang.amd64-host 
WITH_META_MODE=yes MAKEOBJDIRPREFIX=/usr/obj/amd64_clang/amd64.amd64 make -j4 
buildworld buildkernel


# svnlite status -u -r325351 /usr/src | sort
*   320623   /usr/src/contrib/jemalloc/include/jemalloc/internal/tsd.h
?/usr/src/sys/amd64/conf/GENERIC-DBG
?/usr/src/sys/amd64/conf/GENERIC-NODBG
?/usr/src/sys/arm/conf/GENERIC-DBG
?/usr/src/sys/arm/conf/GENERIC-NODBG
?/usr/src/sys/arm64/conf/GENERIC-DBG
?/usr/src/sys/arm64/conf/GENERIC-NODBG
?/usr/src/sys/powerpc/conf/GENERIC64vtsc-DBG
?/usr/src/sys/powerpc/conf/GENERIC64vtsc-NODBG
?/usr/src/sys/powerpc/conf/GENERICvtsc-DBG
?/usr/src/sys/powerpc/conf/GENERICvtsc-NODBG
M   325351   
/usr/src/contrib/llvm/lib/Target/PowerPC/PPCFrameLowering.cpp
M   325351   /usr/src/contrib/llvm/tools/lld/ELF/Arch/PPC64.cpp
M   325351   /usr/src/crypto/openssl/crypto/armcap.c
M   325351   /usr/src/lib/libkvm/kvm_powerpc.c
M   325351   /usr/src/lib/libkvm/kvm_private.c
M   325351   /usr/src/sys/arm/allwinner/aw_usbphy.c
M   325351   /usr/src/sys/arm64/arm64/identcpu.c
M   325351   /usr/src/sys/boot/fdt/dts/arm/a83t.dtsi
M   325351   /usr/src/sys/boot/ofw/Makefile.inc
M   325351   /usr/src/sys/boot/powerpc/Makefile.inc
M   325351   /usr/src/sys/boot/powerpc/boot1.chrp/Makefile
M   325351   /usr/src/sys/boot/powerpc/kboot/Makefile
M   325351   /usr/src/sys/boot/uboot/Makefile.inc
M   325351   /usr/src/sys/conf/kmod.mk
M   325351   /usr/src/sys/conf/ldscript.powerpc
M   325351   /usr/src/sys/kern/subr_pcpu.c
M   325351   /usr/src/sys/powerpc/aim/mmu_oea64.c
M   325351   /usr/src/sys/powerpc/ofw/ofw_machdep.c
M   325351   /usr/src/sys/powerpc/powerpc/interrupt.c
M   325351   /usr/src/sys/powerpc/powerpc/mp_machdep.c
M   325351   /usr/src/sys/powerpc/powerpc/trap.c


--
>>> stage 5.1: building lib32 shim libraries
--
. . .
--- obj ---
--- lib/libgcc_eh__PL ---
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/libunwind.o
--- gnu/lib/libssp/libssp_nonshared__PL ---
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/gnu/lib/libssp/libssp_nonshared/_libinstall
--- lib/libcompiler_rt__PL ---
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libcompiler_rt/_libinstall
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libcompiler_rt/_installlinks
--- _installlinks ---
/usr/lib32/libgcc.a -> libcompiler_rt.a
--- lib/libgcc_eh__PL ---
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/libgcc_eh.a
--- libgcc_eh.a ---
building static gcc_eh library
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/libgcc_eh/_libinstall
--- gnu/lib/csu__L ---
--- lib/csu__L ---
--- lib/libcompiler_rt__L ---
--- lib/libc__L ---
--- gnu/lib/csu__L ---
===> gnu/lib/csu (obj,all,install)
--- lib/csu__L ---
===> lib/csu (obj,all,install)
--- lib/libcompiler_rt__L ---
===> lib/libcompiler_rt (obj,all,install)
--- lib/libc__L ---
===> lib/libc (obj,all,install)
--- lib/csu__L ---
--- obj_subdir_lib/csu/i386 ---
===> lib/csu/i386 (obj)
--- gnu/lib/csu__L ---
--- obj ---
--- lib/csu__L ---
--- obj ---
--- all_subdir_lib/csu/i386 ---
===> lib/csu/i386 (all)
--- lib/libcompiler_rt__L ---
--- obj ---
--- gnu/lib/csu__L ---
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/gnu/lib/csu/crtbegin.o
--- lib/csu__L ---
--- realinstall_subdir_lib/csu/i386 ---
===> lib/csu/i386 (install)
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/lib/csu/i386/_FILESINS
--- gnu/lib/csu__L ---
Building 
/usr/obj/amd64_clang/amd64.amd64/usr/src/amd64.amd64/obj-lib32/amd64.amd64/gnu/lib/csu/crtend.o
--- lib/libc_nonshared__L ---
===> lib/libc_nonshared (obj,all,inst

Re: Example of Bryan Drewery's "Something is very wrong" (from his disabling head/Makefile)?: obj-cross-tools path referenced but file is under obj-bootstrap-tools

2017-11-02 Thread Bryan Drewery
On 11/2/17 3:44 PM, Mark Millard wrote:
>> Author: bdrewery
>> Date: Thu Nov  2 22:23:00 2017
>> New Revision: 325347
>> URL: 
>> https://svnweb.freebsd.org/changeset/base/325347
>>
>>
>> Log:
>>   Something is very wrong
>>
>> Modified:
>>   head/Makefile
>>
>> Modified: head/Makefile
>> ==
>> --- head/MakefileThu Nov  2 21:58:18 2017(r325346)
>> +++ head/MakefileThu Nov  2 22:23:00 2017(r325347)
>> @@ -1,3 +1,4 @@
>> +.error Bad revision, please wait for a fix in head
>>  #
>>  # $FreeBSD$
>>  #
> 
> I just happened to have started a cross build before
> this showed up based on -r325332 . It got:
> 
> --- clang-tblgen.full ---
> c++: error: no such file or directory: 
> '/usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7/tmp/obj-cross-tools/lib/clang/libllvmminimal/libllvmminimal.a'
> *** [clang-tblgen.full] Error code 1

Someone else reported this one as well but I have not been able to
reproduce it yet.

I've tweaked the commit causing it though, r325329.  Fixed in r325350.

> 
> But find shows:
> 
> # find /usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7 -name 
> "libllvmminimal*" -print | more
> /usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7/tmp/obj-bootstrap-tools/lib/clang/libllvmminimal
> /usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7/tmp/obj-bootstrap-tools/lib/clang/libllvmminimal/libllvmminimal.a
> /usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7/tmp/obj-bootstrap-tools/lib/clang/libllvmminimal/libllvmminimal.a.meta
> 
> Comparing side-by-side shows obj-cross-tools vs.
> obj-bootstrap-tools :
> 
> /usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7/tmp/obj-cross-tools/lib/clang/libllvmminimal/libllvmminimal.a
> /usr/obj/bpim3_clang/arm.armv7/usr/src/arm.armv7/tmp/obj-bootstrap-tools/lib/clang/libllvmminimal/libllvmminimal.a
> 
> 
> ===
> Mark Millard
> markmi at dsl-only.net
> 


-- 
Regards,
Bryan Drewery



signature.asc
Description: OpenPGP digital signature