On 10/8/21 11:10 AM, John Paul Adrian Glaubitz wrote: > Hi Stan! > > On 10/8/21 18:49, Stan Johnson wrote: >> ... >> $ ls -l vmlinux >> -rwxr-xr-x 1 johnson johnson 208626696 Oct 8 09:03 vmlinux > ... > That is the unstripped, uncompressed image. You can either strip this image: > > glaubitz@node54:/data/home/glaubitz/linux> ls -lh vmlinux > -rwxr-xr-x 1 glaubitz users 274M Oct 8 17:09 vmlinux > glaubitz@node54:/data/home/glaubitz/linux> strip vmlinux > glaubitz@node54:/data/home/glaubitz/linux> ls -lh vmlinux > -rwxr-xr-x 1 glaubitz users 27M Oct 8 17:09 vmlinux > glaubitz@node54:/data/home/glaubitz/linux>
thanks, stripping vmlinux was the step I was missing. Starting with the kernel source linux-source-5.14.tar.xz installed from "apt-get install linux-source", Test 1) Compile using config-5.14.0-2 X fails as before; everything else seems to work. This confirms the problem with the Debian stock kernel vmlinux-5.14.0-2-powerpc. Test 2) Compile using config-5.10.0-8 Since the Debian default kernel vmlinux-5.10.0-8-powerpc works, I expected compiling using config-5.10.0-8 would also work, but the kernel fails while mounting filesystems with these errors, after successfully checking the rootfs: ext4: Unknown symbol utf8_strncasecmp_folded (err -2) ext4: Unknown symbol utf8_load (err -r) ext4: Unknown symbol utf8_casefold (err -2) ext4: Unknown symbol utf8_strncasecup (err -2) ext4: Unknown symbol utf8_validate (err -2) ext4: Unknown symbol utf8_unload (err -2) At this point, the system drops to a busybox shell. So these two tests were inconclusive, other than suggesting that config-5.14.0-2 may have one or more options that possibly hit a kernel regression. Next, I plan to tweak config-5.14.0-2 so I can boot vmlinux without having to compile or install any modules. The current test process is too slow -- it only takes a few minutes to cross-compile the kernel, but it takes almost two hours to cross-compile all of the modules, and the build directory ends up being 10 GB. We also know that dot-config-powermac-5.13 works with 5.14.0-2, but it likely doesn't have the option(s) selected that are needed to hit the regression. Next, I'll use git bisect to look for a regression somewhere after mainline v5.15, but I may have to go back to v5.13 or v5.14. At this point, my guess is that Debian selected one or more options that hit a kernel regression, much like the KUAP/KUEP regressions that were seen in v5.13 on the Wallstreet and PB 3400. Here's a diff of config-5.10.0-8-powerpc and config-5.14.0-2-powerpc, after stripping out the comments: $ fgrep -v \# config-5.10.0-8-powerpc > t1 $ fgrep -v \# config-5.14.0-2-powerpc > t2 $ diff t1 t2 1c1 < CONFIG_CC_VERSION_TEXT="gcc-10 (Debian 10.2.1-6) 10.2.1 20210110" --- > CONFIG_CC_VERSION_TEXT="gcc-10 (Debian 10.3.0-11) 10.3.0" 3,4c3 < CONFIG_GCC_VERSION=100201 < CONFIG_LD_VERSION=235020000 --- > CONFIG_GCC_VERSION=100300 5a5,8 > CONFIG_AS_IS_GNU=y > CONFIG_AS_VERSION=23700 > CONFIG_LD_IS_BFD=y > CONFIG_LD_VERSION=23700 10a14 > CONFIG_CC_HAS_NO_PROFILE_FN_ATTR=y 18d21 < CONFIG_BUILD_SALT="5.10.0-8-powerpc" 52a56,63 > CONFIG_BPF=y > CONFIG_HAVE_EBPF_JIT=y > > CONFIG_BPF_SYSCALL=y > CONFIG_BPF_JIT=y > CONFIG_BPF_UNPRIV_DEFAULT_OFF=y > CONFIG_BPF_LSM=y > 92a104 > CONFIG_CGROUP_MISC=y 95a108 > CONFIG_TIME_NS=y 118d130 < CONFIG_BPF=y 144,145d155 < CONFIG_BPF_LSM=y < CONFIG_BPF_SYSCALL=y 166d175 < CONFIG_PPC_BOOK3S_32=y 168c177,179 < CONFIG_PPC_BOOK3S_6xx=y --- > CONFIG_PPC_BOOK3S_32=y > CONFIG_PPC_BOOK3S_603=y > CONFIG_PPC_BOOK3S_604=y 170a182 > CONFIG_PPC_FPU_REGS=y 178a191 > CONFIG_NR_CPUS=1 200a214 > CONFIG_GENERIC_BUG_RELATIVE_POINTERS=y 203d216 < CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y 205d217 < CONFIG_ZONE_DMA=y 247,248d258 < CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y < CONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=y 285c295 < CONFIG_TASK_SIZE=0xc0000000 --- > CONFIG_TASK_SIZE=0xb0000000 292,293d301 < CONFIG_OPROFILE=m < CONFIG_HAVE_OPROFILE=y 295a304 > CONFIG_OPTPROBES=y 302a312 > CONFIG_HAVE_OPTPROBES=y 308a319 > CONFIG_ARCH_HAS_SET_MEMORY=y 316a328 > CONFIG_HAVE_ARCH_JUMP_LABEL_RELATIVE=y 330a343 > CONFIG_LTO_NONE=y 335a349 > CONFIG_HAVE_SOFTIRQ_ON_OWN_STACK=y 338a353 > CONFIG_HAVE_RELIABLE_STACKTRACE=y 347a363 > CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y 364a381,382 > CONFIG_MODULE_COMPRESS_NONE=y > CONFIG_MODPROBE_PATH="/sbin/modprobe" 377d394 < CONFIG_BLK_CGROUP_IOCOST=y 378a396 > CONFIG_BLK_CGROUP_IOCOST=y 418d435 < CONFIG_FLAT_NODE_MEM_MAP=y 420a438,439 > CONFIG_ARCH_ENABLE_MEMORY_HOTPLUG=y > CONFIG_ARCH_ENABLE_MEMORY_HOTREMOVE=y 443a463 > CONFIG_ZONE_DMA=y 445d464 < CONFIG_FRAME_VECTOR=y 446a466 > CONFIG_KMAP_LOCAL=y 557a578,580 > CONFIG_MPTCP=y > CONFIG_INET_MPTCP_DIAG=m > CONFIG_MPTCP_IPV6=y 573,574c596 < CONFIG_NF_LOG_COMMON=m < CONFIG_NF_LOG_NETDEV=m --- > CONFIG_NF_LOG_SYSLOG=m 854d875 < CONFIG_NF_LOG_BRIDGE=m 913d933 < CONFIG_HAVE_NET_DSA=y 1034a1055 > CONFIG_BATMAN_ADV_BATMAN_V=y 1039d1059 < CONFIG_BATMAN_ADV_DEBUGFS=y 1063d1082 < CONFIG_BPF_JIT=y 1202,1203d1220 < CONFIG_WIMAX=m < CONFIG_WIMAX_DEBUG_LEVEL=8 1224a1242 > CONFIG_NET_SELFTESTS=m 1230d1247 < CONFIG_HAVE_CBPF_JIT=y 1276a1294 > CONFIG_AUXILIARY_BUS=y 1291a1310 > CONFIG_REGMAP_MMIO=m 1325a1345,1346 > CONFIG_ZRAM_DEF_COMP_LZORLE=y > CONFIG_ZRAM_DEF_COMP="lzo-rle" 1328d1348 < CONFIG_BLK_DEV_UMEM=m 1393,1394d1412 < CONFIG_HAVE_IDE=y < 1717,1718d1734 < < 1740a1757 > CONFIG_AQTION=m 1830a1848 > CONFIG_NET_VENDOR_MICROSOFT=y 1850a1869 > CONFIG_MLX5_BRIDGE=y 1851a1871 > CONFIG_MLX5_TC_SAMPLE=y 1956a1977 > CONFIG_AX88796B_PHY=m 1986a2008 > CONFIG_FWNODE_MDIO=m 2183a2206 > CONFIG_MT76_CONNAC_LIB=m 2189a2213,2218 > CONFIG_MT7615_COMMON=m > CONFIG_MT7615E=m > CONFIG_MT7663_USB_SDIO_COMMON=m > CONFIG_MT7663U=m > CONFIG_MT7915E=m > CONFIG_MT7921E=m 2264,2268d2292 < < CONFIG_WIMAX_I2400M=m < CONFIG_WIMAX_I2400M_USB=m < CONFIG_WIMAX_I2400M_DEBUG_LEVEL=8 < 2280,2281d2303 < CONFIG_DLCI=m < CONFIG_DLCI_MAX=8 2289a2312,2313 > > 2382d2405 < CONFIG_TABLET_USB_GTCO=m 2388d2410 < CONFIG_TOUCHSCREEN_PROPERTIES=y 2532a2555,2558 > CONFIG_TCG_TPM=y > CONFIG_TCG_TIS_CORE=m > CONFIG_TCG_TIS_SPI=m > CONFIG_TCG_VTPM_PROXY=m 2609a2636 > 2806a2834 > CONFIG_MEDIA_CEC_RC=y 2829a2858 > CONFIG_V4L2_ASYNC=m 2842d2870 < CONFIG_TTPCI_EEPROM=m 3013,3015d3040 < CONFIG_DVB_AV7110_IR=y < CONFIG_DVB_AV7110=m < CONFIG_DVB_AV7110_OSD=y 3020d3044 < CONFIG_DVB_BUDGET_PATCH=m 3048a3073 > CONFIG_TTPCI_EEPROM=m 3220d3244 < CONFIG_DVB_SP8870=m 3265a3290 > CONFIG_DVB_MXL692=m 3307d3331 < CONFIG_DRM_KMS_FB_HELPER=y 3443a3468 > CONFIG_SND_CTL_LED=m 3627a3653 > CONFIG_HID_CREATIVE_SB0540=m 3635a3662 > CONFIG_HID_FT260=m 3637a3665 > CONFIG_HID_GLORIOUS=m 3639a3668 > CONFIG_HID_VIVALDI=m 3681a3711,3712 > CONFIG_HID_PLAYSTATION=m > CONFIG_PLAYSTATION_FF=y 3686a3718 > CONFIG_HID_SEMITEK=m 3713a3746 > CONFIG_HID_MCP2221=m 3830d3862 < CONFIG_USB_SERIAL_XIRCOM=m 3913a3946 > 3957d3989 < CONFIG_INFINIBAND_I40IW=m 4011a4044 > CONFIG_VIRTIO_PCI_LIB=m 4043,4044d4075 < < 4047d4077 < CONFIG_CLKDEV_LOOKUP=y 4050a4081,4082 > > 4187a4220 > 4193a4227 > 4459a4494 > CONFIG_F2FS_FS_LZ4HC=y 4491a4527 > CONFIG_NETFS_SUPPORT=m 4560d4595 < CONFIG_EROFS_FS_CLUSTER_PAGE_LIMIT=1 4591a4627 > CONFIG_NFS_V4_2_SSC_HELPER=y 4602a4639 > CONFIG_CIFS_STATS2=y 4670a4708 > CONFIG_UNICODE=y 4674a4713 > CONFIG_ENCRYPTED_KEYS=y 4703a4743 > CONFIG_SECURITY_LANDLOCK=y 4706a4747 > CONFIG_INTEGRITY_TRUSTED_KEYRING=y 4708a4750,4763 > CONFIG_IMA=y > CONFIG_IMA_MEASURE_PCR_IDX=10 > CONFIG_IMA_LSM_RULES=y > CONFIG_IMA_SIG_TEMPLATE=y > CONFIG_IMA_DEFAULT_TEMPLATE="ima-sig" > CONFIG_IMA_DEFAULT_HASH_SHA256=y > CONFIG_IMA_DEFAULT_HASH="sha256" > CONFIG_IMA_APPRAISE=y > CONFIG_IMA_APPRAISE_BOOTPARAM=y > CONFIG_IMA_TRUSTED_KEYRING=y > CONFIG_IMA_MEASURE_ASYMMETRIC_KEYS=y > CONFIG_IMA_QUEUE_EARLY_BOOT_KEYS=y > CONFIG_EVM=y > CONFIG_EVM_ATTR_FSUUID=y 4733c4788 < CONFIG_CRYPTO_RNG=m --- > CONFIG_CRYPTO_RNG=y 4765c4820 < CONFIG_CRYPTO_CBC=m --- > CONFIG_CRYPTO_CBC=y 4795d4849 < CONFIG_CRYPTO_RMD128=m 4797,4798d4850 < CONFIG_CRYPTO_RMD256=m < CONFIG_CRYPTO_RMD320=m 4805d4856 < CONFIG_CRYPTO_TGR192=m 4808c4859 < CONFIG_CRYPTO_AES=m --- > CONFIG_CRYPTO_AES=y 4818d4868 < CONFIG_CRYPTO_SALSA20=m 4844c4894 < CONFIG_CRYPTO_LIB_AES=m --- > CONFIG_CRYPTO_LIB_AES=y 4869d4918 < CONFIG_MODULE_SIG_KEY="" 4871d4919 < CONFIG_SYSTEM_TRUSTED_KEYS="debian/certs/debian-uefi-certs.pem" 4902c4950 < CONFIG_LZ4_COMPRESS=y --- > CONFIG_LZ4_COMPRESS=m 4905c4953 < CONFIG_ZSTD_COMPRESS=y --- > CONFIG_ZSTD_COMPRESS=m 4943a4992,4994 > CONFIG_HAVE_GENERIC_VDSO=y > CONFIG_GENERIC_GETTIMEOFDAY=y > CONFIG_GENERIC_VDSO_TIME_NS=y 4952a5004 > CONFIG_ARCH_STACKWALK=y 4968c5020,5021 < CONFIG_ENABLE_MUST_CHECK=y --- > CONFIG_DEBUG_INFO_DWARF_TOOLCHAIN_DEFAULT=y > CONFIG_PAHOLE_HAS_SPLIT_BTF=y 4987d5039 < CONFIG_PAGE_POISONING_NO_SANITY=y 4989a5042 > CONFIG_ARCH_HAS_DEBUG_VM_PGTABLE=y 4996a5050 > CONFIG_HAVE_ARCH_KFENCE=y 5033d5086 < CONFIG_RING_BUFFER_ALLOW_SWAP=y 5051a5105 > CONFIG_FTRACE_MCOUNT_USE_RECORDMCOUNT=y 5074a5129 > CONFIG_ARCH_USE_MEMTEST=y
