Hello, Copying vhost/virtio people.
On Thu, Mar 9, 2023 at 2:05 PM Pei, Andy <[email protected]> wrote: > I am running testpmd on a virtio PCI device, and encounter this issue when > enable ASAN. > > I got this ERROR, > > check_vq_phys_addr_ok(): vring address shouldn't be above 16TB! > virtio_init_queue(): setup_queue failed > eth_virtio_pci_init(): Failed to init virtio device > EAL: Releasing PCI mapped resource for 0000:18:00.0 > EAL: Calling pci_unmap_resource for 0000:18:00.0 at 0x7fc9c0000000 > EAL: Calling pci_unmap_resource for 0000:18:00.0 at 0x7fc197a75000 > EAL: Requested device 0000:18:00.0 cannot be used > EAL: Bus (pci) probe failed. > TELEMETRY: No legacy callbacks, legacy socket not created > testpmd: No probed ethernet devices > > > How to fix this issue when ASAN is enabled, huge pages are all mapped to very > high address, adding “--base-virtaddr” args does not works. I am not able to reproduce your issue. You'll have to share more details about your setup. Could you try --in-memory mode? Maybe Anatoly has a better idea. > > 00400000-1079b000 r-xp 00000000 08:03 1671254677 > /home/andy/dpdk/asan/app/dpdk-testpmd > 1099b000-109df000 r--p 1039b000 08:03 1671254677 > /home/andy/dpdk/asan/app/dpdk-testpmd > 109df000-110ba000 rw-p 103df000 08:03 1671254677 > /home/andy/dpdk/asan/app/dpdk-testpmd > 110ba000-116c6000 rw-p 00000000 00:00 0 > 7fff7000-8fff7000 rw-p 00000000 00:00 0 > 8fff7000-2008fff7000 ---p 00000000 00:00 0 > 2008fff7000-10007fff8000 rw-p 00000000 00:00 0 > 600000000000-600400000000 ---p 00000000 00:00 0 > 600400000000-600400010000 rw-p 00000000 00:00 0 > 7fb140000000-7fb180000000 rw-s 00000000 00:24 769328 > /dev/hugepages/rtemap_16384 > 7fb180000000-7fb1c0000000 rw-s 00000000 00:24 769329 > /dev/hugepages/rtemap_16385 > 7fb1c0000000-7fb200000000 rw-s 00000000 00:24 769330 > /dev/hugepages/rtemap_16386 > 7fb200000000-7fb240000000 rw-s 00000000 00:24 769331 > /dev/hugepages/rtemap_16387 > 7fc1c0000000-7fc200000000 rw-s 00000000 00:24 769319 > /dev/hugepages/rtemap_0 > 7fc200000000-7fc240000000 rw-s 00000000 00:24 769324 > /dev/hugepages/rtemap_1 > 7fc240000000-7fc280000000 rw-s 00000000 00:24 769326 > /dev/hugepages/rtemap_2 > 7fc280000000-7fc2c0000000 rw-s 00000000 00:24 769327 > /dev/hugepages/rtemap_3 > 7fc9d967c000-7fc9d967d000 rw-s 00000000 00:13 622047 > /run/dpdk/rte/fbarray_memseg-1048576k-1-1 > 7fc9d967d000-7fc9d967e000 rw-s 00000000 00:13 622046 > /run/dpdk/rte/fbarray_memseg-1048576k-1-0 > 7fc9d967e000-7fc9d967f000 rw-s 00000000 00:13 622045 > /run/dpdk/rte/fbarray_memseg-1048576k-0-1 > 7fc9d967f000-7fc9d96ad000 rw-s 00000000 00:13 622043 > /run/dpdk/rte/fbarray_memzone > 7fc9d96ad000-7fc9d96ae000 ---p 00000000 00:00 0 > 7fc9d96ae000-7fc9da1b4000 rw-p 00000000 00:00 0 > 7fc9da1b4000-7fc9da1b5000 ---p 00000000 00:00 0 > 7fc9da1b5000-7fc9dacbb000 rw-p 00000000 00:00 0 > 7fc9dacbb000-7fc9dacc2000 rw-s 00000000 00:13 622030 > /run/dpdk/rte/config > 7fc9dacc2000-7fc9dacf2000 rw-p 00000000 00:00 0 > 7fc9dacf2000-7fc9dad10000 r-xp 00000000 08:03 536960915 > /usr/lib64/libnl-3.so.200.23.0 > 7fc9dad10000-7fc9daf10000 ---p 0001e000 08:03 536960915 > /usr/lib64/libnl-3.so.200.23.0 > 7fc9daf10000-7fc9daf12000 r--p 0001e000 08:03 536960915 > /usr/lib64/libnl-3.so.200.23.0 > 7fc9daf12000-7fc9daf13000 rw-p 00020000 08:03 536960915 > /usr/lib64/libnl-3.so.200.23.0 > 7fc9daf13000-7fc9daf77000 r-xp 00000000 08:03 536960923 > /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9daf77000-7fc9db176000 ---p 00064000 08:03 536960923 > /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9db176000-7fc9db179000 r--p 00063000 08:03 536960923 > /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9db179000-7fc9db17e000 rw-p 00066000 08:03 536960923 > /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9db17e000-7fc9db180000 rw-p 00000000 00:00 0 > 7fc9db180000-7fc9db195000 r-xp 00000000 08:03 593696022 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db195000-7fc9db394000 ---p 00015000 08:03 593696022 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db394000-7fc9db395000 r--p 00014000 08:03 593696022 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db395000-7fc9db396000 rw-p 00015000 08:03 593696022 > /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db396000-7fc9db47f000 r-xp 00000000 08:03 538833557 > /usr/lib64/libstdc++.so.6.0.19 > 7fc9db47f000-7fc9db67f000 ---p 000e9000 08:03 538833557 > /usr/lib64/libstdc++.so.6.0.19 > 7fc9db67f000-7fc9db687000 r--p 000e9000 08:03 538833557 > /usr/lib64/libstdc++.so.6.0.19 > 7fc9db687000-7fc9db689000 rw-p 000f1000 08:03 538833557 > /usr/lib64/libstdc++.so.6.0.19 > 7fc9db689000-7fc9db69e000 rw-p 00000000 00:00 0 > 7fc9db69e000-7fc9db862000 r-xp 00000000 08:03 536960220 > /usr/lib64/libc-2.17.so > 7fc9db862000-7fc9dba61000 ---p 001c4000 08:03 536960220 > /usr/lib64/libc-2.17.so > 7fc9dba61000-7fc9dba65000 r--p 001c3000 08:03 536960220 > /usr/lib64/libc-2.17.so > 7fc9dba65000-7fc9dba67000 rw-p 001c7000 08:03 536960220 > /usr/lib64/libc-2.17.so > 7fc9dba67000-7fc9dba6c000 rw-p 00000000 00:00 0 > 7fc9dba6c000-7fc9dba83000 r-xp 00000000 08:03 536960246 > /usr/lib64/libpthread-2.17.so > 7fc9dba83000-7fc9dbc82000 ---p 00017000 08:03 536960246 > /usr/lib64/libpthread-2.17.so > 7fc9dbc82000-7fc9dbc83000 r--p 00016000 08:03 536960246 > /usr/lib64/libpthread-2.17.so > 7fc9dbc83000-7fc9dbc84000 rw-p 00017000 08:03 536960246 > /usr/lib64/libpthread-2.17.so > 7fc9dbc84000-7fc9dbc88000 rw-p 00000000 00:00 0 > 7fc9dbc88000-7fc9dbc93000 r-xp 00000000 08:03 537880973 > /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbc93000-7fc9dbe92000 ---p 0000b000 08:03 537880973 > /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbe92000-7fc9dbe93000 r--p 0000a000 08:03 537880973 > /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbe93000-7fc9dbe94000 rw-p 0000b000 08:03 537880973 > /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbe94000-7fc9dbea9000 r-xp 00000000 08:03 536960265 > /usr/lib64/libz.so.1.2.7 > 7fc9dbea9000-7fc9dc0a8000 ---p 00015000 08:03 536960265 > /usr/lib64/libz.so.1.2.7 > 7fc9dc0a8000-7fc9dc0a9000 r--p 00014000 08:03 536960265 > /usr/lib64/libz.so.1.2.7 > 7fc9dc0a9000-7fc9dc0aa000 rw-p 00015000 08:03 536960265 > /usr/lib64/libz.so.1.2.7 > 7fc9dc0aa000-7fc9dc2e1000 r-xp 00000000 08:03 680121447 > /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc2e1000-7fc9dc4e0000 ---p 00237000 08:03 680121447 > /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc4e0000-7fc9dc4fc000 r--p 00236000 08:03 680121447 > /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc4fc000-7fc9dc509000 rw-p 00252000 08:03 680121447 > /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc509000-7fc9dc50d000 rw-p 00000000 00:00 0 > 7fc9dc50d000-7fc9dc525000 r-xp 00000000 08:03 537880966 > /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc525000-7fc9dc724000 ---p 00018000 08:03 537880966 > /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc724000-7fc9dc725000 r--p 00017000 08:03 537880966 > /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc725000-7fc9dc726000 rw-p 00018000 08:03 537880966 > /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc726000-7fc9dc74d000 r-xp 00000000 08:03 537880975 > /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc74d000-7fc9dc94c000 ---p 00027000 08:03 537880975 > /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc94c000-7fc9dc94d000 r--p 00026000 08:03 537880975 > /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc94d000-7fc9dc94e000 rw-p 00027000 08:03 537880975 > /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc94e000-7fc9dc98c000 r-xp 00000000 08:03 538119976 > /usr/lib64/libpcap.so.1.5.3 > 7fc9dc98c000-7fc9dcb8b000 ---p 0003e000 08:03 538119976 > /usr/lib64/libpcap.so.1.5.3 > 7fc9dcb8b000-7fc9dcb8d000 r--p 0003d000 08:03 538119976 > /usr/lib64/libpcap.so.1.5.3 > 7fc9dcb8d000-7fc9dcb8e000 rw-p 0003f000 08:03 538119976 > /usr/lib64/libpcap.so.1.5.3 > 7fc9dcb8e000-7fc9dcb8f000 rw-p 00000000 00:00 0 > 7fc9dcb8f000-7fc9dcb99000 r-xp 00000000 08:03 538833618 > /usr/lib64/libnuma.so.1.0.0 > 7fc9dcb99000-7fc9dcd99000 ---p 0000a000 08:03 538833618 > /usr/lib64/libnuma.so.1.0.0 > 7fc9dcd99000-7fc9dcd9a000 r--p 0000a000 08:03 538833618 > /usr/lib64/libnuma.so.1.0.0 > 7fc9dcd9a000-7fc9dcd9b000 rw-p 0000b000 08:03 538833618 > /usr/lib64/libnuma.so.1.0.0 > 7fc9dcd9b000-7fc9dcd9d000 r-xp 00000000 08:03 536960226 > /usr/lib64/libdl-2.17.so > 7fc9dcd9d000-7fc9dcf9d000 ---p 00002000 08:03 536960226 > /usr/lib64/libdl-2.17.so > 7fc9dcf9d000-7fc9dcf9e000 r--p 00002000 08:03 536960226 > /usr/lib64/libdl-2.17.so > 7fc9dcf9e000-7fc9dcf9f000 rw-p 00003000 08:03 536960226 > /usr/lib64/libdl-2.17.so > 7fc9dcf9f000-7fc9dd0a0000 r-xp 00000000 08:03 536960228 > /usr/lib64/libm-2.17.so > 7fc9dd0a0000-7fc9dd29f000 ---p 00101000 08:03 536960228 > /usr/lib64/libm-2.17.so > 7fc9dd29f000-7fc9dd2a0000 r--p 00100000 08:03 536960228 > /usr/lib64/libm-2.17.so > 7fc9dd2a0000-7fc9dd2a1000 rw-p 00101000 08:03 536960228 > /usr/lib64/libm-2.17.so > 7fc9dd2a1000-7fc9dd2cb000 r-xp 00000000 08:03 671752690 > /usr/lib64/libasan.so.0.0.0 > 7fc9dd2cb000-7fc9dd4ca000 ---p 0002a000 08:03 671752690 > /usr/lib64/libasan.so.0.0.0 > 7fc9dd4ca000-7fc9dd4cb000 r--p 00029000 08:03 671752690 > /usr/lib64/libasan.so.0.0.0 > 7fc9dd4cb000-7fc9dd4cc000 rw-p 0002a000 08:03 671752690 > /usr/lib64/libasan.so.0.0.0 > 7fc9dd4cc000-7fc9e0231000 rw-p 00000000 00:00 0 > 7fc9e0231000-7fc9e0253000 r-xp 00000000 08:03 536960213 > /usr/lib64/ld-2.17.so > 7fc9e0253000-7fc9e0254000 rw-s 00000000 00:13 622044 > /run/dpdk/rte/fbarray_memseg-1048576k-0-0 > 7fc9e0254000-7fc9e043a000 rw-p 00000000 00:00 0 > 7fc9e043a000-7fc9e0452000 rw-p 00000000 00:00 0 > 7fc9e0452000-7fc9e0453000 r--p 00021000 08:03 536960213 > /usr/lib64/ld-2.17.so > 7fc9e0453000-7fc9e0454000 rw-p 00022000 08:03 536960213 > /usr/lib64/ld-2.17.so > 7fc9e0454000-7fc9e0455000 rw-p 00000000 00:00 0 > 7fff29f46000-7fff29f67000 rw-p 00000000 00:00 0 > [stack] > 7fff29fe9000-7fff29feb000 r-xp 00000000 00:00 0 > [vdso] > ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 > [vsyscall] -- David Marchand
