VPP passes --in-memory so there should be no hugepage files created in the
fliesystem.
> On 26 May 2020, at 18:42, Benoit Ganne (bganne) via lists.fd.io
> <bganne=cisco....@lists.fd.io> wrote:
>
> Hi Manoj,
>
> The issue is because of DPDK initialization. In the working conf, you disable
> DPDK plugin so DPDK is not initialized and everything is fine.
> Can you check whether /mnt/huge is full of dpdk-created staled files? I saw
> this happen from time to time. The fix is simple, just remove the staled
> files.
>
> Best
> ben
>
>> -----Original Message-----
>> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Manoj Iyer
>> Sent: mardi 26 mai 2020 18:20
>> To: vpp-dev@lists.fd.io
>> Cc: Rodney Schmidt <rodney.schm...@arm.com>; Kshitij Sudan
>> <kshitij.su...@arm.com>
>> Subject: [vpp-dev] VPP fails to start - error message EAL: FATAL: Cannot
>> get hugepage information.
>>
>> Hello,
>>
>>
>> I am trying to start the VPP (19.04) service on an ARM64 system. VPP fails
>> with the message:
>>
>>
>> /usr/bin/vpp[1252]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-
>> prefix vpp -w 0008:01:00.0 --master-lcore 0
>>
>> EAL: FATAL: Cannot get hugepage information.
>>
>> vpp[1252]: dpdk_config: rte_eal_init returned -1
>>
>>
>> But when I start vpp as no-daemon manually, I can start VPP and use vppctl
>> to get a console prompt. Could you please help me figure out why my
>> service fails with "Cannot get hugepage information" ?
>>
>>
>> Here is my service setup, although I am starting the service from command
>> line, the exact setup in systemd service fails the same way:
>>
>>
>> $ cat /proc/meminfo | grep -i huge
>>
>> AnonHugePages: 0 kB
>>
>> ShmemHugePages: 0 kB
>>
>> FileHugePages: 0 kB
>>
>> HugePages_Total: 1024
>>
>> HugePages_Free: 1024
>>
>> HugePages_Rsvd: 0
>>
>> HugePages_Surp: 0
>>
>> Hugepagesize: 2048 kB
>>
>> Hugetlb: 2097152 kB
>>
>>
>> $ mount | grep hugetlbfs
>>
>> hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
>>
>> nodev on /mnt/huge type hugetlbfs (rw,relatime,pagesize=2M)
>>
>>
>> # modprobe igb_uio
>>
>> # dpdk-devbind -u 0008:01:00.0
>>
>> # dpdk-devbind --bind=igb_uio 0008:01:00.0
>>
>> # mkdir -p /run/vpp/
>>
>> # vpp -c /usr/share/vpp/vpp.conf
>>
>> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
>> gnu/vpp_plugins/
>>
>> load_one_plugin:117: Plugin disabled (default): abf_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): acl_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): avf_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): cdp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): crypto_openssl_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ct6_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: dpdk_plugin.so (Data Plane Development
>> Kit (DPDK))
>>
>> load_one_plugin:117: Plugin disabled (default): flowprobe_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): gbp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): gtpu_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): igmp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ikev2_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ila_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ioam_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): l2e_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): lacp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): lb_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): mactime_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): map_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): memif_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): nat_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): nsh_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): nsim_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): pppoe_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): quic_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): rdma_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): srv6ad_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): srv6am_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): srv6as_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): stn_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): svs_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): tlsmbedtls_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): tlsopenssl_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): vmxnet3_plugin.so
>>
>> vpp[1554]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
>> directory
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
>>
>> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip6-fa'
>> not found (before 'ip6-dvr-reinject', arc 'ip6-output')
>>
>> vpp[1554]: vnet_feature_arc_init:250: feature node 'nat44-in2out-output'
>> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
>>
>> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip4-fa'
>> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
>>
>> vpp[1554]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-prefix vpp --
>> master-lcore 0
>>
>> EAL: FATAL: Cannot get hugepage information.
>>
>> vpp[1554]: dpdk_config: rte_eal_init returned -1
>>
>>
>>
>> Where /usr/share/vpp/vpp.conf is as follows:
>>
>> unix {
>>
>> nodaemon
>>
>> log /var/log/vpp.log
>>
>> cli-listen /run/vpp/cli.sock
>>
>> }
>>
>>
>> api-trace {
>>
>> on
>>
>> }
>>
>>
>> socksvr {
>>
>> default
>>
>> }
>>
>>
>> plugins {
>>
>> path /usr/lib/aarch64-linux-gnu/vpp_plugins/
>>
>>
>> plugin default { disable }
>>
>> plugin dpdk_plugin.so { enable }
>>
>> }
>>
>>
>> session {
>>
>> evt_qs_memfd_seg
>>
>> }
>>
>>
>> dpdk {
>>
>> dev 0008:01:00.0 {
>>
>> name enP8p1s0f0np0
>>
>> }
>>
>> }
>>
>>
>> But if I use a simple vpp.conf script as no-daemon, vpp does start.
>>
>>
>> === simple vpp.conf ===
>>
>> unix {nodaemon cli-listen /run/vpp/cli-vpp1.sock}
>>
>> api-segment { prefix vpp1 }
>>
>> plugins { plugin dpdk_plugin.so { disable } }
>>
>> ===================
>>
>>
>> # vpp -c /tmp/startup.conf
>>
>> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
>> gnu/vpp_plugins:/usr/lib/vpp_plugins
>>
>> load_one_plugin:189: Loaded plugin: abf_plugin.so (ACL based Forwarding)
>>
>> load_one_plugin:189: Loaded plugin: acl_plugin.so (Access Control Lists)
>>
>> load_one_plugin:189: Loaded plugin: avf_plugin.so (Intel Adaptive Virtual
>> Function (AVF) Device Plugin)
>>
>> load_one_plugin:191: Loaded plugin: cdp_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: crypto_openssl_plugin.so (OpenSSL
>> Crypto Engine Plugin)
>>
>> load_one_plugin:189: Loaded plugin: ct6_plugin.so (ipv6 connection
>> tracker)
>>
>> load_one_plugin:106: Plugin disabled: dpdk_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: flowprobe_plugin.so (Flow per Packet)
>>
>> load_one_plugin:189: Loaded plugin: gbp_plugin.so (Group Based Policy)
>>
>> load_one_plugin:189: Loaded plugin: gtpu_plugin.so (GTPv1-U)
>>
>> load_one_plugin:189: Loaded plugin: igmp_plugin.so (IGMP messaging)
>>
>> load_one_plugin:189: Loaded plugin: ikev2_plugin.so (IKEv2)
>>
>> load_one_plugin:189: Loaded plugin: ila_plugin.so (Identifier-locator
>> addressing for IPv6)
>>
>> load_one_plugin:189: Loaded plugin: ioam_plugin.so (Inbound OAM)
>>
>> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: l2e_plugin.so (L2 Emulation)
>>
>> load_one_plugin:189: Loaded plugin: lacp_plugin.so (Link Aggregation
>> Control Protocol)
>>
>> load_one_plugin:189: Loaded plugin: lb_plugin.so (Load Balancer)
>>
>> load_one_plugin:189: Loaded plugin: mactime_plugin.so (Time-based MAC
>> source-address filter)
>>
>> load_one_plugin:189: Loaded plugin: map_plugin.so (Mapping of address and
>> port (MAP))
>>
>> load_one_plugin:189: Loaded plugin: memif_plugin.so (Packet Memory
>> Interface (experimental))
>>
>> load_one_plugin:189: Loaded plugin: nat_plugin.so (Network Address
>> Translation)
>>
>> load_one_plugin:189: Loaded plugin: nsh_plugin.so (Network Service Header)
>>
>> load_one_plugin:189: Loaded plugin: nsim_plugin.so (network delay
>> simulator plugin)
>>
>> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: pppoe_plugin.so (PPPoE)
>>
>> load_one_plugin:189: Loaded plugin: quic_plugin.so (Quic transport
>> protocol)
>>
>> load_one_plugin:189: Loaded plugin: rdma_plugin.so (RDMA (ibverb) Device
>> Plugin)
>>
>> load_one_plugin:189: Loaded plugin: srv6ad_plugin.so (Dynamic SRv6 proxy)
>>
>> load_one_plugin:189: Loaded plugin: srv6am_plugin.so (Masquerading SRv6
>> proxy)
>>
>> load_one_plugin:189: Loaded plugin: srv6as_plugin.so (Static SRv6 proxy)
>>
>> load_one_plugin:189: Loaded plugin: stn_plugin.so (VPP Steals the NIC for
>> Container integration)
>>
>> load_one_plugin:189: Loaded plugin: svs_plugin.so (Source VRF Select)
>>
>> load_one_plugin:189: Loaded plugin: tlsmbedtls_plugin.so (mbedtls based
>> TLS Engine)
>>
>> load_one_plugin:189: Loaded plugin: tlsopenssl_plugin.so (openssl based
>> TLS Engine)
>>
>> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: vmxnet3_plugin.so (VMWare Vmxnet3
>> Device Plugin)
>>
>> vpp[1565]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
>> directory
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
>>
>>
>>
>> On a separate terminal I can get VPP console.
>>
>>
>> $ sudo vppctl -s /run/vpp/cli-vpp1.sock
>>
>> [sudo] password for ubuntu:
>>
>> _______ _ _ _____ ___
>>
>> __/ __/ _ \ (_)__ | | / / _ \/ _ \
>>
>> _/ _// // / / / _ \ | |/ / ___/ ___/
>>
>> /_/ /____(_)_/\___/ |___/_/ /_/
>>
>>
>> vpp#
>>
>>
>> Thanks a ton in advance for your help.
>>
>> Manoj Iyer
>>
>> IMPORTANT NOTICE: The contents of this email and any attachments are
>> confidential and may also be privileged. If you are not the intended
>> recipient, please notify the sender immediately and do not disclose the
>> contents to any other person, use it for any purpose, or store or copy the
>> information in any medium. Thank you.
>
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#16515): https://lists.fd.io/g/vpp-dev/message/16515
Mute This Topic: https://lists.fd.io/mt/74481192/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
