But the issue is VPP's dpgk plugin fails and VPP service is not started as a
result.
________________________________
From: Damjan Marion <dmar...@me.com>
Sent: Tuesday, May 26, 2020 5:44 PM
To: bga...@cisco.com <bga...@cisco.com>
Cc: Manoj Iyer <manoj.i...@arm.com>; vpp-dev@lists.fd.io <vpp-dev@lists.fd.io>;
Rodney Schmidt <rodney.schm...@arm.com>; Kshitij Sudan <kshitij.su...@arm.com>
Subject: Re: [vpp-dev] VPP fails to start - error message EAL: FATAL: Cannot
get hugepage information.
VPP passes --in-memory so there should be no hugepage files created in the
fliesystem.
> On 26 May 2020, at 18:42, Benoit Ganne (bganne) via lists.fd.io
> <bganne=cisco....@lists.fd.io> wrote:
>
> Hi Manoj,
>
> The issue is because of DPDK initialization. In the working conf, you disable
> DPDK plugin so DPDK is not initialized and everything is fine.
> Can you check whether /mnt/huge is full of dpdk-created staled files? I saw
> this happen from time to time. The fix is simple, just remove the staled
> files.
>
> Best
> ben
>
>> -----Original Message-----
>> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Manoj Iyer
>> Sent: mardi 26 mai 2020 18:20
>> To: vpp-dev@lists.fd.io
>> Cc: Rodney Schmidt <rodney.schm...@arm.com>; Kshitij Sudan
>> <kshitij.su...@arm.com>
>> Subject: [vpp-dev] VPP fails to start - error message EAL: FATAL: Cannot
>> get hugepage information.
>>
>> Hello,
>>
>>
>> I am trying to start the VPP (19.04) service on an ARM64 system. VPP fails
>> with the message:
>>
>>
>> /usr/bin/vpp[1252]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-
>> prefix vpp -w 0008:01:00.0 --master-lcore 0
>>
>> EAL: FATAL: Cannot get hugepage information.
>>
>> vpp[1252]: dpdk_config: rte_eal_init returned -1
>>
>>
>> But when I start vpp as no-daemon manually, I can start VPP and use vppctl
>> to get a console prompt. Could you please help me figure out why my
>> service fails with "Cannot get hugepage information" ?
>>
>>
>> Here is my service setup, although I am starting the service from command
>> line, the exact setup in systemd service fails the same way:
>>
>>
>> $ cat /proc/meminfo | grep -i huge
>>
>> AnonHugePages: 0 kB
>>
>> ShmemHugePages: 0 kB
>>
>> FileHugePages: 0 kB
>>
>> HugePages_Total: 1024
>>
>> HugePages_Free: 1024
>>
>> HugePages_Rsvd: 0
>>
>> HugePages_Surp: 0
>>
>> Hugepagesize: 2048 kB
>>
>> Hugetlb: 2097152 kB
>>
>>
>> $ mount | grep hugetlbfs
>>
>> hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
>>
>> nodev on /mnt/huge type hugetlbfs (rw,relatime,pagesize=2M)
>>
>>
>> # modprobe igb_uio
>>
>> # dpdk-devbind -u 0008:01:00.0
>>
>> # dpdk-devbind --bind=igb_uio 0008:01:00.0
>>
>> # mkdir -p /run/vpp/
>>
>> # vpp -c /usr/share/vpp/vpp.conf
>>
>> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
>> gnu/vpp_plugins/
>>
>> load_one_plugin:117: Plugin disabled (default): abf_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): acl_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): avf_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): cdp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): crypto_openssl_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ct6_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: dpdk_plugin.so (Data Plane Development
>> Kit (DPDK))
>>
>> load_one_plugin:117: Plugin disabled (default): flowprobe_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): gbp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): gtpu_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): igmp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ikev2_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ila_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ioam_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): l2e_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): lacp_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): lb_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): mactime_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): map_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): memif_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): nat_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): nsh_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): nsim_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): pppoe_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): quic_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): rdma_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): srv6ad_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): srv6am_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): srv6as_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): stn_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): svs_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): tlsmbedtls_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): tlsopenssl_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
>>
>> load_one_plugin:117: Plugin disabled (default): vmxnet3_plugin.so
>>
>> vpp[1554]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
>> directory
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
>>
>> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
>>
>> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip6-fa'
>> not found (before 'ip6-dvr-reinject', arc 'ip6-output')
>>
>> vpp[1554]: vnet_feature_arc_init:250: feature node 'nat44-in2out-output'
>> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
>>
>> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip4-fa'
>> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
>>
>> vpp[1554]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-prefix vpp --
>> master-lcore 0
>>
>> EAL: FATAL: Cannot get hugepage information.
>>
>> vpp[1554]: dpdk_config: rte_eal_init returned -1
>>
>>
>>
>> Where /usr/share/vpp/vpp.conf is as follows:
>>
>> unix {
>>
>> nodaemon
>>
>> log /var/log/vpp.log
>>
>> cli-listen /run/vpp/cli.sock
>>
>> }
>>
>>
>> api-trace {
>>
>> on
>>
>> }
>>
>>
>> socksvr {
>>
>> default
>>
>> }
>>
>>
>> plugins {
>>
>> path /usr/lib/aarch64-linux-gnu/vpp_plugins/
>>
>>
>> plugin default { disable }
>>
>> plugin dpdk_plugin.so { enable }
>>
>> }
>>
>>
>> session {
>>
>> evt_qs_memfd_seg
>>
>> }
>>
>>
>> dpdk {
>>
>> dev 0008:01:00.0 {
>>
>> name enP8p1s0f0np0
>>
>> }
>>
>> }
>>
>>
>> But if I use a simple vpp.conf script as no-daemon, vpp does start.
>>
>>
>> === simple vpp.conf ===
>>
>> unix {nodaemon cli-listen /run/vpp/cli-vpp1.sock}
>>
>> api-segment { prefix vpp1 }
>>
>> plugins { plugin dpdk_plugin.so { disable } }
>>
>> ===================
>>
>>
>> # vpp -c /tmp/startup.conf
>>
>> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
>> gnu/vpp_plugins:/usr/lib/vpp_plugins
>>
>> load_one_plugin:189: Loaded plugin: abf_plugin.so (ACL based Forwarding)
>>
>> load_one_plugin:189: Loaded plugin: acl_plugin.so (Access Control Lists)
>>
>> load_one_plugin:189: Loaded plugin: avf_plugin.so (Intel Adaptive Virtual
>> Function (AVF) Device Plugin)
>>
>> load_one_plugin:191: Loaded plugin: cdp_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: crypto_openssl_plugin.so (OpenSSL
>> Crypto Engine Plugin)
>>
>> load_one_plugin:189: Loaded plugin: ct6_plugin.so (ipv6 connection
>> tracker)
>>
>> load_one_plugin:106: Plugin disabled: dpdk_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: flowprobe_plugin.so (Flow per Packet)
>>
>> load_one_plugin:189: Loaded plugin: gbp_plugin.so (Group Based Policy)
>>
>> load_one_plugin:189: Loaded plugin: gtpu_plugin.so (GTPv1-U)
>>
>> load_one_plugin:189: Loaded plugin: igmp_plugin.so (IGMP messaging)
>>
>> load_one_plugin:189: Loaded plugin: ikev2_plugin.so (IKEv2)
>>
>> load_one_plugin:189: Loaded plugin: ila_plugin.so (Identifier-locator
>> addressing for IPv6)
>>
>> load_one_plugin:189: Loaded plugin: ioam_plugin.so (Inbound OAM)
>>
>> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: l2e_plugin.so (L2 Emulation)
>>
>> load_one_plugin:189: Loaded plugin: lacp_plugin.so (Link Aggregation
>> Control Protocol)
>>
>> load_one_plugin:189: Loaded plugin: lb_plugin.so (Load Balancer)
>>
>> load_one_plugin:189: Loaded plugin: mactime_plugin.so (Time-based MAC
>> source-address filter)
>>
>> load_one_plugin:189: Loaded plugin: map_plugin.so (Mapping of address and
>> port (MAP))
>>
>> load_one_plugin:189: Loaded plugin: memif_plugin.so (Packet Memory
>> Interface (experimental))
>>
>> load_one_plugin:189: Loaded plugin: nat_plugin.so (Network Address
>> Translation)
>>
>> load_one_plugin:189: Loaded plugin: nsh_plugin.so (Network Service Header)
>>
>> load_one_plugin:189: Loaded plugin: nsim_plugin.so (network delay
>> simulator plugin)
>>
>> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: pppoe_plugin.so (PPPoE)
>>
>> load_one_plugin:189: Loaded plugin: quic_plugin.so (Quic transport
>> protocol)
>>
>> load_one_plugin:189: Loaded plugin: rdma_plugin.so (RDMA (ibverb) Device
>> Plugin)
>>
>> load_one_plugin:189: Loaded plugin: srv6ad_plugin.so (Dynamic SRv6 proxy)
>>
>> load_one_plugin:189: Loaded plugin: srv6am_plugin.so (Masquerading SRv6
>> proxy)
>>
>> load_one_plugin:189: Loaded plugin: srv6as_plugin.so (Static SRv6 proxy)
>>
>> load_one_plugin:189: Loaded plugin: stn_plugin.so (VPP Steals the NIC for
>> Container integration)
>>
>> load_one_plugin:189: Loaded plugin: svs_plugin.so (Source VRF Select)
>>
>> load_one_plugin:189: Loaded plugin: tlsmbedtls_plugin.so (mbedtls based
>> TLS Engine)
>>
>> load_one_plugin:189: Loaded plugin: tlsopenssl_plugin.so (openssl based
>> TLS Engine)
>>
>> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
>>
>> load_one_plugin:189: Loaded plugin: vmxnet3_plugin.so (VMWare Vmxnet3
>> Device Plugin)
>>
>> vpp[1565]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
>> directory
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
>>
>> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
>>
>>
>>
>> On a separate terminal I can get VPP console.
>>
>>
>> $ sudo vppctl -s /run/vpp/cli-vpp1.sock
>>
>> [sudo] password for ubuntu:
>>
>> _______ _ _ _____ ___
>>
>> __/ __/ _ \ (_)__ | | / / _ \/ _ \
>>
>> _/ _// // / / / _ \ | |/ / ___/ ___/
>>
>> /_/ /____(_)_/\___/ |___/_/ /_/
>>
>>
>> vpp#
>>
>>
>> Thanks a ton in advance for your help.
>>
>> Manoj Iyer
>>
>> IMPORTANT NOTICE: The contents of this email and any attachments are
>> confidential and may also be privileged. If you are not the intended
>> recipient, please notify the sender immediately and do not disclose the
>> contents to any other person, use it for any purpose, or store or copy the
>> information in any medium. Thank you.
>
IMPORTANT NOTICE: The contents of this email and any attachments are
confidential and may also be privileged. If you are not the intended recipient,
please notify the sender immediately and do not disclose the contents to any
other person, use it for any purpose, or store or copy the information in any
medium. Thank you.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#16516): https://lists.fd.io/g/vpp-dev/message/16516
Mute This Topic: https://lists.fd.io/mt/74481192/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
