Hello Dawid,
thank you for your answer.
Probably you are right, but I think that the issue is one or more steps before.
Looking at Intel and Mellanox driver sources ("ixgbe_ethdev.c" and "mlx4.c"
respectively),
I found that, in the driver function called by rte_eal_init to initialize pci
devs, is mandatory
to distinguish if the process is running as SECONDARY (--proc-type=secondary in
EAL prameters).
For example:
eth_ixgbe_dev_init() function of the ixgbe Intel driver, at line 988 :
/*
* For secondary processes, we don't initialise any further as primary
* has already done this work. Only check we don't need a different
* RX and TX function.
*/
if (rte_eal_process_type() != RTE_PROC_PRIMARY){
... some code lines here ...
return 0;
}
While in Mellanox mlx4 driver there is a check in ALL driver functions that
makes them return
immediatelly if the running process is of type "secondary".
That means that a driver has to take into account that the process could be a
SECONDARY process...
but in Qlogic (Broadcom) bnx2x driver I didn't find anything about that.
Do you think I've missed something ?
Thank you for your help,
David
> -Messaggio originale-
> Da: dawid_jurek [mailto:dawid_jurek at vp.pl]
> Inviato: mercoled? 4 maggio 2016 21:08
> A: users at dpdk.org; David Coen
> Oggetto: Re: [dpdk-users] Error in rte_eal_init using dpdk 16.04 and Qlogic
> (Broadcom) bnx2x driver in a SECONDARY process
>
> Hello David,
>
> By looking on driver sources (bnx2x_ethdev.c) assertion `sc-
> >bar[0].base_addr' fail is caused by pci_dev->mem_resource[0].addr ==
> NULL. It means that MMIO mapping of region nr. 0 failed.
> The reason of this may be print reported on ring level some time before
> crash:
>
> "EAL: memzone_reserve_aligned_thread_unsafe(): memzone
> already exists
> RING: Cannot reserve memory."
>
> I suspect some memory allocation issue but not 100% sure.
>
> Regards,
> Dawid
>
>
> > Hello,
> >
> > We are trying to run the
> > "dpdk-16.04\examples\multi_process\client_server_mp" sample
> > application on a RHEL6.7 linux server, with DPDK 16.04 and the
> > following network
> > interfaces:
> >
> > Network devices using DPDK-compatible driver
> >
> > :10:00.0 'BCM57840 NetXtreme II 10 Gigabit Ethernet' drv=igb_uio
> > unused=bnx2x
> > :10:00.1 'BCM57840 NetXtreme II 10 Gigabit Ethernet' drv=igb_uio
> > unused=bnx2x ===
> >
> > PMD: bnx2x_print_adapter_info(): ASIC : 0x168d1010
> > PMD: bnx2x_print_adapter_info(): Rev : B1
> > PMD: bnx2x_print_adapter_info(): Bus PCIe : 8,
> > PMD: bnx2x_print_adapter_info():5 Gbps
> > PMD: bnx2x_print_adapter_info():Flags :
> > PMD: bnx2x_print_adapter_info():MSI
> > PMD: bnx2x_print_adapter_info(): |
> > PMD: bnx2x_print_adapter_info():MSI-X
> > PMD: bnx2x_print_adapter_info(): Queues :
> > PMD: bnx2x_print_adapter_info():RSS : 1
> > PMD: bnx2x_print_adapter_info(): DPDK : DPDK 16.04.0
> > PMD: bnx2x_print_adapter_info(): Driver : BNX2X PMD 1.78.18_1.0.0
> > PMD: bnx2x_print_adapter_info(): Firmware : 7.2.51
> > PMD: bnx2x_print_adapter_info(): Bootcode : 7.13.24
> > PMD: bnx2x_print_adapter_info():
> >
> > We can run the server process, without problems, with the following
> command.
> >
> > ./mp_server -c 6 -n 4 -- -p 3 -n 1
> >
> > .than, in a second shell, we run the client process with the
> > following command .
> >
> > ./mp_client -c 8 -n 4 --proc-type=auto -- -n 0
> >
> > .and we always get this output:
> >
> > EAL: Detected lcore 0 as core 0 on socket 0
> > EAL: Detected lcore 1 as core 1 on socket 0
> > EAL: Detected lcore 2 as core 2 on socket 0
> > EAL: Detected lcore 3 as core 3 on socket 0
> > EAL: Detected lcore 4 as core 4 on socket 0
> > EAL: Detected lcore 5 as core 5 on socket 0
> > EAL: Detected lcore 6 as core 0 on socket 1
> > EAL: Detected lcore 7 as core 1 on socket 1
> > EAL: Detected lcore 8 as core 2 on socket 1
> > EAL: Detected lcore 9 as core 3 on socket 1
> > EAL: Detected lcore 10 as core 4 on socket 1
> > EAL: Detected lcore 11 as core 5 on socket 1
> > EAL: Support maximum 128 logical core(s) by configuration.
> > EAL: Detected 12 lcore(s)
> > EAL: Auto-detected process type: SECONDARY
> > EAL: Setting up physically contiguous memory...
> > EAL: Analysing 16 files
> > EAL: Mapped segment 0 of size 0x2
> > EAL: Mapped segment 1 of size 0x2
> > EAL: memzone_reserve_aligned_thread_unsafe(): memzone
> > already exists
> > RING: Cannot reserve memory
> > EAL: TSC frequency is ~240 KHz
> > EAL: Master lcore 3 is ready (tid=f7fec880;cpuset=[3])
> > PMD: rte_bnx2x_pmd_init(): >>
> > PMD: rte_bnx2xvf_pmd_init(): >>
> > EAL: PCI device :10:00.0 on NUMA socket 0
> > EAL: probe driver: 14e4:16a1
