So with Andrew's guidance here are the config files I'll be testing: /kernel/myri10ge.conf: # # Myricom 10G Ethernet driver configuration #
# MTU - Jumbo Frames myri10ge_mtu_override=9000; # Set RX buffer counts: myri10ge_bigbufs_initial=4096; myri10ge_bigbufs_max=32768; # Large Receive Offload # Note that increasing this to a value beyond 2 causes the Solaris kernel # to take a slow path on receive (and not honor TCP checksum offload). # This is fixed in recent kernels. If increasing this above 2 results in # poor performance, your kernel does not have the fix. myri10ge_lro=1; myri10ge_lro_max_aggr=8; # Interrupt Coalescence Delay # Default is 125 # Should be set to 0 for Latency (HFT) and 125 for Bandwidth (File Servers) myri10ge_intr_coal_delay=125; # Running a lot of streams in parallel- Pick this or the next- not both myri10ge_use_msix=1; myri10ge_max_slices=8; /etc/system: * Settings recommended by Myricom for the myri10ge cards * See: http://www.myri.com/serve/cache/511.html#solaris * And: http://www.solarisinternals.com/wiki/index.php/Networks * set ddi_msix_alloc_limit=8 * set pcplusmp:apic_multi_msi_max=8 * set pcplusmp:apic_msix_max=8 * set pcplusmp:apic_intr_policy=1 /etc/inittab: tm::sysinit:/usr/sbin/ndd -set /dev/tcp tcp_recv_hiwat 786432 > /dev/console tm::sysinit:/usr/sbin/ndd -set /dev/tcp tcp_xmit_hiwat 786432 > /dev/console tm::sysinit:/usr/sbin/ndd -set /dev/tcp tcp_max_buf 2097152 > /dev/console tm::sysinit:/usr/sbin/ndd -set /dev/tcp tcp_cwnd_max 2097152 > /dev/console tm::sysinit:/usr/sbin/ndd -set /dev/tcp tcp_naglim_def 1 > /dev/console Nagle has been disabled- whether this is done anyway for iscsi targets I'm not certain but I don't foresee a problem disabling it for our usage pattern. We'll test both ways just to be sure. -- This message posted from opensolaris.org _______________________________________________ networking-discuss mailing list networking-discuss@opensolaris.org
