[dpdk-dev] Previous DPDK version API documentation for app developers

2015-02-11 Thread Matthew Hall
Hi all, I ran into a funny situation today with the API documentation. For stability until I can get my app mostly working, I was using DPDK 1.7.X, so I could concentrate on making the app reliable. But the DPDK website only has the API docs for DPDK 1.8.X / HEAD. I was wondering if we could

[dpdk-dev] Intel DPDK support for ntop DPI

2015-02-16 Thread Matthew Hall
I did some research on this previously before concluding NDPI wouldn't help me much with my own particular application. Just for running NDPI DPDK is not strictly needed, as NDPI is normally read-only so something like PF_RING would work in default ntop / ndpi. If you're trying to use NDPI in

[dpdk-dev] kernel: BUG: soft lockup - CPU#1 stuck for 22s! [kni_single:1782]

2015-02-16 Thread Matthew Hall
On Mon, Feb 16, 2015 at 10:33:52AM -0600, Jay Rolette wrote: > In kni_net_rx_normal(), it was calling netif_receive_skb() instead of > netif_rx(). The source for netif_receive_skb() point out that it should > only be called from soft-irq context, which isn't the case for KNI. For the uninitiated

[dpdk-dev] Previous DPDK version API documentation for app developers

2015-02-17 Thread Matthew Hall
On Feb 12, 2015, at 1:29 AM, Thomas Monjalon wrote: > Yes you can: make doc > For doxygen API only: make doc-api-html > For sphinx only: doc-guides-html. Hi Thomas, In 1.7 for me at least I found the target was called: doc-htmlapi . Did the way this stuff works get changed at some point?

[dpdk-dev] Previous DPDK version API documentation for app developers

2015-02-17 Thread Matthew Hall
On Feb 17, 2015, at 1:30 AM, Thomas Monjalon wrote: > Yes, you're right. It has been renamed. > But I think you should better work on improving the HEAD ;) Yes, I agree. But to get to this point I have to get the core application features to even work in 1.7, before I can switch the app to

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-02-21 Thread Matthew Hall
Hello fellow stack hackers :) , I'm working on a simple server-side implementation of TCP on DPDK. For this to work I need a good data structure to store some sockets. The lookup key is like this: struct ss_flow_key_s { uint8_t sip[IPV6_ALEN]; uint8_t dip[IPV6_ALEN]; uint16_t

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-02-22 Thread Matthew Hall
On Feb 22, 2015, at 4:02 PM, Stephen Hemminger wrote: > Use userspace RCU? or BSD RB_TREE Thanks Stephen, I think the RB_TREE stuff is single threaded mostly. But user-space RCU looks quite good indeed, I didn't know somebody ported it out of the kernel. I'll check it out. Matthew.

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-02-23 Thread Matthew Hall
On Mon, Feb 23, 2015 at 08:48:57AM -0600, Matt Laswell wrote: > Apologies in advance for likely being a bit long-winded. Long winded is great, helps me get context. > First, you really need to take cache performance into account when you're > choosing a data structure. Something like a balanced

[dpdk-dev] IPv6 Offload Capabilities

2015-01-05 Thread Matthew Hall
On Jan 4, 2015, at 11:56 PM, Gal Sagie wrote: > I noticed that in version 1.8, there are no flags to indicate IPv6 check > sum offloading > (only DEV_TX_OFFLOAD_IPV4_CKSUM) > which means TSO offloading is also not supported for IPv6. I need that feature too. Right now I disabled the IP checksum

[dpdk-dev] IPv6 Offload Capabilities

2015-01-05 Thread Matthew Hall
On Mon, Jan 05, 2015 at 09:36:54AM +0100, Thomas Monjalon wrote: > Which checksum are you talking about? IPv6 checsum doesn't exist. The same computation algorithm must be reused to calculate the IPV6 Pseudoheader checksum when generating ICMPV6, UDPV6, and other L4 protocols whose definitions

[dpdk-dev] IPv6 Offload Capabilities

2015-01-05 Thread Matthew Hall
On Mon, Jan 05, 2015 at 09:25:37PM -0800, Matthew Hall wrote: > The same computation algorithm must be reused to calculate the IPV6 > Pseudoheader checksum when generating ICMPV6, UDPV6, and other L4 protocols > whose definitions were retroactively modified to include the IPV6 >

[dpdk-dev] Why nothing since 1.8.0?

2015-01-15 Thread Matthew Hall
On Thu, Jan 15, 2015 at 09:55:00PM +, O'driscoll, Tim wrote: > As you said, there's a balance to be struck, and too many subtrees may > become unmanageable. With respect to your concern about developers having to > potentially develop patches against multiple subtrees, this has never been >

[dpdk-dev] Why nothing since 1.8.0?

2015-01-16 Thread Matthew Hall
On Fri, Jan 16, 2015 at 07:18:19PM +0100, Thomas Monjalon wrote: > I'd like to try solving the review challenge first and see what else can be > done after that. Step by step. FWIW, I know the kernel guys seem to really love it, but not everybody else has much fun trying to do the reviews

[dpdk-dev] Why nothing since 1.8.0?

2015-01-16 Thread Matthew Hall
On Fri, Jan 16, 2015 at 03:00:57PM -0500, Neil Horman wrote: > Like Gerrit: > https://code.google.com/p/gerrit/ Maybe we could work on setting up a community copy? I'd prefer if we could avoid n=1 and make our community as strong as possible. Matthew.

[dpdk-dev] Why nothing since 1.8.0?

2015-01-16 Thread Matthew Hall
On Fri, Jan 16, 2015 at 04:14:38PM -0500, Neil Horman wrote: > Sure, Its a bit orthogonal to this conversation, but I think its a fine idea > to > have if it aids in general reviewing. Thomas can it be setup on dpdk.org? > > Neil Admittedly I'm not a PMD expert to comment on all the specifics

[dpdk-dev] [PATCH] hash: move rte_hash structure to C file and make it internal

2015-07-09 Thread Matthew Hall
On Thu, Jul 09, 2015 at 09:12:23AM +0100, Bruce Richardson wrote: > Thanks for the feedback Matthew. Can you suggest a function prototype for such > a walk operation that would make it useful for you. While we can keep the > hash structure public, I'd prefer if we could avoid it, as it makes

[dpdk-dev] Wireless NICs are supported?

2015-07-20 Thread Matthew Hall
Not sure for Mr. Kim, but for me, performance is actually not my main inspiration to use DPDK. I began using it in about 2011 when I got a training on it from the 6WIND guys before it became open source. What impressed me most was how much simpler it was to troubleshoot, debug, maintain, and

[dpdk-dev] Any chance someone could fix the SPF records for this mailing list?

2015-06-03 Thread Matthew Hall
On Wed, Jun 03, 2015 at 07:54:11PM -0700, Alexander Duyck wrote: > However the ones that are going straight into my spam folder list an IPv6 > address that is rated neutral by the SPF: > Received: from dpdk.org ([2001:4b98:dc0:41:216:3eff:fe72:dd13]) > by mx.google.com with ESMTP id

[dpdk-dev] Any chance someone could fix the SPF records for this mailing list?

2015-06-03 Thread Matthew Hall
On Wed, Jun 03, 2015 at 08:07:57PM -0700, Matthew Hall wrote: > Hello, > > I can confirm your claims. When I enabled IPv6 on my mail server Google began > dropping or severely graylisting 100% of the mail until the IPv6 subnet was > added to the SPF record. This needs to get fi

[dpdk-dev] More KNI performance

2015-06-05 Thread Matthew Hall
On Fri, Jun 05, 2015 at 10:27:21AM -0500, Jay Rolette wrote: > Is there some mechanism available that the KNI kernel thread could sleep > periodically, but somehow be awoken from user space? This is wildly unvalidated, but futex and SysV semaphore appear to be accessible from the kernel side.

[dpdk-dev] [dpdk-announce] important design choices - statistics - ABI

2015-06-16 Thread Matthew Hall
On Wed, Jun 17, 2015 at 01:29:47AM +0200, Thomas Monjalon wrote: > There were some debates about software statistics disabling. > Should they be always on or possibly disabled when compiled? > We need to take a decision shortly and discuss (or agree) this proposal: >

[dpdk-dev] clang build failing in v2.0.0 from poisoned symbols

2015-06-18 Thread Matthew Hall
Hi all, I am getting some odd behavior compiling the DPDK v2.0.0 tag with clang: /* deprecated options */ #pragma GCC poison RTE_MBUF_SCATTER_GATHER #pragma GCC poison RTE_MBUF_REFCNT In file included from dpdk/lib/librte_mbuf/rte_mbuf.c:58: dpdk/lib/librte_mbuf/rte_mbuf.h:68:20: error:

[dpdk-dev] clang build failing in v2.0.0 from poisoned symbols

2015-06-18 Thread Matthew Hall
On Thu, Jun 18, 2015 at 08:37:46PM -0700, Matthew Hall wrote: > dpdk/lib/librte_mbuf/rte_mbuf.h:68:20: error: poisoning existing macro > [-Werror] Hi all, I finally figured out what happened. My older DPDK build configuration file had defined the poisoned macros to try to enable the fe

[dpdk-dev] DPDK v2.0.0 has different rte_eal_pci_probe() behavior

2015-06-20 Thread Matthew Hall
On Jun 19, 2015, at 3:15 AM, Bruce Richardson wrote: > Thank you. It's finally nice to get some good news about compatibility! :-) Hi Bruce, I did manage to find just one weird issue when I was trying to use the new DPDK v2.0.0. Previously I had code which was calling rte_eal_pci_probe()

[dpdk-dev] DPDK v2.0.0 has different rte_eal_pci_probe() behavior

2015-06-21 Thread Matthew Hall
On Jun 21, 2015, at 3:54 PM, Tom Barbette wrote: > Application call to rte_eal_pci_probe() is not needed anymore since DPDK 1.8. > > http://dpdk.org/ml/archives/dev/2014-September/005890.html > > You were not wrong before, it is just a change in DPDK. I came across the > same problem a few

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-21 Thread Matthew Hall
Hello, I have gone out on the internet for days looking at a bunch of different radix tree implementations to see if I could figure a way to implement my own tree, just to work around the really low 255 CIDR block limitation in librte_lpm. Unfortunately every single one I could find falls into

[dpdk-dev] DPDK packet capture question

2015-06-21 Thread Matthew Hall
On Jun 21, 2015, at 5:09 PM, Daeyoung Kim wrote: > I am a newbie to DPDK. Welcome! > I'm making a packet capture program from the l3fwd > sample application. When I tested my program in a virtual environment, it > worked. But in a real world, it does not work correctly. This topology is kind

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-22 Thread Matthew Hall
_)); > /* Using single uint8_t to store 3 values. */ > uint32_t valid :1; /**< Validation flag. */ > uint32_t ext_entry :1; /**< External entry. */ > uint32_t depth :6; /**< Rule depth. */ > }; > so we have 24 bit for next_hop. &

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-23 Thread Matthew Hall
On Mon, Jun 22, 2015 at 11:51:02PM -0400, Stephen Hemminger wrote: > In order to make Vyatta/Brocade router work with LPM code > I ended up redoing the layout. It is: > > And also several other scalability improvements (plus IPv6) > and the correct handling of /32. > > Unfortunately, this is such

[dpdk-dev] [PATCH] Use pthread_setname APIs

2015-04-22 Thread Matthew Hall
On Wed, Apr 22, 2015 at 03:57:44PM -0700, Stephen Hemminger wrote: > Since it possible to have multiple DPDK applications in same environment, > and the thread name size is so limited, I wonder if this is a good idea. Why not try to opportunistically make the code easier to debug? DPDK is not

[dpdk-dev] Beyond DPDK 2.0

2015-04-24 Thread Matthew Hall
On Fri, Apr 24, 2015 at 12:39:47PM -0500, Jay Rolette wrote: > I can tell you that if DPDK were GPL-based, my company wouldn't be using > it. I suspect we wouldn't be the only ones... > > Jay I could second this, from the past employer where I used it. Right now I am using it in an open source

[dpdk-dev] What to do about UIO breakage in 2.0

2015-04-27 Thread Matthew Hall
Stephen, This mail is a bit confusing for end users of DPDK which might be why you didn't get many replies yet. If I understand this mail right, you're saying that nothing works? Or it works, but igb_uio doesn't work, and the performance isn't good because MSI-X is not working? I am confused

[dpdk-dev] Performance regression in DPDK 1.8/2.0

2015-04-27 Thread Matthew Hall
On Apr 27, 2015, at 3:28 PM, Paul Emmerich wrote: > Let me know if you need any additional information. > I'd also be interested in the configuration that resulted in the 20% speed- > up that was mentioned in the original mbuf patch Not sure if it's relevant or not, but there was another mail

[dpdk-dev] Beyond DPDK 2.0

2015-04-28 Thread Matthew Hall
On Apr 25, 2015, at 5:10 AM, Neil Horman wrote: > I'm more focused on why that level of participation is not higher Hi Neal, This mail is probably way too long, but here is what I saw about participation, in my case I used DPDK on two projects so far: 1) proprietary project for a L4-L7

[dpdk-dev] [PATCH] eal/linux: fix negative value for undetermined numa_node

2015-07-31 Thread Matthew Hall
I asked about this many months ago and was informed that "-1" is a "standard error value" that I should expect from these APIs when NUMA is not present. Now we're saying I have to change my code again to handle a zero value? Also not sure how to tell the difference between no NUMA, something

[dpdk-dev] [PATCH] eal/linux: fix negative value for undetermined numa_node

2015-08-02 Thread Matthew Hall
On Mon, Aug 03, 2015 at 09:46:54AM +0800, Liang, Cunming wrote: > According to the API definition, if the socket could not be determined, a > default of zero will take. > The '-1' is returned when the port_id value is out of range. Yes, but when I asked the exact same question and was told the

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 11:58:16AM +, Bruce Richardson wrote: > Hi, > > that is indeed very similar to what we are thinking ourselves. Is there any of > what you have already done that you could contribute publically to save us > duplicating some of your effort? [The one big difference, is

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 01:16:47PM +, O'Driscoll, Tim wrote: > True. The goal is to merge the best of the various patches that were > submitted on this. This could involve changes to IPv6 as well as IPv4. > > > Tim If it's possible to fix IPv6 as well this would be good for me. Offering a

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 09:45:56AM -0500, Kyle Larose wrote: > Earlier Stephen mentioned using the named pipe behaviour of tcpdump. > Is there an opportunity to take what you have mentioned here and marry > it to the named pipe output to get the perf you need? I am wondering about the same thing.

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Wed, Dec 02, 2015 at 01:38:07AM +, Wiles, Keith wrote: > In Pktgen I used tap interface to wireshark and that worked very nicely the > only problem is it was slow :-( > > Having a tap PMD would be nice to be able to remove that code from Pktgen. All these approaches we discussed so far

[dpdk-dev] 2.3 Roadmap

2015-12-02 Thread Matthew Hall
On Wed, Dec 02, 2015 at 12:35:16PM +, Bruce Richardson wrote: > Hi Matthew, > > thanks for the info, but I'm not sure I understand it correctly. It seems to > me that you are mostly referring to the depths/sizes of the tables being used, > rather than to the "data-size" being stored in each

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-14 Thread Matthew Hall
> an integer value indicating how many bytes of the packet should be mirrored > by the capturing application. +1 to Matthew Hall for taking this direction! Yes, performance wise I think this is the only way that will really work 100% of the time. Otherwise I think we end up in the very bad

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-16 Thread Matthew Hall
On Wed, Dec 16, 2015 at 11:56:11AM +, Bruce Richardson wrote: > Having this work with any application is one of our primary targets here. > The app author should not have to worry too much about getting basic debug > support. Even if it doesn't work at 40G small packet rates, you can get a

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-21 Thread Matthew Hall
On Mon, Dec 21, 2015 at 04:17:26PM +, Gray, Mark D wrote: > Is tcpdump used in large production cloud environments? I would have > thought other less intrusive (and less manual) tools would be used? Isn't > that one of the benefits of SDN. tcpdump, tshark, wireshark, libpcap, etc. have been

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-23 Thread Matthew Hall
On Tue, Jun 23, 2015 at 10:19:58AM +0300, Vladimir Medvedkin wrote: > Hi all, > > Matthew, I think ipv6 lpm code need less changes > struct rte_lpm6_tbl_entry { > uint32_t next_hop: 21; /**< Next hop / next table to be > checked. */ > uint32_t depth :8; /**< Rule

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-23 Thread Matthew Hall
On Tue, Jun 23, 2015 at 09:13:14PM -0700, Matthew Hall wrote: > Vladimir, > > One thing I was confused, you published the changes to rte_lpm_tbl24_entry > but > you didn't say what you did to change rte_lpm_tbl8_entry, as that one only > had > an 8-bit next_hop as well.

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-23 Thread Matthew Hall
OK, I went and made a whole ton of patches to LPM and the tests and examples, now the selftest errors out... but I think maybe I don't have an adequate amount of hugepages. How much hugepage memory did people have when they did the selftest successfully before? I just keep seeing this over and

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-24 Thread Matthew Hall
On Wed, Jun 24, 2015 at 10:04:53AM +0300, Vladimir Medvedkin wrote: > I published changes to rte_lpm_tbl24_entry only because it was just an idea > :) Understood. Just wanted to be sure I understood it right to convert it into C code. :) > different defines and checks should be modified too.

[dpdk-dev] VMXNET3 on vmware, ping delay

2015-06-25 Thread Matthew Hall
On Thu, Jun 25, 2015 at 09:14:53AM +, Vass, Sandor (Nokia - HU/Budapest) wrote: > According to my understanding each packet should go > through BR as fast as possible, but it seems that the rte_eth_rx_burst > retrieves packets only when there are at least 2 packets on the RX queue of > the

[dpdk-dev] VMXNET3 on vmware, ping delay

2015-06-25 Thread Matthew Hall
On Thu, Jun 25, 2015 at 06:46:30PM +0300, Avi Kivity wrote: > What would be useful is a runtime switch between polling and interrupt > modes. This was if the load is load you use interrupts, and as mitigation, > you switch to poll mode, until the load drops again. Yes... I believe this is part

[dpdk-dev] VMXNET3 on vmware, ping delay

2015-06-25 Thread Matthew Hall
On Thu, Jun 25, 2015 at 08:44:51PM +0200, Thomas Monjalon wrote: > DPDK is not a stack. Hi Thomas, Don't worry too much about that challenge. When I get my app feature complete, I think we can change that. Same for Avi and they server frameworks they are making at Cloudius. ;) Matthew.

[dpdk-dev] VMXNET3 on vmware, ping delay

2015-06-25 Thread Matthew Hall
On Thu, Jun 25, 2015 at 09:13:59PM +, Vass, Sandor (Nokia - HU/Budapest) wrote: > Can anyone tell me the reason of this behavior? Using CPU 1 there are huge > latencies, using other CPUs everything work as expected... One possible guess what could be related. Normally DPDK uses "Core #0" as

[dpdk-dev] rte_lpm with larger nexthops or another method?

2015-06-26 Thread Matthew Hall
Hi guys, So I just finally fixed all the weird unit test failures for the basic-mode. But the rte_lpm_lookupx4 will take quite a bit longer because it uses a lot of real weird SSE intrinsic functions I never used before in my life. However pretty soon I should get some kind of results how it

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-28 Thread Matthew Hall
Hi all, I am getting a strange error compiling some RTM instructions when I upgraded my VM environment from VirtualBox 4 to VirtualBox 5 and AVX instructions from the host CPU became available. However when I am reading the opcode description for XABORT it supposedly allows an immediate

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-28 Thread Matthew Hall
It would appear there is some bug in the new lock elision patches that is preventing it from compiling with clang. Any suggestions? On Jun 28, 2015, at 10:16 AM, Matthew Hall wrote: > Hi all, > > I am getting a strange error compiling some RTM instructions when I upgraded > my VM

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-03-13 Thread Matthew Hall
On Mon, Feb 23, 2015 at 11:51:46PM +0200, Avi Kivity wrote: > https://github.com/cloudius-systems/seastar Hi Avi and others, My code unintentionally ended up looking somewhat like a C version of your seastar C++ code, even though I didn't really look at yours too much when I coded mine as it

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-14 Thread Matthew Hall
A few months ago we had this thread about symmetric hashing of TCP in RSS: http://dpdk.org/ml/archives/dev/2014-December/010148.html I was wondering if we ever did figure out how to get the 0x6d5a hash key mentioned in there to work, or another alternative one. Thanks, Matthew.

[dpdk-dev] "FATAL: Module uio not found" for dpdk usage on Amazon AWS

2015-03-18 Thread Matthew Hall
On Wed, Mar 18, 2015 at 06:41:05PM +, Naveen Gamini wrote: > When I tried to install dpdk on Amazon AWS ubuntu based linux, I see uio > module error. Can anyone help me to how to load uio module on ubuntu linux > so that IGB UIO module. Amazon Cloud Images usually include minimized kernel

[dpdk-dev] Packet data out of bounds after rte_eth_rx_burst

2015-03-23 Thread Matthew Hall
On Mon, Mar 23, 2015 at 05:19:00PM +0200, Dor Green wrote: > I changed it to free and it still happens. Note that the segmentation fault > happens before that anyway. > > I am using 1.7.1 at the moment. I can try using a newer version. I'm using 1.7.X in my open-source DPDK-based app and it

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-23 Thread Matthew Hall
On Mon, Mar 23, 2015 at 04:20:33PM +0100, Thomas Monjalon wrote: > 2015-03-23 10:05, Matt Laswell: > > Hey Folks, > > > > I have essentially the same question as Matthew. Has there been progress > > in this area? > > No, AFAIK. > Submitting a patch would be a good start I think. Hi Thomas, We

[dpdk-dev] tools brainstorming

2015-03-23 Thread Matthew Hall
On Mon, Mar 23, 2015 at 05:18:49PM +0100, Thomas Monjalon wrote: > Don't you think adding a bug tracker would artificially split discussions > between mailing list threads and bug tracker entries? It is difficult to track the workflow around bugs without some kind of bug-friendly workflow tool.

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-27 Thread Matthew Hall
On Mar 26, 2015, at 10:30 PM, Zhang, Helin wrote: > Hi guys > > Did you guys talk about symmetric hash in software or in hardware? > > If about hardware, I have one comment. > I40e supports symmetric hash by hardware, which was enabled in i40e PMD > recently. You can have a try. > > Regards,

[dpdk-dev] [RFC PATCH] eal: rte_rand yields only 62 random bits

2015-03-27 Thread Matthew Hall
On Fri, Mar 27, 2015 at 05:03:02PM -0700, Stephen Hemminger wrote: > I would argue remove rte_rand from DPDK. +1 To paraphrase Donald Knuth, "Random numbers should not be generated [using a function coded] at random." It'd be better to fix libc, or considering that has a slow dev cycle and

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-28 Thread Matthew Hall
On Sat, Mar 28, 2015 at 12:10:20PM +0300, Vladimir Medvedkin wrote: > I just verify RSS symmetric in my code, all works great. > ... > By the way, maybe it will be usefull to add softrss function in DPDK? Vladimir, All of this is super-awesome code. I agree having SW RSS would be quite nice.

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-01 Thread Matthew Hall
On Fri, May 01, 2015 at 12:45:12PM -0400, Neil Horman wrote: > Yes, but as you said above, using a web browser doesn't make reviewing patches > faster. In fact, I would assert that it slows the process down, as it > prevents > quick, easy command line access to patch review (as you have with a

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-01 Thread Matthew Hall
On Fri, May 01, 2015 at 11:09:14AM -0700, Stephen Hemminger wrote: > With email, the patches are right in front of developers and easier to quote > for review comments. Right in front of that subset of developers who do everything kernel-style, perhaps yes. But this sort of workflow is in the

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-01 Thread Matthew Hall
On Fri, May 01, 2015 at 10:59:32PM +0300, Aaro Koskinen wrote: > Projects like GCC, GLIBC, binutils, busybox, etc or what? > > A. You'll notice all of these are low-level UNIX hacker sorts of tools mostly, with the partial exception of busybox. But even that is mainly for embedded use. It

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-04 Thread Matthew Hall
On Mon, May 04, 2015 at 12:43:48PM +, Qiu, Michael wrote: > What mail client do you use? I think mail client supporting thread mode > is important for patch review. Like many UNIX people, I use mutt. My concern is that, if we're making the widespread adoption, usage, and contributions for

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-02 Thread Matthew Hall
On Sun, Aug 03, 2014 at 01:37:06AM +0900, Masaru Oki wrote: > cc links library funtion from archive only if call from other object. > but new dpdk pmd library has constractor section and not call directly. > ld always links library funtion with constractor section. > use -Xlinker, or use ld

[dpdk-dev] is there any function like rte_mempool_destroy compare with rte_mempool_create

2014-08-27 Thread Matthew Hall
On Wed, Aug 27, 2014 at 07:46:26AM +, Ni, Xun wrote: > If I run an application twice, is there possible that > the app has the memory leak? Or it just doesn't have enough memory to > execute it again because the first one already get most of the memory but > without release it. User-mapped

[dpdk-dev] Clang Scan build results

2014-08-27 Thread Matthew Hall
On Wed, Aug 27, 2014 at 03:13:43PM +, Wiles, Roger Keith wrote: > Hi Everyone, Hi Keith, For me the build failed with clang but I made a series of awful patches to get it to compile... not sure if the clang failures could be related to your scan-build failures. If it will help you I can

[dpdk-dev] rte_mbuf: documentation, meta-data, and inconsistencies

2014-08-28 Thread Matthew Hall
On Thu, Aug 28, 2014 at 08:00:59PM -0400, daniel chapiesky wrote: > But, in the end, sharing the meta-data area with the packet headroom seems > to be a very > bad idea. > > Sincerely, > > Daniel Chapiesky You might have picked a good time to inquire about it as some of the Intel guys are

[dpdk-dev] A question about hugepage initialization time

2014-12-09 Thread Matthew Hall
On Tue, Dec 09, 2014 at 10:33:59AM -0600, Matt Laswell wrote: > Our DPDK application deals with very large in memory data structures, and > can potentially use tens or even hundreds of gigabytes of hugepage memory. What you're doing is an unusual use case and this is open source code where

[dpdk-dev] [PATCH 1/4] l3fwd: some functions are unused in l3fwd-acl

2014-07-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- examples/l3fwd/Makefile | 1 + 1 file changed, 1 insertion(+) diff --git a/examples/l3fwd/Makefile b/examples/l3fwd/Makefile index 68de8fc..5cd7396 100644 --- a/examples/l3fwd/Makefile +++ b/examples/l3fwd/Makefile @@ -46,6 +46,7 @@ SRCS-y := main.c CFLAGS

[dpdk-dev] [PATCH 2/4] virtio-net.c: incorrect parens around equality check

2014-07-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- examples/vhost/virtio-net.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/examples/vhost/virtio-net.c b/examples/vhost/virtio-net.c index 801607a..5e659c7 100644 --- a/examples/vhost/virtio-net.c +++ b/examples/vhost/virtio-net.c

[dpdk-dev] [PATCH 3/4] examples/*: -Wno-switch required for weird ioctl() ID's

2014-07-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- examples/multi_process/client_server_mp/mp_client/Makefile | 1 + examples/multi_process/client_server_mp/mp_server/Makefile | 1 + examples/multi_process/l2fwd_fork/Makefile | 1 + examples/multi_process/simple_mp/Makefile | 1

[dpdk-dev] [PATCH 1/4] l3fwd: some functions are unused in l3fwd-acl

2014-07-21 Thread Matthew Hall
The same code is used in l3fwd and l3fwd-acl. When it is reused in l3fwd-acl a packet processing function from original l3fwd is not used any more. -- Sent from my mobile device. On July 21, 2014 6:44:41 AM PDT, Thomas Monjalon wrote: >Hi, > >2014-07-20 20:47, Matthew Hall: >>

[dpdk-dev] [PATCH 2/4] virtio-net.c: incorrect parens around equality check

2014-07-22 Thread Matthew Hall
On Tue, Jul 22, 2014 at 03:14:51PM +0200, Thomas Monjalon wrote: > Hi Matthew, > > I think that patches 1, 3 and 4 need some rework but this one is valid > and has no relation with other ones in the serie. So it can be integrated now. Great thanks! I'll work a bit more on the others when I've

[dpdk-dev] Performance - linking against DPDK shared vs static libraries

2014-07-23 Thread Matthew Hall
On Wed, Jul 23, 2014 at 09:43:49PM +, Kavanagh, Mark B wrote: > I take it ... that the performance drop when using shared libraries is > expected behavior? s/expected behavior/and unavoidable consequence/g ;) Matthew Hall.

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-24 Thread Matthew Hall
Hello, I ran into some weird symbol conflicts between system netinet/in.h and DPDK rte_ip.h. They have a lot of duplicated definitions for stuff like IPPROTO_IP and so on. This breaks when you want to use inet_pton from arpa/inet.h, because it includes netinet/in.h to define struct in_addr.

[dpdk-dev] [PATCH 3/5] i40e: support selecting hash functions

2014-07-24 Thread Matthew Hall
On Thu, Jul 24, 2014 at 09:59:23AM +0200, Thomas Monjalon wrote: > Is it really a good idea to configure this kind of thing at build time? > Maybe yes, I'm not sure. Whether it's safe to set at runtime probably depends what happens to the card if it gets changed. Do you have to reset the card or

[dpdk-dev] [PATCH 3/5] i40e: support selecting hash functions

2014-07-24 Thread Matthew Hall
If no reboot of the card is needed then it's probably better to add it to one of the ethtool style APIs... -- Sent from my mobile device. On July 24, 2014 1:07:37 AM PDT, Thomas Monjalon wrote: >2014-07-24 01:01, Matthew Hall: >> On Thu, Jul 24, 2014 at 09:59:23AM +0200, Thomas Monja

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-24 Thread Matthew Hall
On Thu, Jul 24, 2014 at 10:55:59PM +, Antti Kantee wrote: > In my experience from years of fighting with more or less this exact same > problem -- the fight is now thankfully over but the scars remain -- you > either want to expose a complete set of types and provide support for > everything,

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-25 Thread Matthew Hall
On 24/07/14 07:59, Matthew Hall wrote: >>>> I ran into some weird symbol conflicts between system netinet/in.h >and DPDK >>>> rte_ip.h. They have a lot of duplicated definitions for stuff like >IPPROTO_IP >>>> and so on. This breaks when you want to use

[dpdk-dev] [dpdk-announce] DPDK Features for Q1 2015

2014-10-24 Thread Matthew Hall
On Fri, Oct 24, 2014 at 08:10:40AM +, O'driscoll, Tim wrote: > At the moment, within Intel we test with KVM, Xen and ESXi. We've never > tested with VirtualBox. So, maybe this is an error on the Supported NICs > page, or maybe somebody else is testing that configuration. So, one of the most

[dpdk-dev] [dpdk-announce] DPDK Features for Q1 2015

2014-10-24 Thread Matthew Hall
On Fri, Oct 24, 2014 at 12:10:20PM +0200, Thomas Monjalon wrote: > I'm the author of this page. I think I've written VirtualBox to show where > virtio is implemented. You interpreted this as "supported environment", so > I'm removing it. Thanks for testing and reporting. Of course, I'm very

[dpdk-dev] Possible bug in eal_pci pci_scan_one

2014-10-24 Thread Matthew Hall
On Fri, Oct 24, 2014 at 06:36:29PM +0530, Stephen Hemminger wrote: > The code is fairly consistent in returning -1 for cases of not a NUMA socket, > bogus port value. It is interpreted as SOCKET_ID_ANY in several places. > The examples mostly check for -1 and use socket 0 as a fallback. > Probably

[dpdk-dev] [PATCH v3 3/8] i40e: support of setting hash lookup table size

2014-10-27 Thread Matthew Hall
On Mon, Oct 27, 2014 at 03:13:39PM +0100, Thomas Monjalon wrote: > You didn't answer to my previous comment on this. > I think these definitions are useless. 64 is 64. Putting labels on the constants gives meaning to them as well as a numeric value. Not doing so is an antipattern referred to as

[dpdk-dev] [PATCH] add free hugepage function

2014-10-28 Thread Matthew Hall
On Wed, Oct 29, 2014 at 03:27:58AM +, Qiu, Michael wrote: > I just saw one return path with value '0', and no any other place > return a negative value, so it is better to be designed as one > non-return function, > > +void > +rte_eal_hugepage_free(void) > +{ > + struct hugepage_file

[dpdk-dev] [PATCH v2] support free hugepages

2014-10-29 Thread Matthew Hall
On Wed, Oct 29, 2014 at 01:47:39PM +0800, linhaifeng wrote: > +int > +rte_eal_hugepage_free(void) > +{ > + struct hugepage_file *hugepg_tbl = g_hugepage_table.hugepg_tbl; > + unsigned i; > + unsigned nr_hugefiles = g_hugepage_table.nr_hugefiles; > + int ret = 0; > + > + for (i

[dpdk-dev] [PATCH] add free hugepage function

2014-10-29 Thread Matthew Hall
On Wed, Oct 29, 2014 at 11:32:12AM -0400, Neil Horman wrote: > > > Well, abnormal termination results in abnormal consequences. You expect > garbage to get left behind of a program crashes, so I wouldn't really worry > about that too much. If you really wanted to you can register chained >

[dpdk-dev] [PATCH] eal_pci.c: pci_scan_one: fix inaccurate NUMA node error comment

2014-10-30 Thread Matthew Hall
Signed-off-by: Matthew Hall --- lib/librte_eal/linuxapp/eal/eal_pci.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lib/librte_eal/linuxapp/eal/eal_pci.c b/lib/librte_eal/linuxapp/eal/eal_pci.c index 5fe3961..ddb0535 100644 --- a/lib/librte_eal/linuxapp/eal/eal_pci.c +++ b

[dpdk-dev] [PATCH] add free hugepage function

2014-10-30 Thread Matthew Hall
5PM -0700, Matthew Hall wrote: >> On Wed, Oct 29, 2014 at 11:32:12AM -0400, Neil Horman wrote: >> > > >> > Well, abnormal termination results in abnormal consequences. You >expect >> > garbage to get left behind of a program crashes, so I wouldn't >really w

[dpdk-dev] [PATCH RFC] Update/Improve build system

2014-10-30 Thread Matthew Hall
On Thu, Oct 30, 2014 at 09:18:23AM +, Gonzalez Monroy, Sergio wrote: > I would say that D) is a good balance, although not being the simplest. A, or D. Depending on things such as, "If you run the DPDK on Random Platform X," where X could be something like Power CPUs or other weird stuff,

[dpdk-dev] [PATCH RFC] Update/Improve build system

2014-10-31 Thread Matthew Hall
On Fri, Oct 31, 2014 at 10:45:07AM +, Gonzalez Monroy, Sergio wrote: > That flow work still presents some issues as they may be features that are > incompatible between each other and would need to be in different DPDK > copies. > > Regards, > Sergio So I think the two questions are: 1)

[dpdk-dev] reg : adding grub entry with hugepages.

2014-09-01 Thread Matthew Hall
On Mon, Sep 01, 2014 at 02:32:40PM +0530, Anand S Angadi wrote: > >Hello everyone, > >I am using fedora 16, i want to Add additional Grub entry with hugepages > >enabled permanently can u tell me how can i add? > >and wher can i add? Try /etc/default/grub .

[dpdk-dev] [PATCHv5] librte_acl make it build/work for 'default' target

2014-09-02 Thread Matthew Hall
On Wed, Sep 03, 2014 at 03:29:16AM +0200, Thomas Monjalon wrote: > > > Make ACL library to build/work on 'default' architecture: Upon reading all the steps taken to implement the new multi-arch version of the code, I had a funny feeling where each time I asked, "But... what if X???" the next

[dpdk-dev] TCP/IP stack for DPDK

2014-09-09 Thread Matthew Hall
On Tue, Sep 09, 2014 at 08:49:44AM +0800, zimeiw wrote: > I have porting major FreeBSD tcp/ip stack to dpdk. new tcp/ip stack is based > on dpdk rte_mbuf, rte_ring, rte_memory and rte_table. it is faster to > forwarding packets. Hello, This is awesome work to be doing and badly needed to use

[dpdk-dev] TCP/IP stack for DPDK

2014-09-09 Thread Matthew Hall
On Tue, Sep 09, 2014 at 06:47:48AM +, Zhang, Helin wrote: > That means your great works under GPL/LGPL license will not occur in DPDK > main line, as it is always BSD license. > > Regards, > Helin However despite this issue, there are some cases where the Linux stack is greatly superior to

[dpdk-dev] Defaults for rte_hash

2014-09-09 Thread Matthew Hall
Hello, I was looking at the code which inits rte_hash objects in examples/l3fwd. It's using approx. 1M to 4M hash 'entries' depending on 32-bit vs 64-bit, but it's setting the 'bucket_entries' to just 4. Normally I'm used to using somewhat deeper hash buckets than that... it seems like having

  1   2   3   >