Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-04-25 Thread Stephen Hemminger
On Wed, 25 Apr 2018 17:02:48 +0100 "Burakov, Anatoly" wrote: > On 14-Feb-18 10:07 AM, Burakov, Anatoly wrote: > > On 14-Feb-18 8:04 AM, Thomas Monjalon wrote: > >> Hi Anatoly, > >> > >> 19/12/2017 12:14, Anatoly Burakov: > >>>   * Memory tagging. This is related to previous item. Right now, w

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-04-25 Thread Burakov, Anatoly
On 14-Feb-18 10:07 AM, Burakov, Anatoly wrote: On 14-Feb-18 8:04 AM, Thomas Monjalon wrote: Hi Anatoly, 19/12/2017 12:14, Anatoly Burakov:   * Memory tagging. This is related to previous item. Right now, we can only ask     malloc to allocate memory by page size, but one could potentially hav

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-14 Thread Yongseok Koh
> On Feb 14, 2018, at 1:32 AM, Burakov, Anatoly > wrote: > > On 14-Feb-18 2:01 AM, Yongseok Koh wrote: >>> On Feb 5, 2018, at 2:03 AM, Burakov, Anatoly >>> wrote: >>> >>> Thanks for your feedback, good to hear we're on the right track. I already >>> have a prototype implementation of this

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-14 Thread Burakov, Anatoly
On 14-Feb-18 8:04 AM, Thomas Monjalon wrote: Hi Anatoly, 19/12/2017 12:14, Anatoly Burakov: * Memory tagging. This is related to previous item. Right now, we can only ask malloc to allocate memory by page size, but one could potentially have different memory regions backed by pages of

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-14 Thread Burakov, Anatoly
On 14-Feb-18 2:01 AM, Yongseok Koh wrote: On Feb 5, 2018, at 2:03 AM, Burakov, Anatoly wrote: Thanks for your feedback, good to hear we're on the right track. I already have a prototype implementation of this working, due for v1 submission :) Anatoly, One more suggestion. Currently, when

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-14 Thread Thomas Monjalon
Hi Anatoly, 19/12/2017 12:14, Anatoly Burakov: > * Memory tagging. This is related to previous item. Right now, we can only > ask >malloc to allocate memory by page size, but one could potentially have >different memory regions backed by pages of similar sizes (for example, >locked 1

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-13 Thread Yongseok Koh
> On Feb 5, 2018, at 2:03 AM, Burakov, Anatoly > wrote: > > Thanks for your feedback, good to hear we're on the right track. I already > have a prototype implementation of this working, due for v1 submission :) Anatoly, One more suggestion. Currently, when populating mempool, there's a chanc

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-06 Thread Nélio Laranjeiro
On Mon, Feb 05, 2018 at 10:36:58AM +, Burakov, Anatoly wrote: > On 05-Feb-18 10:18 AM, Nélio Laranjeiro wrote: > > On Mon, Feb 05, 2018 at 10:03:35AM +, Burakov, Anatoly wrote: > > > On 02-Feb-18 7:28 PM, Yongseok Koh wrote: > > > > On Tue, Dec 26, 2017 at 05:19:25PM +, Walker, Benjamin

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-05 Thread Burakov, Anatoly
On 05-Feb-18 10:18 AM, Nélio Laranjeiro wrote: On Mon, Feb 05, 2018 at 10:03:35AM +, Burakov, Anatoly wrote: On 02-Feb-18 7:28 PM, Yongseok Koh wrote: On Tue, Dec 26, 2017 at 05:19:25PM +, Walker, Benjamin wrote: On Fri, 2017-12-22 at 09:13 +, Burakov, Anatoly wrote: On 21-Dec-17

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-05 Thread Nélio Laranjeiro
On Mon, Feb 05, 2018 at 10:03:35AM +, Burakov, Anatoly wrote: > On 02-Feb-18 7:28 PM, Yongseok Koh wrote: > > On Tue, Dec 26, 2017 at 05:19:25PM +, Walker, Benjamin wrote: > > > On Fri, 2017-12-22 at 09:13 +, Burakov, Anatoly wrote: > > > > On 21-Dec-17 9:38 PM, Walker, Benjamin wrote:

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-05 Thread Burakov, Anatoly
On 02-Feb-18 7:28 PM, Yongseok Koh wrote: On Tue, Dec 26, 2017 at 05:19:25PM +, Walker, Benjamin wrote: On Fri, 2017-12-22 at 09:13 +, Burakov, Anatoly wrote: On 21-Dec-17 9:38 PM, Walker, Benjamin wrote: SPDK will need some way to register for a notification when pages are allocated o

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-02-02 Thread Yongseok Koh
On Tue, Dec 26, 2017 at 05:19:25PM +, Walker, Benjamin wrote: > On Fri, 2017-12-22 at 09:13 +, Burakov, Anatoly wrote: > > On 21-Dec-17 9:38 PM, Walker, Benjamin wrote: > > > SPDK will need some way to register for a notification when pages are > > > allocated > > > or freed. For storage, t

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-01-25 Thread Burakov, Anatoly
On 23-Jan-18 10:33 PM, Yongseok Koh wrote: On Dec 19, 2017, at 3:14 AM, Anatoly Burakov wrote: [...] Quick outline of all changes done as part of this patchset: * Malloc heap adjusted to handle holes in address space * Single memseg list replaced by multiple expandable memseg lists * VA spa

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-01-23 Thread Yongseok Koh
> On Dec 19, 2017, at 3:14 AM, Anatoly Burakov > wrote: [...] > Quick outline of all changes done as part of this patchset: > > * Malloc heap adjusted to handle holes in address space > * Single memseg list replaced by multiple expandable memseg lists > * VA space for hugepages is preallocated

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2018-01-13 Thread Burakov, Anatoly
On 19-Dec-17 11:14 AM, Anatoly Burakov wrote: This patchset introduces a prototype implementation of dynamic memory allocation for DPDK. It is intended to start a conversation and build consensus on the best way to implement this functionality. The patchset works well enough to pass all unit test

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-26 Thread Walker, Benjamin
On Fri, 2017-12-22 at 09:13 +, Burakov, Anatoly wrote: > On 21-Dec-17 9:38 PM, Walker, Benjamin wrote: > > SPDK will need some way to register for a notification when pages are > > allocated > > or freed. For storage, the number of requests per second is (relative to > > networking) fairly smal

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-22 Thread Burakov, Anatoly
On 21-Dec-17 9:38 PM, Walker, Benjamin wrote: On Tue, 2017-12-19 at 11:14 +, Anatoly Burakov wrote: Quick outline of all changes done as part of this patchset: * Malloc heap adjusted to handle holes in address space * Single memseg list replaced by multiple expandable memseg lists

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-21 Thread Walker, Benjamin
On Tue, 2017-12-19 at 11:14 +, Anatoly Burakov wrote: > > Quick outline of all changes done as part of this patchset: > > * Malloc heap adjusted to handle holes in address space > * Single memseg list replaced by multiple expandable memseg lists > * VA space for hugepages is preallocated

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-19 Thread Burakov, Anatoly
On 19-Dec-17 4:06 PM, Stephen Hemminger wrote: On Tue, 19 Dec 2017 16:02:51 + "Burakov, Anatoly" wrote: On 19-Dec-17 3:46 PM, Stephen Hemminger wrote: On Tue, 19 Dec 2017 11:14:27 + Anatoly Burakov wrote: This patchset introduces a prototype implementation of dynamic memory allo

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-19 Thread Stephen Hemminger
On Tue, 19 Dec 2017 16:02:51 + "Burakov, Anatoly" wrote: > On 19-Dec-17 3:46 PM, Stephen Hemminger wrote: > > On Tue, 19 Dec 2017 11:14:27 + > > Anatoly Burakov wrote: > > > >> This patchset introduces a prototype implementation of dynamic memory > >> allocation > >> for DPDK. It is

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-19 Thread Burakov, Anatoly
On 19-Dec-17 3:46 PM, Stephen Hemminger wrote: On Tue, 19 Dec 2017 11:14:27 + Anatoly Burakov wrote: This patchset introduces a prototype implementation of dynamic memory allocation for DPDK. It is intended to start a conversation and build consensus on the best way to implement this funct

Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK

2017-12-19 Thread Stephen Hemminger
On Tue, 19 Dec 2017 11:14:27 + Anatoly Burakov wrote: > This patchset introduces a prototype implementation of dynamic memory > allocation > for DPDK. It is intended to start a conversation and build consensus on the > best > way to implement this functionality. The patchset works well enou