RE: [PATCHv13 3/4] zswap: add to mm/

2013-06-21 Thread Dan Magenheimer
> From: Bob Liu [mailto:lliu...@gmail.com] Subject: Re: [PATCHv13 3/4] zswap: add to mm/ > > On Thu, Jun 20, 2013 at 10:23 PM, Seth Jennings > wrote: > > On Thu, Jun 20, 2013 at 05:42:04PM +0800, Bob Liu wrote: > >> > Just made a mmtests run of my own and got very different results: > >> > > >>

RE: [PATCHv13 3/4] zswap: add to mm/

2013-06-21 Thread Dan Magenheimer
From: Bob Liu [mailto:lliu...@gmail.com] Subject: Re: [PATCHv13 3/4] zswap: add to mm/ On Thu, Jun 20, 2013 at 10:23 PM, Seth Jennings sjenn...@linux.vnet.ibm.com wrote: On Thu, Jun 20, 2013 at 05:42:04PM +0800, Bob Liu wrote: Just made a mmtests run of my own and got very different

RE: [PATCHv12 2/4] zbud: add to mm/

2013-05-29 Thread Dan Magenheimer
> From: Andrew Morton [mailto:a...@linux-foundation.org] > Subject: Re: [PATCHv12 2/4] zbud: add to mm/ > > On Wed, 29 May 2013 15:42:36 -0500 Seth Jennings > wrote: > > > > > > I worry about any code which independently looks at the pageframe > > > > > tables and expects to find page struts

RE: [PATCHv12 2/4] zbud: add to mm/

2013-05-29 Thread Dan Magenheimer
From: Andrew Morton [mailto:a...@linux-foundation.org] Subject: Re: [PATCHv12 2/4] zbud: add to mm/ On Wed, 29 May 2013 15:42:36 -0500 Seth Jennings sjenn...@linux.vnet.ibm.com wrote: I worry about any code which independently looks at the pageframe tables and expects to find

Bye bye Mr tmem guy

2013-05-20 Thread Dan Magenheimer
thanks for all the fish!" Cheers, Dan Magenheimer The Transcendent Memory ("tmem") guy Tmem-related historical webography: http://lwn.net/Articles/454795/ http://lwn.net/Articles/475681/ http://lwn.net/Articles/545244/ https://oss.oracle.com/projects/tmem/ http://www.

RE: [PATCH] staging: ramster: add how-to document

2013-05-20 Thread Dan Magenheimer
> From: Dan Magenheimer [mailto:dan.magenhei...@oracle.com] > Sent: Monday, May 20, 2013 8:52 AM > To: de...@linuxdriverproject.org; linux-kernel@vger.kernel.org; > gre...@linuxfoundation.org; linux- > m...@kvack.org; konrad.w...@oracle.com; dan.magenhei...@oracle.com; > liw...@

[PATCH] staging: ramster: add how-to document

2013-05-20 Thread Dan Magenheimer
Add how-to documentation that provides a step-by-step guide for configuring and trying out a ramster cluster. Signed-off-by: Dan Magenheimer --- drivers/staging/zcache/ramster/ramster-howto.txt | 366 ++ 1 files changed, 366 insertions(+), 0 deletions(-) create mode 100644

[PATCH] staging: ramster: add how-to document

2013-05-20 Thread Dan Magenheimer
Add how-to documentation that provides a step-by-step guide for configuring and trying out a ramster cluster. Signed-off-by: Dan Magenheimer dan.magenhei...@oracle.com --- drivers/staging/zcache/ramster/ramster-howto.txt | 366 ++ 1 files changed, 366 insertions(+), 0

RE: [PATCH] staging: ramster: add how-to document

2013-05-20 Thread Dan Magenheimer
From: Dan Magenheimer [mailto:dan.magenhei...@oracle.com] Sent: Monday, May 20, 2013 8:52 AM To: de...@linuxdriverproject.org; linux-kernel@vger.kernel.org; gre...@linuxfoundation.org; linux- m...@kvack.org; konrad.w...@oracle.com; dan.magenhei...@oracle.com; liw...@linux.vnet.ibm.com; bob

Bye bye Mr tmem guy

2013-05-20 Thread Dan Magenheimer
the fish! Cheers, Dan Magenheimer The Transcendent Memory (tmem) guy Tmem-related historical webography: http://lwn.net/Articles/454795/ http://lwn.net/Articles/475681/ http://lwn.net/Articles/545244/ https://oss.oracle.com/projects/tmem/ http://www.linux-kvm.org/wiki/images/d/d7/TmemNotVirt

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-16 Thread Dan Magenheimer
> From: Rik van Riel [mailto:r...@redhat.com] > Sent: Wednesday, May 15, 2013 4:15 PM > To: Dan Magenheimer > Cc: Seth Jennings; Andrew Morton; Greg Kroah-Hartman; Nitin Gupta; Minchan > Kim; Konrad Wilk; Robert > Jennings; Jenifer Hopper; Mel Gorman; Johannes Weiner; Larry Wo

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-16 Thread Dan Magenheimer
From: Rik van Riel [mailto:r...@redhat.com] Sent: Wednesday, May 15, 2013 4:15 PM To: Dan Magenheimer Cc: Seth Jennings; Andrew Morton; Greg Kroah-Hartman; Nitin Gupta; Minchan Kim; Konrad Wilk; Robert Jennings; Jenifer Hopper; Mel Gorman; Johannes Weiner; Larry Woodman; Benjamin

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
> From: Rik van Riel [mailto:r...@redhat.com] > Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > > On 05/15/2013 03:35 PM, Dan Magenheimer wrote: > >> From: Konrad Rzeszutek Wilk > >> Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > >> > >>> Sorr

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
> From: Dave Hansen [mailto:d...@sr71.net] > Sent: Wednesday, May 15, 2013 2:24 PM > To: Seth Jennings > Cc: Konrad Rzeszutek Wilk; Dan Magenheimer; Andrew Morton; Greg > Kroah-Hartman; Nitin Gupta; Minchan > Kim; Robert Jennings; Jenifer Hopper; Mel Gorman; Johannes Weine

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Sent: Wednesday, May 15, 2013 2:10 PM > To: Konrad Rzeszutek Wilk > Cc: Dan Magenheimer; Andrew Morton; Greg Kroah-Hartman; Nitin Gupta; Minchan > Kim; Robert Jennings; > Jenifer Hopper; Mel Gorman; Johannes Weiner; R

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
> From: Konrad Rzeszutek Wilk > Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > > > Sorry, but I don't think that's appropriate for a patch in the MM subsystem. > > I am heading to the airport shortly so this email is a bit hastily typed. > > Perhaps a compromise can be reached where this code

RE: [PATCH] Fixes, cleanups, compile warning fixes, and documentation update for Xen tmem driver (v2).

2013-05-15 Thread Dan Magenheimer
n Monday. FWIW, I've scanned all of these and they look sane and good. So consider all: Acked-by: Dan Magenheimer > Documentation/kernel-parameters.txt | 21 > drivers/xen/Kconfig |7 +-- > drivers/xen/tmem.c | 87 > --

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > > On Tue, May 14, 2013 at 01:18:48PM -0700, Dan Magenheimer wrote: > > > From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > > > Subject: Re: [

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ On Tue, May 14, 2013 at 01:18:48PM -0700, Dan Magenheimer wrote: From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ snip

RE: [PATCH] Fixes, cleanups, compile warning fixes, and documentation update for Xen tmem driver (v2).

2013-05-15 Thread Dan Magenheimer
- And lastly add some logic to not enable selfshrinking and selfballooning if frontswap functionality is off. That is it. Tested and ready to go. If nobody objects will put on my queue for Linus on Monday. FWIW, I've scanned all of these and they look sane and good. So consider all: Acked-by: Dan

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
From: Konrad Rzeszutek Wilk Subject: Re: [PATCHv11 3/4] zswap: add to mm/ Sorry, but I don't think that's appropriate for a patch in the MM subsystem. I am heading to the airport shortly so this email is a bit hastily typed. Perhaps a compromise can be reached where this code is merged

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Sent: Wednesday, May 15, 2013 2:10 PM To: Konrad Rzeszutek Wilk Cc: Dan Magenheimer; Andrew Morton; Greg Kroah-Hartman; Nitin Gupta; Minchan Kim; Robert Jennings; Jenifer Hopper; Mel Gorman; Johannes Weiner; Rik van Riel; Larry

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
From: Dave Hansen [mailto:d...@sr71.net] Sent: Wednesday, May 15, 2013 2:24 PM To: Seth Jennings Cc: Konrad Rzeszutek Wilk; Dan Magenheimer; Andrew Morton; Greg Kroah-Hartman; Nitin Gupta; Minchan Kim; Robert Jennings; Jenifer Hopper; Mel Gorman; Johannes Weiner; Rik van Riel; Larry

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-15 Thread Dan Magenheimer
From: Rik van Riel [mailto:r...@redhat.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ On 05/15/2013 03:35 PM, Dan Magenheimer wrote: From: Konrad Rzeszutek Wilk Subject: Re: [PATCHv11 3/4] zswap: add to mm/ Sorry, but I don't think that's appropriate for a patch in the MM

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-14 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > > On Tue, May 14, 2013 at 09:37:08AM -0700, Dan Magenheimer wrote: > > > From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > > > Subject: Re: [

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-14 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > > > > > > +/* The maximum percentage of memory that the compressed pool can occupy > > > */ > > > +static unsigned int zswap_max_pool_percent = 20; > > >

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-14 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: [PATCHv11 3/4] zswap: add to mm/ > > On Tue, May 14, 2013 at 05:19:19PM +0800, Bob Liu wrote: > > Hi Seth, > > Hi Bob, thanks for the review! > > > > > > + /* reclaim space if needed */ > > > + if (zswap_is_full()) { > >

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-14 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ On Tue, May 14, 2013 at 05:19:19PM +0800, Bob Liu wrote: Hi Seth, Hi Bob, thanks for the review! + /* reclaim space if needed */ + if (zswap_is_full()) { +

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-14 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ snip +/* The maximum percentage of memory that the compressed pool can occupy */ +static unsigned int zswap_max_pool_percent = 20; +module_param_named(max_pool_percent, +

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-14 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ On Tue, May 14, 2013 at 09:37:08AM -0700, Dan Magenheimer wrote: From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: [PATCHv11 3/4] zswap: add to mm/ On Tue

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-13 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: [PATCHv11 3/4] zswap: add to mm/ > > zswap is a thin compression backend for frontswap. It receives pages from > frontswap and attempts to store them in a compressed memory pool, resulting in > an effective partial memory

RE: [PATCHv11 2/4] zbud: add to mm/

2013-05-13 Thread Dan Magenheimer
o > obj-$(CONFIG_DEBUG_KMEMLEAK_TEST) += kmemleak-test.o > obj-$(CONFIG_CLEANCACHE) += cleancache.o > obj-$(CONFIG_MEMORY_ISOLATION) += page_isolation.o > +obj-$(CONFIG_ZBUD) += zbud.o > diff --git a/mm/zbud.c b/mm/zbud.c > new file mode 100644 > index 000..e5bd0e6 >

RE: [PATCHv11 2/4] zbud: add to mm/

2013-05-13 Thread Dan Magenheimer
+ * + * Copyright (C) 2013, Seth Jennings, IBM + * + * Concepts based on zcache internal zbud allocator by Dan Magenheimer. + * + * zbud is an special purpose allocator for storing compressed pages. It is + * designed to store up to two compressed pages per physical page. While

RE: [PATCHv11 3/4] zswap: add to mm/

2013-05-13 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: [PATCHv11 3/4] zswap: add to mm/ zswap is a thin compression backend for frontswap. It receives pages from frontswap and attempts to store them in a compressed memory pool, resulting in an effective partial memory reclaim and

RE: zsmalloc zbud hybrid design discussion?

2013-04-12 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: zsmalloc zbud hybrid design discussion? > > On Thu, Apr 11, 2013 at 04:28:19PM -0700, Dan Magenheimer wrote: > > (Bob Liu added) > > > > > From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm

RE: zsmalloc zbud hybrid design discussion?

2013-04-12 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: zsmalloc zbud hybrid design discussion? On Thu, Apr 11, 2013 at 04:28:19PM -0700, Dan Magenheimer wrote: (Bob Liu added) From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: zsmalloc zbud hybrid

RE: zsmalloc zbud hybrid design discussion?

2013-04-11 Thread Dan Magenheimer
(Bob Liu added) > From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: zsmalloc zbud hybrid design discussion? > > On Wed, Mar 27, 2013 at 01:04:25PM -0700, Dan Magenheimer wrote: > > Seth and all zproject folks -- > > > > I've been giving some

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
wrote: > > > On Tue, Apr 09, 2013 at 10:27:19AM +0900, Minchan Kim wrote: > > >> Hi Dan, > > >> > > >> On Mon, Apr 08, 2013 at 09:32:38AM -0700, Dan Magenheimer wrote: > > >>>> From: Minchan Kim [mailto:minc...@kernel.org] > > >>&

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from > zram in-memory) > > On Tue, Apr 09, 2013 at 01:37:47PM -0700, Dan Magenheimer wrote: > > > From: Minchan Kim [mailto:minc...@kernel.org] >

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from > zram in-memory) > > On Tue, Apr 09, 2013 at 01:25:45PM -0700, Dan Magenheimer wrote: > > > From: Minchan Kim [mailto:minc...@kernel.org] >

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
;> Hi Dan, > >> > >> On Mon, Apr 08, 2013 at 09:32:38AM -0700, Dan Magenheimer wrote: > >>>> From: Minchan Kim [mailto:minc...@kernel.org] > >>>> Sent: Monday, April 08, 2013 12:01 AM > >>>> Subject: [PATCH] mm: remove compressed co

RE: [PATCH 00/10] staging: zcache/ramster: fix and ramster/debugfs improvement

2013-04-11 Thread Dan Magenheimer
> From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] > Sent: Tuesday, April 09, 2013 6:26 PM > To: Greg Kroah-Hartman > Cc: Dan Magenheimer; Seth Jennings; Konrad Rzeszutek Wilk; Minchan Kim; > linux...@kvack.org; linux- > ker...@vger.kernel.org; Andrew Morton; Bob Liu; Wa

RE: [PATCH 02/10] staging: zcache: remove zcache_freeze

2013-04-11 Thread Dan Magenheimer
> From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] > Subject: [PATCH 02/10] staging: zcache: remove zcache_freeze > > The default value of zcache_freeze is false and it won't be modified by > other codes. Remove zcache_freeze since no routine can disable zcache > during system running. > >

RE: [PATCH 02/10] staging: zcache: remove zcache_freeze

2013-04-11 Thread Dan Magenheimer
From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] Subject: [PATCH 02/10] staging: zcache: remove zcache_freeze The default value of zcache_freeze is false and it won't be modified by other codes. Remove zcache_freeze since no routine can disable zcache during system running.

RE: [PATCH 00/10] staging: zcache/ramster: fix and ramster/debugfs improvement

2013-04-11 Thread Dan Magenheimer
From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] Sent: Tuesday, April 09, 2013 6:26 PM To: Greg Kroah-Hartman Cc: Dan Magenheimer; Seth Jennings; Konrad Rzeszutek Wilk; Minchan Kim; linux...@kvack.org; linux- ker...@vger.kernel.org; Andrew Morton; Bob Liu; Wanpeng Li Subject: [PATCH 00

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
at 09:32:38AM -0700, Dan Magenheimer wrote: From: Minchan Kim [mailto:minc...@kernel.org] Sent: Monday, April 08, 2013 12:01 AM Subject: [PATCH] mm: remove compressed copy from zram in-memory (patch removed) Fragment ratio is almost same but memory consumption and compile time

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory) On Tue, Apr 09, 2013 at 01:25:45PM -0700, Dan Magenheimer wrote: From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: zsmalloc defrag

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory) On Tue, Apr 09, 2013 at 01:37:47PM -0700, Dan Magenheimer wrote: From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: zsmalloc defrag

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-11 Thread Dan Magenheimer
:19AM +0900, Minchan Kim wrote: Hi Dan, On Mon, Apr 08, 2013 at 09:32:38AM -0700, Dan Magenheimer wrote: From: Minchan Kim [mailto:minc...@kernel.org] Sent: Monday, April 08, 2013 12:01 AM Subject: [PATCH] mm: remove compressed copy from zram in-memory (patch removed

RE: zsmalloc zbud hybrid design discussion?

2013-04-11 Thread Dan Magenheimer
(Bob Liu added) From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: zsmalloc zbud hybrid design discussion? On Wed, Mar 27, 2013 at 01:04:25PM -0700, Dan Magenheimer wrote: Seth and all zproject folks -- I've been giving some deep thought as to how a zpage allocator

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-09 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from > zram in-memory) > > On Tue, Apr 09, 2013 at 10:27:19AM +0900, Minchan Kim wrote: > > Hi Dan, > > > > On Mon, Apr 08, 2013 at 09:32:

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-09 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from > zram in-memory) > > Hi Dan, > > On Mon, Apr 08, 2013 at 09:32:38AM -0700, Dan Magenheimer wrote: > > > From: Minchan Kim [mailto:minc...@

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-09 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory) Hi Dan, On Mon, Apr 08, 2013 at 09:32:38AM -0700, Dan Magenheimer wrote: From: Minchan Kim [mailto:minc...@kernel.org] Sent: Monday, April 08

RE: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-09 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory) On Tue, Apr 09, 2013 at 10:27:19AM +0900, Minchan Kim wrote: Hi Dan, On Mon, Apr 08, 2013 at 09:32:38AM -0700, Dan Magenheimer wrote: From

zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-08 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Sent: Monday, April 08, 2013 12:01 AM > Subject: [PATCH] mm: remove compressed copy from zram in-memory (patch removed) > Fragment ratio is almost same but memory consumption and compile time > is better. I am working to add defragment function

zsmalloc defrag (Was: [PATCH] mm: remove compressed copy from zram in-memory)

2013-04-08 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Sent: Monday, April 08, 2013 12:01 AM Subject: [PATCH] mm: remove compressed copy from zram in-memory (patch removed) Fragment ratio is almost same but memory consumption and compile time is better. I am working to add defragment function of

RE: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently

2013-04-07 Thread Dan Magenheimer
> From: Dan Magenheimer > Subject: RE: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages > more efficiently > > > From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] > > Subject: Re: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled > > pag

RE: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently

2013-04-07 Thread Dan Magenheimer
> From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] > Subject: Re: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages > more efficiently > > Hi Dan, > > Some issues against Ramster: > > - Ramster who takes advantage of zcache also should support zero-filled > pages more

RE: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently

2013-04-07 Thread Dan Magenheimer
From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] Subject: Re: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently Hi Dan, Some issues against Ramster: - Ramster who takes advantage of zcache also should support zero-filled pages more efficiently,

RE: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently

2013-04-07 Thread Dan Magenheimer
From: Dan Magenheimer Subject: RE: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] Subject: Re: [PATCH part2 v6 0/3] staging: zcache: Support zero-filled pages more efficiently Hi Dan, Some

RE: [PATCHv8 5/8] mm: break up swap_writepage() for frontswap backends

2013-04-04 Thread Dan Magenheimer
another revision of the patchset is needed for other > reasons, I'll pull this change into the next version. > > I think Dan and Bob would be ok with their tags being applied to 5 and 6: > > Acked-by: Bob Liu > Reviewed-by: Dan Magenheimer > > That ok? OK with me. I do

RE: [PATCHv8 0/8] zswap: compressed swap caching

2013-04-04 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: [PATCHv8 0/8] zswap: compressed swap caching > > ... I am submitting this as a > candidate for merging in the v3.10 window... > : > I'll be attending the LSF/MM summit where there (hopefully) will be a > discussion this

RE: [PATCHv8 0/8] zswap: compressed swap caching

2013-04-04 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: [PATCHv8 0/8] zswap: compressed swap caching ... I am submitting this as a candidate for merging in the v3.10 window... : I'll be attending the LSF/MM summit where there (hopefully) will be a discussion this patchset and

RE: [PATCHv8 5/8] mm: break up swap_writepage() for frontswap backends

2013-04-04 Thread Dan Magenheimer
with their tags being applied to 5 and 6: Acked-by: Bob Liu bob@oracle.com Reviewed-by: Dan Magenheimer dan.magenhei...@oracle.com That ok? OK with me. I do support these two MM patches as candidates for the 3.10 window since both zswap AND in-tree zcache depend on them, but the silence from Andrew

RE: zsmalloc/lzo compressibility vs entropy

2013-03-29 Thread Dan Magenheimer
> From: Dan Magenheimer > Sent: Wednesday, March 27, 2013 3:42 PM > To: Seth Jennings; Konrad Wilk; Minchan Kim; Bob Liu; Robert Jennings; Nitin > Gupta; Wanpeng Li; Andrew > Morton; Mel Gorman > Cc: linux...@kvack.org; linux-kernel@vger.kernel.org > Subject: zsmalloc/l

RE: zsmalloc/lzo compressibility vs entropy

2013-03-29 Thread Dan Magenheimer
From: Dan Magenheimer Sent: Wednesday, March 27, 2013 3:42 PM To: Seth Jennings; Konrad Wilk; Minchan Kim; Bob Liu; Robert Jennings; Nitin Gupta; Wanpeng Li; Andrew Morton; Mel Gorman Cc: linux...@kvack.org; linux-kernel@vger.kernel.org Subject: zsmalloc/lzo compressibility vs entropy

RE: [RFC] mm: remove swapcache page early

2013-03-28 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Subject: Re: [RFC] mm: remove swapcache page early > > Hi Dan, > > On Wed, Mar 27, 2013 at 03:24:00PM -0700, Dan Magenheimer wrote: > > > From: Hugh Dickins [mailto:hu...@google.com] > > > Subject: Re: [

RE: [RFC] mm: remove swapcache page early

2013-03-28 Thread Dan Magenheimer
> From: Hugh Dickins [mailto:hu...@google.com] > Subject: RE: [RFC] mm: remove swapcache page early > > On Wed, 27 Mar 2013, Dan Magenheimer wrote: > > > From: Hugh Dickins [mailto:hu...@google.com] > > > Subject: Re: [RFC] mm: remove swapcache page early >

RE: [RFC] mm: remove swapcache page early

2013-03-28 Thread Dan Magenheimer
From: Hugh Dickins [mailto:hu...@google.com] Subject: RE: [RFC] mm: remove swapcache page early On Wed, 27 Mar 2013, Dan Magenheimer wrote: From: Hugh Dickins [mailto:hu...@google.com] Subject: Re: [RFC] mm: remove swapcache page early The issue you are raising here is (2). You

RE: [RFC] mm: remove swapcache page early

2013-03-28 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Subject: Re: [RFC] mm: remove swapcache page early Hi Dan, On Wed, Mar 27, 2013 at 03:24:00PM -0700, Dan Magenheimer wrote: From: Hugh Dickins [mailto:hu...@google.com] Subject: Re: [RFC] mm: remove swapcache page early I believe

RE: [RFC] mm: remove swapcache page early

2013-03-27 Thread Dan Magenheimer
> From: Hugh Dickins [mailto:hu...@google.com] > Subject: Re: [RFC] mm: remove swapcache page early > > On Wed, 27 Mar 2013, Minchan Kim wrote: > > > Swap subsystem does lazy swap slot free with expecting the page > > would be swapped out again so we can't avoid unnecessary write. >

zsmalloc/lzo compressibility vs entropy

2013-03-27 Thread Dan Magenheimer
This might be obvious to those of you who are better mathematicians than I, but I ran some experiments to confirm the relationship between entropy and compressibility and thought I should report the results to the list. Using the LZO code in the kernel via zsmalloc and some hacks in zswap, I

RE: [RFC] mm: remove swapcache page early

2013-03-27 Thread Dan Magenheimer
> From: Minchan Kim [mailto:minc...@kernel.org] > Subject: [RFC] mm: remove swapcache page early > > Swap subsystem does lazy swap slot free with expecting the page > would be swapped out again so we can't avoid unnecessary write. > > But the problem in in-memory swap is that it consumes memory

RE: [RFC] mm: remove swapcache page early

2013-03-27 Thread Dan Magenheimer
From: Minchan Kim [mailto:minc...@kernel.org] Subject: [RFC] mm: remove swapcache page early Swap subsystem does lazy swap slot free with expecting the page would be swapped out again so we can't avoid unnecessary write. But the problem in in-memory swap is that it consumes memory space

zsmalloc/lzo compressibility vs entropy

2013-03-27 Thread Dan Magenheimer
This might be obvious to those of you who are better mathematicians than I, but I ran some experiments to confirm the relationship between entropy and compressibility and thought I should report the results to the list. Using the LZO code in the kernel via zsmalloc and some hacks in zswap, I

RE: [RFC] mm: remove swapcache page early

2013-03-27 Thread Dan Magenheimer
From: Hugh Dickins [mailto:hu...@google.com] Subject: Re: [RFC] mm: remove swapcache page early On Wed, 27 Mar 2013, Minchan Kim wrote: Swap subsystem does lazy swap slot free with expecting the page would be swapped out again so we can't avoid unnecessary write.

RE: [PATCH v2 1/4] introduce zero filled pages handler

2013-03-25 Thread Dan Magenheimer
> From: Konrad Rzeszutek Wilk [mailto:kon...@darnok.org] > Sent: Tuesday, March 19, 2013 10:44 AM > To: Dan Magenheimer > Cc: Wanpeng Li; Greg Kroah-Hartman; Andrew Morton; Seth Jennings; Minchan > Kim; linux...@kvack.org; > linux-kernel@vger.kernel.org > Subject: Re: [PA

RE: [PATCH v2 1/4] introduce zero filled pages handler

2013-03-25 Thread Dan Magenheimer
From: Konrad Rzeszutek Wilk [mailto:kon...@darnok.org] Sent: Tuesday, March 19, 2013 10:44 AM To: Dan Magenheimer Cc: Wanpeng Li; Greg Kroah-Hartman; Andrew Morton; Seth Jennings; Minchan Kim; linux...@kvack.org; linux-kernel@vger.kernel.org Subject: Re: [PATCH v2 1/4] introduce zero

RE: [PATCH v2 1/4] introduce zero filled pages handler

2013-03-16 Thread Dan Magenheimer
> From: Konrad Rzeszutek Wilk [mailto:kon...@darnok.org] > Subject: Re: [PATCH v2 1/4] introduce zero filled pages handler > > > + > > + for (pos = 0; pos < PAGE_SIZE / sizeof(*page); pos++) { > > + if (page[pos]) > > + return false; > > Perhaps allocate a static

RE: [PATCH v2 1/4] introduce zero filled pages handler

2013-03-16 Thread Dan Magenheimer
From: Konrad Rzeszutek Wilk [mailto:kon...@darnok.org] Subject: Re: [PATCH v2 1/4] introduce zero filled pages handler + + for (pos = 0; pos PAGE_SIZE / sizeof(*page); pos++) { + if (page[pos]) + return false; Perhaps allocate a static page filled with

RE: zsmalloc limitations and related topics

2013-03-15 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: zsmalloc limitations and related topics > > On 03/14/2013 01:54 PM, Dan Magenheimer wrote: > >> From: Robert Jennings [mailto:r...@linux.vnet.ibm.com] > >> Subject: Re: zsmalloc

RE: zsmalloc limitations and related topics

2013-03-15 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: zsmalloc limitations and related topics On 03/14/2013 01:54 PM, Dan Magenheimer wrote: From: Robert Jennings [mailto:r...@linux.vnet.ibm.com] Subject: Re: zsmalloc limitations and related topics * Bob (bob

RE: zsmalloc limitations and related topics

2013-03-14 Thread Dan Magenheimer
> From: Dan Magenheimer > Subject: RE: zsmalloc limitations and related topics > > > > I would welcome ideas on how to evaluate workloads for > > > "representativeness". Personally I don't believe we should > > > be making decisions about selecti

RE: zsmalloc limitations and related topics

2013-03-14 Thread Dan Magenheimer
> From: Robert Jennings [mailto:r...@linux.vnet.ibm.com] > Sent: Thursday, March 14, 2013 7:21 AM > To: Bob > Cc: Seth Jennings; Dan Magenheimer; minc...@kernel.org; Nitin Gupta; Konrad > Wilk; linux...@kvack.org; > linux-kernel@vger.kernel.org; Bob Liu; Luigi Semenzato; Mel Go

RE: zsmalloc limitations and related topics

2013-03-14 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > Subject: Re: zsmalloc limitations and related topics Hi Seth -- Thanks for the reply. I think it is very important to be having these conversations. > >>> 2) When not full and especially when nearly-empty _after_ > >>>being full,

RE: [PATCH 4/4] zcache: add pageframes count once compress zero-filled pages twice

2013-03-14 Thread Dan Magenheimer
> From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] > Sent: Wednesday, March 13, 2013 6:21 PM > To: Dan Magenheimer > Cc: Andrew Morton; Greg Kroah-Hartman; Dan Magenheimer; Seth Jennings; Konrad > Rzeszutek Wilk; Minchan > Kim; linux...@kvack.org; linux-kernel@vger.kernel

RE: [PATCH 4/4] zcache: add pageframes count once compress zero-filled pages twice

2013-03-14 Thread Dan Magenheimer
From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] Sent: Wednesday, March 13, 2013 6:21 PM To: Dan Magenheimer Cc: Andrew Morton; Greg Kroah-Hartman; Dan Magenheimer; Seth Jennings; Konrad Rzeszutek Wilk; Minchan Kim; linux...@kvack.org; linux-kernel@vger.kernel.org Subject: Re: [PATCH 4

RE: zsmalloc limitations and related topics

2013-03-14 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] Subject: Re: zsmalloc limitations and related topics Hi Seth -- Thanks for the reply. I think it is very important to be having these conversations. 2) When not full and especially when nearly-empty _after_ being full, density

RE: zsmalloc limitations and related topics

2013-03-14 Thread Dan Magenheimer
From: Robert Jennings [mailto:r...@linux.vnet.ibm.com] Sent: Thursday, March 14, 2013 7:21 AM To: Bob Cc: Seth Jennings; Dan Magenheimer; minc...@kernel.org; Nitin Gupta; Konrad Wilk; linux...@kvack.org; linux-kernel@vger.kernel.org; Bob Liu; Luigi Semenzato; Mel Gorman Subject: Re

RE: zsmalloc limitations and related topics

2013-03-14 Thread Dan Magenheimer
From: Dan Magenheimer Subject: RE: zsmalloc limitations and related topics I would welcome ideas on how to evaluate workloads for representativeness. Personally I don't believe we should be making decisions about selecting the best algorithms or merging code without an agreement

RE: zsmalloc limitations and related topics

2013-03-13 Thread Dan Magenheimer
> From: Robert Jennings [mailto:r...@linux.vnet.ibm.com] > Subject: Re: zsmalloc limitations and related topics Hi Robert -- Thanks for the well-considered reply! > * Dan Magenheimer (dan.magenhei...@oracle.com) wrote: > > Hi all -- > > > > I've been doing some

RE: [PATCH 2/4] zcache: zero-filled pages awareness

2013-03-13 Thread Dan Magenheimer
ERO_FILLED into zcache_pampd_create_finish() I think that would be cleaner... If you change this and make the pageframe counter fix for PATCH 4/4, please add my ack for the next version: Acked-by: Dan Magenheimer -- To unsubscribe from this list: send the line "unsubscribe linux-kernel"

RE: [PATCH 4/4] zcache: add pageframes count once compress zero-filled pages twice

2013-03-13 Thread Dan Magenheimer
> From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] > Sent: Wednesday, March 13, 2013 1:05 AM > To: Andrew Morton > Cc: Greg Kroah-Hartman; Dan Magenheimer; Seth Jennings; Konrad Rzeszutek > Wilk; Minchan Kim; linux- > m...@kvack.org; linux-kernel@vger.kernel.org; Wanpeng Li &

RE: [PATCH 4/4] zcache: add pageframes count once compress zero-filled pages twice

2013-03-13 Thread Dan Magenheimer
From: Wanpeng Li [mailto:liw...@linux.vnet.ibm.com] Sent: Wednesday, March 13, 2013 1:05 AM To: Andrew Morton Cc: Greg Kroah-Hartman; Dan Magenheimer; Seth Jennings; Konrad Rzeszutek Wilk; Minchan Kim; linux- m...@kvack.org; linux-kernel@vger.kernel.org; Wanpeng Li Subject: [PATCH 4/4

RE: [PATCH 2/4] zcache: zero-filled pages awareness

2013-03-13 Thread Dan Magenheimer
version: Acked-by: Dan Magenheimer dan.magenhei...@oracle.com -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org

RE: zsmalloc limitations and related topics

2013-03-13 Thread Dan Magenheimer
From: Robert Jennings [mailto:r...@linux.vnet.ibm.com] Subject: Re: zsmalloc limitations and related topics Hi Robert -- Thanks for the well-considered reply! * Dan Magenheimer (dan.magenhei...@oracle.com) wrote: Hi all -- I've been doing some experimentation on zsmalloc

RE: [PATCHv7 4/8] zswap: add to mm/

2013-03-07 Thread Dan Magenheimer
> From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] > To: Dave Hansen > Subject: Re: [PATCHv7 4/8] zswap: add to mm/ > > On 03/07/2013 01:00 PM, Dave Hansen wrote: > > On 03/06/2013 07:52 AM, Seth Jennings wrote: > > ... > >> +**/ > >> +/* attempts to

RE: [PATCHv7 4/8] zswap: add to mm/

2013-03-07 Thread Dan Magenheimer
From: Seth Jennings [mailto:sjenn...@linux.vnet.ibm.com] To: Dave Hansen Subject: Re: [PATCHv7 4/8] zswap: add to mm/ On 03/07/2013 01:00 PM, Dave Hansen wrote: On 03/06/2013 07:52 AM, Seth Jennings wrote: ... +**/ +/* attempts to compress and store an

RE: zsmalloc limitations and related topics

2013-03-04 Thread Dan Magenheimer
> From: Ric Mason [mailto:ric.mas...@gmail.com] > Subject: Re: zsmalloc limitations and related topics > > On 02/28/2013 07:24 AM, Dan Magenheimer wrote: > > Hi all -- > > > > I've been doing some experimentation on zsmalloc in preparation > > for my topic prop

RE: zsmalloc limitations and related topics

2013-03-04 Thread Dan Magenheimer
From: Ric Mason [mailto:ric.mas...@gmail.com] Subject: Re: zsmalloc limitations and related topics On 02/28/2013 07:24 AM, Dan Magenheimer wrote: Hi all -- I've been doing some experimentation on zsmalloc in preparation for my topic proposed for LSFMM13 and have run across some

  1   2   3   4   >