Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-16 Thread Mel Gorman
On Fri, 13 Apr 2007, Yasunori Goto wrote: Hello. cmdline_parse_kernelcore() should return the next pointer of boot option like memparse() doing. If not, it is cause of eternal loop on ia64 box. This patch is for 2.6.21-rc6-mm1. Signed-off-by: Yasunori Goto [EMAIL PROTECTED] Acked-by: Mel

Re: [PATCH -mm] fix undefined symbol if CONFIG_PAGE_GROUP_BY_MOBILITY not set

2007-04-20 Thread Mel Gorman
(), page_group_by_mobility_disabled ? off : on, vm_total_pages); +#else + printk(Built %i zonelists. Total pages: %ld\n, + num_online_nodes(), vm_total_pages); +#endif } /* -- Pierre -- Mel Gorman Part-time Phd Student Linux

Re: [RFC 2/8] Basic allocation for higher order page cache pages

2007-04-20 Thread Mel Gorman
); page = NULL; - -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED

Re: [RFC 3/8] Flushing and zeroing higher order page cache pages

2007-04-20 Thread Mel Gorman
linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick

Re: [RFC 4/8] Enhance fallback functions in libs to support higher order pages

2007-04-20 Thread Mel Gorman
the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- -- Mel Gorman Part-time Phd Student Linux Technology Center University

Re: [RFC 7/8] Enhance ramfs to support higher order pages

2007-04-20 Thread Mel Gorman
@@ extern int ramfs_nommu_mmap(struct file #endif extern const struct file_operations ramfs_file_operations; +extern const struct file_operations ramfs_file_higher_order_operations; extern struct vm_operations_struct generic_file_vm_ops; extern int __init init_rootfs(void); -- Mel

Re: [RFC 0/8] Variable Order Page Cache

2007-04-20 Thread Mel Gorman
this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- -- Mel Gorman Part-time Phd Student Linux Technology Center

Re: [RFC 0/8] Variable Order Page Cache

2007-04-20 Thread Mel Gorman
-movable pages towards the lower PFNs. Assuming it had a reasonable level of success, even high-order ramfs pages that were unmovable should work out. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software

Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-23 Thread Mel Gorman
. It's nasty looking because sizing the portion of memory usable by any allocation so that it is evenly spread throughout all nodes is not trivial. I think that having mem= parsing broken on NUMA at various times in the past (and probably still broken) highlights that. -- Mel Gorman Part-time

Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-23 Thread Mel Gorman
so that is compatible with both early_param() way of doing things and IA64. [EMAIL PROTECTED]: Fix parsing kernelcore boot option V1] Signed-off-by: Mel Gorman [EMAIL PROTECTED] diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.21-rc6-mm1-001_latest/arch/i386/kernel/setup.c linux-2.6.21

Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-23 Thread Mel Gorman
On (23/04/07 19:32), Mel Gorman didst pronounce: There was a second problem that showed up while testing this in relation to the bootmem allocator assumptions about zone boundary alignment. I'll follow up this mail with the patch in case you are seeing that problem. Tony Luck added to cc

Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-24 Thread Mel Gorman
that is easily avoided. Bye. Thanks -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message

Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-24 Thread Mel Gorman
to a boundary. This patch aligns the zone to a MAX_ORDER_NR_PAGES boundary. Signed-off-by: Mel Gorman [EMAIL PROTECTED] diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.21-rc6-mm1-002_commonparse/mm/page_alloc.c linux-2.6.21-rc6-mm1-003_alignmovable/mm/page_alloc.c --- linux-2.6.21-rc6-mm1

Re: [PATCH]Fix parsing kernelcore boot option for ia64

2007-04-24 Thread Mel Gorman
on most test machines. In combination with the align-zone_movable-to-maxordernrpages-boundary patch, x86_64, ppc64 and IA64 test machines all booted successfully with and without kernelcore= specified. Acked-by: Mel Gorman [EMAIL PROTECTED] I'll resend the two relevant patches for this problem

[PATCH 0/2] Fix two boot problems related to ZONE_MOVABLE sizing

2007-04-24 Thread Mel Gorman
on the freelists for the wrong zone resulting in a BUG() later. Aligning ZONE_MOVABLE avoids the problem. They have been successfully boot-tested with and without kernelcore= specified on x86_64, ppc64 and IA64 (where the bug was first triggered). -- Mel Gorman Part-time Phd Student

[PATCH 1/2] Handle kernelcore= boot parameter in common code to avoid boot problem on IA64

2007-04-24 Thread Mel Gorman
-memory-at-boot-time.patch x86_64-specify-amount-of-kernel-memory-at-boot-time.patch x86-specify-amount-of-kernel-memory-at-boot-time.patch Signed-off-by: Yasunori Goto [EMAIL PROTECTED] Acked-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Andy Whitcroft [EMAIL PROTECTED] --- arch/i386/kernel

[PATCH 2/2] Align ZONE_MOVABLE to a MAX_ORDER_NR_PAGES boundary

2007-04-24 Thread Mel Gorman
requested instead of smaller. The impact is that the kernel-usable portion of memory because a minimum guarantee instead of the exact size requested by the user. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Andy Whitcroft [EMAIL PROTECTED] --- page_alloc.c |5 + 1 files changed, 5

Re: [SLUB 0/3] SLUB: The unqueued slab allocator V4

2007-03-08 Thread Mel Gorman
On (08/03/07 08:48), Christoph Lameter didst pronounce: On Thu, 8 Mar 2007, Mel Gorman wrote: On x86_64, it completed successfully and looked reliable. There was a 5% performance loss on kernbench and aim9 figures were way down. However, with slub_debug enabled, I would expect that so

Re: [SLUB 0/3] SLUB: The unqueued slab allocator V4

2007-03-09 Thread Mel Gorman
On Thu, 8 Mar 2007, Christoph Lameter wrote: On Thu, 8 Mar 2007, Mel Gorman wrote: Note that the 16kb page size has a major impact on SLUB performance. On IA64 slub will use only 1/4th the locking overhead as on 4kb platforms. It'll be interesting to see the kernbench tests

Re: [SLUB 0/3] SLUB: The unqueued slab allocator V4

2007-03-09 Thread Mel Gorman
be avoided by using kmalloc. Yuck! Hopefully your patches fix that fundamental problem. One way to find out for sure. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from

Re: [SLUB 0/3] SLUB: The unqueued slab allocator V4

2007-03-09 Thread Mel Gorman
Note that I am amazed that the kernbench even worked. The results without slub_debug were not good except for IA64. x86_64 and ppc64 both blew up for a variety of reasons. The IA64 results were KernBench Comparison 2.6.21-rc2-mm2-clean

[PATCH] Fix corruption of memmap on IA64 SPARSEMEM when mem_section is not a power of 2

2007-03-13 Thread Mel Gorman
for the section. Signed-off-by: Bob Picco [EMAIL PROTECTED] Signed-off-by: Andy Whitcroft [EMAIL PROTECTED] Signed-off-by: Mel Gorman [EMAIL PROTECTED] include/linux/mmzone.h |6 -- mm/sparse.c| 49 ++--- 2 files changed, 50 insertions

Re: 2.6.21-rc3-mm2 (oops in move_freepages)

2007-03-14 Thread Mel Gorman
[EMAIL PROTECTED] Cc: linux-kernel@vger.kernel.org, Mel Gorman [EMAIL PROTECTED] Subject: [PATCH] fix BUG_ON check at move_freepages() (Re: 2.6.21-rc3-mm2) Hello. The BUG_ON() check at move_freepages() is wrong. Its end_page is start_page + MAX_ORDER_NR_PAGES. So, it can be next zone. BUG_ON

Re: [RFC][PATCH 2/7] RSS controller core

2007-03-14 Thread Mel Gorman
and all the data migrated. hmm -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

Re: 2.6.21-rc3-mm2 (oops in move_freepages)

2007-03-14 Thread Mel Gorman
On (14/03/07 09:11), Bjorn Helgaas didst pronounce: On Wednesday 14 March 2007 03:44, Mel Gorman wrote: Please try the following patch from Yasunori Goto. ... --- current_test.orig/mm/page_alloc.c 2007-03-08 15:44:10.0 +0900 +++ current_test/mm/page_alloc.c2007-03-08

Re: [RFC][PATCH 2/7] RSS controller core

2007-03-14 Thread Mel Gorman
to assume the accounting cost. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

Re: 2.6.21-rc3-mm2 (oops in move_freepages)

2007-03-14 Thread Mel Gorman
On (14/03/07 10:52), Bjorn Helgaas didst pronounce: On Wednesday 14 March 2007 10:13, Mel Gorman wrote: Ok. This looks like another case of HOLES_IN_ZONE hilarity with page_zone(). As I take a new look at the BUG_ON check in move_freepages(), it isn't even necessary as move_freepages_block

Re: 2.6.21-rc3-mm2 (oops in move_freepages)

2007-03-14 Thread Mel Gorman
On Wed, 14 Mar 2007, Bjorn Helgaas wrote: On Wednesday 14 March 2007 11:21, Mel Gorman wrote: Can you tell me if the faulting line was at the check for PageBuddy? I don't know, sorry. No problem, the fact the patch booted lets me know that calling PageBuddy() on an invalid page had

[PATCH] Avoid unsafe use of struct pages in move_freepages when CONFIG_HOLES_IN_ZONE is set

2007-03-14 Thread Mel Gorman
CONFIG_HOLES_IN_ZONE and checks pfn_valid() earlier before calling PageBuddy(). It applies on top of move-free-pages-between-lists-on-steal-fix-2.patch from Yasunori Goto in -mm. Credit to Bjorn Helgaas for reporting this bug and testing. Signed-off-by: Mel Gorman [EMAIL PROTECTED] page_alloc.c | 18

Re: 2.6.21-rc3-mm2 (oops in move_freepages)

2007-03-14 Thread Mel Gorman
On Wed, 14 Mar 2007, Bjorn Helgaas wrote: On Wednesday 14 March 2007 12:59, Mel Gorman wrote: SNIP Virtual mem_map starts at 0xa0007fffc720 Zone PFN ranges: Total aside, a message should have been printed out here with sizeof(struct page) = ?? when loglevel was set to 8. I wanted it so I

Re: [QUICKLIST 4/6] x86_64: Single Quicklist

2007-03-14 Thread Mel Gorman
/ -- -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info

Re: 2.6.21-rc3-mm1

2007-03-15 Thread Mel Gorman
even though I think it will lower success rates for superpage allocations because of increased fragmentation. Benchmarking will tell me for sure. Thanks Mariusz for the report. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick

Re: 2.6.21-rc3-mm1

2007-03-15 Thread Mel Gorman
++-- 3 files changed, 67 insertions(+), 22 deletions(-) Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.21-rc3-mm2-clean/include/linux/mmzone.h linux-2.6.21-rc3-mm2-blockreserve/include/linux/mmzone.h --- linux-2.6.21

Re: 2.6.21-rc3-mm1

2007-03-16 Thread Mel Gorman
today. Thanks a million for testing. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message

[PATCH] Bias the location of pages freed for min_free_kbytes in the same MAX_ORDER_NR_PAGES blocks

2007-03-17 Thread Mel Gorman
MIGRATE_HIGHALLOC and see if the reports stay missing. Credit to Mariusz Kozlowski for discovering the problem, describing the failure scenario and testing patches and scenarios. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Andy Whitcroft [EMAIL PROTECTED] include/linux/mmzone.h |4

Re: [PATCH] Bias the location of pages freed for min_free_kbytes in the same MAX_ORDER_NR_PAGES blocks

2007-03-18 Thread Mel Gorman
On Sun, 18 Mar 2007, Andrew Morton wrote: On Sat, 17 Mar 2007 18:26:41 + [EMAIL PROTECTED] (Mel Gorman) wrote: I still haven't got onto reviewing all your mm patches :( There are a lot them admittadly. Nor has anyone else, afaik. They have been reviewed at various points

Re: [PATCH] Bias the location of pages freed for min_free_kbytes in the same MAX_ORDER_NR_PAGES blocks

2007-03-18 Thread Mel Gorman
On Sun, 18 Mar 2007, Andrew Morton wrote: On Sun, 18 Mar 2007 11:35:36 + (GMT) Mel Gorman [EMAIL PROTECTED] wrote: But let me leap ahead of myself. CONFIG_PAGE_GROUP_BY_MOBILITY Why does this config item exist? It's not good to have some mysterious knob which affects mm behaviour

Re: [PATCH] Bias the location of pages freed for min_free_kbytes in the same MAX_ORDER_NR_PAGES blocks

2007-03-18 Thread Mel Gorman
On Sun, 18 Mar 2007, Andrew Morton wrote: On Sun, 18 Mar 2007 19:05:41 + (GMT) Mel Gorman [EMAIL PROTECTED] wrote: How much additional memory consumption are we expecting here? Short answer, about 1.5KB on a 1GB system of which 1.3KB is statically defined in the 3 struct zones on a 1

Re: [PATCH] Bias the location of pages freed for min_free_kbytes in the same MAX_ORDER_NR_PAGES blocks

2007-03-18 Thread Mel Gorman
On Sun, 18 Mar 2007, Andrew Morton wrote: On Sun, 18 Mar 2007 20:08:49 + (GMT) Mel Gorman [EMAIL PROTECTED] wrote: On Sun, 18 Mar 2007, Andrew Morton wrote: On Sun, 18 Mar 2007 19:05:41 + (GMT) Mel Gorman [EMAIL PROTECTED] wrote: How much additional memory consumption are we

Re: [RFC][PATCH 2/7] RSS controller core

2007-03-20 Thread Mel Gorman
On (14/03/07 13:42), Dave Hansen didst pronounce: On Wed, 2007-03-14 at 15:38 +, Mel Gorman wrote: On (13/03/07 10:05), Dave Hansen didst pronounce: How do we determine what is shared, and goes into the shared zones? Assuming we had a means of creating a zone that was assigned

Re: pagetable_ops: Hugetlb character device example

2007-03-22 Thread Mel Gorman
(or maybe just give hints) which page size to use for this mapping. If a driver wants to tell what pagesize to use, they can override the ops to call the appropriate hugetlb code. Hints will be damn near impossible to get right in all cases. -- Mel Gorman Part-time Phd Student

Re: pagetable_ops: Hugetlb character device example

2007-03-23 Thread Mel Gorman
On Thu, 22 Mar 2007, Christoph Hellwig wrote: On Thu, Mar 22, 2007 at 03:42:27PM +, Mel Gorman wrote: A year ago, I may have agreed with you. However, Linus not only veto'd it but stamped on it repeatadly at VM Summit. He couldn't have made it clearer if he wore a t-shirt a hat

Re: [patch] rfc: introduce /dev/hugetlb

2007-03-23 Thread Mel Gorman
); shp-mlock_user = current-user; } else { int acctflag = VM_ACCOUNT; Otherwise, seems promising. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab

Re: [patch] rfc: introduce /dev/hugetlb

2007-03-23 Thread Mel Gorman
-static unsigned long +unsigned long hugetlb_get_unmapped_area(struct file *file, unsigned long addr, unsigned long len, unsigned long pgoff, unsigned long flags) On Fri, Mar 23, 2007 at 03:03:57PM +, Mel Gorman wrote: What is going on here? Why do arches not get to specify

[PATCH] Do not disable interrupts when reading min_free_kbytes

2007-03-26 Thread Mel Gorman
. It might even be noticable machines with large numbers of zones if a process started constantly reading min_free_kbytes. This patch only calls setup_per_zone_pages_min() only on write. Tested on an x86 laptop and it did the right thing. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- page_alloc.c

Re: [PATCH 1/7] Introduce the pagetable_operations and associated helper macros.

2007-02-20 Thread Mel Gorman
with pagetable_operations when they really know what they are doing and why. Having the pagetable_ops set is similar to VM_HUGETLB set as a strong sign that something unusual is going on that is fairly easy to check for. I prefer the additional struct to extending VMAs anyway. -- Mel Gorman Part-time Phd

[PATCH 0/12] Group pages of related mobility together to reduce external fragmentation v28

2007-03-01 Thread Mel Gorman
towards the start of memory. This is with a view of supporting memory hot-remove of DIMMs with higher PFNs in the future. The biasing could be enforced a lot heavier but it would cost. The last patch agressively clusters reclaimable pages like inode caches together. -- Mel Gorman Part-time Phd Student

[PATCH 1/12] Add a bitmap that is used to track flags affecting a block of pages

2007-03-01 Thread Mel Gorman
allocating the memory is quite high. Additional credit to Andy Whitcroft who reviewed up an earlier implementation of the mechanism an suggested how to make it a *lot* cleaner. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- include/linux/mmzone.h | 13 include/linux/pageblock

[PATCH 2/12] Add __GFP_MOVABLE for callers to flag allocations from high memory that may be migrated

2007-03-01 Thread Mel Gorman
-by: Mel Gorman [EMAIL PROTECTED] --- fs/inode.c| 10 ++-- fs/ramfs/inode.c |1 include/asm-alpha/page.h |3 +- include/asm-cris/page.h |3 +- include/asm-h8300/page.h |3 +- include/asm-i386/page.h |3 +- include/asm-ia64/page.h |5

[PATCH 3/12] Add __GFP_MOVABLE for callers to flag allocations from low memory that may be migrated

2007-03-01 Thread Mel Gorman
GFP_*_MOVABLE for one use unless people feel it would help self-documentation. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- block_dev.c |2 +- buffer.c|2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2

[PATCH 4/12] Split the free lists for movable and unmovable allocations

2007-03-01 Thread Mel Gorman
This patch adds the core of the fragmentation reduction strategy. It works by grouping pages together based on their ability to migrate or be reclaimed. Basically, it works by breaking the list in zone-free_area list into MIGRATE_TYPES number of lists. Signed-off-by: Mel Gorman [EMAIL PROTECTED

[PATCH 5/12] Choose pages from the per-cpu list based on migration type

2007-03-01 Thread Mel Gorman
is not measurably slower for the workloads we've tested. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- page_alloc.c | 28 1 files changed, 24 insertions(+), 4 deletions(-) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2-004_clustering_core/mm

[PATCH 6/12] Add a configure option to group pages by mobility

2007-03-01 Thread Mel Gorman
with the standard buddy allocator. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Signed-off-by: Joel Schopp [EMAIL PROTECTED] --- include/linux/mmzone.h |6 ++ init/Kconfig | 13 + mm/page_alloc.c| 31 +++ 3 files changed, 50 insertions

[PATCH 7/12] Drain per-cpu lists when high-order allocations fail

2007-03-01 Thread Mel Gorman
by suspend and hotplug. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- page_alloc.c | 28 +++- 1 files changed, 27 insertions(+), 1 deletion(-) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2-006_configurable/mm/page_alloc.c linux-2.6.20-mm2

[PATCH 9/12] Group short-lived and reclaimable kernel allocations

2007-03-01 Thread Mel Gorman
-by: Mel Gorman [EMAIL PROTECTED] --- fs/buffer.c |6 -- fs/dcache.c |2 +- fs/ext2/super.c |3 ++- fs/ext3/super.c |2 +- fs/jbd/journal.c|6 -- fs/jbd/revoke.c |6

[PATCH 8/12] Move free pages between lists on steal

2007-03-01 Thread Mel Gorman
When a fallback occurs, there will be free pages for one allocation type stored on the list for another. When a large steal occurs, this patch will move all the free pages within one list to the other. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- page_alloc.c | 65

[PATCH 11/12] Bias the placement of kernel pages at lower PFNs

2007-03-01 Thread Mel Gorman
This patch chooses blocks with lower PFNs when placing kernel allocations. This is particularly important during fallback in low memory situations to stop unmovable pages being placed throughout the entire address space. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- page_alloc.c | 20

[PATCH 10/12] Group high-order atomic allocations

2007-03-01 Thread Mel Gorman
as possible by adding a new MIGRATE_TYPE. The MIGRATE_HIGHATOMIC type are exactly what they sound like. Care is taken that pages of other migrate types do not use the same blocks as high-order atomic allocations. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- include/linux/mmzone.h |4 +++- mm

[PATCH 12/12] Be more agressive about stealing when MIGRATE_RECLAIMABLE allocations fallback

2007-03-01 Thread Mel Gorman
agressive about stealing blocks of pages for MIGRATE_RECLAIMABLE. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- page_alloc.c | 18 +++--- 1 files changed, 15 insertions(+), 3 deletions(-) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2-011_biasplacement/mm

[PATCH 0/8] Create optional ZONE_MOVABLE to partition memory between movable and non-movable pages v2

2007-03-01 Thread Mel Gorman
of problems during review of the patches. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

[PATCH 1/8] Add __GFP_MOVABLE for callers to flag allocations that may be migrated

2007-03-01 Thread Mel Gorman
to Hugh Dickens for catching issues with shmem swap vector and ramfs allocations. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- fs/inode.c| 10 ++-- fs/ramfs/inode.c |1 include/asm-alpha/page.h |3 +- include/asm-cris/page.h |3 +- include/asm

[PATCH 2/8] Create the ZONE_MOVABLE zone

2007-03-01 Thread Mel Gorman
-by: Mel Gorman [EMAIL PROTECTED] --- include/linux/gfp.h|3 include/linux/mm.h |1 include/linux/mmzone.h | 19 +++ include/linux/vmstat.h |5 mm/highmem.c |7 + mm/page_alloc.c| 229 +++- mm/vmstat.c

[PATCH 3/8] Allow huge page allocations to use GFP_HIGH_MOVABLE

2007-03-01 Thread Mel Gorman
external fragmentation of note as huge pages are always the largest contiguous block we care about. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- include/linux/hugetlb.h |3 +++ include/linux/mempolicy.h |6 +++--- include/linux/sysctl.h|1 + kernel/sysctl.c |8

[PATCH 4/8] x86 - Specify amount of kernel memory at boot time

2007-03-01 Thread Mel Gorman
This patch adds the kernelcore= parameter for x86. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- setup.c |1 + 1 files changed, 1 insertion(+) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2-003_mark_hugepages_movable/arch/i386/kernel/setup.c linux-2.6.20-mm2

[PATCH 5/8] ppc and powerpc - Specify amount of kernel memory at boot time

2007-03-01 Thread Mel Gorman
This patch adds the kernelcore= parameter for ppc and powerpc. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- powerpc/kernel/prom.c |1 + ppc/mm/init.c |2 ++ 2 files changed, 3 insertions(+) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2

[PATCH 6/8] x86_64 - Specify amount of kernel memory at boot time

2007-03-01 Thread Mel Gorman
This patch adds the kernelcore= parameter for x86_64. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- e820.c |1 + 1 files changed, 1 insertion(+) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2-005_ppc64_set_kernelcore/arch/x86_64/kernel/e820.c linux-2.6.20-mm2

[PATCH 7/8] ia64 - Specify amount of kernel memory at boot time

2007-03-01 Thread Mel Gorman
This patch adds the kernelcore= parameter for ia64. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- efi.c |3 +++ 1 files changed, 3 insertions(+) diff -rup -X /usr/src/patchset-0.6/bin//dontdiff linux-2.6.20-mm2-006_x8664_set_kernelcore/arch/ia64/kernel/efi.c linux-2.6.20-mm2

[PATCH 8/8] Add documentation for additional boot parameter and sysctl

2007-03-01 Thread Mel Gorman
Once all patches are applied, a new command-line parameter exist and a new sysctl. This patch adds the necessary documentation. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- filesystems/proc.txt | 15 +++ kernel-parameters.txt | 16 sysctl/vm.txt

The performance and behaviour of the anti-fragmentation related patches

2007-03-01 Thread Mel Gorman
systems, I found ffplay from the ffmpeg package worked. If neither of these work for you, the tar.gz contains the JPG files making up the frames and you can view them with any image viewer. -- Mel Gorman Part-time Phd Student Linux Technology Center

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
On Thu, 1 Mar 2007, Bill Irwin wrote: On Thu, Mar 01, 2007 at 10:12:50AM +, Mel Gorman wrote: These are figures based on kernels patches with Andy Whitcrofts reclaim patches. You will see that the zone-based kernel is getting success rates closer to 40% as one would expect although

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
On (01/03/07 16:09), Andrew Morton didst pronounce: On Thu, 1 Mar 2007 10:12:50 + [EMAIL PROTECTED] (Mel Gorman) wrote: Any opinion on merging these patches into -mm for wider testing? I'm a little reluctant to make changes to -mm's core mm unless those changes are reasonably

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
if it's simpler. Linus -- -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
to offline is MAX_ORDER_NR_PAGES, anti-fragmentation should group pages you can reclaim into those size of chunks. It might simplify the number of hacks you have to perform to limit where the kernel uses memory. -- -- Mel Gorman Part-time Phd Student Linux Technology

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
no different to today. Linux is *not* happy on 256GB systems. Even on some 32GB systems the swappiness setting *needs* to be tweaked before Linux will even run in a reasonable way. Please send testcases. -- -- Mel Gorman Part-time Phd Student Linux Technology

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
On (02/03/07 09:19), Christoph Lameter didst pronounce: On Fri, 2 Mar 2007, Mel Gorman wrote: However, if that is objectionable, I'd at least like to see zone-based patches go into -mm on the expectation that the memory hot-remove patches will be able to use the infrastructure. It's

Re: The performance and behaviour of the anti-fragmentation related patches

2007-03-02 Thread Mel Gorman
On Fri, 2 Mar 2007, Christoph Lameter wrote: On Fri, 2 Mar 2007, Mel Gorman wrote: I still think that the list based approach is sufficient for memory hotplug if one restricts the location of the unmovable MAX_ORDER chunks to not overlap the memory area where we would like to be able

Re: kref refcounting breakage in mainline

2007-03-06 Thread Mel Gorman
this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- -- Mel Gorman Part-time Phd Student Linux Technology

[PATCH] 2.6.21-rc2-mm2 Fix boot problem on IA64 with CONFIG_HOLE_IN_ZONES and CONFIG_PAGE_GROUP_BY_MOBILITY

2007-03-07 Thread Mel Gorman
/sn2_defconfig . Credit to Christoph Lameter for testing, reporting the bug and verifying this fixes the problem. Credit to Andy Whitcroft for giving the patch a quick review to ensure no functionality was changed. Signed-off-by: Mel Gorman [EMAIL PROTECTED] diff -rup -X /usr/src/patchset-0.6/bin//dontdiff

Re: [SLUB 0/3] SLUB: The unqueued slab allocator V4

2007-03-08 Thread Mel Gorman
-- (bot:conmon-payload) disconnected -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message

Re: [PATCH] fix BUG_ON check at move_freepages() (Re: 2.6.21-rc3-mm2)

2007-03-08 Thread Mel Gorman
-by: Yasunori Goto [EMAIL PROTECTED] Acked-by: Mel Gorman [EMAIL PROTECTED] --- mm/page_alloc.c |2 +- 1 file changed, 1 insertion(+), 1 deletion(-) Index: current_test/mm/page_alloc.c === --- current_test.orig/mm/page_alloc.c

Re: [PATCH] Fix crash with FLAT_MEMORY and ARCH_PFN_OFFSET != 0

2008-01-07 Thread Mel Gorman
On (30/12/07 12:37), Thomas Bogendoerfer didst pronounce: On Thu, Dec 20, 2007 at 01:27:20PM +, Mel Gorman wrote: On (20/12/07 13:43), Thomas Bogendoerfer didst pronounce: On Thu, Dec 20, 2007 at 11:44:06AM +, Mel Gorman wrote: --- a/include/asm-mips/page.h +++ b/include/asm

Re: [PATCH 01/10] x86: Change size of APICIDs from u8 to u16

2008-01-14 Thread Mel Gorman
] /a -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo

Re: [patch 09/19] (NEW) more aggressively use lumpy reclaim

2008-01-14 Thread Mel Gorman
-by: Mel Gorman [EMAIL PROTECTED] -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab -- To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL

[PATCH 0/6] Use one zonelist per node instead of multiple zonelists v6

2007-09-12 Thread Mel Gorman
appear to be any regressions there. The hackbench results for both sockets and pipes were within noise. -- Mel Gorman Part-time Phd Student Linux Technology Center University of Limerick IBM Dublin Software Lab - To unsubscribe from this list: send

[PATCH 1/6] Use zonelists instead of zones when direct reclaiming pages

2007-09-12 Thread Mel Gorman
. This simplifies zonelist iterators in the next patch. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Christoph Lameter [EMAIL PROTECTED] --- include/linux/swap.h |2 +- mm/page_alloc.c |2 +- mm/vmscan.c | 13 - 3 files changed, 10 insertions(+), 7

[PATCH 2/6] Introduce node_zonelist() for accessing the zonelist for a GFP mask

2007-09-12 Thread Mel Gorman
without problems. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- drivers/char/sysrq.c |3 +-- fs/buffer.c |6 +++--- include/linux/gfp.h | 10 +++--- include/linux/mempolicy.h |2 +- mm/mempolicy.c|6 +++--- mm/page_alloc.c

[PATCH 3/6] Use two zonelist that are filtered by GFP mask

2007-09-12 Thread Mel Gorman
that is allowed by the GFP flags. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Christoph Lameter [EMAIL PROTECTED] --- arch/parisc/mm/init.c | 11 +- fs/buffer.c|6 + include/linux/gfp.h| 29 --- include/linux/mmzone.h | 65 +++- mm/hugetlb.c

[PATCH 4/6] Have zonelist contains structs with both a zone pointer and zone_idx

2007-09-12 Thread Mel Gorman
for accessing the zone index as well as the node index. [EMAIL PROTECTED]: Suggested struct zoneref instead of embedding information in pointers] Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Christoph Lameter [EMAIL PROTECTED] --- arch/parisc/mm/init.c |2 - fs/buffer.c|6

[PATCH 5/6] Filter based on a nodemask as well as a gfp_mask

2007-09-12 Thread Mel Gorman
. This eliminates the need for MPOL_BIND to create a custom zonelist. A positive benefit of this is that allocations using MPOL_BIND now use the local-node-ordered zonelist instead of a custom node-id-ordered zonelist. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- fs/buffer.c |2 include

[PATCH 6/6] Use one zonelist that is filtered by nodemask

2007-09-12 Thread Mel Gorman
nodemask is created with only the node local to the CPU set. This allows us to eliminate the second zonelist. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- drivers/char/sysrq.c |2 - fs/buffer.c |5 +-- include/linux/gfp.h | 23 +++ include/linux

Re: [00/41] Large Blocksize Support V7 (adds memmap support)

2007-09-13 Thread Mel Gorman
for anything other than emergency situations. If nothing else pools == wasted memory + a sizing problem. But hey, it is one option. Are we going to agree on some sort of plan or are we just going to handwave ourselves to death? -- Mel Gorman Part-time Phd Student Linux

Re: [PATCH 0/6] Use one zonelist per node instead of multiple zonelists v5 (resend)

2007-09-13 Thread Mel Gorman
On (12/09/07 16:27), Lee Schermerhorn didst pronounce: On Tue, 2007-09-11 at 22:30 +0100, Mel Gorman wrote: (Sorry for the resend, I mucked up the TO: line in the earlier sending) This is the latest version of one-zonelist and it should be solid enough for wider testing. To briefly

Re: [PATCH 5/6] Filter based on a nodemask as well as a gfp_mask

2007-09-13 Thread Mel Gorman
On (12/09/07 14:23), Christoph Lameter didst pronounce: On Wed, 12 Sep 2007, Mel Gorman wrote: - z++) - ; + if (likely(nodes == NULL)) + for (; zonelist_zone_idx(z) highest_zoneidx; + z

[PATCH 0/6] Use one zonelist per node instead of multiple zonelists v7

2007-09-13 Thread Mel Gorman
: -1.02% to 1.56% The TBench figures were too variable between runs to draw conclusions from but there didn't appear to be any regressions there. The hackbench results for both sockets and pipes were within noise. -- Mel Gorman Part-time Phd Student Linux Technology

[PATCH 1/6] Use zonelists instead of zones when direct reclaiming pages

2007-09-13 Thread Mel Gorman
. This simplifies zonelist iterators in the next patch. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Christoph Lameter [EMAIL PROTECTED] --- include/linux/swap.h |2 +- mm/page_alloc.c |2 +- mm/vmscan.c | 19 +++ 3 files changed, 13 insertions(+), 10

[PATCH 2/6] Introduce node_zonelist() for accessing the zonelist for a GFP mask

2007-09-13 Thread Mel Gorman
without problems. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- drivers/char/sysrq.c |3 +-- fs/buffer.c |6 +++--- include/linux/gfp.h | 22 +++--- include/linux/mempolicy.h |2 +- mm/mempolicy.c|6 +++--- mm/page_alloc.c

[PATCH 3/6] Use two zonelist that are filtered by GFP mask

2007-09-13 Thread Mel Gorman
that is allowed by the GFP flags. Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Christoph Lameter [EMAIL PROTECTED] --- arch/parisc/mm/init.c | 11 +- fs/buffer.c|6 + include/linux/gfp.h| 17 +--- include/linux/mmzone.h | 65 +++- mm/hugetlb.c

[PATCH 4/6] Have zonelist contains structs with both a zone pointer and zone_idx

2007-09-13 Thread Mel Gorman
for accessing the zone index as well as the node index. [EMAIL PROTECTED]: Suggested struct zoneref instead of embedding information in pointers] Signed-off-by: Mel Gorman [EMAIL PROTECTED] Acked-by: Christoph Lameter [EMAIL PROTECTED] --- arch/parisc/mm/init.c |2 - fs/buffer.c|6

[PATCH 5/6] Filter based on a nodemask as well as a gfp_mask

2007-09-13 Thread Mel Gorman
. This eliminates the need for MPOL_BIND to create a custom zonelist. A positive benefit of this is that allocations using MPOL_BIND now use the local-node-ordered zonelist instead of a custom node-id-ordered zonelist. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- fs/buffer.c |2 include

[PATCH 6/6] Use one zonelist that is filtered by nodemask

2007-09-13 Thread Mel Gorman
nodemask is created with only the node local to the CPU set. This allows us to eliminate the second zonelist. Signed-off-by: Mel Gorman [EMAIL PROTECTED] --- drivers/char/sysrq.c |2 - fs/buffer.c |5 +-- include/linux/gfp.h | 23 +++ include/linux

  1   2   3   4   5   6   7   8   9   10   >