Re: [Libhugetlbfs-devel] [PATCH] Add scripts to measure cost of tlb miss in cycles

2009-10-28 Thread Adam Litke
On Tue, 2009-10-27 at 12:38 +, Eric B Munson wrote: > The scripts added by this patch are used to measure the cost of a tlb > miss on the running machine. They rely on the administrator obtaining > the source for calibrator from: > http://monetdb.cwi.nl/Calibrator/src/calibrator.c compiling it

Re: [Libhugetlbfs-devel] [PATCH] Rework test suite for multiple huge page size testing

2009-01-30 Thread Adam Litke
On Fri, 2009-01-30 at 15:56 +, Eric B Munson wrote: > From: Adam Litke > > Now that libhugetlbfs can work with multiple huge page sizes, testing this > support has become a priority. The following patch enables automatic testing > of page sizes that are mounted and have at

Re: [Libhugetlbfs-devel] Lib hugetlbfs

2009-01-05 Thread Adam Litke
ed ?? > > Since libhugetlbfs is a library, it has it's own text and data > segments (independent of the program). So the library code runs > uninhibited since only the program segments (not the library segments) > are unmapped. > > > thanks, > Mehul. > >

Re: [Libhugetlbfs-devel] Lib hugetlbfs

2009-01-05 Thread Adam Litke
On Mon, 2009-01-05 at 10:25 -0800, mehul vora wrote: > > Adam, > > I just commented out printfs, but still program gets a seg fault. I > have a tight loop after "munmap", so ideally program should never come > out, but for me program gets a SIGSEGV after first munmap > > Could you run your

Re: [Libhugetlbfs-devel] Lib hugetlbfs

2009-01-05 Thread Adam Litke
On Mon, 2009-01-05 at 09:07 -0800, Nishanth Aravamudan wrote: > On 05.01.2009 [06:26:55 -0800], mehul vora wrote: > > Nishanth, > > > > I went through "munmap" code and found that core kernel (arch > > independent) code removes all "vma" references of the passed vaddr and > > then it calls a

Re: [Libhugetlbfs-devel] [PATCH 3/3] hugeadm: Correct calculation of "Current"

2008-12-10 Thread Adam Litke
nr_used); > pool->pagesize = size; > pool->minimum = nr_static; > pool->maximum = nr_static + nr_over; > - pool->size = nr_used + nr_resv; > + pool->size = nr_used; > pool->

Re: [Libhugetlbfs-devel] [PATCH] Update HOWTO for NX bit workaround V3

2008-12-03 Thread Adam Litke
> +support enabled, the binary segfaults. Is the NX bit a feature of x86 chips only? Perhaps we should say "on an x86 host with support for the NX bit enabled". > +TRY:Recompiling with the --hugetlbfs-align options and use the new > relinking > +method or

Re: [Libhugetlbfs-devel] [PATCH] Update HOWTO for NX bit workaround

2008-12-02 Thread Adam Litke
I recently added a troubleshooting section for things like this. Would you consider putting it there? -- Adam Litke - (agl at us.ibm.com) IBM Linux Technology Center - This SF.Net email is sponsored by the Moblin Your Move De

Re: [Libhugetlbfs-devel] [PATCH V2] Update SECTIONS from linker scripts for binutils 2.19 compatibility

2008-11-25 Thread Adam Litke
; all of the linker scripts. > > Credit goes to Alan Modra for identifying what change needed to be made > > Signed-off-by: Eric B Munson <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> -- Adam Litke - (agl at us.

Re: [Libhugetlbfs-devel] [PATCH] Update SECTIONS from linker scripts for binutils 2.19 compatibility

2008-11-25 Thread Adam Litke
cripts/elf_x86_64.xBDT > @@ -31,6 +31,7 @@ SECTIONS >.hash : { *(.hash) } :htext >.note.SuSE : { *(.note.SuSE) } :htext :note >.note.ABI-tag : { *(.note.ABI-tag) } :htext :note > + .note.gnu.build-id : { *(.note.gnu.build-id) } :text :note >.dynsym

Re: [Libhugetlbfs-devel] libhugetlbfs: Provide more debug info readback testcase

2008-11-25 Thread Adam Litke
t; read back instead. This can be useful for debugging failures. > > Signed-off-by: David Gibson <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > > Index: libhugetlbfs/tests/readback.c > === &

[Libhugetlbfs-devel] [PATCH] tests: fork-cow test requires 2 huge pages

2008-11-20 Thread Adam Litke
: Adam Litke <[EMAIL PROTECTED]> --- tests/fork-cow.c | 26 ++ 1 files changed, 22 insertions(+), 4 deletions(-) diff --git a/tests/fork-cow.c b/tests/fork-cow.c index ef0f3e7..70d3904 100644 --- a/tests/fork-cow.c +++ b/tests/fork-cow.c @@ -47,6 +47,18 @@ #

[Libhugetlbfs-devel] [PATCH] elflink: Print deprecation message when --hugetlbfs-link is used

2008-11-20 Thread Adam Litke
Now that use of the libhugetlbfs linker scripts is deprecated, print a warning message when ld.hugetlbfs is invoked with the --hugetlbfs-link option to encourage the user to migrate to --hugetlbfs-align. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- ld.hugetlbfs |2 ++ 1 files c

Re: [Libhugetlbfs-devel] [PATCH] [RFC] Enable automatic testing of multiple huge page sizes

2008-11-19 Thread Adam Litke
On Mon, 2008-11-17 at 11:50 +1100, David Gibson wrote: > On Sat, Nov 15, 2008 at 11:56:54AM +1100, David Gibson wrote: > > On Fri, Nov 14, 2008 at 10:06:57AM -0600, Adam Litke wrote: > > > On Fri, 2008-11-14 at 17:51 +1100, David Gibson wrote: > > > > On Thu, Nov 13,

Re: [Libhugetlbfs-devel] [PATCH] [RFC] Enable automatic testing of multiple huge page sizes

2008-11-19 Thread Adam Litke
On Sat, 2008-11-15 at 11:56 +1100, David Gibson wrote: > On Fri, Nov 14, 2008 at 10:06:57AM -0600, Adam Litke wrote: > > On Fri, 2008-11-14 at 17:51 +1100, David Gibson wrote: > > > On Thu, Nov 13, 2008 at 08:26:12PM +, Adam Litke wrote: > [snip] > > > The one b

Re: [Libhugetlbfs-devel] [PATCH] [RFC] Enable automatic testing of multiple huge page sizes

2008-11-18 Thread Adam Litke
strongly recommend we proceed with the conversion. On Mon, 2008-11-17 at 16:50 +, Mel Gorman wrote: > On Fri, Nov 14, 2008 at 05:51:29PM +1100, David Gibson wrote: > > On Thu, Nov 13, 2008 at 08:26:12PM +0000, Adam Litke wrote: > > > Now that libhugetlbfs can work with multip

[Libhugetlbfs-devel] [PATCH 7/7] Audit verbosity of messages in the library utility functions (V2)

2008-11-18 Thread Adam Litke
Changes since V1: - In the event that the normal default huge page size cannot be used by libhugetlbfs (due to no usable mount point), if the user specified the size print a WARNING (since semantics are altered), otherwise just print an INFO message. Signed-off-by: Adam Litke <[EM

[Libhugetlbfs-devel] [PATCH 6/7] Audit verbosity of messages in shm.c

2008-11-18 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- shm.c |4 ++-- 1 files changed, 2 insertions(+), 2 deletions(-) diff --git a/shm.c b/shm.c index ac3b52a..ed7731e 100644 --- a/shm.c +++ b/shm.c @@ -67,7 +67,7 @@ int shmget(key_t key, size_t size, int

[Libhugetlbfs-devel] [PATCH 4/7] Audit verbosity of messages in alloc.c

2008-11-18 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- alloc.c |5 +++-- 1 files changed, 3 insertions(+), 2 deletions(-) diff --git a/alloc.c b/alloc.c index 750b2cb..ccf550c 100644 --- a/alloc.c +++ b/alloc.c @@ -35,7 +35,7 @@ static void *fallback_base_pages(size_t len, ghp_t

[Libhugetlbfs-devel] [PATCH 5/7] Audit verbosity of messages in the utilities

2008-11-18 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- hugeadm.c | 12 ++-- hugectl.c |8 pagesize.c |4 ++-- 3 files changed, 12 insertions(+), 12 deletions(-) diff --git a/hugeadm.c b/hugeadm.c index 6e9e939..f190a41 100644 --- a/hugeadm.c +++ b/hugeadm.c @@

[Libhugetlbfs-devel] [PATCH 3/7] Audit verbosity of messages in morecore.c

2008-11-18 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- morecore.c | 36 ++-- 1 files changed, 18 insertions(+), 18 deletions(-) diff --git a/morecore.c b/morecore.c index 95d0470..ccda51f 100644 --- a/morecore.c +++ b/morecore.c @@ -74,7 +74,7 @@ stati

[Libhugetlbfs-devel] [PATCH 2/7] Audit verbosity of messages in elflink.c (V2)

2008-11-18 Thread Adam Litke
Changes since V1: - When find_or_create_share_path() fails, segment remapping is disabled. Print a message to make this clear to the user. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- elflink.c | 105 + 1 files chang

[Libhugetlbfs-devel] [PATCH 1/7] Add an INFO verbosity level and simplify debugging mode (V2)

2008-11-18 Thread Adam Litke
, unrecoverable errors WARNING - Recoverable condition, but may result in altered semantics INFO- Detailed information about normal library operations DEBUG - Diagnostic information for debugging, potential runtime overhead Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- d

[Libhugetlbfs-devel] [PATCH] utils: Disable prefaulting with kernel private reservations (V2)

2008-11-18 Thread Adam Litke
idea. Unfortunately this variable is part of the API and must be maintained. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> Acked-by: Mel Gorman <[EMAIL PROTECTED]> --- HOWTO | 44 +--- debug.c| 11 ++- man/li

[Libhugetlbfs-devel] [PATCH] utils: Disable prefaulting with kernel private reservations

2008-11-17 Thread Adam Litke
be maintained. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- HOWTO | 45 ++--- debug.c| 11 ++- man/libhugetlbfs.7 | 16 +--- 3 files changed, 45 insertions(+), 27 deletions(-) diff --git a/H

Re: [Libhugetlbfs-devel] [PATCH 7/7] Audit verbosity of messages in the library utility functions

2008-11-17 Thread Adam Litke
On Mon, 2008-11-17 at 17:32 +, Mel Gorman wrote: > On Fri, Nov 14, 2008 at 09:01:09PM +0000, Adam Litke wrote: > > Signed-off-by: Adam Litke <[EMAIL PROTECTED]> > > --- > > > > hugeutils.c | 12 ++-- > > kernel-features.c | 16 ++

Re: [Libhugetlbfs-devel] [PATCH 6/7] Audit verbosity of messages in shm.c

2008-11-17 Thread Adam Litke
On Mon, 2008-11-17 at 17:30 +, Mel Gorman wrote: > On Fri, Nov 14, 2008 at 09:01:03PM +0000, Adam Litke wrote: > > > > --- > > > > shm.c |8 > > 1 files changed, 4 insertions(+), 4 deletions(-) > > > > diff --git a/shm.c b/shm.

Re: [Libhugetlbfs-devel] [PATCH 4/7] Audit verbosity of messages in alloc.c

2008-11-17 Thread Adam Litke
On Mon, 2008-11-17 at 17:28 +, Mel Gorman wrote: > On Fri, Nov 14, 2008 at 09:00:50PM +0000, Adam Litke wrote: > > > > --- > > > > alloc.c |8 +--- > > 1 files changed, 5 insertions(+), 3 deletions(-) > > > > diff --git a/alloc.

Re: [Libhugetlbfs-devel] [PATCH 2/7] Audit verbosity of messages in elflink.c

2008-11-17 Thread Adam Litke
ll look like errors to me that result in broken sharing. We seem to disagree on the definition of a warning. Since all of these cases result in fallback to no sharing, I'd consider them noteworthy warning messages. > > @@ -1063,7 +1064,7 @@ static int obtain_prepared_file(struct

Re: [Libhugetlbfs-devel] [PATCH 1/7] Add an INFO verbosity level and simplify debugging mode

2008-11-17 Thread Adam Litke
On Mon, 2008-11-17 at 17:17 +, Mel Gorman wrote: > On Fri, Nov 14, 2008 at 09:00:32PM +0000, Adam Litke wrote: > > The default verbosity level in libhugetlbfs is 1, meaning that only errors > > are > > printed. Many of the new library features can have outcomes that ar

[Libhugetlbfs-devel] [PATCH 7/7] Audit verbosity of messages in the library utility functions

2008-11-17 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- hugeutils.c | 12 ++-- kernel-features.c | 16 2 files changed, 14 insertions(+), 14 deletions(-) diff --git a/hugeutils.c b/hugeutils.c index 1121966..999da74 100644 --- a/hugeutils.c +++ b/hugeu

[Libhugetlbfs-devel] [PATCH 3/7] Audit verbosity of messages in morecore.c

2008-11-17 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- morecore.c | 36 ++-- 1 files changed, 18 insertions(+), 18 deletions(-) diff --git a/morecore.c b/morecore.c index 95d0470..ccda51f 100644 --- a/morecore.c +++ b/morecore.c @@ -74,7 +74,7 @@ stati

[Libhugetlbfs-devel] [PATCH 6/7] Audit verbosity of messages in shm.c

2008-11-17 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- shm.c |8 1 files changed, 4 insertions(+), 4 deletions(-) diff --git a/shm.c b/shm.c index ac3b52a..5e96400 100644 --- a/shm.c +++ b/shm.c @@ -38,7 +38,7 @@ int shmget(key_t key, size_t size, int shmflg) size_t aligne

[Libhugetlbfs-devel] [PATCH 4/7] Audit verbosity of messages in alloc.c

2008-11-17 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- alloc.c |8 +--- 1 files changed, 5 insertions(+), 3 deletions(-) diff --git a/alloc.c b/alloc.c index 750b2cb..f231f2c 100644 --- a/alloc.c +++ b/alloc.c @@ -35,7 +35,7 @@ static void *fallback_base_pages(size_t len, ghp_t

[Libhugetlbfs-devel] [PATCH 5/7] Audit verbosity of messages in the utilities

2008-11-17 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- hugeadm.c | 12 ++-- hugectl.c |8 pagesize.c |4 ++-- 3 files changed, 12 insertions(+), 12 deletions(-) diff --git a/hugeadm.c b/hugeadm.c index 6e9e939..f190a41 100644 --- a/hugeadm.c +++ b/hugeadm.c @@

[Libhugetlbfs-devel] [PATCH 2/7] Audit verbosity of messages in elflink.c

2008-11-17 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- elflink.c | 101 - 1 files changed, 53 insertions(+), 48 deletions(-) diff --git a/elflink.c b/elflink.c index 63229f6..e38e796 100644 --- a/elflink.c +++ b/elflink.c @@ -

[Libhugetlbfs-devel] [PATCH 1/7] Add an INFO verbosity level and simplify debugging mode

2008-11-17 Thread Adam Litke
INFO- Detailed information about normal library operations DEBUG - Diagnostic information for debugging, potential runtime overhead Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- debug.c |3 +-- libhugetlbfs_debug.h| 17 + libhugetlbfs_inte

[Libhugetlbfs-devel] [PATCH 7/7] Audit verbosity of messages in the library utility functions

2008-11-14 Thread Adam Litke
Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- hugeutils.c | 12 ++-- kernel-features.c | 16 2 files changed, 14 insertions(+), 14 deletions(-) diff --git a/hugeutils.c b/hugeutils.c index 1121966..999da74 100644 --- a/hugeutils.c +++ b/hugeu

[Libhugetlbfs-devel] [PATCH 6/7] Audit verbosity of messages in shm.c

2008-11-14 Thread Adam Litke
--- shm.c |8 1 files changed, 4 insertions(+), 4 deletions(-) diff --git a/shm.c b/shm.c index ac3b52a..5e96400 100644 --- a/shm.c +++ b/shm.c @@ -38,7 +38,7 @@ int shmget(key_t key, size_t size, int shmflg) size_t aligned_size = size; int hugetlbshm_enabled = 0;

[Libhugetlbfs-devel] [PATCH 5/7] Audit verbosity of messages in the utilities

2008-11-14 Thread Adam Litke
--- hugeadm.c | 12 ++-- hugectl.c |8 pagesize.c |4 ++-- 3 files changed, 12 insertions(+), 12 deletions(-) diff --git a/hugeadm.c b/hugeadm.c index 6e9e939..f190a41 100644 --- a/hugeadm.c +++ b/hugeadm.c @@ -162,7 +162,7 @@ void pool_adjust(char *cmd, unsigned in

[Libhugetlbfs-devel] [PATCH 4/7] Audit verbosity of messages in alloc.c

2008-11-14 Thread Adam Litke
--- alloc.c |8 +--- 1 files changed, 5 insertions(+), 3 deletions(-) diff --git a/alloc.c b/alloc.c index 750b2cb..f231f2c 100644 --- a/alloc.c +++ b/alloc.c @@ -35,7 +35,7 @@ static void *fallback_base_pages(size_t len, ghp_t flags) { int fd; void *buf; - DEBUG(

[Libhugetlbfs-devel] [PATCH 2/7] Audit verbosity of messages in elflink.c

2008-11-14 Thread Adam Litke
--- elflink.c | 101 - 1 files changed, 53 insertions(+), 48 deletions(-) diff --git a/elflink.c b/elflink.c index 63229f6..e38e796 100644 --- a/elflink.c +++ b/elflink.c @@ -252,14 +252,14 @@ static int find_or_create_share_path(long

[Libhugetlbfs-devel] [PATCH 3/7] Audit verbosity of messages in morecore.c

2008-11-14 Thread Adam Litke
--- morecore.c | 36 ++-- 1 files changed, 18 insertions(+), 18 deletions(-) diff --git a/morecore.c b/morecore.c index 95d0470..ccda51f 100644 --- a/morecore.c +++ b/morecore.c @@ -74,7 +74,7 @@ static void *hugetlbfs_morecore(ptrdiff_t increment) void

[Libhugetlbfs-devel] [PATCH 1/7] Add an INFO verbosity level and simplify debugging mode

2008-11-14 Thread Adam Litke
INFO- Detailed information about normal library operations DEBUG - Diagnostic information for debugging, potential runtime overhead Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- debug.c |3 +-- libhugetlbfs_debug.h| 17 + libhugetlbfs_inte

[Libhugetlbfs-devel] [PATCH 1/7] Add an INFO verbosity level and simplify debugging mode

2008-11-14 Thread Adam Litke
INFO- Detailed information about normal library operations DEBUG - Diagnostic information for debugging, potential runtime overhead Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- debug.c |3 +-- libhugetlbfs_debug.h| 17 + libhugetlbfs_inte

[Libhugetlbfs-devel] [PATCH 2/7] Audit verbosity of messages in elflink.c

2008-11-14 Thread Adam Litke
--- elflink.c | 101 - 1 files changed, 53 insertions(+), 48 deletions(-) diff --git a/elflink.c b/elflink.c index 63229f6..e38e796 100644 --- a/elflink.c +++ b/elflink.c @@ -252,14 +252,14 @@ static int find_or_create_share_path(long

Re: [Libhugetlbfs-devel] [PATCH] [RFC] Enable automatic testing of multiple huge page sizes

2008-11-14 Thread Adam Litke
On Fri, 2008-11-14 at 17:51 +1100, David Gibson wrote: > On Thu, Nov 13, 2008 at 08:26:12PM +0000, Adam Litke wrote: > > Now that libhugetlbfs can work with multiple huge page sizes, testing this > > support has become a priority. The following patch enables automatic > >

[Libhugetlbfs-devel] [PATCH] tests: linkhuge_rw is expected to fail when some linker options do not exist

2008-11-13 Thread Adam Litke
If -z common-page-size and -z max-page-size are not recognized by the linker then the linkhuge_rw binary won't be suitably aligned and failures are expected. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/Makefile |2 +- tests/linkhuge_r

[Libhugetlbfs-devel] [PATCH] [RFC] Enable automatic testing of multiple huge page sizes

2008-11-13 Thread Adam Litke
Now that libhugetlbfs can work with multiple huge page sizes, testing this support has become a priority. The following patch enables automatic testing of page sizes that are mounted and have at least one page allocated. Care is taken to assure that only valid combinations are tested. For exampl

Re: [Libhugetlbfs-devel] [PATCH 0/7] *** SUBJECT HERE ***

2008-11-13 Thread Adam Litke
ns with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ___ > Libhugetlbfs-devel mailing list > Libhugetlbfs-

Re: [Libhugetlbfs-devel] [PATCH 3/7] Move the elfmap env parsing into setup_env function

2008-11-11 Thread Adam Litke
t; #endif > > struct libhugeopts_t { > + int min_copy; > + int sharing; > + unsigned long force_elfmap; > + char*ld_preload; > + char*elfmap; > + char*share_path; > }; > > /* --

Re: [Libhugetlbfs-devel] [PATCH 2/3] Ensure that the overcommit pool is empty before running heap-overflow

2008-11-11 Thread Adam Litke
> > hpagesize = check_hugepagesize(); > > + /* Must be root because this test modifies the overcommit pool */ > + check_must_be_root(); > + > + pool_size = save_overcommit_pages(hpagesize); > + set_nr_overcommit_hugepages(hpagesize, 0); > + > freepages =

Re: [Libhugetlbfs-devel] [PATCH 3/3] Use wasted bytes in get_hugepage_region() to place buffers at different cache lines

2008-11-10 Thread Adam Litke
y be wasted to > offset the buffer by some random cacheline. Effort is made to select a > random cache-line to give good average performance. > > Signed-off-by: Mel Gorman <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTEC

[Libhugetlbfs-devel] [PATCH] tests: meminfo_nohuge multiple hpage sizes fix

2008-11-07 Thread Adam Litke
/proc/mounts is now used in addition to /proc/meminfo for detecting huge page sizes. Override the contents of that file as well. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/meminfo_nohuge.c |7 +++ 1 files changed, 7 insertions(+), 0 deletions(-) diff --git a

Re: [Libhugetlbfs-devel] [PATCH 1/3] Force get_huge_pages() to only deal with hugepages

2008-11-07 Thread Adam Litke
for example. This patch enforces the meaning implied by the function name by > removing the ability of the function to fallback to base pages and redefines > GHP_DEFAULT to mean "Use the default hugepage size to back the region". > > Signed-off-by: Mel Gorman <[EMAIL PROT

Re: [Libhugetlbfs-devel] [PATCH 2/3] Add get_hugepage_region() as a malloc-like interface that uses hugepages

2008-11-07 Thread Adam Litke
oes not care for such things, this patch adds get_hugepage_region(). > It allocates regions of memory that are backed by hugepages where possible > but callers are not required to align their length and can request fallback > to base pages. > > Signed-off-by: Mel Gorman <[EMAIL PRO

Re: [Libhugetlbfs-devel] [PATCH 3/3] Use wasted bytes in get_hugepage_region() to place buffers at different cache lines

2008-11-07 Thread Adam Litke
e selection */ > + linemod += len % numlines; > + } > + DEBUG("Using line offset %d from start\n", line); > + > + return bytebuf; > +} > + -- Adam Litke - (agl at us.ibm.com) IBM Linux Technology Center --

[Libhugetlbfs-devel] [PATCH] elflink: Do not worry about layout for base page segments

2008-11-07 Thread Adam Litke
-type linker scripts because it leaves the text and data segments untouched and creates a new segment for a huge page BSS. We need to ignore the boundary between the text and data segment because it is not important. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- elflink.c |9 +++

Re: [Libhugetlbfs-devel] [PATCH 1/1] Add manual pages for path-related functions

2008-11-06 Thread Adam Litke
behave more like anonymous memory (in that the huge pages are freed after an unmap and the data will not persist) and that another process cannot open the same fd to snoop data. Otherwise these all look good. > +.SH SEE ALSO > +.I oprofile(1) > +, > +.I libhugetlbfs(7) > +.SH AUTHORS

Re: [Libhugetlbfs-devel] [PATCH 2/2] Use wasted bytes in get_huge_pages() to place buffers at different cache lines

2008-11-06 Thread Adam Litke
On Thu, 2008-11-06 at 10:15 +1100, David Gibson wrote: > On Wed, Nov 05, 2008 at 09:43:40AM -0600, Adam Litke wrote: > > On Wed, 2008-11-05 at 14:02 +, Mel Gorman wrote: > > > @@ -127,6 +140,34 @@ void *get_huge_pages(size_t len, ghp_t flags) > >

Re: [Libhugetlbfs-devel] [PATCH 1/2] Align the len for get_huge_pages() on behalf of the caller

2008-11-05 Thread Adam Litke
being > a useless and unnecessary burden, it prevents anything useful being done > with the wasted bytes. This patch relieves the caller of some responsibility. > > Signed-off-by: Mel Gorman <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > alloc.c | 3

Re: [Libhugetlbfs-devel] [PATCH 2/2] Use wasted bytes in get_huge_pages() to place buffers at different cache lines

2008-11-05 Thread Adam Litke
gt; + > + buf = (void *)bytebuf; > + } > + > /* woo, new buffer of shiny */ > return buf; > } -- Adam Litke - (agl at us.ibm.com) IBM Linux Technology Center - This SF.Net email is

Re: [Libhugetlbfs-devel] [PATCH] Do not pass offset to mmap() in get_huge_pages()

2008-11-04 Thread Adam Litke
On Tue, 2008-11-04 at 15:21 +, Mel Gorman wrote: > Currently an offset is being passed in to mmap() when allocating a > region. This is pointless so pass in 0. > > Signed-off-by: Mel Gorman <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- >

Re: [Libhugetlbfs-devel] [PATCH 1/1] hugectl: add support for multiple page sizes

2008-10-30 Thread Adam Litke
but expected semantics will be altered INFO - Detailed information about normal operation DEBUG - Diagnostic information with a potential run-time acquisition cost. We will then switch the default verbosity level to WARNING. -- Adam Litke - (agl at us.ibm.com) IBM Linux Technology Center -

Re: [Libhugetlbfs-devel] [PATCH 1/1] hugectl: fix up Makefile to correctly pass LIB32/LIB64 to hugectl

2008-10-29 Thread Adam Litke
TECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > Makefile |4 ++-- > 1 files changed, 2 insertions(+), 2 deletions(-) > > diff --git a/Makefile b/Makefile > index b9e2540..4554154 100644 > --- a/Makefile > +++ b/Makefile > @@ -297,12 +29

[Libhugetlbfs-devel] [PATCH] doc: Add specific troubleshooting scenarios to HOWTO

2008-10-28 Thread Adam Litke
We want to document the possible need to use --relax with GNU ld to avoid truncated relocations. Update the documentation. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- HOWTO | 10 ++ 1 files changed, 10 insertions(+), 0 deletions(-) diff --git a/HOWTO b/HOWTO index 5

Re: [Libhugetlbfs-devel] [PATCH 3/3] hugetlbfs default page size is cached so expose reset for testing

2008-10-28 Thread Adam Litke
alidate this cache to allow us test with various values. > > Add and expose kernel_default_hugepage_size_reset() as a test probe, > and use this within the gethugepagesizes test. > > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMA

Re: [Libhugetlbfs-devel] [PATCH 2/3] add a new export type for main library probe points for tests

2008-10-28 Thread Adam Litke
44 > --- a/version.lds > +++ b/version.lds > @@ -4,6 +4,8 @@ VERS_1.0 { > hugetlbfs_test_path; > hugetlbfs_find_path; > hugetlbfs_unlinked_fd; > + > + __tp_*; Are these 1.0 symbols? I would think they should go in HTLBFS_2.1 > local:

Re: [Libhugetlbfs-devel] [PATCH 1/3] privutils: cache and expose the kernel default page size

2008-10-28 Thread Adam Litke
> > Acked-by: Mel Gorman <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > hugeutils.c | 33 + > libhugetlbfs_privutils.h |3 +++ > shm.c|2 +- > 3 files changed, 25 inserti

[Libhugetlbfs-devel] [PATCH] doc: Update HOWTO with instructions for specifying page sizes

2008-10-24 Thread Adam Litke
The HUGETLB_MORECORE and HUGETLB_ELFMAP options can now accept page size specifiers. Provide the details on how to do this in the HOWTO. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- HOWTO | 61 +++-- 1 files changed, 55 inse

Re: [Libhugetlbfs-devel] [PATCH 1/2] tests: gethugepagesizes -- switch meminfo override to intercepting open

2008-10-24 Thread Adam Litke
X, 1, expected_sizes); > > - INIT_LIST(expected_sizes, base_size, meminfo_size); > + INIT_LIST(expected_sizes, base_size, 2048 * 1024); Magic numbers :( Since these have some correlation to the values in the fake memin

[Libhugetlbfs-devel] [PATCH 2/4] tests: Infrastructure for expected test failures (V2)

2008-10-23 Thread Adam Litke
instead of the c program directly. The shell script must perform any required discovery, execute the real test case, and interpret the result. Comments? Changes since V1: - Revamped the build so wrappers properly depend on their test cases Signed-off-by: Adam Litke <[EMAIL PROTEC

[Libhugetlbfs-devel] [PATCH 4/4] tests: Catch expected failures for quota test (V2)

2008-10-23 Thread Adam Litke
ned-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/Makefile |4 +++ tests/quota.sh | 13 +++ tests/run_tests.sh |2 +- tests/wrapper-utils.sh | 56 4 files changed, 73 insertions(+), 2 deletions(-) cr

[Libhugetlbfs-devel] [PATCH 3/4] tests: Add helper for comparing kernel versions

2008-10-23 Thread Adam Litke
Make use of pre-existing kernel version comparison code and create a helper that can be used by test wrapper scripts to compare two kernel versions. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- kernel-features.c| 11 +++ libhugetlbfs_privutils.h |3 +++ tests/Ma

[Libhugetlbfs-devel] [PATCH 1/4] utils: Buglet in kernel version comparison function

2008-10-23 Thread Adam Litke
Oops. The greater-than operator (>) is not commutative. While trying to test for a > b, we are accidentally re-testing a < b. Fix. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- kernel-features.c |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/ke

Re: [Libhugetlbfs-devel] [PATCH 2/4] tests: Infrastructure for expected test failures

2008-10-23 Thread Adam Litke
lure detection. Hmm. Maybe I can have an unexpected pass return RC_BUG? Or perhaps we don't care about them and can just return PASS? -- Adam Litke - (agl at us.ibm.com) IBM Linux Technology Center - This SF.Net email

[Libhugetlbfs-devel] [PATCH 4/4] tests: Catch expected failures for quota test

2008-10-22 Thread Adam Litke
quota is known to fail on kernels < 2.6.24. Create a wrapper script to check for an old running kernel and report the failure as expected. Place reusable shell functions into their own wrapper-utils.sh script. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/Makefile

[Libhugetlbfs-devel] [PATCH 2/4] tests: Infrastructure for expected test failures

2008-10-22 Thread Adam Litke
instead of the c program directly. The shell script must perform any required discovery, execute the real test case, and interpret the result. Comments? Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/Makefile | 18 +- tests/hugetests.h |2 ++

[Libhugetlbfs-devel] [PATCH 3/4] tests: Add helper for comparing kernel versions

2008-10-22 Thread Adam Litke
Make use of pre-existing kernel version comparison code and create a helper that can be used by test wrapper scripts to compare two kernel versions. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- kernel-features.c| 11 +++ libhugetlbfs_privutils.h |3 +++ tests/Ma

[Libhugetlbfs-devel] [PATCH 1/4] utils: Buglet in kernel version comparison function

2008-10-22 Thread Adam Litke
Oops. The greater-than operator (>) is not commutative. While trying to test for a > b, we are accidentally re-testing a < b. Fix. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- kernel-features.c |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/ke

Re: [Libhugetlbfs-devel] [PATCH] Add reference to hugeadm for pool admin and adjust page count for tests V2

2008-10-22 Thread Adam Litke
HOWTO > index 54519e2..02fb6a8 100644 > --- a/HOWTO > +++ b/HOWTO > @@ -2,7 +2,7 @@ libhugetlbfs HOWTO > ====== > > Author: David Gibson <[EMAIL PROTECTED]>, Adam Litke <[EMAIL PROTECTED]>, > and others > -Last updated: Wed

Re: [Libhugetlbfs-devel] [PATCH] Add reference to hugeadm for pool admin and adjust page count for tests

2008-10-21 Thread Adam Litke
h 25 hugepages allocated, most tests should succeed. However, with > +smaller hugepages sizes, (like PowerPC 64kb pages) many more hugepages > +may be necessary. > > To use libhugetlbfs features, as well as to run the testsuite, hugetlbfs > must be mounted: -- Adam Litke - (

Re: [Libhugetlbfs-devel] [PATCH 1/2] document which headers to use for library static and private utility functions

2008-10-20 Thread Adam Litke
nor part of the libhugetlfs API. > + * > + * All functions declared external here must be externalised using a define > + * of the following form: > + * > + * #define foo __pu_foo > + */ > + > #ifndef _LIBHUGETLBFS_PRIVUTILS_H > #define _LIBHUGETLBFS_PRIVUTILS_H > -- Ada

[Libhugetlbfs-devel] [PATCH] tests: check_linkhuge_tests style FIXES

2008-10-20 Thread Adam Litke
Andy Whitcroft had some good suggestions on my check_linkhuge_tests patch. - Comment the format of LINKHUGE_WORDSIZES - Use a case statement instead of an if/else Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/run_tests.sh | 14 -- 1 files changed, 8 insertions

Re: [Libhugetlbfs-devel] [PATCH 02/14] add a new private utilities library

2008-10-20 Thread Adam Litke
ust test the real one. > > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > Makefile | 31 ++- > init_privutils.c | 25 + > libhugetlbfs_int

Re: [Libhugetlbfs-devel] [PATCH 14/14] export hugetlbfs_find_path_for_size/hugetlbfs_unlinked_fd_for_size as V2.1 API

2008-10-17 Thread Adam Litke
OTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > version.lds |2 ++ > 1 files changed, 2 insertions(+), 0 deletions(-) > > diff --git a/version.lds b/version.lds > index 1429230..626ee02 100644 > --- a/version.lds > +++ b/version.

Re: [Libhugetlbfs-devel] [PATCH 13/14] export getpagesizes/gethugepagesizes as V2.1 API

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > version.lds |6 ++ > 1 files changed, 6 insertions(+), 0 deletions(-) > > diff --git a/version.lds

Re: [Libhugetlbfs-devel] [PATCH 12/14] make direct_syscall library static

2008-10-17 Thread Adam Litke
; Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Fair enough reasoning. I agree. Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > version.lds |1 + > 1 files changed, 1 insertions(+), 0 deletions(-) > > diff --git a/version.lds b/version.lds > index ba06c8

Re: [Libhugetlbfs-devel] [PATCH 11/14] make plt_extrasz library static

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > elf32ppclinux.c |2 ++ > elf64ppc.c |2 ++ > libhugetlbfs_internal.h |

Re: [Libhugetlbfs-devel] [PATCH 10/14] make __hugetlbfs_* flags library static

2008-10-17 Thread Adam Litke
; > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > libhugetlbfs_internal.h |4 > 1 files changed, 4 insertions(+), 0 deletions(-) > > diff --git a/libhugetlbfs_internal.h b/libhugetlbfs_internal.h > inde

Re: [Libhugetlbfs-devel] [PATCH 09/14] make libhugetlbfs_version file static

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > version.c |2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > diff --git a/version.c b/vers

Re: [Libhugetlbfs-devel] [PATCH 08/14] make hpage_sizes file static

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > hugeutils.c |2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > diff --git a/hugeutils.c

Re: [Libhugetlbfs-devel] [PATCH 07/14] make dump_proc_pid_maps library static

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > hugetlbfs.h |4 > libhugetlbfs_internal.h |4 > 2 files changed, 4 insertions(+

Re: [Libhugetlbfs-devel] [PATCH 06/14] make print_valid_features/check_features_env_valid file static

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > hugetlbfs.h |1 - > kernel-features.c |4 ++-- > libhugetlbfs_internal.h |

Re: [Libhugetlbfs-devel] [PATCH 05/14] stop exporting kernel detection

2008-10-17 Thread Adam Litke
document in each .c file if it is a part of a library and which one. That will make it easier for someone to figure out in which file a new function is to be implemented. On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: A

Re: [Libhugetlbfs-devel] [PATCH 04/14] make hugetlb_counter_info/select_pool_counter file static

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > hugeutils.c |4 ++-- > 1 files changed, 2 insertions(+), 2 deletions(-) > > diff --git a/hugeutils.c

Re: [Libhugetlbfs-devel] [PATCH 03/14] stop exposing pool configuration in the main library

2008-10-17 Thread Adam Litke
On Fri, 2008-10-17 at 17:14 +0100, Andy Whitcroft wrote: > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-by: Adam Litke <[EMAIL PROTECTED]> > --- > Makefile |6 +++--- > hugetlbfs.h | 16 > huge

Re: [Libhugetlbfs-devel] [PATCH 02/14] add a new private utilities library

2008-10-17 Thread Adam Litke
; +++ b/tests/counters.c > @@ -181,6 +181,7 @@ void _set_nr_hugepages(unsigned long count, int line) > out: > verify_counters(line, et, ef, er, es); > } > +#undef set_nr_hugepages Why is this needed? > #define set_nr_hugepages(c) _set_nr_hugepages(c, __LINE

Re: [Libhugetlbfs-devel] [PATCH 01/14] move to a new library local idiom

2008-10-17 Thread Adam Litke
> will remain unexported: > > #define hpool_sizes __lh_hpool_sizes > extern int hpool_sizes(struct hpage_pool *, int); > > This patch converts all current library local functions to this new idiom. > > Signed-off-by: Andy Whitcroft <[EMAIL PROTECTED]> Acked-

[Libhugetlbfs-devel] [PATCH] tests: check_linkhuge_tests must check each word size

2008-10-17 Thread Adam Litke
. Signed-off-by: Adam Litke <[EMAIL PROTECTED]> --- tests/run_tests.sh | 38 ++ 1 files changed, 26 insertions(+), 12 deletions(-) diff --git a/tests/run_tests.sh b/tests/run_tests.sh index 4fe6eed..dc2370f 100755 --- a/tests/run_tests.sh +++ b/tests/run_te

  1   2   3   4   5   6   >