[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-15 Thread Peter Maydell
** Changed in: qemu-linaro Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922 Title: qemu-arm-static chroots give copious memory errors when setting up

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-12 Thread Peter Maydell
I've committed to qemu-linaro the default-to-R-on-64-bit-hosts patch (so Steve, you'll want to drop it from the packaging) and also the followup patch which fixes the bash issues Loic lists. These will both be in qemu-linaro 2011.03 (due this Thursday!) ** Changed in: qemu-linaro Status:

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-10 Thread Peter Maydell
Yes, I've seen the bash failures too. They should be fixed by http://patchwork.ozlabs.org/patch/144476/ which I'm intending to put into qemu-linaro for next week's release. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-09 Thread Nick Moffitt
So currently all of the armel PPA buildds that are in auto-mode on production launchpad are using qemu-arm-static to run their build chroots. On staging I saw a dramatic decrease in the number of OOM-type failures and catastrophic mmap() failures, with a slight uptick in sig11s (on different

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-09 Thread Loïc Minier
In my case, I'm using qemu-arm-static from precise against an unstable Debian armel chroot and that used to work fine but now I get: bash: xmalloc: ../bash/variables.c:1969: cannot allocate 28 bytes (24576 bytes allocated) when starting bash; if I run sh (which is dash) I don't have the problem.

Re: [Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-09 Thread Steve Langasek
On Fri, Mar 09, 2012 at 08:35:44PM -, Loïc Minier wrote: In my case, I'm using qemu-arm-static from precise against an unstable Debian armel chroot and that used to work fine but now I get: bash: xmalloc: ../bash/variables.c:1969: cannot allocate 28 bytes (24576 bytes allocated) when

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-03 Thread Peter Maydell
I'm not sure. I don't have a feel for whether it has fixed more cases than it has broken or vice-versa, I'm afraid. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922 Title: qemu-arm-static

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-02 Thread Peter Maydell
This workaround turns out to cause some regressions in other cases, for example: http://comments.gmane.org/gmane.comp.emulators.qemu/138180 which seems to be because when we use -R (either explicitly or implicitly because of this patch) we tend to map the guest stack immediately above the guest

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-02 Thread Steve Langasek
Nick, I think you're certainly exercising qemu-arm-static more than anyone else at the moment with the autobuilder prototyping. Are you seeing different regressions now as a result of this patch? Should we consider reverting this patch until there's a clean upstream solution? -- You received

Re: [Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-03-02 Thread Loïc Minier
On Fri, Mar 02, 2012, Peter Maydell wrote: This workaround turns out to cause some regressions in other cases, for example: http://comments.gmane.org/gmane.comp.emulators.qemu/138180 which seems to be because when we use -R (either explicitly or implicitly because of this patch) we tend to

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-02-18 Thread Launchpad Bug Tracker
This bug was fixed in the package qemu-linaro - 1.0.50-2012.01-0ubuntu4 --- qemu-linaro (1.0.50-2012.01-0ubuntu4) precise; urgency=low * New patch, 0001_linux-user-reserve-4GB-of-vmem-for-32-on-64, from http://lists.gnu.org/archive/html/qemu-devel/2011-12/msg01697.html; fixes

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-02-17 Thread Loïc Minier
** Changed in: qemu-linaro (Ubuntu) Assignee: (unassigned) = Loïc Minier (lool) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922 Title: qemu-arm-static chroots give copious memory errors

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-02-13 Thread Nick Moffitt
Has anyone here or upstream got a good patch to do this? We need a workaround as soon as possible, and my initial hacky attempts don't seem to have worked. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-02-13 Thread Loïc Minier
Peter, is there a chance of regressing important and currently working functionality by setting QEMU_RESERVED_VA=0xf700 as the default in qemu-linaro in Ubuntu? If not, any reason for not doing it upstream until a better mmap implementation appears? -- You received this bug notification

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-02-13 Thread Peter Maydell
Oh, and also you (probably) don't want to set the environment variable for running 64 bit guests as I suspect it will unnecessarily restrict the total amount of RAM that they can use. Re: doing it upstream: the current status of the discussion is here (plus followups):

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-02-13 Thread Peter Maydell
Loic: You don't want to do it on 32 bit platforms, but for 64 bit hosts I think it should be OK. The only thing that I can think of that is likely to break is if the user has a ulimit -v setting which we would now be breaching. -- You received this bug notification because you are a member of

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-01-20 Thread Steve Langasek
I don't think there's a good way to put env vars into the binfmt glue; I think we'd be better off patching it into qemu itself the way Peter says upstream is considering. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2012-01-17 Thread Nick Moffitt
Steve: if this can be worked around with the QEMU_RESERVED_VA environment variable, then is there any straightforward place to put this (such as in the binfmt glue) for right now? I wonder if this could be worked around in the packaged version easily. -- You received this bug notification

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Nick Moffitt
** Attachment added: buildlog_ubuntu-precise-armel.ant_1.8.2-4build1_FAILEDTOBUILD.txt.gz https://bugs.launchpad.net/bugs/906922/+attachment/2641337/+files/buildlog_ubuntu-precise-armel.ant_1.8.2-4build1_FAILEDTOBUILD.txt.gz -- You received this bug notification because you are a member of

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Nick Moffitt
Er sorry, of course the buildd was in a precise chroot, not a Hardy one. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922 Title: qemu-arm-static chroots give copious memory errors when setting

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Steve Langasek
Matthias, could this be related to the memory mapping issues previously identified on ARM that affect Java? If so, can you explain what the issue is so that we can get this fixed in qemu-linaro? ** Changed in: qemu-linaro (Ubuntu) Assignee: (unassigned) = Matthias Klose (doko) ** Also

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Nick Moffitt
Hmm. So I was going to file another bug about a binutils build on precise running out of ptys, but on osageorange's oneiric-armel chroot, it exhausts virtual memory: g++ -DHAVE_CONFIG_H -I. -I../../gold -I../../gold -I../../gold/../include -I../../gold/../elfcpp

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Nick Moffitt
The same thing happened to me with bzr: precise build using 0.15.91 hit max open files limit, but oneiric build using 1.0 did the following: gcc -pthread -fno-strict-aliasing -g -O0 -Wall -Wstrict-prototypes -g -O2 -fPIC -I/usr/include/python2.7_d -c bzrlib/_dirstate_helpers_pyx.c -o

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Matthias Klose
so this triggers with the first alloc; I don't think that has something to do with the current 2GB limit -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922 Title: qemu-arm-static chroots give

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Matthias Klose
building the test case from bug 861296: (oneiric-armel)doko@osageorange:~/tmp$ gcc -g mmap-test.c (oneiric-armel)doko@osageorange:~/tmp$ ./a.out Couldn't allocate the heap: 32Mb -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Peter Maydell
An untested workaround you could try: arrange to set the environment variable QEMU_RESERVED_VA=0xf700 so the qemu in the chroot can see it. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Steve Langasek
double-checked that this symptom is the same with both 1.0 and 0.15.91, so yes, it doesn't seem related to the 2GB limit that affects java elsewhere - even though the behavior between 1.0 and 0.15.91 is different for bzr and binutils. ** Changed in: qemu-linaro (Ubuntu) Assignee: Matthias

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Steve Langasek
Peter, I can confirm that export QEMU_RESERVED_VA=0xf700 fixes this for Matthias's test case. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/906922 Title: qemu-arm-static chroots give copious

[Bug 906922] Re: qemu-arm-static chroots give copious memory errors when setting up java build dependencies

2011-12-20 Thread Peter Maydell
Right, so this is really down to qemu not being very good at handling mmap() in the 32-bit-guest-on-64-bit-host case -- it tends to fail mmap() even when there's more address space available because it hasn't managed to get the host kernel to allocate it within the 32-bit region of the address