Re: VirtualBox mangles memory

[Bernhard Fröhlich]

To me this sounds a lot like vbox and zfs arc are fighting for resources.
What does the memory line in top look like when this problem happens?

A simple workaround would be to limit zfs arc in loader.conf if that is the
problem.

Am 22.09.2015 5:13 nachm. schrieb "Martin Birgmeier" :
>
> This did not happen when the machine was running FreeBSD 9.2 with
virtualbox-ose-4.3.20 installed. So I would not qualify this as "known
behavior".
>
> One server has 16G main memory, a VM gets 3G. The other has 8G main mem
and again 3G allocated to the VM.
>
> This is definitely a bug in how VirtualBox handles memory on FreeBSD 10.
I am pretty sure that something changed in FBSD 10 which was not properly
taken care of in VB.
>
> -- Martin
>
>
>
> On 09/21/15 22:10, Mark Felder wrote:
> >
> > On Sun, Sep 20, 2015, at 06:20, Martin Birgmeier wrote:
> >> On machines where VirtualBox is running, I get memory allocation
errors.
> >>
> >> 'dd' aborts with 'dd: stdout: Cannot allocate memory'
> >>
> >> 'zfs send' aborts with 'internal error: Cannot allocate memory'
> >>
> >> I have created https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=195970
> >> to track this.
> >>
> >> Could a knowledgeable person please have a look into this?
> >>
> >> FreeBSD 10.2, VirtualBox 4.3.30
> >>
> >> -- Martin
> >>
> > I'm not an expert, but I think this is known behavior. Virtualbox
> > requires a huge contiguous chunk of memory for the VM and that's
> > probably what you're running into.
> >
> > Can you give more information about the specs of the server itself and
> > the amount of resources allocated to VMs?
> >
>
> ___
> freebsd-emulation@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
> To unsubscribe, send any mail to "
freebsd-emulation-unsubscr...@freebsd.org"
___
freebsd-emulation@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
To unsubscribe, send any mail to "freebsd-emulation-unsubscr...@freebsd.org"

Re: VirtualBox mangles memory

[Martin Birgmeier]

I don't think it is related to zfs. The 8GB machine did not even have
zfs loaded or a zfs file system when I first reported the problem. (The
problem with 'zfs send' only happened recently on the 16GB machine.)

I'd like to know what has changed between FBSD 9 and 10 regarding memory
management and maybe memory tuning parameters. I am quite sure that the
cause is to be found there, and in VirtualBox not properly taking into
account these changes. Maybe it is just some page table or similar
temporarily running out of entries. The problem is easy to reproduce, so
if I get some good hints on what to tune I can check whether they help.

-- Martin

On 09/22/15 20:50, Bernhard Fröhlich wrote:
>
> To me this sounds a lot like vbox and zfs arc are fighting for
> resources. What does the memory line in top look like when this
> problem happens?
>
> A simple workaround would be to limit zfs arc in loader.conf if that
> is the problem.
>
> Am 22.09.2015 5:13 nachm. schrieb "Martin Birgmeier"  >:
> >
> > This did not happen when the machine was running FreeBSD 9.2 with
> virtualbox-ose-4.3.20 installed. So I would not qualify this as "known
> behavior".
> >
> > One server has 16G main memory, a VM gets 3G. The other has 8G main
> mem and again 3G allocated to the VM.
> >
> > This is definitely a bug in how VirtualBox handles memory on FreeBSD
> 10. I am pretty sure that something changed in FBSD 10 which was not
> properly taken care of in VB.
> >
> > -- Martin
> >
> >
> >
> > On 09/21/15 22:10, Mark Felder wrote:
> > >
> > > On Sun, Sep 20, 2015, at 06:20, Martin Birgmeier wrote:
> > >> On machines where VirtualBox is running, I get memory allocation
> errors.
> > >>
> > >> 'dd' aborts with 'dd: stdout: Cannot allocate memory'
> > >>
> > >> 'zfs send' aborts with 'internal error: Cannot allocate memory'
> > >>
> > >> I have created
> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=195970
> > >> to track this.
> > >>
> > >> Could a knowledgeable person please have a look into this?
> > >>
> > >> FreeBSD 10.2, VirtualBox 4.3.30
> > >>
> > >> -- Martin
> > >>
> > > I'm not an expert, but I think this is known behavior. Virtualbox
> > > requires a huge contiguous chunk of memory for the VM and that's
> > > probably what you're running into.
> > >
> > > Can you give more information about the specs of the server itself and
> > > the amount of resources allocated to VMs?
> > >
> >
> > ___
> > freebsd-emulation@freebsd.org 
> mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
> > To unsubscribe, send any mail to
> "freebsd-emulation-unsubscr...@freebsd.org
> "
>

___
freebsd-emulation@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
To unsubscribe, send any mail to "freebsd-emulation-unsubscr...@freebsd.org"

Re: VirtualBox mangles memory

[Mark Felder]

On Tue, Sep 22, 2015, at 15:57, Michael Butler wrote:
> On 09/22/15 16:20, Adam Vande More wrote:
> > On Tue, Sep 22, 2015 at 2:26 PM, Martin Birgmeier  wrote:
> 
> >> I am quite sure that the
> >> cause is to be found there
> >>
> > 
> > I don't see any cause for surety in the info you have given us.  Have you
> > tried any basic steps like monitoring usage during these events or running
> > it under truss/valgrind etc to find out what is going on?
> > 
> 
> Another data point ..
> 
> I run it on -CURRENT and there have been a number of VM-related changes
> of late but I don't have any problems with it.
> 
> However, you *must* recompile (at least) the modules whenever the kernel
> is rebuilt as they depend heavily on the underlying kernel structures,
> 
>   imb
> 

I agree. Just to be safe we really shouldn't provide packages for the
virtualbox kmods. It's just asking for trouble.


-- 
  Mark Felder
  ports-secteam member
  f...@freebsd.org
___
freebsd-emulation@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
To unsubscribe, send any mail to "freebsd-emulation-unsubscr...@freebsd.org"

Re: VirtualBox mangles memory

[Michael Butler]

On 09/22/15 16:20, Adam Vande More wrote:
> On Tue, Sep 22, 2015 at 2:26 PM, Martin Birgmeier  wrote:

>> I am quite sure that the
>> cause is to be found there
>>
> 
> I don't see any cause for surety in the info you have given us.  Have you
> tried any basic steps like monitoring usage during these events or running
> it under truss/valgrind etc to find out what is going on?
> 

Another data point ..

I run it on -CURRENT and there have been a number of VM-related changes
of late but I don't have any problems with it.

However, you *must* recompile (at least) the modules whenever the kernel
is rebuilt as they depend heavily on the underlying kernel structures,

imb

___
freebsd-emulation@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
To unsubscribe, send any mail to "freebsd-emulation-unsubscr...@freebsd.org"

Re: VirtualBox mangles memory

[Martin Birgmeier]

This did not happen when the machine was running FreeBSD 9.2 with 
virtualbox-ose-4.3.20 installed. So I would not qualify this as "known 
behavior".

One server has 16G main memory, a VM gets 3G. The other has 8G main mem and 
again 3G allocated to the VM.

This is definitely a bug in how VirtualBox handles memory on FreeBSD 10. I am 
pretty sure that something changed in FBSD 10 which was not properly taken care 
of in VB.

-- Martin



On 09/21/15 22:10, Mark Felder wrote:
>
> On Sun, Sep 20, 2015, at 06:20, Martin Birgmeier wrote:
>> On machines where VirtualBox is running, I get memory allocation errors.
>>
>> 'dd' aborts with 'dd: stdout: Cannot allocate memory'
>>
>> 'zfs send' aborts with 'internal error: Cannot allocate memory'
>>
>> I have created https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=195970
>> to track this.
>>
>> Could a knowledgeable person please have a look into this?
>>
>> FreeBSD 10.2, VirtualBox 4.3.30
>>
>> -- Martin
>>
> I'm not an expert, but I think this is known behavior. Virtualbox
> requires a huge contiguous chunk of memory for the VM and that's
> probably what you're running into.
>
> Can you give more information about the specs of the server itself and
> the amount of resources allocated to VMs?
>

___
freebsd-emulation@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-emulation
To unsubscribe, send any mail to "freebsd-emulation-unsubscr...@freebsd.org"