[Bug 213814] AWS/EC2: no egress traffic stats on ixv(4) xn(4)

[bugzilla-noreply]

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814

--- Comment #14 from Andreas Andersson  ---
This still does not work.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
freebsd-virtualization@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
To unsubscribe, send any mail to 
"freebsd-virtualization-unsubscr...@freebsd.org"

Re: bhyve VM drive size limit?

[Allan Jude]

On 2017-09-02 10:52, Ruben wrote:
> Hi Jason,
> 
> 
>> Make sure
>> you adjust the zvol block size in the default config before creating your
>> guest or you will wonder where your storage starts to disappear to.
>>
>> Cheers,
>>
>> Jason
> Perhaps slightly off-topic, but might you have any recommendations
> regarding those blocksizes?
> 
> I'm not really that well versed in blocksizes / filesystems and am often
> wondering where my 5TB zvol (bhyves into an ext4 volume for an ubuntu
> guest) exactly disappears into :P
> 
> Regards,
> 
> Ruben
>> On 2 Sep 2017 2:46 p.m., "Dylan Williams"  wrote:
>>
>> Dear all,
>>
>> Is there a limit with respect to the size of the virtual drive I can create
>> for a VM using bhyve? Presumably not but I’m running into problems with a
>> larger drive.
>>
>> I am trying to create a 4T Ubuntu machine on a FreeBSD11.1 server using
>> iohyve. There’s plenty of drive space available so it’s not a drive space
>> issue. I am able to create a 40G machine without any problems but exactly
>> the same commands to create a 4000G machine results in a server that won’t
>> boot past Grub. Is this an iohyve issue perhaps?
>>
>> Commands used that results in a working Ubuntu server:
>>
>> iohyve create ubu 40G
>> iohyve set ubu loader=grub-bhyve os=debian ram=40G cpu=10
>> iohyve install ubu ubuntu-16.04.3-server-amd64.iso <
>> ftp://ftp.cuhk.edu.hk/pub/Linux/ubuntu-releases/16.04.3/
>> ubuntu-16.04.3-server-amd64.iso>
>>
>> Commands used that results in a broken Ubuntu server:
>>
>> iohyve create ubu 4000G
>> iohyve set ubu loader=grub-bhyve os=debian ram=40G cpu=10
>> iohyve install ubu ubuntu-16.04.3-server-amd64.iso <
>> ftp://ftp.cuhk.edu.hk/pub/Linux/ubuntu-releases/16.04.3/
>> ubuntu-16.04.3-server-amd64.iso>
>>
>> The screen I get in the console when I boot (iohyve start ubu) the 4T
>> machine is:
>>
>>  GNU GRUB  version 2.00
>>
>>Minimal BASH-like line editing is supported. For the first word, TAB
>>lists possible command completions. Anywhere else TAB lists possible
>>device or file completions.
>>
>>
>> grub>
>>
>> Does anyone have any ideas? I’ve been at this for hours trying different
>> configurations. LVM is not selected when installing either of the above
>> machines as that seems to cause more problems.
>>
>> Many thanks,
>> Dylan.
>> ___
>> freebsd-virtualization@freebsd.org mailing list
>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
>> To unsubscribe, send any mail to "freebsd-virtualization-
>> unsubscr...@freebsd.org"
>> ___
>> freebsd-virtualization@freebsd.org mailing list
>> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
>> To unsubscribe, send any mail to 
>> "freebsd-virtualization-unsubscr...@freebsd.org"
> ___
> freebsd-virtualization@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to 
> "freebsd-virtualization-unsubscr...@freebsd.org"
> 

To understand why space in a ZVOL goes missing, research 'raidz padding'.

See here:
https://www.delphix.com/blog/delphix-engineering/zfs-raidz-stripe-width-or-how-i-learned-stop-worrying-and-love-raidz

For more detail, see Chapter 9 of "FreeBSD Mastery: Advanced ZFS" from
http://www.zfsbook.com


-- 
Allan Jude



signature.asc
Description: OpenPGP digital signature

Re: bhyve VM drive size limit?

[Jason Tubnor]

Hi Ruben,

On 3 September 2017 at 00:52, Ruben  wrote:

>
> Perhaps slightly off-topic, but might you have any recommendations
> regarding those blocksizes?
>

I use 8k zvol block sizes.  This seems to work consistently for me with
OpenBSD and Windows Server 2016 guests.  While you could probably go
larger, it really depends on your use case and how the data intends to move
around in the guest.  Some people have had performance issues with 8k
blocks, however, I am yet to experience this.  Chyves by default used 512
byte block sizes, this is sub-optimal for a guest with > 9GB storage needs,
so I change the default settings back to 8k.

>
> I'm not really that well versed in blocksizes / filesystems and am often
> wondering where my 5TB zvol (bhyves into an ext4 volume for an ubuntu
> guest) exactly disappears into :P


For the above, I have experienced where block sizes were defined at 512
bytes, the associated block checksums would eat up the storage, just as
quick as the data being committed to the zvol (even more so as the
snapshots pile up).  Increasing the zvol block size increased the storage
to checksum ratio, reducing how much the checksum overhead had an affect on
the storage.  Keep in mind, this is with a zmirror, so mileage may vary
with raidz or raidz2 setups.  Another thing to keep in mind, as you
increase the block size, this can have performance impacts on the guest as
a 4k update in the guest filesystem, would but upwards pressure on array
performance if you used say 32-64k blocks (rewriting > 32x the
data+checksum calcs).

I suggest trying different sizes for the same workload you plan to commit
to the guest storage to see which has the best storage to performance ratio.

Cheers,

Jason.

P.S.  In the above, I wouldn't commit the 5TB to the guest in one hit.
Either grow it out as you need it or add additional zvols to your guest as
needed.
___
freebsd-virtualization@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
To unsubscribe, send any mail to 
"freebsd-virtualization-unsubscr...@freebsd.org"

Re: bhyve VM drive size limit?

[Ruben]

Hi Jason,


> Make sure
> you adjust the zvol block size in the default config before creating your
> guest or you will wonder where your storage starts to disappear to.
>
> Cheers,
>
> Jason
Perhaps slightly off-topic, but might you have any recommendations
regarding those blocksizes?

I'm not really that well versed in blocksizes / filesystems and am often
wondering where my 5TB zvol (bhyves into an ext4 volume for an ubuntu
guest) exactly disappears into :P

Regards,

Ruben
> On 2 Sep 2017 2:46 p.m., "Dylan Williams"  wrote:
>
> Dear all,
>
> Is there a limit with respect to the size of the virtual drive I can create
> for a VM using bhyve? Presumably not but I’m running into problems with a
> larger drive.
>
> I am trying to create a 4T Ubuntu machine on a FreeBSD11.1 server using
> iohyve. There’s plenty of drive space available so it’s not a drive space
> issue. I am able to create a 40G machine without any problems but exactly
> the same commands to create a 4000G machine results in a server that won’t
> boot past Grub. Is this an iohyve issue perhaps?
>
> Commands used that results in a working Ubuntu server:
>
> iohyve create ubu 40G
> iohyve set ubu loader=grub-bhyve os=debian ram=40G cpu=10
> iohyve install ubu ubuntu-16.04.3-server-amd64.iso <
> ftp://ftp.cuhk.edu.hk/pub/Linux/ubuntu-releases/16.04.3/
> ubuntu-16.04.3-server-amd64.iso>
>
> Commands used that results in a broken Ubuntu server:
>
> iohyve create ubu 4000G
> iohyve set ubu loader=grub-bhyve os=debian ram=40G cpu=10
> iohyve install ubu ubuntu-16.04.3-server-amd64.iso <
> ftp://ftp.cuhk.edu.hk/pub/Linux/ubuntu-releases/16.04.3/
> ubuntu-16.04.3-server-amd64.iso>
>
> The screen I get in the console when I boot (iohyve start ubu) the 4T
> machine is:
>
>  GNU GRUB  version 2.00
>
>Minimal BASH-like line editing is supported. For the first word, TAB
>lists possible command completions. Anywhere else TAB lists possible
>device or file completions.
>
>
> grub>
>
> Does anyone have any ideas? I’ve been at this for hours trying different
> configurations. LVM is not selected when installing either of the above
> machines as that seems to cause more problems.
>
> Many thanks,
> Dylan.
> ___
> freebsd-virtualization@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-
> unsubscr...@freebsd.org"
> ___
> freebsd-virtualization@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to 
> "freebsd-virtualization-unsubscr...@freebsd.org"
___
freebsd-virtualization@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
To unsubscribe, send any mail to 
"freebsd-virtualization-unsubscr...@freebsd.org"