Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-15 Thread Kevin Wolf
Am 14.08.2014 um 22:53 hat Xingbo Wu geschrieben: > >> >> The main trick of QED was to introduce a dirty flag, which allowed to > >> >> call fdatasync() less often because it was okay for image metadata to > >> >> become inconsistent. After a crash, you have to repair the image then. > >> >> > >> >

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-14 Thread Xingbo Wu
>> >> The main trick of QED was to introduce a dirty flag, which allowed to >> >> call fdatasync() less often because it was okay for image metadata to >> >> become inconsistent. After a crash, you have to repair the image then. >> >> >> > >> > I'm very curious about this dirty flag trick. I was su

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-14 Thread Kevin Wolf
Am 14.08.2014 um 04:42 hat Xingbo Wu geschrieben: > On Wed, Aug 13, 2014 at 5:04 PM, Xingbo Wu wrote: > > On Wed, Aug 13, 2014 at 2:32 PM, Kevin Wolf wrote: > >> Am 13.08.2014 um 18:38 hat Xingbo Wu geschrieben: > >>> On Wed, Aug 13, 2014 at 11:54 AM, Kevin Wolf wrote: > >>> > Am 12.08.2014 um 0

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Xingbo Wu
On Wed, Aug 13, 2014 at 5:04 PM, Xingbo Wu wrote: > On Wed, Aug 13, 2014 at 2:32 PM, Kevin Wolf wrote: >> Am 13.08.2014 um 18:38 hat Xingbo Wu geschrieben: >>> On Wed, Aug 13, 2014 at 11:54 AM, Kevin Wolf wrote: >>> > Am 12.08.2014 um 01:38 hat 吴兴博 geschrieben: >>> >> Hello, >>> >> >>> >> The

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Eric Blake
On 08/13/2014 03:04 PM, Xingbo Wu wrote: >>> I read several messages from this thread: "[RFC] qed: Add QEMU >>> Enhanced Disk format". To my understanding, if the new format can be >>> acceptable to the community: >>> It needs to retain all the key features provided by qcow2, >>> especially for

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Xingbo Wu
On Wed, Aug 13, 2014 at 2:32 PM, Kevin Wolf wrote: > Am 13.08.2014 um 18:38 hat Xingbo Wu geschrieben: >> On Wed, Aug 13, 2014 at 11:54 AM, Kevin Wolf wrote: >> > Am 12.08.2014 um 01:38 hat 吴兴博 geschrieben: >> >> Hello, >> >> >> >> The introduction in the wiki page present several advantages of

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Kevin Wolf
Am 13.08.2014 um 18:38 hat Xingbo Wu geschrieben: > On Wed, Aug 13, 2014 at 11:54 AM, Kevin Wolf wrote: > > Am 12.08.2014 um 01:38 hat 吴兴博 geschrieben: > >> Hello, > >> > >> The introduction in the wiki page present several advantages of qcow2 > >> [1]. > >> But I'm a little confused. I really

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Xingbo Wu
On Wed, Aug 13, 2014 at 11:54 AM, Kevin Wolf wrote: > Am 12.08.2014 um 01:38 hat 吴兴博 geschrieben: >> Hello, >> >> The introduction in the wiki page present several advantages of qcow2 [1]. >> But I'm a little confused. I really appreciate if any one can give me some >> help >> on this :). >> >>

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Kevin Wolf
Am 12.08.2014 um 01:38 hat 吴兴博 geschrieben: > Hello, > >   The introduction in the wiki page present several advantages of qcow2 [1]. > But I'm a little confused. I really appreciate if any one can give me some > help > on this :). > >  (1) Currently the raw format doesn't support COW. In other

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-13 Thread Kevin Wolf
Am 12.08.2014 um 17:30 hat Eric Blake geschrieben: > On 08/12/2014 08:14 AM, 吴兴博 wrote: > >>> However FVD seems to have been ignored by community. > >> > >> Care to give a pointer to a URL describing the FVD format? > >> > >> http://lists.nongnu.org/archive/html/qemu-devel/2011-01/msg00398.html > >

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Fam Zheng
On Tue, 08/12 12:22, Xingbo Wu wrote: > On Tue, Aug 12, 2014 at 11:30 AM, Eric Blake wrote: > > > On 08/12/2014 08:14 AM, 吴兴博 wrote: > > >>> However FVD seems to have been ignored by community. > > >> > > >> Care to give a pointer to a URL describing the FVD format? > > >> > > >> http://lists.non

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Richard W.M. Jones
On Tue, Aug 12, 2014 at 03:23:38PM -0400, Xingbo Wu wrote: > would be very space efficient for distribution :). > Would you consider replace xz with lz4? it has faster decompression speed > (~500MB/s)[1] and client-side decompression would be made painless. No. The main benefit of xz is it has a

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Xingbo Wu
On Tue, Aug 12, 2014 at 2:52 PM, Richard W.M. Jones wrote: > On Tue, Aug 12, 2014 at 07:46:30PM +0100, Daniel P. Berrange wrote: > > Taking the compression feature - arguably the biggest benefit of that > > is when you distribute disk images. eg if someone provides a root disk > > image on a web

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Richard W.M. Jones
On Tue, Aug 12, 2014 at 07:46:30PM +0100, Daniel P. Berrange wrote: > Taking the compression feature - arguably the biggest benefit of that > is when you distribute disk images. eg if someone provides a root disk > image on a web server, using compression in qcow2 can dramatically > lower the downl

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Daniel P. Berrange
On Mon, Aug 11, 2014 at 07:38:50PM -0400, 吴兴博 wrote: > Hello, > > The introduction in the wiki page present several advantages of qcow2 > [1]. But I'm a little confused. I really appreciate if any one can give me > some help on this :). > > (1) Currently the raw format doesn't support COW. In

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Richard W.M. Jones
On Tue, Aug 12, 2014 at 08:07:55AM -0600, Eric Blake wrote: > On 08/12/2014 07:45 AM, 吴兴博 wrote: > > [please don't top-post on technical lists] > > > Thanks for your information. It's really helpful. > > I think adding a bitmap alongside the raw file ( or just within that file) > > Umm, how do y

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Xingbo Wu
On Tue, Aug 12, 2014 at 11:30 AM, Eric Blake wrote: > On 08/12/2014 08:14 AM, 吴兴博 wrote: > >>> However FVD seems to have been ignored by community. > >> > >> Care to give a pointer to a URL describing the FVD format? > >> > >> http://lists.nongnu.org/archive/html/qemu-devel/2011-01/msg00398.html

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Eric Blake
On 08/12/2014 08:14 AM, 吴兴博 wrote: >>> However FVD seems to have been ignored by community. >> >> Care to give a pointer to a URL describing the FVD format? >> >> http://lists.nongnu.org/archive/html/qemu-devel/2011-01/msg00398.html > > This thread could be the clearest message on FVD. That very

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread 吴兴博
On Tue, Aug 12, 2014 at 10:07 AM, Eric Blake wrote: > On 08/12/2014 07:45 AM, 吴兴博 wrote: > > [please don't top-post on technical lists] > > Sorry about that.. > > Thanks for your information. It's really helpful. > > I think adding a bitmap alongside the raw file ( or just within that > file) >

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Eric Blake
On 08/12/2014 07:45 AM, 吴兴博 wrote: [please don't top-post on technical lists] > Thanks for your information. It's really helpful. > I think adding a bitmap alongside the raw file ( or just within that file) Umm, how do you propose to add a bitmap within a raw file? The moment the file contains

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread 吴兴博
Thanks for your information. It's really helpful. I think adding a bitmap alongside the raw file ( or just within that file) would be suffice to distinguish between present or in backing file. The idea in FVD looks similar to 'addcow'---use bitmap but delegating allocation to FS. However FVD seems

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Eric Blake
On 08/11/2014 05:38 PM, 吴兴博 wrote: > Hello, > > The introduction in the wiki page present several advantages of qcow2 > [1]. But I'm a little confused. I really appreciate if any one can give me > some help on this :). > > (1) Currently the raw format doesn't support COW. In other words, a raw

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Kirill Batuzov
On Tue, 12 Aug 2014, Fam Zheng wrote: > On Mon, 08/11 19:38, 吴兴博 wrote: > > Hello, > > > > The introduction in the wiki page present several advantages of qcow2 > > [1]. But I'm a little confused. I really appreciate if any one can give me > > some help on this :). > > > > (1) Currently the r

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Fam Zheng
On Tue, 08/12 08:03, 吴兴博 wrote: > I carefully read your reply and thought of it carefully. I'm sorry that > when I said "I get it" I actually meant "I believe you" but not "I > understand it". > The problem would not come from cp or rsync -- It's not their fault. They > just have no way to make it

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread 吴兴博
I carefully read your reply and thought of it carefully. I'm sorry that when I said "I get it" I actually meant "I believe you" but not "I understand it". The problem would not come from cp or rsync -- It's not their fault. They just have no way to make it right. The real reason of it would be that

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread Fam Zheng
On Tue, 08/12 06:46, 吴兴博 wrote: > Hi Fam, > It's glad to hear you, > It is said in this post that "All files systems that support inodes > (ext2/3/4, xfs, btfs, etc) support files with holes while creating the > files..." > [ > http://serverfault.com/questions/558761/best-linux-filesystem-for-spa

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-12 Thread 吴兴博
Hi Fam, It's glad to hear you, It is said in this post that "All files systems that support inodes (ext2/3/4, xfs, btfs, etc) support files with holes while creating the files..." [ http://serverfault.com/questions/558761/best-linux-filesystem-for-sparse-files ] I also heard this claim from othe

Re: [Qemu-devel] disk image: self-organized format or raw file

2014-08-11 Thread Fam Zheng
On Mon, 08/11 19:38, 吴兴博 wrote: > Hello, > > The introduction in the wiki page present several advantages of qcow2 > [1]. But I'm a little confused. I really appreciate if any one can give me > some help on this :). > > (1) Currently the raw format doesn't support COW. In other words, a raw >

[Qemu-devel] disk image: self-organized format or raw file

2014-08-11 Thread 吴兴博
Hello, The introduction in the wiki page present several advantages of qcow2 [1]. But I'm a little confused. I really appreciate if any one can give me some help on this :). (1) Currently the raw format doesn't support COW. In other words, a raw image cannot have a backing file. COW depends on