Re: [Clonezilla-live] Partclone vs Partimage

2010-04-16 Thread Steven Shiau
Lukas,
Thanks. Thomas Tsai will revise this and try to use them.
In the future, we will have more options in partclone to disable some 
jobs, e.g. -q, --quiet to skip all the rate messages update.
Thanks.

Steven.

Lukas Grässlin wrote:
 On 14.04.2010 23:16, Steven Shiau wrote:
   
 Lukas Grässlin wrote:
 
 On 14.04.2010 16:15, Steven Shiau wrote:
  
   
 Lukas Grässlin wrote:

 
 There is an option -f of partclone which you might be interested to
 give it try.
 You can tune it to see if any difference.
 
 
 As I understood the code, -f only affects the time the gui itself would
 be refreshed, but the update_pui method which also runs calculate_speed
 anyway is run.

 
   
 Thanks. I will check with Thomas,
 
 
 No problem.

 You can see it e.g. here in restore.c :

 /// start restore image file to partition
 for( block_id = 0; block_id  image_hdr.totalblock; block_id++ ){
 /* doing things, copying the blocks */
 update_pui(prog, copied, done);
 } // end of for


 I did a patch for myself within I told it just call update_pui once for
 5000 blocks. Don't know if its a good idea, but it worked ;)
   
   
 Good, and the performance is?
 Could you please also send us the patch file?
 Thanks.
 

 I got about 20-39 MB/s.
 Here is the patch. There are some other changes within:

 * I completeley disabled the update_pui on the server side, because
 clonezilla anyway doesn't show the output there.

 * I changed the display of the speed from */min to */s beaucse I thoght
 it's better readable for the most people.

 * I implemented that crc32-checks can be disabled. Not an good idea, but
 I wanted it for testing and its disabled by default.

 Sorry, I had no time to rip off these other changes but it should be ok
 anyway I hope.

 Regards,
 Lukas

   
 Steven.
 
  
   
 If I've time I'll try the older clonezilla live, too.


  
  
   
 BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's
 partclone is older, and we might have a regression somewhere...
 Please let us know the results.
 Thanks.

 Regards,
 Steven.
   
 
 On 14.04.2010 10:33, Steven Shiau wrote:
  
   
   
 Yes, Thomas Tsai is working on the improvement of partclone.

 Lukas,
 Please send us gprof results you have.
 Thanks.

 Steven.

 On 2010/4/14 下午 02:43, Lukas Grässlin wrote:
  
 
 Regarding the perfmance of partclone: Look at the on-the-fly
 performance Thread in this mailing list.

 Partclone does some odd things which slow down the speed. You can
 improve this by saying not to use the gui. (I think this is in the
 expert options). But it stills does stupid things, like
 calculating the
 speed too often which resultes in high cpu load.

 Regards,
 Lukas

 On 14.04.2010 06:39, Jorge Fábregas wrote:

   
 Hello Steven,

 I've been using Clonezilla happily for more than 2 years and I
 always used the
 custom options and specifically partimage as the cloning tool.
 Since partimage
 seems to be a dead project (and no support for ext4) and
 considering that
 Clonezilla uses partclone as the default option I decided to use
 this.

 My observation was that partclone takes some more time.  When it
 started
 saving the partition, I wasn't sure what it was doing.  There was
 some
 progress indicator (percentage) (Generating bitmap..) and I after
 that it
 started again another progress indicator (I guess the actual
 creation of the
 image).  I'm a bit confused about these 2 steps as soon as
 partclone starts.
 Any tip will be appreciated. (just curious).

 Thanks for Clonezillla.

 Best regards,
 Jorge


 --



 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find
 bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Clonezilla-live mailing list
 Clonezilla-live@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/clonezilla-live
 
 
   
   
   
   
 
   
   
   


   

-- 
Steven Shiau steven _at_ nchc org tw steven _at_ stevenshiau org
National Center for High-performance Computing, Taiwan. http://www.nchc.org.tw
Public Key Server PGP Key ID: 1024D/9762755A
Fingerprint: A2A1 08B7 C22C 3D06 34DB  F4BC 08B3 E3D7 9762 755A


--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and 

Re: [Clonezilla-live] Partclone vs Partimage

2010-04-15 Thread Lukas Grässlin
On 14.04.2010 23:16, Steven Shiau wrote:
 
 
 Lukas Grässlin wrote:
 On 14.04.2010 16:15, Steven Shiau wrote:
  
 Lukas Grässlin wrote:

 There is an option -f of partclone which you might be interested to
 give it try.
 You can tune it to see if any difference.
 
 As I understood the code, -f only affects the time the gui itself would
 be refreshed, but the update_pui method which also runs calculate_speed
 anyway is run.

 
 Thanks. I will check with Thomas,
 

 No problem.

 You can see it e.g. here in restore.c :

 /// start restore image file to partition
 for( block_id = 0; block_id  image_hdr.totalblock; block_id++ ){
 /* doing things, copying the blocks */
 update_pui(prog, copied, done);
 } // end of for


 I did a patch for myself within I told it just call update_pui once for
 5000 blocks. Don't know if its a good idea, but it worked ;)
   
 Good, and the performance is?
 Could you please also send us the patch file?
 Thanks.

I got about 20-39 MB/s.
Here is the patch. There are some other changes within:

* I completeley disabled the update_pui on the server side, because
clonezilla anyway doesn't show the output there.

* I changed the display of the speed from */min to */s beaucse I thoght
it's better readable for the most people.

* I implemented that crc32-checks can be disabled. Not an good idea, but
I wanted it for testing and its disabled by default.

Sorry, I had no time to rip off these other changes but it should be ok
anyway I hope.

Regards,
Lukas

 
 Steven.

  
 If I've time I'll try the older clonezilla live, too.


  
  
 BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's
 partclone is older, and we might have a regression somewhere...
 Please let us know the results.
 Thanks.

 Regards,
 Steven.
   
 On 14.04.2010 10:33, Steven Shiau wrote:
  
   
 Yes, Thomas Tsai is working on the improvement of partclone.

 Lukas,
 Please send us gprof results you have.
 Thanks.

 Steven.

 On 2010/4/14 下午 02:43, Lukas Grässlin wrote:
  
 Regarding the perfmance of partclone: Look at the on-the-fly
 performance Thread in this mailing list.

 Partclone does some odd things which slow down the speed. You can
 improve this by saying not to use the gui. (I think this is in the
 expert options). But it stills does stupid things, like
 calculating the
 speed too often which resultes in high cpu load.

 Regards,
 Lukas

 On 14.04.2010 06:39, Jorge Fábregas wrote:

 Hello Steven,

 I've been using Clonezilla happily for more than 2 years and I
 always used the
 custom options and specifically partimage as the cloning tool.
 Since partimage
 seems to be a dead project (and no support for ext4) and
 considering that
 Clonezilla uses partclone as the default option I decided to use
 this.

 My observation was that partclone takes some more time.  When it
 started
 saving the partition, I wasn't sure what it was doing.  There was
 some
 progress indicator (percentage) (Generating bitmap..) and I after
 that it
 started again another progress indicator (I guess the actual
 creation of the
 image).  I'm a bit confused about these 2 steps as soon as
 partclone starts.
 Any tip will be appreciated. (just curious).

 Thanks for Clonezillla.

 Best regards,
 Jorge


 --



 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find
 bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Clonezilla-live mailing list
 Clonezilla-live@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/clonezilla-live
 
   
   
 


   
 


-- 
Lukas Grässlin

Collax GmbH . Basler Str. 115a . 79115 Freiburg . Germany

p: +49 (0) 89-990 157-23

Collax - Simply Linux.

Geschäftsführer: Boris Nalbach
AG München HRB 158898 * Ust.-IdNr: DE 814464942
diff -Nur partclone-0.2.8/src/chkimg.c partclone-0.2.8-cx-patched/src/chkimg.c
--- partclone-0.2.8/src/chkimg.c2010-03-29 10:25:04.0 +0200
+++ partclone-0.2.8-cx-patched/src/chkimg.c 2010-04-13 15:08:00.0 
+0200
@@ -327,7 +327,7 @@
 log_mesg(0, 1, 1, debug, read errno = %i \n, errno);
 
 /// read crc32 code and check it.
-crc_ck = crc32(crc_ck, buffer, r_size);
+crc_ck = crc32(crc_ck, buffer, r_size, opt);
 crc_buffer = (char*)malloc(CRC_SIZE); ///alloc a memory to copy 
data
 if(crc_buffer == NULL){
 log_mesg(0, 1, 1, debug, %s, %i, ERROR:%s, __func__, 
__LINE__, strerror(errno));
@@ -347,7 +347,7 @@
 

Re: [Clonezilla-live] Partclone vs Partimage

2010-04-15 Thread Jorge Fábregas
On Wednesday 14 April 2010 09:44:55 Steven Shiau wrote:
 Did you try 1.2.5-1?

Wow!  I tried 1.2.5-2 today and it was about 200% faster! Here are the test 
results:

For both tests, I used the following:

- partition image backup to SSH server thru Gigabit link
- Filessytem: ext3
- Device size:  58 GB
- Space in use:  3.5 GB
- Block size: 4096 bytes
- size in MB to split partition image: 100 (to avoid split)
- Compression on image: none
- the rest of settings were default ones

For the above scenario, the times were:

a) Using clonezilla-live-1.2.4-28-686.iso, it took 8 minutes and 5 seconds

b) Using clonezilla-live-1.2.5-2.686.iso, it took 2 minutes and 31 seconds

The elapsed time above is just after hitting Are you sure ... where you 
press y  until the end of the image creation + hw gathering info output etc, 
specifically Press Enter to continue

Impressive really.   Excellent job guys!  

So when does testing becomes stable. Is it based on some time or is it if 
it's been there for some time without many people reporting any issues?

All the best,
Jorge

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Clonezilla-live mailing list
Clonezilla-live@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clonezilla-live


Re: [Clonezilla-live] Partclone vs Partimage

2010-04-14 Thread Lukas Grässlin
 There is an option -f of partclone which you might be interested to
 give it try.
 You can tune it to see if any difference.

As I understood the code, -f only affects the time the gui itself would
be refreshed, but the update_pui method which also runs calculate_speed
anyway is run.

If I've time I'll try the older clonezilla live, too.


 BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's
 partclone is older, and we might have a regression somewhere...
 Please let us know the results.
 Thanks.
 
 Regards,
 Steven.
 On 14.04.2010 10:33, Steven Shiau wrote:
  
 Yes, Thomas Tsai is working on the improvement of partclone.

 Lukas,
 Please send us gprof results you have.
 Thanks.

 Steven.

 On 2010/4/14 下午 02:43, Lukas Grässlin wrote:

 Regarding the perfmance of partclone: Look at the on-the-fly
 performance Thread in this mailing list.

 Partclone does some odd things which slow down the speed. You can
 improve this by saying not to use the gui. (I think this is in the
 expert options). But it stills does stupid things, like calculating the
 speed too often which resultes in high cpu load.

 Regards,
 Lukas

 On 14.04.2010 06:39, Jorge Fábregas wrote:
  
 Hello Steven,

 I've been using Clonezilla happily for more than 2 years and I
 always used the
 custom options and specifically partimage as the cloning tool. 
 Since partimage
 seems to be a dead project (and no support for ext4) and
 considering that
 Clonezilla uses partclone as the default option I decided to use this.

 My observation was that partclone takes some more time.  When it
 started
 saving the partition, I wasn't sure what it was doing.  There was some
 progress indicator (percentage) (Generating bitmap..) and I after
 that it
 started again another progress indicator (I guess the actual
 creation of the
 image).  I'm a bit confused about these 2 steps as soon as
 partclone starts.
 Any tip will be appreciated. (just curious).

 Thanks for Clonezillla.

 Best regards,
 Jorge


 --

 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Clonezilla-live mailing list
 Clonezilla-live@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/clonezilla-live
 
   


   
 


-- 
Lukas Grässlin

Collax GmbH . Basler Str. 115a . 79115 Freiburg . Germany

p: +49 (0) 89-990 157-23

Collax - Simply Linux.

Geschäftsführer: Boris Nalbach
AG München HRB 158898 * Ust.-IdNr: DE 814464942

--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Clonezilla-live mailing list
Clonezilla-live@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clonezilla-live


Re: [Clonezilla-live] Partclone vs Partimage

2010-04-14 Thread Steven Shiau


Lukas Grässlin wrote:
 As I understood the code, -f only affects the time the gui itself would
 be refreshed, but the update_pui method which also runs calculate_speed
 anyway is run.
   

Thomas,
Please make sure the update_pui method which also runs calculate_speed 
anyway is run. If it's true, I believe this can be improved...
Thanks.

Steven.

-- 
Steven Shiau steven _at_ nchc org tw steven _at_ stevenshiau org
National Center for High-performance Computing, Taiwan.
http://www.nchc.org.tw
Public Key Server PGP Key ID: 1024D/9762755A
Fingerprint: A2A1 08B7 C22C 3D06 34DB  F4BC 08B3 E3D7 9762 755A


--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Clonezilla-live mailing list
Clonezilla-live@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clonezilla-live


Re: [Clonezilla-live] Partclone vs Partimage

2010-04-14 Thread Steven Shiau


Lukas Grässlin wrote:
 On 14.04.2010 16:15, Steven Shiau wrote:
   
 Lukas Grässlin wrote:
 
 There is an option -f of partclone which you might be interested to
 give it try.
 You can tune it to see if any difference.
 
 
 As I understood the code, -f only affects the time the gui itself would
 be refreshed, but the update_pui method which also runs calculate_speed
 anyway is run.

   
   
 Thanks. I will check with Thomas,
 

 No problem.

 You can see it e.g. here in restore.c :

 /// start restore image file to partition
 for( block_id = 0; block_id  image_hdr.totalblock; block_id++ ){
 /* doing things, copying the blocks */
 update_pui(prog, copied, done);
 } // end of for


 I did a patch for myself within I told it just call update_pui once for
 5000 blocks. Don't know if its a good idea, but it worked ;)
   
Good, and the performance is?
Could you please also send us the patch file?
Thanks.

Steven.

   
 If I've time I'll try the older clonezilla live, too.


  
   
 BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's
 partclone is older, and we might have a regression somewhere...
 Please let us know the results.
 Thanks.

 Regards,
 Steven.

 
 On 14.04.2010 10:33, Steven Shiau wrote:
  
  
   
 Yes, Thomas Tsai is working on the improvement of partclone.

 Lukas,
 Please send us gprof results you have.
 Thanks.

 Steven.

 On 2010/4/14 下午 02:43, Lukas Grässlin wrote:
   
 
 Regarding the perfmance of partclone: Look at the on-the-fly
 performance Thread in this mailing list.

 Partclone does some odd things which slow down the speed. You can
 improve this by saying not to use the gui. (I think this is in the
 expert options). But it stills does stupid things, like
 calculating the
 speed too often which resultes in high cpu load.

 Regards,
 Lukas

 On 14.04.2010 06:39, Jorge Fábregas wrote:
   
   
 Hello Steven,

 I've been using Clonezilla happily for more than 2 years and I
 always used the
 custom options and specifically partimage as the cloning tool.
 Since partimage
 seems to be a dead project (and no support for ext4) and
 considering that
 Clonezilla uses partclone as the default option I decided to use
 this.

 My observation was that partclone takes some more time.  When it
 started
 saving the partition, I wasn't sure what it was doing.  There was
 some
 progress indicator (percentage) (Generating bitmap..) and I after
 that it
 started again another progress indicator (I guess the actual
 creation of the
 image).  I'm a bit confused about these 2 steps as soon as
 partclone starts.
 Any tip will be appreciated. (just curious).

 Thanks for Clonezillla.

 Best regards,
 Jorge


 --


 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Clonezilla-live mailing list
 Clonezilla-live@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/clonezilla-live
 
 
 
   
 
   
   
   


   

-- 
Steven Shiau steven _at_ nchc org tw steven _at_ stevenshiau org
National Center for High-performance Computing, Taiwan.
http://www.nchc.org.tw
Public Key Server PGP Key ID: 1024D/9762755A
Fingerprint: A2A1 08B7 C22C 3D06 34DB  F4BC 08B3 E3D7 9762 755A


--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Clonezilla-live mailing list
Clonezilla-live@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/clonezilla-live