Re: [Clonezilla-live] Partclone vs Partimage
Lukas, Thanks. Thomas Tsai will revise this and try to use them. In the future, we will have more options in partclone to disable some jobs, e.g. -q, --quiet to skip all the rate messages update. Thanks. Steven. Lukas Grässlin wrote: On 14.04.2010 23:16, Steven Shiau wrote: Lukas Grässlin wrote: On 14.04.2010 16:15, Steven Shiau wrote: Lukas Grässlin wrote: There is an option -f of partclone which you might be interested to give it try. You can tune it to see if any difference. As I understood the code, -f only affects the time the gui itself would be refreshed, but the update_pui method which also runs calculate_speed anyway is run. Thanks. I will check with Thomas, No problem. You can see it e.g. here in restore.c : /// start restore image file to partition for( block_id = 0; block_id image_hdr.totalblock; block_id++ ){ /* doing things, copying the blocks */ update_pui(prog, copied, done); } // end of for I did a patch for myself within I told it just call update_pui once for 5000 blocks. Don't know if its a good idea, but it worked ;) Good, and the performance is? Could you please also send us the patch file? Thanks. I got about 20-39 MB/s. Here is the patch. There are some other changes within: * I completeley disabled the update_pui on the server side, because clonezilla anyway doesn't show the output there. * I changed the display of the speed from */min to */s beaucse I thoght it's better readable for the most people. * I implemented that crc32-checks can be disabled. Not an good idea, but I wanted it for testing and its disabled by default. Sorry, I had no time to rip off these other changes but it should be ok anyway I hope. Regards, Lukas Steven. If I've time I'll try the older clonezilla live, too. BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's partclone is older, and we might have a regression somewhere... Please let us know the results. Thanks. Regards, Steven. On 14.04.2010 10:33, Steven Shiau wrote: Yes, Thomas Tsai is working on the improvement of partclone. Lukas, Please send us gprof results you have. Thanks. Steven. On 2010/4/14 下午 02:43, Lukas Grässlin wrote: Regarding the perfmance of partclone: Look at the on-the-fly performance Thread in this mailing list. Partclone does some odd things which slow down the speed. You can improve this by saying not to use the gui. (I think this is in the expert options). But it stills does stupid things, like calculating the speed too often which resultes in high cpu load. Regards, Lukas On 14.04.2010 06:39, Jorge Fábregas wrote: Hello Steven, I've been using Clonezilla happily for more than 2 years and I always used the custom options and specifically partimage as the cloning tool. Since partimage seems to be a dead project (and no support for ext4) and considering that Clonezilla uses partclone as the default option I decided to use this. My observation was that partclone takes some more time. When it started saving the partition, I wasn't sure what it was doing. There was some progress indicator (percentage) (Generating bitmap..) and I after that it started again another progress indicator (I guess the actual creation of the image). I'm a bit confused about these 2 steps as soon as partclone starts. Any tip will be appreciated. (just curious). Thanks for Clonezillla. Best regards, Jorge -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live -- Steven Shiau steven _at_ nchc org tw steven _at_ stevenshiau org National Center for High-performance Computing, Taiwan. http://www.nchc.org.tw Public Key Server PGP Key ID: 1024D/9762755A Fingerprint: A2A1 08B7 C22C 3D06 34DB F4BC 08B3 E3D7 9762 755A -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and
Re: [Clonezilla-live] Partclone vs Partimage
On 14.04.2010 23:16, Steven Shiau wrote: Lukas Grässlin wrote: On 14.04.2010 16:15, Steven Shiau wrote: Lukas Grässlin wrote: There is an option -f of partclone which you might be interested to give it try. You can tune it to see if any difference. As I understood the code, -f only affects the time the gui itself would be refreshed, but the update_pui method which also runs calculate_speed anyway is run. Thanks. I will check with Thomas, No problem. You can see it e.g. here in restore.c : /// start restore image file to partition for( block_id = 0; block_id image_hdr.totalblock; block_id++ ){ /* doing things, copying the blocks */ update_pui(prog, copied, done); } // end of for I did a patch for myself within I told it just call update_pui once for 5000 blocks. Don't know if its a good idea, but it worked ;) Good, and the performance is? Could you please also send us the patch file? Thanks. I got about 20-39 MB/s. Here is the patch. There are some other changes within: * I completeley disabled the update_pui on the server side, because clonezilla anyway doesn't show the output there. * I changed the display of the speed from */min to */s beaucse I thoght it's better readable for the most people. * I implemented that crc32-checks can be disabled. Not an good idea, but I wanted it for testing and its disabled by default. Sorry, I had no time to rip off these other changes but it should be ok anyway I hope. Regards, Lukas Steven. If I've time I'll try the older clonezilla live, too. BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's partclone is older, and we might have a regression somewhere... Please let us know the results. Thanks. Regards, Steven. On 14.04.2010 10:33, Steven Shiau wrote: Yes, Thomas Tsai is working on the improvement of partclone. Lukas, Please send us gprof results you have. Thanks. Steven. On 2010/4/14 下午 02:43, Lukas Grässlin wrote: Regarding the perfmance of partclone: Look at the on-the-fly performance Thread in this mailing list. Partclone does some odd things which slow down the speed. You can improve this by saying not to use the gui. (I think this is in the expert options). But it stills does stupid things, like calculating the speed too often which resultes in high cpu load. Regards, Lukas On 14.04.2010 06:39, Jorge Fábregas wrote: Hello Steven, I've been using Clonezilla happily for more than 2 years and I always used the custom options and specifically partimage as the cloning tool. Since partimage seems to be a dead project (and no support for ext4) and considering that Clonezilla uses partclone as the default option I decided to use this. My observation was that partclone takes some more time. When it started saving the partition, I wasn't sure what it was doing. There was some progress indicator (percentage) (Generating bitmap..) and I after that it started again another progress indicator (I guess the actual creation of the image). I'm a bit confused about these 2 steps as soon as partclone starts. Any tip will be appreciated. (just curious). Thanks for Clonezillla. Best regards, Jorge -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live -- Lukas Grässlin Collax GmbH . Basler Str. 115a . 79115 Freiburg . Germany p: +49 (0) 89-990 157-23 Collax - Simply Linux. Geschäftsführer: Boris Nalbach AG München HRB 158898 * Ust.-IdNr: DE 814464942 diff -Nur partclone-0.2.8/src/chkimg.c partclone-0.2.8-cx-patched/src/chkimg.c --- partclone-0.2.8/src/chkimg.c2010-03-29 10:25:04.0 +0200 +++ partclone-0.2.8-cx-patched/src/chkimg.c 2010-04-13 15:08:00.0 +0200 @@ -327,7 +327,7 @@ log_mesg(0, 1, 1, debug, read errno = %i \n, errno); /// read crc32 code and check it. -crc_ck = crc32(crc_ck, buffer, r_size); +crc_ck = crc32(crc_ck, buffer, r_size, opt); crc_buffer = (char*)malloc(CRC_SIZE); ///alloc a memory to copy data if(crc_buffer == NULL){ log_mesg(0, 1, 1, debug, %s, %i, ERROR:%s, __func__, __LINE__, strerror(errno)); @@ -347,7 +347,7 @@
Re: [Clonezilla-live] Partclone vs Partimage
On Wednesday 14 April 2010 09:44:55 Steven Shiau wrote: Did you try 1.2.5-1? Wow! I tried 1.2.5-2 today and it was about 200% faster! Here are the test results: For both tests, I used the following: - partition image backup to SSH server thru Gigabit link - Filessytem: ext3 - Device size: 58 GB - Space in use: 3.5 GB - Block size: 4096 bytes - size in MB to split partition image: 100 (to avoid split) - Compression on image: none - the rest of settings were default ones For the above scenario, the times were: a) Using clonezilla-live-1.2.4-28-686.iso, it took 8 minutes and 5 seconds b) Using clonezilla-live-1.2.5-2.686.iso, it took 2 minutes and 31 seconds The elapsed time above is just after hitting Are you sure ... where you press y until the end of the image creation + hw gathering info output etc, specifically Press Enter to continue Impressive really. Excellent job guys! So when does testing becomes stable. Is it based on some time or is it if it's been there for some time without many people reporting any issues? All the best, Jorge -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live
Re: [Clonezilla-live] Partclone vs Partimage
There is an option -f of partclone which you might be interested to give it try. You can tune it to see if any difference. As I understood the code, -f only affects the time the gui itself would be refreshed, but the update_pui method which also runs calculate_speed anyway is run. If I've time I'll try the older clonezilla live, too. BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's partclone is older, and we might have a regression somewhere... Please let us know the results. Thanks. Regards, Steven. On 14.04.2010 10:33, Steven Shiau wrote: Yes, Thomas Tsai is working on the improvement of partclone. Lukas, Please send us gprof results you have. Thanks. Steven. On 2010/4/14 下午 02:43, Lukas Grässlin wrote: Regarding the perfmance of partclone: Look at the on-the-fly performance Thread in this mailing list. Partclone does some odd things which slow down the speed. You can improve this by saying not to use the gui. (I think this is in the expert options). But it stills does stupid things, like calculating the speed too often which resultes in high cpu load. Regards, Lukas On 14.04.2010 06:39, Jorge Fábregas wrote: Hello Steven, I've been using Clonezilla happily for more than 2 years and I always used the custom options and specifically partimage as the cloning tool. Since partimage seems to be a dead project (and no support for ext4) and considering that Clonezilla uses partclone as the default option I decided to use this. My observation was that partclone takes some more time. When it started saving the partition, I wasn't sure what it was doing. There was some progress indicator (percentage) (Generating bitmap..) and I after that it started again another progress indicator (I guess the actual creation of the image). I'm a bit confused about these 2 steps as soon as partclone starts. Any tip will be appreciated. (just curious). Thanks for Clonezillla. Best regards, Jorge -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live -- Lukas Grässlin Collax GmbH . Basler Str. 115a . 79115 Freiburg . Germany p: +49 (0) 89-990 157-23 Collax - Simply Linux. Geschäftsführer: Boris Nalbach AG München HRB 158898 * Ust.-IdNr: DE 814464942 -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live
Re: [Clonezilla-live] Partclone vs Partimage
Lukas Grässlin wrote: As I understood the code, -f only affects the time the gui itself would be refreshed, but the update_pui method which also runs calculate_speed anyway is run. Thomas, Please make sure the update_pui method which also runs calculate_speed anyway is run. If it's true, I believe this can be improved... Thanks. Steven. -- Steven Shiau steven _at_ nchc org tw steven _at_ stevenshiau org National Center for High-performance Computing, Taiwan. http://www.nchc.org.tw Public Key Server PGP Key ID: 1024D/9762755A Fingerprint: A2A1 08B7 C22C 3D06 34DB F4BC 08B3 E3D7 9762 755A -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live
Re: [Clonezilla-live] Partclone vs Partimage
Lukas Grässlin wrote: On 14.04.2010 16:15, Steven Shiau wrote: Lukas Grässlin wrote: There is an option -f of partclone which you might be interested to give it try. You can tune it to see if any difference. As I understood the code, -f only affects the time the gui itself would be refreshed, but the update_pui method which also runs calculate_speed anyway is run. Thanks. I will check with Thomas, No problem. You can see it e.g. here in restore.c : /// start restore image file to partition for( block_id = 0; block_id image_hdr.totalblock; block_id++ ){ /* doing things, copying the blocks */ update_pui(prog, copied, done); } // end of for I did a patch for myself within I told it just call update_pui once for 5000 blocks. Don't know if its a good idea, but it worked ;) Good, and the performance is? Could you please also send us the patch file? Thanks. Steven. If I've time I'll try the older clonezilla live, too. BTW, maybe you can also give Clonezilla live 1.2.2-14 a try? It's partclone is older, and we might have a regression somewhere... Please let us know the results. Thanks. Regards, Steven. On 14.04.2010 10:33, Steven Shiau wrote: Yes, Thomas Tsai is working on the improvement of partclone. Lukas, Please send us gprof results you have. Thanks. Steven. On 2010/4/14 下午 02:43, Lukas Grässlin wrote: Regarding the perfmance of partclone: Look at the on-the-fly performance Thread in this mailing list. Partclone does some odd things which slow down the speed. You can improve this by saying not to use the gui. (I think this is in the expert options). But it stills does stupid things, like calculating the speed too often which resultes in high cpu load. Regards, Lukas On 14.04.2010 06:39, Jorge Fábregas wrote: Hello Steven, I've been using Clonezilla happily for more than 2 years and I always used the custom options and specifically partimage as the cloning tool. Since partimage seems to be a dead project (and no support for ext4) and considering that Clonezilla uses partclone as the default option I decided to use this. My observation was that partclone takes some more time. When it started saving the partition, I wasn't sure what it was doing. There was some progress indicator (percentage) (Generating bitmap..) and I after that it started again another progress indicator (I guess the actual creation of the image). I'm a bit confused about these 2 steps as soon as partclone starts. Any tip will be appreciated. (just curious). Thanks for Clonezillla. Best regards, Jorge -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live -- Steven Shiau steven _at_ nchc org tw steven _at_ stevenshiau org National Center for High-performance Computing, Taiwan. http://www.nchc.org.tw Public Key Server PGP Key ID: 1024D/9762755A Fingerprint: A2A1 08B7 C22C 3D06 34DB F4BC 08B3 E3D7 9762 755A -- Download Intel#174; Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ Clonezilla-live mailing list Clonezilla-live@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/clonezilla-live