Op 20120928 om 20:38 schreef Rodrigo Abrantes Antunes: > Citando Rodrigo Abrantes Antunes <rodrigoantu...@pelotas.ifsul.edu.br>: > > Citando Geert Stappers <geert.stapp...@vanadgroup.com>: > > Rodrigo Abrantes Antunes: > > > > Director: 5.0.1-1ubuntu1 > > > > Storage: 5.0.1-1ubuntu1 > > > > FD: 5.0.1-1ubuntu1 (some clients have lower version) > > > > Database: mysqI > > > > OS: Ubuntu 10.04.4 x64 Server > > > > FC Storage 4 GBits/s. > > > > All my network is Gigabit Ethernet. > > > > > > Yes, and how is the further design? > > > > > > In others words: The provided list can read as > > > One physical computer with fibre channel disk hosts all the VMs. > > } One physical computer, with fibre channel disk, hosts all the VMs. > > > If it is so, then tell so. Otherwise eloborate the setup, the design. > > > > > > Back to > > > > > > > During a backup I can see bacula-sd using 100% cpu, > > > > > > And where did you see the "100%"? ( Which tool was used to read that > > > performance valule? ) > > > > > > I would like to see the output of > > > > > > vmstat 2 5 > > > > > > during non-back-up-time and also the output of > > > > > > vmstat 2 5 > > > > > > during back-up-time. Thing I'm interrested in, are the CPU columns. > > > Especial the colums "system" and "wait". > > > > > > <screenshot> > > > $ vmstat 2 3 > > > procs -----------memory---------- ---swap-- -----io---- -system-- > > > ----cpu---- > > > r b swpd free buff cache si so bi bo in cs us sy id > > > wa > > > 0 0 6712 11360 192584 159120 0 0 5 4 6 11 5 6 90 > > > 0 > > > 0 0 6712 11344 192584 159120 0 0 0 0 67 342 7 15 79 > > > 0 > > > 0 0 6712 11344 192584 159120 0 0 0 0 65 340 8 14 78 > > > 0 > > > </screenshot> > > > > > > > > > And to avoid an extra e-mail exchange: > > > I'm asking for 2 to the power 3, so 8 measurements. > > > > > > So 2 moments (during backup or outside backup) > > > on 2 Bacula compoments ( storage deamon and file deamon ) on the VMs > > > on 2 physical hosts. > > > > > > Yes, that means that I assume the VMware hosts have a 'vmstat' command. > > > That is because I'm not familair with VMware, I'm from the Xen world :-) > > > > > > > > I have a physical machine that is a Vmware ESX node wich hosts only one vm, > > the one with bacula-director, bacula-sd and bacula-fd (called > > bacula-server), this vm has an RDM with the fibre channel storage where the > > volumes partition is mounted. Then I have all my clients (some are physycal > > machines and others are vms in other ESX nodes) with bacula-fd that are > > backed up. When I manually run a job to backup one of these clients in > > bacula-server I can see (with the command htop) that bacula-sd is using > > 100% of the cpu, I also noted that the backup starts at around 4MB/s and
What I see for the 'htop' over here, is that there seen to be information in the color of cpu usage. It would interresting to see how 100% CPU usage is divide in system, user and I/O wait. > > after some time it is around 300KB/s. If I simple send the same files to be > > backed up with scp for example the transfer goes around 100MB/s. The vms > > don't have vmstat, I use linux own commands. AFAIK is 'vmstat' default installed on every Linux and Unix system. > One thing I noted now, in the vm htop says that 100% cpu is used and actually > the machine is very slow when backing up so I think this value is accurate but > in VSphere Client in the performance chart it says that the vm is using only > 400Mhz of the 5000Mhz that were allocated, but the node cpu usage is low so I > don't know why it isn't aloccating more MHZ to the bacula-server. How VMware allocates CPU cycles to VMs is beyond my current knowledge (and off-topic on the bacula user mailinglist ) > I installed vmstat, I can't do vmstat during non backup time because it is > currently backing up my mail server, about 200gb, it is doing this for almost > 15h: > > vmstat 2 5 during backing-up on the bacula-server (director, storagedaemon) > > procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu---- > r b swpd free buff cache si so bi bo in cs us sy id wa > 3 0 0 16576 15592 1763272 0 0 10 55 2 7 0 8 92 0 > 1 0 0 15916 15592 1763964 0 0 0 0 204 49 1 50 49 0 > 2 0 0 16812 15588 1762996 0 0 0 2 172 72 1 78 21 0 > 2 0 0 17820 15604 1767348 0 0 0 18 193 114 3 66 32 0 > 1 0 0 16296 15604 1769924 0 0 0 0 277 29 0 55 45 0 That is _not_ 100% CPU usage, there was at least 20% idle time. > vmstat 2 5 during backing-up on the physical mail-server (filedaemon) > > procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu---- > r b swpd free buff cache si so bi bo in cs us sy id wa > 0 0 16824 38496 143856 5019424 0 0 45 42 3 4 1 0 98 1 > 0 0 16824 30928 143868 5020004 0 0 336 434 1328 981 1 1 96 2 > 2 0 16824 35844 143868 5020768 0 0 458 116 1121 635 0 1 99 0 > 0 0 16824 32180 143876 5024996 0 0 2060 116 1861 686 0 1 97 2 > 0 0 16824 30192 143912 5026304 0 0 640 521 1505 1032 1 1 86 13 That is even further from 100% CPU usage. The 13% waiting for IO is still far from the IOwait time I was expecting. I think it is an interresting problem, luckly I have allready interresting challenges. Good luck Stappers ------------------------------------------------------------------------------ How fast is your code? 3 out of 4 devs don\\\'t know how their code performs in production. Find out how slow your code is with AppDynamics Lite. http://ad.doubleclick.net/clk;262219672;13503038;z? http://info.appdynamics.com/FreeJavaPerformanceDownload.html _______________________________________________ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
