Re: [Dhis2-devs] some testing of data mart export
Hi all Sorry to be jumping in on this discussion (the genesis of which I know nothing!) but it got me thinking that we should consider developing a couple of uniform performance tests like this one for comparison purposes. This would require that we make use of a standard sample data set. Were you guys using your own data or the sanitized sample data from South Africa? If we use the same data we can start benchmarking and publishing up on the wiki. This kind of information would be really useful for programmers optimizing stuff but also for implementors getting some idea if their configuration is producing reasonable performance. Does anybody know how representative is the existing sample data ie. would it form a good basis for testing? What are the real bottleneck processes to benchmark: 1. startup/initial login time 2. datamart export 3. We can use selenium to automate some of the processes and timing, Regards Bob PS. just re-read and noticed that you are using the SL orgunit. 2009/4/21 joha...@ifi.uio.no: Forwarding mail from Andris Bjornson of Inveneo, who have done some tests on their low-energy computers. Just thought more people would be interested in the results.. Andris, what's the data load of these exports? Original Message Subject: Re: Connecting Inveneo/HISP From: and...@inveneo.org abjorn...@inveneo.org Date: Wed, April 15, 2009 19:41 To: joha...@ifi.uio.no Cc: Eric Blantz e...@inveneo.org jb...@ifi.uio.no Mark Summer mark.sum...@inveneo.org Bob Marsh bob.ma...@inveneo.org -- Hi Johan, Yup I have DHIS2 up and running on two boxes we're comparing performance on: a 1.2GHz, 512MB RAM system, and a dual core Intel Atom 1.6GHz, 2GB RAM system. Your suggestion to use the data mart export made for a very helpful test...thanks! We were actually surprised to see a relatively small performance difference between the two. My initial tests use: export all data elements, all indicators, for the entire Sierra Leone organizational unit for the months of June 2008, July 2008, and August 2008. (I plan to scale up and use more dates later...but it's difficult since I can't automate the timing I have to use a stopwatch and keep an eye on the window to make sure I stop the clock when it finishes.) This takes approximately 6m20s on the single core system, and 5m on the dual core. Does this sound reasonable? We had perhaps expected a greater bump in performance from the more powerful hardware. Thanks again for your help, Andris On Wed, Apr 15, 2009 at 2:05 AM, joha...@ifi.uio.no wrote: Thanks Andris, I've forwarded all the info to the right people. btw, did you manage to get latest DHIS2 up and running on your machines, and with the latest Sierra Leone database? Johan Hi Johan: The following hardware will be used for the demonstration setup: 20W Yingli Solar panel: panel size 610mm x 291mm 2.3kg mounting holes: (see attached YL20W.pdf for mount hole locations marked 'A'...dimensions in mm) holes are rectangular, approx 7mm x 10mm SolarMax Charge Controller + Battery Approx 205mm x 190mm x 390mm Approx 6.5kg Server No larger than 240mm x 240mm x 80mm (let me know if you need mounting info) Inveneo Computing Station Standard 15 LCD with rear mounted computer unit, attached keyboard and mouse 350mm x 350mm x 180mm Base is 180mm circular diameter Asus eeeTop http://usa.asus.com/products.aspx?l1=24l2=169l3=0l4=0model=2290modelmenu=2 PC with integrated widescreen 15.6 touchscreen, attached keyboard 405mm x 330mm x 90mm requires rectangular area 405mm x 160mm table space if using attached stand (See pages 18-19 of attached E4251_Eee_Top_ET16_Series_HW.pdf for mounting info if required) 5 port network swich 200mm x 120mm x 30mm Hope this helps, let me know if you need more info. Thanks, Andris Bjornson On Tue, Apr 14, 2009 at 1:25 PM, Eric Blantz e...@inveneo.org wrote: Johan: We have a very small panel (perhaps 20w) that we prefer for these sort of demos along with a demonstration battery/charge controller. As for Hardware, our computing station takes very little desktop space, as the computer is integrated with the monitor. The server is similarly quite small, especially if standing upright. Andris: can you please locate and provide specific dimensions for all? I won't be in until Thursday. Cheers, Eric Blantz Sr. Director Inveneo (www.inveneo.org) email: eric.bla...@inveneo.org tel: 415-901-1969 x1275 cell: 415-847-1232 AIM/Yahoo/Skype: eblantz fax: 415-449-6073 ... Watch Inveneo in action on CNN
Re: [Dhis2-devs] some testing of data mart export
Hi Johan, Yup I have DHIS2 up and running on two boxes we're comparing performance on: a 1.2GHz, 512MB RAM system, and a dual core Intel Atom 1.6GHz, 2GB RAM system. Your suggestion to use the data mart export made for a very helpful test...thanks! We were actually surprised to see a relatively small performance difference between the two. My initial tests use: export all data elements, all indicators, for the entire Sierra Leone organizational unit for the months of June 2008, July 2008, and August 2008. (I plan to scale up and use more dates later...but it's difficult since I can't automate the timing I have to use a stopwatch and keep an eye on the window to make sure I stop the clock when it finishes.) Hi, just a note: The datamart process logs how much time it takes (see the eg Tomcat log for something like Datamart process completed in ...) This takes approximately 6m20s on the single core system, and 5m on the dual core. Does this sound reasonable? We had perhaps expected a greater bump in performance from the more powerful hardware. Thanks again for your help, Andris On Wed, Apr 15, 2009 at 2:05 AM, joha...@ifi.uio.no wrote: Thanks Andris, I've forwarded all the info to the right people. btw, did you manage to get latest DHIS2 up and running on your machines, and with the latest Sierra Leone database? Johan Hi Johan: The following hardware will be used for the demonstration setup: 20W Yingli Solar panel: panel size 610mm x 291mm 2.3kg mounting holes: (see attached YL20W.pdf for mount hole locations marked 'A'...dimensions in mm) holes are rectangular, approx 7mm x 10mm SolarMax Charge Controller + Battery Approx 205mm x 190mm x 390mm Approx 6.5kg Server No larger than 240mm x 240mm x 80mm (let me know if you need mounting info) Inveneo Computing Station Standard 15 LCD with rear mounted computer unit, attached keyboard and mouse 350mm x 350mm x 180mm Base is 180mm circular diameter Asus eeeTop http://usa.asus.com/products.aspx?l1=24l2=169l3=0l4=0model=2290modelmenu=2 PC with integrated widescreen 15.6 touchscreen, attached keyboard 405mm x 330mm x 90mm requires rectangular area 405mm x 160mm table space if using attached stand (See pages 18-19 of attached E4251_Eee_Top_ET16_Series_HW.pdf for mounting info if required) 5 port network swich 200mm x 120mm x 30mm Hope this helps, let me know if you need more info. Thanks, Andris Bjornson On Tue, Apr 14, 2009 at 1:25 PM, Eric Blantz e...@inveneo.org wrote: Johan: We have a very small panel (perhaps 20w) that we prefer for these sort of demos along with a demonstration battery/charge controller. As for Hardware, our computing station takes very little desktop space, as the computer is integrated with the monitor. The server is similarly quite small, especially if standing upright. Andris: can you please locate and provide specific dimensions for all? I won't be in until Thursday. Cheers, Eric Blantz Sr. Director Inveneo (www.inveneo.org) email: eric.bla...@inveneo.org tel: 415-901-1969 x1275 cell: 415-847-1232 AIM/Yahoo/Skype: eblantz fax: 415-449-6073 ... Watch Inveneo in action on CNN http://www.inveneo.org/?q=CNNPrincipalVoices Subscribe to the Inveneo news feed http://www.inveneo.org/?q=blog/feed On Apr 14, 2009, at 1:17 PM, joha...@ifi.uio.no wrote: Eric and Andris, the design firm that is preparing our stand wonders about the dimensions of any hardware, especially the solar panel. Can you please provide this? Regards, Johan Johan: I'd like to introduce you to Andris, who is one of Inveneo's lead engineers. He'll be working with us to prepare the demo for the May conference and to do the testing we discussed. Please connect with Andris directly as soon as you've located the correct build/ database for us to work with. Cheers, Eric Blantz Sr. Director Inveneo (www.inveneo.org) email: eric.bla...@inveneo.org tel: 415-901-1969 x1275 cell: 415-847-1232 AIM/Yahoo/Skype: eblantz fax: 415-449-6073 ... Watch Inveneo in action on CNN http://www.inveneo.org/?q=CNNPrincipalVoices Subscribe to the Inveneo news feed http://www.inveneo.org/?q=blog/feed -- andris bjornson inveneo project engineer office: +1.415.901.1969x 1215 skype: andris.bjornson yahoo: a_bjornson1 AIM: and...@inveneo.org gTalk:
