Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

entOS, >>>>>>> others Ubuntu) during the academy in August, but did not get much - it >>>>>>> seems most users/providers have found a setup that works for them for >>>>>>> now >>>>>>> and nobody i

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

lts on analytics time with every >>>>>> upgrade / tweak you do - starting with the upgrade to Pg 9.5.4 >>>>>> >>>>>> Best regards >>>>>> Calle >>>>>> >>>>>> On 19 October

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

index statistics (if the shape of your data has changed over >>>>> time, this can make indices run faster). >>>>> >>>>> >>>>> >>>>> I’m new to PostgreSQL, but the core principles are the same, and a >>>>> quick bit

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

gt;>>> >>>>>> Like Brajesh, my background is MySQL, and one database admin task >>>>>> that is often overlooked in MySQL is OPTIMIZE TABLEs. This reclaims >>>>>> unused >>>>>> space (we’ve had 10

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

19 October 2016 at 13:28, Sam Johnson <samuel.john...@qebo.co.uk> >>>>>> wrote: >>>>>> >>>>>>> Hi Neeraj, >>>>>>> >>>>>>> >>>>>>> >>>>>>> *Using VACUUM and ANAL

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

LEs. This reclaims >>>>>> unused >>>>>> space (we’ve had 100Gb databases files drop to half their size) and >>>>>> refreshes index statistics (if the shape of your data has changed over >>>>>> time, this can make indices run fas

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

;>>>> Like Brajesh, my background is MySQL, and one database admin task >>>>>> that is often overlooked in MySQL is OPTIMIZE TABLEs. This reclaims >>>>>> unused >>>>>> space (we’ve had 100Gb databa

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

s run faster). >>>>> >>>>> >>>>> >>>>> I’m new to PostgreSQL, but the core principles are the same, and a >>>>> quick bit of Googling shows that the equivalents in PostgreSQL are the >>>>> VACUUM and ANALYZE co

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

ll literally rewrite all of >>>> your database tables and indices into smaller, more efficient files (note, >>>> however, that on a 500Gb database this could take a *looong* time – >>>> perhaps test on a backup first?). The following forum post is a really >&g

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

500Gb database this could take a *looong* time – perhaps test on a >>> backup first?). The following forum post is a really nice, plain-English >>> explanation of what VACUUM does: >>> >>> http://dba.stackexchange.com/questions/126258/what-is-table- >>>

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

; bloating-in-databases >> >> >> >> As I mentioned, my background is MySQL rather than Postgres, so someone >> with more specific Postgres experience might like to also chime in here. >> >> >> >> Cheers, Sam. >> >>

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

s-table- >> bloating-in-databases >> >> >> >> As I mentioned, my background is MySQL rather than Postgres, so someone >> with more specific Postgres experience might like to also chime in here. >> >> >> >> Cheers, Sam. >> >>

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Dear Sir, I had issues in connecting to PoastgreSQL 9.6 due to HSBC error has that been resolved now. Please let me know. I believe 9.6 can handle parallel queries & will have better handling of vacuum, which might be usesful for large databases as handled by Neeraj. Dr. Sunil Gavaskar

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

=qebo.co.uk@lists. > launchpad.net> on behalf of Brajesh Murari <brajesh.mur...@gmail.com> > *Date: *Wednesday, 19 October 2016 at 08:28 > *To: *Knut Staring <knu...@gmail.com> > *Cc: *DHIS 2 Users list <dhis2-us...@lists.launchpad.net>, DHIS2 > Developers <

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

st <dhis2-us...@lists.launchpad.net>, DHIS2 Developers <dhis2-devs@lists.launchpad.net> Subject: Re: [Dhis2-users] [Dhis2-devs] 25 hours in completing Analytic Hi Neeraj, Using VACUUM and ANALYZE Like Brajesh, my background is MySQL, and one database admin task that is often overlooked in

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

ers list <dhis2-us...@lists.launchpad.net>, DHIS2 Developers <dhis2-devs@lists.launchpad.net> Subject: Re: [Dhis2-users] [Dhis2-devs] 25 hours in completing Analytic Dear Neeraj, The physical database size doesn't matter much, even the number of records don't matter. In my experience the bigg

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Hi Neeraj, not sure about the relevance of this detail: when I upgraded from 9.4 to 9.5 I found out that there was a postgres parameter (wal_buffers) removed from the current DHIS2 implementer's guide (relating to 9.5), which was still in there up to 2.24 (relating to 9.4). Also I had the feeling

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Thanks Knut and Brajesh, Lars we are using 12 Core CPu with SSD and having 48GB RAM but using Postgres 9.4. We will try with Postgres 9.5 now and let you know the results. Do you recommend anything else other than this? Thanks, Neeraj On Wed, Oct 19, 2016 at 12:35 PM, Knut Staring

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Dear Neeraj, The physical database size doesn't matter much, even the number of records don't matter. In my experience the biggest problem that one can going to run in to is not size, but the number of queries you can handle at a time instance specially during analytic functionality execution.

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so perhaps you should try upgrading to 9.5 first. On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland wrote: > > Hi Neeraj, > > what usually helps to improve runtime is to improve/increase: > > - ssd (read

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Thanks Lars, we will give this a try and let you know. How much time do you expect to run for 100 GB database in ideal conditions? Thanks, Neeraj On Wed, Oct 19, 2016 at 12:28 PM, Lars Helge Øverland wrote: > > Hi Neeraj, > > what usually helps to improve runtime is to

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Hi Neeraj, what usually helps to improve runtime is to improve/increase: - ssd (read and write speed) - number of CPUs - using latest postgresql (9.6 claims to have even better indexing performance than 9.5) - tuning

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

Hi Neeraj, what usually helps to improve runtime is: - ssd () - number of CPUs - On Wed, Oct 19, 2016 at 7:13 AM, Neeraj Gupta wrote: > Dear team, > > In one of the Indian state we are using DHIS 2.23 and the database size is > going around 100 GB and once we run