Re: [Dhis2-devs] [DHIS] Updating Program Version

2016-10-19 Thread Archana Chillala
Hi Abyot,

Could you please provide any update on this? Program version gets
incremented by when update button is clicked, even if there are no actual
changes made to the program. Tested this on Play Server as well - 2.25.
It's still the same. Could you please help fix it.

Archana Chillala
Application Developer
Email archa...@thoughtworks.com
Telephone +91 9100960533 <+91+9100960533>
[image: ThoughtWorks]


On Fri, May 20, 2016 at 4:44 PM, Vanya Seth  wrote:

> Hi Abyot
>
> This bug still exists in the latest 2.23 version. Can you please have a
> look at this?
>
> Regards
> Vanya
>
> On Mon, Mar 28, 2016 at 5:53 PM, Archana Chillala <
> archa...@thoughtworks.com> wrote:
>
>> Thanks, Abyot.
>>
>> Archana Chillala
>> Application Developer
>> Email archa...@thoughtworks.com
>> Telephone +91 9100960533 <+91+9100960533>
>> [image: ThoughtWorks]
>> 
>>
>> On Mon, Mar 28, 2016 at 4:48 PM, Abyot Asalefew Gizaw 
>> wrote:
>>
>>> Hi,
>>>
>>> When to increase a version is really tricky - there are lots of
>>> scenarios / changes that trigger or do not trigger version increment.
>>>
>>> For now, we will fix for a program version not to increment when there
>>> is no change at all.
>>>
>>> --
>>> Abyot A. Gizaw.
>>> Senior Engineer, DHIS2
>>> University of Oslo
>>> http://www.dhis2.org
>>>
>>> On Mon, Mar 28, 2016 at 12:48 PM, Archana Chillala <
>>> archa...@thoughtworks.com> wrote:
>>>
 Hi,

 Could you please provide any update on this? Program version gets
 incremented by when update button is clicked, even if there are no actual
 changes made to the program. Currently using DHIS version 2.23.

 Thank you.

 Archana Chillala
 Application Developer
 Email archa...@thoughtworks.com
 Telephone +91 9100960533 <+91+9100960533>
 [image: ThoughtWorks]
 

 On Wed, Mar 16, 2016 at 3:55 PM, Abyot Asalefew Gizaw 
 wrote:

> Hi,
>
> I don't know how this is implemented. Yes, it doesn't make sense to
> bump the version while there is no change in the program.
>
> Otherwise, we need the program version. Even't capture updates its
> cache of programs based on version.
>
>
>
> ---
> Thank you,
> Abyot.
>
> On Wed, Mar 16, 2016 at 10:41 AM, Morten Olav Hansen  > wrote:
>
>> Hi
>>
>> When it comes to the web-api, we do not update the program version
>> for every update. I'm not sure exactly why its being done like that in 
>> the
>> program module.. but I see this comment:
>> program.increaseVersion(); //TODO make more fine-grained
>>
>> So probably they wanted to do something more with it.. Maybe Abyot
>> can shed some light on it? is this version flag in use today? I can see 
>> it
>> being used for doing offline metadata, but then again.. its not very 
>> useful
>> if the version gets updated regardless of any actual changes..
>>
>> On Wed, Mar 16, 2016 at 3:53 PM, Archana Chillala <
>> archa...@thoughtworks.com> wrote:
>>
>>> Hi Morten,
>>>
>>> I am using DHIS version 2.23. In the Program/attributes module, when
>>> we create a program, one of the properties of the program - *Version
>>> -* is automatically assigned a value 1. When we update the program,
>>> the Version value gets incremented by 1 each time. But, even if we do 
>>> not
>>> make any changes to the program and just click update button, the 
>>> program
>>> version still gets incremented by 1.
>>>
>>> Is this the expected functionality? Could you please explain.
>>>
>>>
>>>
>>> *Thanks*
>>>
>>> Archana Chillala
>>> Application Developer
>>> Email archa...@thoughtworks.com
>>> Telephone +91 9100960533 <+91+9100960533>
>>> [image: ThoughtWorks]
>>> 
>>>
>>
>>
>>
>> --
>> Morten
>>
>
>

>>>
>>
>
>
> --
> With Regards
> ThoughtWorks Technologies
> Hyderabad
>
> --Stay Hungry Stay Foolish!!
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] CODE field for Data Set Sections

2016-10-19 Thread Archana Chillala
Hi Lars,

Looks like the new version 2.25 still does not have the CODE field exposed
in the UI of Data Set Sections (as raised on issue #204). Any update on
this?


*Cheers,*

Archana Chillala
Application Developer
Email archa...@thoughtworks.com
Telephone +91 9100960533 <+91+9100960533>
[image: ThoughtWorks]


On Tue, Jul 26, 2016 at 2:54 PM, Lars Helge Øverland  wrote:

> Hi Archana,
>
> yes we can add both code and metadata attributes. (The code field for
> section is actually there in the model so you can use it through the API as
> of now).
>
> I have written issues here:
>
> https://github.com/dhis2/maintenance-app/issues/204
>
> https://blueprints.launchpad.net/dhis2/+spec/metadata-attributes-section
>
>
> Feel free to take these on ;)
>
> regards,
>
> Lars
>
>
>
> On Tue, Jul 26, 2016 at 11:00 AM, Archana Chillala <
> archa...@thoughtworks.com> wrote:
>
>> Hi,
>>
>> For Data Set sections, there is no '*CODE*' field as of now. Also, custom*
>> attributes* cannot be assigned to data set section. Is there any scope
>> of incorporating these in the future, as we need an additional field to
>> store some kind of code for data set sections.
>>
>>
>>
>> *Cheers,*
>>
>> Archana Chillala
>> Application Developer
>> Email archa...@thoughtworks.com
>> Telephone +91 9100960533 <+91+9100960533>
>> [image: ThoughtWorks]
>> 
>>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-devs
>> Post to : dhis2-devs@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-devs
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> Lars Helge Øverland
> Lead developer, DHIS 2
> University of Oslo
> Skype: larshelgeoverland
> l...@dhis2.org
> http://www.dhis2.org 
>
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] DHIS2 Roadmap for time periods

2016-10-19 Thread Archana Chillala
Hi team,

Any information on this would be highly appreciated.

Archana Chillala
Application Developer
Email archa...@thoughtworks.com
Telephone +91 9100960533 <+91+9100960533>
[image: ThoughtWorks]


On Mon, Oct 10, 2016 at 6:04 PM, Archana Chillala  wrote:

> Hi,
>
> We are using DHIS2 and understand that currently data collected weekly
> (always Mon-Sun period shown) is aggregated into months based on whichever
> month the Monday of the week is in. We heard that, on the roadmap, is to
> change this to whichever month >=4 days of the week are in - that is how we
> currently aggregated our weekly data. Is it correct that there is nothing
> else related to week -> month aggregation on the roadmap? We are wondering
> specifically about aggregating weekly data into calendar months using
> proportional allocation of the weekly data *(*that is, if 2 days in the
> week are in Feb and 5 in March, 2/7 of the totals are allocated to Feb
> (likely rounded to whole numbers) and 5/7 allocated to March*)*?
>
>
> Could you please let us know if on the roadmap, is proportional allocation
> of weeks to months, will create calendar months? or months of 4 or 5 weeks?
>
>
>
> *Cheers,*
>
> Archana Chillala
> Application Developer
> Email archa...@thoughtworks.com
> Telephone +91 9100960533 <+91+9100960533>
> [image: ThoughtWorks]
> 
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Neeraj Gupta
Thank you everyone. I will give try to each options you gave and post the
result on the mail.

Thanks,
Neeraj

On Wed, Oct 19, 2016 at 6:46 PM, Calle Hedberg 
wrote:

> Neeraj,
>
> It's always an element of uncertainty linked to database sizes - ref Sam's
> post over. So indicating the number of records you have in the datavalue
> table & key meta-data tables would be useful + indicating whether you are
> running other instances on the same server. Some comments - I've been doing
> a lot of similar optimising work recently:
>
> 1. Upgrading to 9.5.4 is strongly recommended (and don't use 9.6 before
> the worst bugs are fixed and it has stabilised).
>
> 2. Carefully check your postgres.conf against the recommended settings.
> The guide is a bit superficial in the sense that it has recommended "fixed"
> values only and no explanations around ranges below or above those, but you
> can experiment a bit yourself (e.g. the recommended "max_connections = 200"
> might not be sufficient for a really large system like what you have.
>
> 3. If your server is running that single instance only, then 48GB or RAM
> should be sufficient. Our servers are all having 128GB RAM so we
> experimented quite a bit earlier this year with giving a DHIS2 instance
> large amounts or RAM (up to 60-70gb), with negligible impact on
> performance. According to Lars, the DHIS2 cannot really utilize more than
> around 16gb RAM (at least that is how I understood his communication at the
> time). So 48GB should be sufficient for a single instance.
>
> 4. I've been doing performance optimizing recently on an instance with
> - 4-core server with 2x 512gb ssd, 12gb allocated to DHIS2
> - 31,000 Orgunits
> - 420 data elements
> - 250 indicators
> - around 100 mill datavalue records
> - total size around 140gb with analytics tables.
>
> So the size is only 25% of your 500GB, but RUNNING ANALYTICS ON THAT
> DATABASE INSTANCE IS TAKING JUST OVER 1 HOUR. Fundamentally, if the
> analytics engine is designed well, I would expect a nearly linear
> relationship between database size and the time analytics takes to run. So
> running analytics on your database on our server should in theory take 4-5
> hours.
>
> We are obviously comparing oranges and nectarines here, in the sense that
> there might be other aspects of our server and database that is different
> from yours (type of CPU, no of OUs, no of DEs/Indicators, whether your
> instance have lots of tracker data, etc etc). I have not seen any
> scientific/quantified comparative performance values related to specific
> parameters like number of CPUs and/or number of cores, but 12 cores SHOULD
> improve analytics performance quite a bit - assuming around 30% then it
> means running analytics on your database/server should take around 3
> hours..
>
> I tried getting comparative, quantitative data on various configurations
> of hardware and software (e.g. some users prefer CentOS, others Ubuntu)
> during the academy in August, but did not get much - it seems most
> users/providers have found a setup that works for them for now and nobody
> is doing any systematic performance testing (some of the international
> NGOs/companies using DHIS2 might have, but as with internally developed
> apps they are not that keen on sharing). So it would be highly appreciated
> if you would post the results on analytics time with every upgrade / tweak
> you do - starting with the upgrade to Pg 9.5.4
>
> Best regards
> Calle
>
> On 19 October 2016 at 13:28, Sam Johnson 
> wrote:
>
>> Hi Neeraj,
>>
>>
>>
>> *Using VACUUM and ANALYZE*
>>
>>
>>
>> Like Brajesh, my background is MySQL, and one database admin task that is
>> often overlooked in MySQL is OPTIMIZE TABLEs.  This reclaims unused space
>> (we’ve had 100Gb databases files drop to half their size) and refreshes
>> index statistics (if the shape of your data has changed over time, this can
>> make indices run faster).
>>
>>
>>
>> I’m new to PostgreSQL, but the core principles are the same, and a quick
>> bit of Googling shows that the equivalents in PostgreSQL are the VACUUM and
>> ANALYZE commands.  If your database isn’t set to automatically do VACUUMs
>> (the default DHIS2 postgres config doesn’t seem to be), you might want to
>> try VACUUM *FULL*, which will literally rewrite all of your database
>> tables and indices into smaller, more efficient files (note, however, that
>> on a 500Gb database this could take a *looong* time – perhaps test on a
>> backup first?).  The following forum post is a really nice, plain-English
>> explanation of what VACUUM does:
>>
>> http://dba.stackexchange.com/questions/126258/what-is-table-
>> bloating-in-databases
>>
>>
>>
>> As I mentioned, my background is MySQL rather than Postgres, so someone
>> with more specific Postgres experience might like to also chime in here.
>>
>>
>>
>> Cheers, Sam.
>>
>>
>>
>>
>>
>> *From: *Dhis2-users > 

Re: [Dhis2-devs] Data set combination

2016-10-19 Thread Neeraj Gupta
Hi Moses,

Yes this is very much possible. You can have any number of dataelements
with different category combinations in single dataset.
You can refer to
https://dhis2.github.io/dhis2-docs/master/en/implementer/html/ch03s03.html#d0e304
for designing datasets.

Thanks,
Neeraj

On Thu, Oct 20, 2016 at 5:32 AM, moses mwale  wrote:

> Is it possible to combine under a single Data set a dataElement with a
> combination Sex(male-female) and a dataElement with default combination?
>
> --
> developer_lusaka_systems
>
> ___
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to : dhis2-devs@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 
Thanks,
Neeraj Gupta
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] Data set combination

2016-10-19 Thread moses mwale
Is it possible to combine under a single Data set a dataElement with a
combination Sex(male-female) and a dataElement with default combination?

-- 
developer_lusaka_systems
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Dr. Sunil Gavaskar ParthaSarathy
Dear Sir,

I had issues in connecting to PoastgreSQL 9.6 due to HSBC error has that been 
resolved now. Please let me know. 

I believe 9.6 can handle parallel queries & will have better handling of 
vacuum, which might be usesful for large databases as handled by Neeraj.

Dr. Sunil Gavaskar ParthaSarathy. M.B., B.S., D.A.,
Medical Officer
Tamil Nadu Health Systems Project

Sent from my iPhone

> On 19-Oct-2016, at 12:28 PM, Lars Helge Øverland  wrote:
> 
> 
> Hi Neeraj,
> 
> what usually helps to improve runtime is to improve/increase:
> 
> - ssd (read and write speed)
> - number of CPUs
> - using latest postgresql (9.6 claims to have even better indexing 
> performance than 9.5)
> - tuning of postgresql
> 
> 
> regards,
> 
> Lars
> 
> 
> 
> -- 
> Lars Helge Øverland
> Lead developer, DHIS 2
> University of Oslo
> Skype: larshelgeoverland
> l...@dhis2.org
> http://www.dhis2.org
> 
> ___
> Mailing list: https://launchpad.net/~dhis2-users
> Post to : dhis2-us...@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] Program indicators and attributes

2016-10-19 Thread Olav Poppe
Great, thanks!

Olav


> 19. okt. 2016 kl. 15.31 skrev Markus Bekken :
> 
> Hey again Olav,
> this is fixed in the latest 2.24, and shortly in 2.25 and master.
> 
> Markus
> 
>> 19. okt. 2016 kl. 00.36 skrev Markus Bekken :
>> 
>> Hey Olav.
>> Thanks for reporting. Reproduced this, will fix and get back to you.
>> 
>> Markus
>> 
>>> 18. okt. 2016 kl. 18.56 skrev Olav Poppe :
>>> 
>>> Hi devs, we’re having problems making a program indicator that attributes 
>>> in the filter, using 2.24. We’ve tried different types of attributes 
>>> (number, option sets), but none of them work. Looking at the web console, 
>>> those with text-type attributes becomes '' and numeric becomes 0. Any 
>>> advice? See screenshots.
>>> 
>>> Regards
>>> Olav
>>> 
>>> >> 17.38.37.png>
>>> ___
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to : dhis2-devs@lists.launchpad.net
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>> 
> 


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] Link to download Dhis 2.22 rev 22060

2016-10-19 Thread Matthieu Pinard
Perfect :)

Matthieu Pinard
DHIS2 Core Team | University of Oslo

On 19 October 2016 at 17:25, Guy Ekani  wrote:

> Thank you all,
>
> Matthieu, i got some trouble with charts on our dashboard : the chart is
> being properly shown now in the data visualizer app, it is still not being
> rendered in the dashboards (where we just got the message "No Series items
> selected").
>
> the following war has solved my problem : https://www.dhis2.org/download
> /releases/2.22/dhis.war
>
>
>
>
> On Wed, Oct 19, 2016 at 4:16 PM, Michael Mwebaze <
> michael.mweb...@gmail.com> wrote:
>
>> Hi Matthieu,
>>
>> Try the link below:
>>
>> http://ci.dhis2.org/job/dhis2-2.22/
>>
>> Regards,
>>
>> Michael
>>
>> On 19 October 2016 at 11:04, Matthieu Pinard  wrote:
>>
>>> Hi Guy,
>>>
>>> any particular reason fo you to ask for this specific rev rather than
>>> the latest one of 222?
>>>
>>> Cheers,
>>> Matthieu
>>>
>>> Matthieu Pinard
>>> DHIS2 Core Team | University of Oslo
>>>
>>> On 19 October 2016 at 16:12, Guy Ekani  wrote:
>>>
 Hello Team,

 Please could someone can share the link for downloading Dhis 2.22 rev
 22060

 Sincerely,

 --
 =
 EKANI Guy


 ___
 Mailing list: https://launchpad.net/~dhis2-devs
 Post to : dhis2-devs@lists.launchpad.net
 Unsubscribe : https://launchpad.net/~dhis2-devs
 More help   : https://help.launchpad.net/ListHelp


>>>
>>> ___
>>> Mailing list: https://launchpad.net/~dhis2-users
>>> Post to : dhis2-us...@lists.launchpad.net
>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>
>
>
> --
> =
> EKANI Guy
>
>
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] Link to download Dhis 2.22 rev 22060

2016-10-19 Thread Guy Ekani
Thank you all,

Matthieu, i got some trouble with charts on our dashboard : the chart is
being properly shown now in the data visualizer app, it is still not being
rendered in the dashboards (where we just got the message "No Series items
selected").

the following war has solved my problem :
https://www.dhis2.org/download/releases/2.22/dhis.war




On Wed, Oct 19, 2016 at 4:16 PM, Michael Mwebaze 
wrote:

> Hi Matthieu,
>
> Try the link below:
>
> http://ci.dhis2.org/job/dhis2-2.22/
>
> Regards,
>
> Michael
>
> On 19 October 2016 at 11:04, Matthieu Pinard  wrote:
>
>> Hi Guy,
>>
>> any particular reason fo you to ask for this specific rev rather than the
>> latest one of 222?
>>
>> Cheers,
>> Matthieu
>>
>> Matthieu Pinard
>> DHIS2 Core Team | University of Oslo
>>
>> On 19 October 2016 at 16:12, Guy Ekani  wrote:
>>
>>> Hello Team,
>>>
>>> Please could someone can share the link for downloading Dhis 2.22 rev
>>> 22060
>>>
>>> Sincerely,
>>>
>>> --
>>> =
>>> EKANI Guy
>>>
>>>
>>> ___
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to : dhis2-devs@lists.launchpad.net
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to : dhis2-us...@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>


-- 
=
EKANI Guy
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] Link to download Dhis 2.22 rev 22060

2016-10-19 Thread Michael Mwebaze
Hi Matthieu,

Try the link below:

http://ci.dhis2.org/job/dhis2-2.22/

Regards,

Michael

On 19 October 2016 at 11:04, Matthieu Pinard  wrote:

> Hi Guy,
>
> any particular reason fo you to ask for this specific rev rather than the
> latest one of 222?
>
> Cheers,
> Matthieu
>
> Matthieu Pinard
> DHIS2 Core Team | University of Oslo
>
> On 19 October 2016 at 16:12, Guy Ekani  wrote:
>
>> Hello Team,
>>
>> Please could someone can share the link for downloading Dhis 2.22 rev
>> 22060
>>
>> Sincerely,
>>
>> --
>> =
>> EKANI Guy
>>
>>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-devs
>> Post to : dhis2-devs@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-devs
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
> ___
> Mailing list: https://launchpad.net/~dhis2-users
> Post to : dhis2-us...@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] Link to download Dhis 2.22 rev 22060

2016-10-19 Thread Matthieu Pinard
Hi Guy,

any particular reason fo you to ask for this specific rev rather than the
latest one of 222?

Cheers,
Matthieu

Matthieu Pinard
DHIS2 Core Team | University of Oslo

On 19 October 2016 at 16:12, Guy Ekani  wrote:

> Hello Team,
>
> Please could someone can share the link for downloading Dhis 2.22 rev 22060
>
> Sincerely,
>
> --
> =
> EKANI Guy
>
>
> ___
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to : dhis2-devs@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] [Bug 1625143] Re: The role/authority ‘Search tracked entity in all Org Units’ is not working, and even with this authority, a search will return only tracked entity instances that are re

2016-10-19 Thread Sam Johnson
PPS - should we still be reporting bugs here on Launchpad, or should we
now register them on Github?

-- 
You received this bug notification because you are a member of DHIS 2
developers, which is subscribed to DHIS.
https://bugs.launchpad.net/bugs/1625143

Title:
  The role/authority ‘Search tracked entity in all Org Units’  is not
  working, and even with this authority, a search will return only
  tracked entity instances that are registered/enrolled within user's
  own assigned org units

Status in DHIS:
  New

Bug description:
  Hi all,

  The ‘search tracked entity instance in all Org Units’ authority
  doesn’t appear to be working in 2.24 – see section 26.2 of the 2.24
  User Guide for details of this authority.  (This feature has been
  documented for quite some time now, but I haven’t yet had a chance to
  check whether or not it’s working in earlier versions of DHIS2.)  Even
  after being given a role containing this authority, users do not
  appear to be able to search for tracked entity instances outside of
  their assigned ‘data capture’ Org Units.

  
  To reproduce this in the 2.24 stable demo:

  1. While logged in as ‘Admin’, go to ‘Tracker Capture’, select ‘MNCH /
  PNC (Adult Woman)’, and select the Njandama MCHP org unit.

  2. Type ‘Sarah’ in the search box – it should return a record for
  Sarah Thompson registered at Ngelehun CHC.

  3. Go to the User app, and update the role ‘MNCH / PNC (Adult Woman) program’ 
to include the following authorities:
  - Add/update tracked entity data value
  - Add/update tracked entity instance
  - Delete tracked entity data value
  - Delete tracked entity instance
  - Search tracked entity instance
  - Search tracked entity instance in All Org Units
  - See browser cache cleaner module
  - See dashboard integration module
  - See Tracker Capture Module

  4. Create a new user with just this role, and give it only the
  Njandama MCHP Org Unit.

  5. Log out and back in again with this new user.

  6. Go to ‘Tracker Capture’, select the Njandama MCHP Org Unit (it
  should be the only one showing), and select the ‘MNCH / PNC’ program.

  7. Type ‘Sarah’ in the search box – no records are returned; click to
  show ‘detailed search’, and only the Njandama Org Unit is showing
  (rather than the wider OU tree mentioned in the documentation),
  meaning this user is not able to search for tracked entity instances
  registered/enrolled at Ngelehun CHC.

  
  Tested on DHIS2 2.24 stable demo (revision fff20a3); Chrome version 
53.0.2785.116 (64-bit); Mac OSX 10.11.6 (15G1004)

To manage notifications about this bug go to:
https://bugs.launchpad.net/dhis2/+bug/1625143/+subscriptions

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] [Bug 1625143] Re: The role/authority ‘Search tracked entity in all Org Units’ is not working, and even with this authority, a search will return only tracked entity instances that are re

2016-10-19 Thread Sam Johnson
Hi Abyot,

When you say “users have no control”, do you mean admin users, or data
capture users?

My understanding is that admin users can control this by having
different roles, and only giving the relevant ones this authority.  They
would only assign the role if they want enforce users to being able to
search all tracked entity instances – eg they want to avoid the same
patient ending up with duplicate records in different regions, simply
because one region’s users weren’t able to find the other region’s
original patient record.  (For us, ensuring everyone shares a single
patient record is very important.)

And data capture users should still have control over their searches –
even if they’re given this authority, they can still go into advanced
search, and use the tree to narrow down the tree of all org units to
just show patients from a particular district or facility.

I think it’s really useful keeping this authority – it is effectively a
shortcut which saves admins from having to individually assign each user
the top-level org unit as a ‘search org unit’ (and making this a role
rather than a user-by-user setting will reduce the number of manual
setup errors, which will in turn reduce the risk of duplicate tracked
entity instances).  It also makes managing security much easier/safer –
if there’s a role that we decide shouldn’t be able to search all
patients after all, we can just remove this authority from that role;
without this authority, we’d have to go into potentially hundreds of
individual user records, manually re-assigning each user’s ‘search org
units’ to match their data capture org units.

>From my perspective, the current design is actually quite good – it just
needs this bug fixed.

Cheers, Sam.

PS – the one tiny tweak I’d suggest would be to move the ‘search org
units’ setting to the same place as the ‘data capture org units’ and the
‘data output org units’, ie the user management screen, so we can see
them all side-by-side (which is important, because my understanding is
that in the absence of a specific ‘search org units’ setting, DHIS2 will
use the ‘data capture org units’ by default).

-- 
You received this bug notification because you are a member of DHIS 2
developers, which is subscribed to DHIS.
https://bugs.launchpad.net/bugs/1625143

Title:
  The role/authority ‘Search tracked entity in all Org Units’  is not
  working, and even with this authority, a search will return only
  tracked entity instances that are registered/enrolled within user's
  own assigned org units

Status in DHIS:
  New

Bug description:
  Hi all,

  The ‘search tracked entity instance in all Org Units’ authority
  doesn’t appear to be working in 2.24 – see section 26.2 of the 2.24
  User Guide for details of this authority.  (This feature has been
  documented for quite some time now, but I haven’t yet had a chance to
  check whether or not it’s working in earlier versions of DHIS2.)  Even
  after being given a role containing this authority, users do not
  appear to be able to search for tracked entity instances outside of
  their assigned ‘data capture’ Org Units.

  
  To reproduce this in the 2.24 stable demo:

  1. While logged in as ‘Admin’, go to ‘Tracker Capture’, select ‘MNCH /
  PNC (Adult Woman)’, and select the Njandama MCHP org unit.

  2. Type ‘Sarah’ in the search box – it should return a record for
  Sarah Thompson registered at Ngelehun CHC.

  3. Go to the User app, and update the role ‘MNCH / PNC (Adult Woman) program’ 
to include the following authorities:
  - Add/update tracked entity data value
  - Add/update tracked entity instance
  - Delete tracked entity data value
  - Delete tracked entity instance
  - Search tracked entity instance
  - Search tracked entity instance in All Org Units
  - See browser cache cleaner module
  - See dashboard integration module
  - See Tracker Capture Module

  4. Create a new user with just this role, and give it only the
  Njandama MCHP Org Unit.

  5. Log out and back in again with this new user.

  6. Go to ‘Tracker Capture’, select the Njandama MCHP Org Unit (it
  should be the only one showing), and select the ‘MNCH / PNC’ program.

  7. Type ‘Sarah’ in the search box – no records are returned; click to
  show ‘detailed search’, and only the Njandama Org Unit is showing
  (rather than the wider OU tree mentioned in the documentation),
  meaning this user is not able to search for tracked entity instances
  registered/enrolled at Ngelehun CHC.

  
  Tested on DHIS2 2.24 stable demo (revision fff20a3); Chrome version 
53.0.2785.116 (64-bit); Mac OSX 10.11.6 (15G1004)

To manage notifications about this bug go to:
https://bugs.launchpad.net/dhis2/+bug/1625143/+subscriptions

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] Program indicators and attributes

2016-10-19 Thread Markus Bekken
Hey again Olav,
this is fixed in the latest 2.24, and shortly in 2.25 and master.

Markus

> 19. okt. 2016 kl. 00.36 skrev Markus Bekken :
> 
> Hey Olav.
> Thanks for reporting. Reproduced this, will fix and get back to you.
> 
> Markus
> 
>> 18. okt. 2016 kl. 18.56 skrev Olav Poppe :
>> 
>> Hi devs, we’re having problems making a program indicator that attributes in 
>> the filter, using 2.24. We’ve tried different types of attributes (number, 
>> option sets), but none of them work. Looking at the web console, those with 
>> text-type attributes becomes '' and numeric becomes 0. Any advice? See 
>> screenshots.
>> 
>> Regards
>> Olav
>> 
>> > 17.38.37.png>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-devs
>> Post to : dhis2-devs@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-devs
>> More help   : https://help.launchpad.net/ListHelp
> 


___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] Link to download Dhis 2.22 rev 22060

2016-10-19 Thread Guy Ekani
Hello Team,

Please could someone can share the link for downloading Dhis 2.22 rev 22060

Sincerely,

-- 
=
EKANI Guy
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] [Bug 1625143] Re: The role/authority ‘Search tracked entity in all Org Units’ is not working, and even with this authority, a search will return only tracked entity instances that are re

2016-10-19 Thread Abyot Asalefew Gizaw
Hi Sam,

Yes, technically a bug. However, a solution we see from our side is to
remove "Search tracked entity instances in all org units" authority.

The problem with this authority is that, once assigned, users have no
control when to use it or not. It doesn't make sense to list all
patients in a country whose name contains an "a" for example.

With our new approach - assigning search organisation unit - users can
control the search scope. By default, there is no difference as the root
orgunit is used for searching. But users can narrow down the search by
selecting a lower level orgunit

-- 
You received this bug notification because you are a member of DHIS 2
developers, which is subscribed to DHIS.
https://bugs.launchpad.net/bugs/1625143

Title:
  The role/authority ‘Search tracked entity in all Org Units’  is not
  working, and even with this authority, a search will return only
  tracked entity instances that are registered/enrolled within user's
  own assigned org units

Status in DHIS:
  New

Bug description:
  Hi all,

  The ‘search tracked entity instance in all Org Units’ authority
  doesn’t appear to be working in 2.24 – see section 26.2 of the 2.24
  User Guide for details of this authority.  (This feature has been
  documented for quite some time now, but I haven’t yet had a chance to
  check whether or not it’s working in earlier versions of DHIS2.)  Even
  after being given a role containing this authority, users do not
  appear to be able to search for tracked entity instances outside of
  their assigned ‘data capture’ Org Units.

  
  To reproduce this in the 2.24 stable demo:

  1. While logged in as ‘Admin’, go to ‘Tracker Capture’, select ‘MNCH /
  PNC (Adult Woman)’, and select the Njandama MCHP org unit.

  2. Type ‘Sarah’ in the search box – it should return a record for
  Sarah Thompson registered at Ngelehun CHC.

  3. Go to the User app, and update the role ‘MNCH / PNC (Adult Woman) program’ 
to include the following authorities:
  - Add/update tracked entity data value
  - Add/update tracked entity instance
  - Delete tracked entity data value
  - Delete tracked entity instance
  - Search tracked entity instance
  - Search tracked entity instance in All Org Units
  - See browser cache cleaner module
  - See dashboard integration module
  - See Tracker Capture Module

  4. Create a new user with just this role, and give it only the
  Njandama MCHP Org Unit.

  5. Log out and back in again with this new user.

  6. Go to ‘Tracker Capture’, select the Njandama MCHP Org Unit (it
  should be the only one showing), and select the ‘MNCH / PNC’ program.

  7. Type ‘Sarah’ in the search box – no records are returned; click to
  show ‘detailed search’, and only the Njandama Org Unit is showing
  (rather than the wider OU tree mentioned in the documentation),
  meaning this user is not able to search for tracked entity instances
  registered/enrolled at Ngelehun CHC.

  
  Tested on DHIS2 2.24 stable demo (revision fff20a3); Chrome version 
53.0.2785.116 (64-bit); Mac OSX 10.11.6 (15G1004)

To manage notifications about this bug go to:
https://bugs.launchpad.net/dhis2/+bug/1625143/+subscriptions

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Bug 1625143] Re: The role/authority ‘Search tracked entity in all Org Units’ is not working, and even with this authority, a search will return only tracked entity instances that are

2016-10-19 Thread Abyot Asalefew Gizaw
Hi Sam,

Yes, technically a bug. However, a solution we see from our side is to
remove "Search tracked entity instances in all org units" authority.

The problem with this authority is that, once assigned, users have no
control when to use it or not. It doesn't make sense to list all patients
in a country whose name contains an "a" for example.

With our new approach - assigning search organisation unit - users can
control the search scope. By default, there is no difference as the root
orgunit is used for searching. But users can narrow down the search by
selecting a lower level orgunit.

--
Abyot A. Gizaw.
Senior Engineer, DHIS2
University of Oslo
http://www.dhis2.org

On Tue, Oct 18, 2016 at 3:18 PM, Sam Johnson 
wrote:

> Hi Abyot,
>
> On reflection, I think this might still be a bug after all.
>
> If you can assign search org units to users, then why would the
> authority 'Search tracked entity instances in all org units' even exist?
> The very name of that authority seems to imply that it should override
> any specific assignments, and allow users to search _all_ tracked entity
> instances.
>
> My guess, looking at how these features have been named, is that the
> functionality should ideally work as follows:
> 1. By default, users can only search in their Data Capture org units (just
> as, by default, they can only see analytics for their Data Capture org
> units);
> 2. This can be overridden by assigning wider/specific Search org units (in
> the same way that you can assign wider/specific Data Output org units).
> 3. For searching, both of these assignments can be overridden by giving
> the user a role with the 'Search tracked entity instances in all org units'
> authority, which (as the documentation states and the authority name
> implies) gives you the same Search permissions as the ALL authority, and
> removes the need for specifying Search org unit assignments on a
> user-by-user basis.
>
> I'm thinking through our own (very typical) use case, which is that we
> want all users to be able to share a common list of patients (tracked
> entity instances) across a DHIS2 instance, while still only being able
> to record events for their own org unit.  Having to individually assign
> (and maintain) Search org units for each one of dozens/hundreds of users
> would be a logistical nightmare, whereas if the feature works as
> specified above (and as the documentation states), we can easily just
> add this authority into the role we set up for the program.  :-)
>
> I'd be very grateful for your feedback on this, and whether or not you
> would be happy to still keep this open as a bug.
>
> Many thanks, Sam.
>
> --
> You received this bug notification because you are a member of DHIS 2
> developers, which is subscribed to DHIS.
> https://bugs.launchpad.net/bugs/1625143
>
> Title:
>   The role/authority ‘Search tracked entity in all Org Units’  is not
>   working, and even with this authority, a search will return only
>   tracked entity instances that are registered/enrolled within user's
>   own assigned org units
>
> Status in DHIS:
>   New
>
> Bug description:
>   Hi all,
>
>   The ‘search tracked entity instance in all Org Units’ authority
>   doesn’t appear to be working in 2.24 – see section 26.2 of the 2.24
>   User Guide for details of this authority.  (This feature has been
>   documented for quite some time now, but I haven’t yet had a chance to
>   check whether or not it’s working in earlier versions of DHIS2.)  Even
>   after being given a role containing this authority, users do not
>   appear to be able to search for tracked entity instances outside of
>   their assigned ‘data capture’ Org Units.
>
>
>   To reproduce this in the 2.24 stable demo:
>
>   1. While logged in as ‘Admin’, go to ‘Tracker Capture’, select ‘MNCH /
>   PNC (Adult Woman)’, and select the Njandama MCHP org unit.
>
>   2. Type ‘Sarah’ in the search box – it should return a record for
>   Sarah Thompson registered at Ngelehun CHC.
>
>   3. Go to the User app, and update the role ‘MNCH / PNC (Adult Woman)
> program’ to include the following authorities:
>   - Add/update tracked entity data value
>   - Add/update tracked entity instance
>   - Delete tracked entity data value
>   - Delete tracked entity instance
>   - Search tracked entity instance
>   - Search tracked entity instance in All Org Units
>   - See browser cache cleaner module
>   - See dashboard integration module
>   - See Tracker Capture Module
>
>   4. Create a new user with just this role, and give it only the
>   Njandama MCHP Org Unit.
>
>   5. Log out and back in again with this new user.
>
>   6. Go to ‘Tracker Capture’, select the Njandama MCHP Org Unit (it
>   should be the only one showing), and select the ‘MNCH / PNC’ program.
>
>   7. Type ‘Sarah’ in the search box – no records are returned; click to
>   show ‘detailed search’, and only the Njandama Org Unit is showing
>   (rather than the wider OU tree mentioned in the 

Re: [Dhis2-devs] XML import bug

2016-10-19 Thread Sam Johnson
Hi Viet,

This fix looks like it has worked – the whole program XML is now importing 
smoothly into my 2.25 instance.  Many thanks for sorting this out so quickly!  ☺

Cheers, Sam.

From: Viet Nguyen 
Date: Wednesday, 19 October 2016 at 05:16
To: Sam Johnson 
Cc: DHIS2 Developers 
Subject: Re: [Dhis2-devs] XML import bug

Hi Sam,

I have applied a fix for this issue on 2.25

Please try again.

Regards,


On Tue, Oct 18, 2016 at 12:23 PM, Viet Nguyen 
> wrote:
Hi Sam,

Can you try to  use the full object name "dataElementCategoryCombo" instead of 
"categoryCombo" and try again. It works on my local.

Need more investigation to understand why the short name does not work though.

Regards.



On Mon, Oct 17, 2016 at 9:55 PM, Sam Johnson 
> wrote:
Hi Devs,

The problem I reported yesterday has actually turned out to be what I think is 
a new bug in 2.25, which is stopping XML imports for data elements.

No matter what I do, any attempt at an XML import of data elements seems to 
throw the error “DataElementCategoryCombo Missing required property 
`categoryCombo`”, even if a valid CategoryCombo is supplied.  The same XML 
import works fine in 2.21.

To reproduce on play.dhis2.org:

• Using the import/export module, do an XML export of data elements 
only.

• Delete all data elements from the XML except DE_1148614 (which uses 
the default CategoryCombo), and change the user of that data element to .

• To circumvent a couple of other export/import bugs:
1. delete the three ‘<’ characters (which have been exported as plaintext 
instead of )
2. delete the  tags (I have no idea why these tags are failing)

• Import this XML file back into play.dhis2.org.

The import fails, and the import summary has the error message 
“DataElementCategoryCombo Missing required property `categoryCombo`” – despite 
the fact that the data element has the default categoryCombo id.

I’ve attached the XML I extracted from play.dhis2.org to 
speed up testing.  I’d be very grateful if you could look into this urgently, 
as I can’t currently do XML imports into my 2.25 instance.

Many thanks,

Sam.


From: Dhis2-devs 
>
 on behalf of Sam Johnson 
>
Date: Monday, 17 October 2016 at 04:54
To: DHIS2 Developers 
>
Cc: Rodolfo Melia 
>
Subject: [Dhis2-devs] FW: Null pointer exception calling .../api/me/programs

Hi all,

I’m trying to produce a generic EventCapture XML config that can be imported 
into any DHIS2 instance, which requires the data elements and program to use 
the default CategoryCombo of the target instance.

My understanding from the documentation (and the email thread below) is that if 
the CategoryCombo for a data element is null, then during metadata import the 
data element will automatically be assigned the local ‘default’ CategoryCombo; 
the problem is that I can’t figure out how to represent this ‘null’ 
CategoryCombo in the XML. I’ve tried:

• simply removing all  tags from the data elements in 
the XML;

• using ;

• using 

• using .

In 2.25, all of these throw the error “DataElementCategoryCombo Missing 
required property `categoryCombo`”…  How can I get these data elements to take 
on the local ‘default’ CategoryCombo as the XML is loaded?

Many thanks for any help anyone is able to give!

Regards, Sam.



From: Dhis2-devs 
>
 on behalf of Rodolfo Melia >
Date: Monday, 9 May 2016 at 09:37
To: Lars Helge Øverland >
Cc: Adebusoye Anifalaje >, 
DHIS2 Developers 
>, JM 
Alcantara >
Subject: Re: [Dhis2-devs] Null pointer exception calling .../api/me/programs

Noted - we look forward to get a resolution to the setting of CatCombo to 
'default' in 2.22 soon - we import hundred of new data elements to our servers 
every week, and many of the templates out there have that column null. This was 
not a problem in 2.20.

R


On 9 May 2016 at 09:24, Lars Helge Øverland 
> wrote:


On Mon, May 9, 2016 at 10:23 AM, Rodolfo Melia 
> wrote:
Hi - I just want to confirm that I'm getting my 

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Calle Hedberg
Neeraj,

It's always an element of uncertainty linked to database sizes - ref Sam's
post over. So indicating the number of records you have in the datavalue
table & key meta-data tables would be useful + indicating whether you are
running other instances on the same server. Some comments - I've been doing
a lot of similar optimising work recently:

1. Upgrading to 9.5.4 is strongly recommended (and don't use 9.6 before the
worst bugs are fixed and it has stabilised).

2. Carefully check your postgres.conf against the recommended settings. The
guide is a bit superficial in the sense that it has recommended "fixed"
values only and no explanations around ranges below or above those, but you
can experiment a bit yourself (e.g. the recommended "max_connections = 200"
might not be sufficient for a really large system like what you have.

3. If your server is running that single instance only, then 48GB or RAM
should be sufficient. Our servers are all having 128GB RAM so we
experimented quite a bit earlier this year with giving a DHIS2 instance
large amounts or RAM (up to 60-70gb), with negligible impact on
performance. According to Lars, the DHIS2 cannot really utilize more than
around 16gb RAM (at least that is how I understood his communication at the
time). So 48GB should be sufficient for a single instance.

4. I've been doing performance optimizing recently on an instance with
- 4-core server with 2x 512gb ssd, 12gb allocated to DHIS2
- 31,000 Orgunits
- 420 data elements
- 250 indicators
- around 100 mill datavalue records
- total size around 140gb with analytics tables.

So the size is only 25% of your 500GB, but RUNNING ANALYTICS ON THAT
DATABASE INSTANCE IS TAKING JUST OVER 1 HOUR. Fundamentally, if the
analytics engine is designed well, I would expect a nearly linear
relationship between database size and the time analytics takes to run. So
running analytics on your database on our server should in theory take 4-5
hours.

We are obviously comparing oranges and nectarines here, in the sense that
there might be other aspects of our server and database that is different
from yours (type of CPU, no of OUs, no of DEs/Indicators, whether your
instance have lots of tracker data, etc etc). I have not seen any
scientific/quantified comparative performance values related to specific
parameters like number of CPUs and/or number of cores, but 12 cores SHOULD
improve analytics performance quite a bit - assuming around 30% then it
means running analytics on your database/server should take around 3
hours..

I tried getting comparative, quantitative data on various configurations of
hardware and software (e.g. some users prefer CentOS, others Ubuntu) during
the academy in August, but did not get much - it seems most users/providers
have found a setup that works for them for now and nobody is doing any
systematic performance testing (some of the international NGOs/companies
using DHIS2 might have, but as with internally developed apps they are not
that keen on sharing). So it would be highly appreciated if you would post
the results on analytics time with every upgrade / tweak you do - starting
with the upgrade to Pg 9.5.4

Best regards
Calle

On 19 October 2016 at 13:28, Sam Johnson  wrote:

> Hi Neeraj,
>
>
>
> *Using VACUUM and ANALYZE*
>
>
>
> Like Brajesh, my background is MySQL, and one database admin task that is
> often overlooked in MySQL is OPTIMIZE TABLEs.  This reclaims unused space
> (we’ve had 100Gb databases files drop to half their size) and refreshes
> index statistics (if the shape of your data has changed over time, this can
> make indices run faster).
>
>
>
> I’m new to PostgreSQL, but the core principles are the same, and a quick
> bit of Googling shows that the equivalents in PostgreSQL are the VACUUM and
> ANALYZE commands.  If your database isn’t set to automatically do VACUUMs
> (the default DHIS2 postgres config doesn’t seem to be), you might want to
> try VACUUM *FULL*, which will literally rewrite all of your database
> tables and indices into smaller, more efficient files (note, however, that
> on a 500Gb database this could take a *looong* time – perhaps test on a
> backup first?).  The following forum post is a really nice, plain-English
> explanation of what VACUUM does:
>
> http://dba.stackexchange.com/questions/126258/what-is-
> table-bloating-in-databases
>
>
>
> As I mentioned, my background is MySQL rather than Postgres, so someone
> with more specific Postgres experience might like to also chime in here.
>
>
>
> Cheers, Sam.
>
>
>
>
>
> *From: *Dhis2-users  launchpad.net> on behalf of Brajesh Murari 
> *Date: *Wednesday, 19 October 2016 at 08:28
> *To: *Knut Staring 
> *Cc: *DHIS 2 Users list , DHIS2
> Developers 
> *Subject: *Re: [Dhis2-users] [Dhis2-devs] 25 hours in completing Analytic

Re: [Dhis2-devs] [Dhis2-users] dhis version 2.25 is released

2016-10-19 Thread Michael Mwebaze
Hi Brajesh,

You can get the code on Github,

https://github.com/dhis2/dhis2-core/

You can also get the latest builds and other information from

http://ci.dhis2.org/job/dhis2-2.25/

Regards,

Michael

On 19 October 2016 at 01:05, Brajesh Murari 
wrote:

> Hello Devs,
>
> I have one question in my mind, that where i can find DHIS2.25 code on
> launchpad.net ?
>
> On Mon, Oct 17, 2016 at 9:02 PM, vunda limbe  wrote:
>
>> Good news! look a way to test and upgrade.
>> Thanks for Dev Team
>>
>> 2016-10-14 9:24 GMT+01:00 riddy ndoma :
>>
>>> Great!
>>>
>>> 2016-10-14 8:52 GMT+01:00 GROUT, Lise :
>>>
 Congratulations to all the team!



 Really looking forward to diving into this version 2.25!



 All the team deserves a nice and long week-end!



 Lise.



 *From:* Dhis2-users [mailto:dhis2-users-bounces+groutl=
 who@lists.launchpad.net] *On Behalf Of *Lars Helge Øverland
 *Sent:* 13 October 2016 12:51
 *To:* DHIS 2 Users list; DHIS 2 Developers list
 *Subject:* [Dhis2-users] dhis version 2.25 is released





 Hi all,



 DHIS version 2.25 is out with a lot of new features, apps and
 improvements.



 *Log in with admin/district on the **demo*
 * system.*





 ANALYTICS FEATURES

 ---



 *External map layers:* The GIS app now supports TMS (Tile Map
 Service), XYZ and WMS (Web Map Service) layers. These are all popular
 protocols for map data and there are numerous map services available,
 allowing you to display maps for rivers, roads, weather, land data and
 everything else. External map layers can be set up from the Maintenance
 app, and then be accessed from the top bar in the GIS app.



 Docs GIS
 
 | Docs setup
 
 | Screenshot 1
 
 | Sc 2
 
 | Sc 3
 
 | Sc Setup
 
 | Demo 1
 
 | Demo 2
 



 *Push analysis*: You can now push data analysis in the form of
 reports, charts and maps to your users over email. This allows for
 improving awareness and visibility of your data, and can encourage people
 to more actively look at analysis. Push analysis is based on dashboards,
 and can be set up, run and scheduled from the Maintenance app. You can also
 run immediately and preview from the the context menu.



 Docs
 
 | Screenshot 1
 
 | Sc 2
 
 | Demo
 



 *Indicator as filter:* A single indicator or data set reporting rate
 can now be used as filter in charts and pivots. This allow you to create
 charts for example with multiple periods and organisation units.



 Docs
 
 | Screenshot
 
 | Demo
 



 *Dashboard translations:* The names of dashboards can now be
 translated, meaning you can have dashboard names appear in user’s local
 language.



 Docs
 
 | Screenshot
 



 *Deep linking of favorites:* When opening favorites in the Pivot Table
 and Visualizer apps, the browser address bar URL will reflect the current
 favorite. This allows for 

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Sam Johnson
One other point to mention: if you do try runing VACUUM FULL, you should do it 
before running the analytics (ie on your initial 100Gb database, not the 500Gb 
database you end up with after running the analytics), as my guess is that the 
DHIS2 analytics tables are dropped and re-created anyway, so there wouldn’t be 
any point in VACUUMing them.

Cheers, Sam.


From: Dhis2-users 
 on behalf 
of Sam Johnson 
Date: Wednesday, 19 October 2016 at 12:28
To: DHIS 2 Users list , DHIS2 Developers 

Subject: Re: [Dhis2-users] [Dhis2-devs] 25 hours in completing Analytic

Hi Neeraj,

Using VACUUM and ANALYZE

Like Brajesh, my background is MySQL, and one database admin task that is often 
overlooked in MySQL is OPTIMIZE TABLEs.  This reclaims unused space (we’ve had 
100Gb databases files drop to half their size) and refreshes index statistics 
(if the shape of your data has changed over time, this can make indices run 
faster).

I’m new to PostgreSQL, but the core principles are the same, and a quick bit of 
Googling shows that the equivalents in PostgreSQL are the VACUUM and ANALYZE 
commands.  If your database isn’t set to automatically do VACUUMs (the default 
DHIS2 postgres config doesn’t seem to be), you might want to try VACUUM FULL, 
which will literally rewrite all of your database tables and indices into 
smaller, more efficient files (note, however, that on a 500Gb database this 
could take a looong time – perhaps test on a backup first?).  The following 
forum post is a really nice, plain-English explanation of what VACUUM does:
http://dba.stackexchange.com/questions/126258/what-is-table-bloating-in-databases

As I mentioned, my background is MySQL rather than Postgres, so someone with 
more specific Postgres experience might like to also chime in here.

Cheers, Sam.


From: Dhis2-users 
 on behalf 
of Brajesh Murari 
Date: Wednesday, 19 October 2016 at 08:28
To: Knut Staring 
Cc: DHIS 2 Users list , DHIS2 Developers 

Subject: Re: [Dhis2-users] [Dhis2-devs] 25 hours in completing Analytic

Dear Neeraj,

The physical database size doesn't matter much, even the number of records 
don't matter. In my experience the biggest problem that one can going to run in 
to is not size, but the number of queries you can handle at a time instance 
specially during analytic functionality execution. Most probably you should 
going to have to move to a master/slave configuration of your database, so that 
the read queries can run against the slaves and the write queries run against 
the master. However, if you and your database management team are not ready for 
this than, you can tweak your indexes for the queries you are running to speed 
up the response times. Also there is a lot of tweaking you can do to the 
network stack and kernel in Linux where MySQL Server has been installed that 
will help.Perhaps, I would focus first on your indexes, then have a server 
admin look at your OS, and if all that doesn't help it might be time to 
implement a master/slave configuration. The most important scalability factor 
is RAM. If the indexes of your tables fit into memory and your queries are 
highly optimized in analytic functionality, you can serve a reasonable amount 
of requests with a average machine. The number of records do matter, depending 
of how your tables look like. It's a difference to have a lot of varchar fields 
or only a couple of ints or longs. The physical size of the database matters as 
well,  think of backups, for instance. Depending on your engine, your physical 
db files on grow, but don't shrink, for instance with innodb. So deleting a lot 
of rows, doesn't help to shrink your physical files. Thus the database size 
does matter. If you have more than one table with more than a million records, 
then performance starts indeed to degrade. Indexig is one of the important 
stand need to take care, If you hit one million records you will get 
performance problems, if the indices are not set right (for example no indices 
for fields in "WHERE statements" or "ON conditions" in joins). If you hit 10 
million records, you will start to get performance problems even if you have 
all your indices right. Hardware upgrades - adding more memory and more 
processor power, especially memory - often help to reduce the most severe 
problems by increasing the performance again, at least to a certain degree.

On Wed, Oct 19, 2016 at 12:35 PM, Knut Staring 
> wrote:
Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so 
perhaps you should try upgrading to 9.5 first.

On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland 

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Sam Johnson
Hi Neeraj,

Using VACUUM and ANALYZE

Like Brajesh, my background is MySQL, and one database admin task that is often 
overlooked in MySQL is OPTIMIZE TABLEs.  This reclaims unused space (we’ve had 
100Gb databases files drop to half their size) and refreshes index statistics 
(if the shape of your data has changed over time, this can make indices run 
faster).

I’m new to PostgreSQL, but the core principles are the same, and a quick bit of 
Googling shows that the equivalents in PostgreSQL are the VACUUM and ANALYZE 
commands.  If your database isn’t set to automatically do VACUUMs (the default 
DHIS2 postgres config doesn’t seem to be), you might want to try VACUUM FULL, 
which will literally rewrite all of your database tables and indices into 
smaller, more efficient files (note, however, that on a 500Gb database this 
could take a looong time – perhaps test on a backup first?).  The following 
forum post is a really nice, plain-English explanation of what VACUUM does:
http://dba.stackexchange.com/questions/126258/what-is-table-bloating-in-databases

As I mentioned, my background is MySQL rather than Postgres, so someone with 
more specific Postgres experience might like to also chime in here.

Cheers, Sam.


From: Dhis2-users 
 on behalf 
of Brajesh Murari 
Date: Wednesday, 19 October 2016 at 08:28
To: Knut Staring 
Cc: DHIS 2 Users list , DHIS2 Developers 

Subject: Re: [Dhis2-users] [Dhis2-devs] 25 hours in completing Analytic

Dear Neeraj,

The physical database size doesn't matter much, even the number of records 
don't matter. In my experience the biggest problem that one can going to run in 
to is not size, but the number of queries you can handle at a time instance 
specially during analytic functionality execution. Most probably you should 
going to have to move to a master/slave configuration of your database, so that 
the read queries can run against the slaves and the write queries run against 
the master. However, if you and your database management team are not ready for 
this than, you can tweak your indexes for the queries you are running to speed 
up the response times. Also there is a lot of tweaking you can do to the 
network stack and kernel in Linux where MySQL Server has been installed that 
will help.Perhaps, I would focus first on your indexes, then have a server 
admin look at your OS, and if all that doesn't help it might be time to 
implement a master/slave configuration. The most important scalability factor 
is RAM. If the indexes of your tables fit into memory and your queries are 
highly optimized in analytic functionality, you can serve a reasonable amount 
of requests with a average machine. The number of records do matter, depending 
of how your tables look like. It's a difference to have a lot of varchar fields 
or only a couple of ints or longs. The physical size of the database matters as 
well,  think of backups, for instance. Depending on your engine, your physical 
db files on grow, but don't shrink, for instance with innodb. So deleting a lot 
of rows, doesn't help to shrink your physical files. Thus the database size 
does matter. If you have more than one table with more than a million records, 
then performance starts indeed to degrade. Indexig is one of the important 
stand need to take care, If you hit one million records you will get 
performance problems, if the indices are not set right (for example no indices 
for fields in "WHERE statements" or "ON conditions" in joins). If you hit 10 
million records, you will start to get performance problems even if you have 
all your indices right. Hardware upgrades - adding more memory and more 
processor power, especially memory - often help to reduce the most severe 
problems by increasing the performance again, at least to a certain degree.

On Wed, Oct 19, 2016 at 12:35 PM, Knut Staring 
> wrote:
Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so 
perhaps you should try upgrading to 9.5 first.

On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland 
> wrote:

Hi Neeraj,

what usually helps to improve runtime is to improve/increase:

- ssd (read and write speed)
- number of CPUs
- using latest postgresql (9.6 claims to have even better indexing 
performance than 
9.5)
- 
tuning
 of postgresql


regards,

Lars



--
Lars Helge Øverland
Lead developer, DHIS 2
University of Oslo
Skype: larshelgeoverland
l...@dhis2.org
http://www.dhis2.org


___
Mailing list: 

Re: [Dhis2-devs] GIS Map pluggin Issue

2016-10-19 Thread Priyanka Bawa
Thanks Jan for the help.

Regards
Priyanka Bawa

On Wed, Oct 19, 2016 at 4:43 PM, Jan Henrik Øverland  wrote:

> Hi Priyanka,
>
> 2.21 only supports mouseover events for one layer at the time. When a
> thematic layer is put on top of the boundary layer, that layer will be the
> "active" one. So you are unfortunately not able to do that.
>
> You will have to upgrade to 2.24+ to get this.
>
> Jan
>
> On 19 October 2016 at 12:48, Priyanka Bawa 
> wrote:
>
>> Hi Team
>>
>> Using the GIS plugin for creating maps, is it possible to provide two
>> layers simultaneously in one map? For example,  for the selected countries
>> from organisation unit hierarchy, i want to show 'Thematic Layer 4' and
>> boundary Layer for the non selected countries.
>>
>> I am able to generate such a map but  it doesn't show the country name on
>> hover with boundary layer countries.
>>
>> Any suggestions?
>> I am using DHIS v221.
>>
>> Regards
>> Priyanka Bawa
>>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-devs
>> Post to : dhis2-devs@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-devs
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> Jan Henrik Øverland
> Software developer, DHIS 2
> University of Oslo
> http://www.dhis2.org 
>
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] GIS Map pluggin Issue

2016-10-19 Thread Priyanka Bawa
Hi Team

Using the GIS plugin for creating maps, is it possible to provide two
layers simultaneously in one map? For example,  for the selected countries
from organisation unit hierarchy, i want to show 'Thematic Layer 4' and
boundary Layer for the non selected countries.

I am able to generate such a map but  it doesn't show the country name on
hover with boundary layer countries.

Any suggestions?
I am using DHIS v221.

Regards
Priyanka Bawa
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


[Dhis2-devs] Issue with data monitoring

2016-10-19 Thread Sakibou ALASSANI
Hi all
I face a issue related to data monitoring. as described this message: 
Monitoring process failed, please check the logs. Time: 
2016-10-14T00:00:00.717Z. System: Staging Message: null Cause: And that is 
errors in the log:
* INFO  2016-10-14 00:00:00,002 Starting scheduled monitoring task 
(DefaultValidationRuleService.java [taskScheduler-6])
* INFO  2016-10-14 00:00:00,658 Scheduled monitoring run sources: 3716, 
periods: 4, rules:63, last run: Tue Aug 30 03:38:36 UTC 2016 
(DefaultValidationRuleService.java [taskScheduler-6])
* INFO  2016-10-14 00:00:00,739 'system-process' create 
org.hisp.dhis.message.MessageConversation, name: Monitoring process failed, 
uid: nMoxsKYQEnO (AuditLogUtil.java [taskScheduler-6])
at 
org.hisp.dhis.validation.scheduling.MonitoringTask.run(MonitoringTask.java:85)I 
start removing groups/rules one by one (on staging) to see if the error 
disappears, but nothing. 

DHIS2 version used : 2.20 build : 20033 and 2.24 build : f25d31a

Anyone has experienced this issue.
Regards 
Sakibou 

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] Event Capture 0.5.x - programs not showing up if they have program rules

2016-10-19 Thread Alex Tumwesigye
Dear Araz,

So do you mean that only one user per organisation units can enter data?
How about if I am assigned to the highest level say a district and I am
entering maternal audit events for many facilities (I may be the only one
authorized to access and enter those events since they are sensitive)? In
this case does it mean I need X users for X organisation Units?

Alex

On Wed, Oct 19, 2016 at 11:21 AM, Araz Abishov  wrote:

> Hi Knut, Mugisha
>
> It seems gmail does not allow to send .apk files as attachments (it was
> filtered out in my previous email). I have pushed new release to GitHub,
> where you can download latest .apk file.
>
> Release: https://github.com/dhis2/dhis2-android-
> eventcapture/releases/tag/0.5.6
>
> Mugisha,
>
> That behaviour is intentional. We download only those organization units
> to which user is directly assigned to.
>
> Please, let me know if you have any issues.
>
> Best regards,
>
> —
> Araz Abishov,
> Android developer, DHIS 2
> University of Oslo
> https://www.dhis2.org/
>
> On October 19, 2016 at 12:22:40 AM, Mugisha, Jean F. (
> jm4...@cumc.columbia.edu) wrote:
>
> Hi Araz,
>
> Thank you for the information.
>
> We have had similar issues as described by Sam (program rules). Could you
> please share the updated version with us as well? When will it be released
> on GitHub?
>
> 2nd Issue: I only have access to District Org Units (as options) even
> though my user settings allow access to all sub-district units (facility
> level). Sam have you experienced this issue? Araz is this a known bug?
>
> Please let me know if you have any questions.
>
> Best regards,
>
> Jean Fabius Mugisha
> ICAP - Columbia University
> Mailman School of Public Health
> 60 Haven Ave, Floor B1
> New York, NY 10032
>
>
> On 10/18/16, 9:43 AM, "Dhis2-devs on behalf of Araz Abishov"
>  a...@dhis2.org> wrote:
>
> >Hi Sam,
> >
> >Could you please test updated version of event capture which I have
> >attached to this email?
> >
> >Please, let me know if it does not work for you.
> >
> >Best regards,
> >
> >‹
> >Araz Abishov,
> >Android developer, DHIS 2
> >University of Oslo
> >https://www.dhis2.org/
> >
> >On October 18, 2016 at 12:39:41 PM, Sam Johnson
> >(samuel.john...@qebo.co.uk) wrote:
> >
> >Hi Araz,
> >
> >
> >
> >That¹s great news, many thanks ­ I look forward to testing it as soon as
> >it¹s released. J
> >
> >
> >
> >Cheers, Sam.
> >
> >
> >
> >
> >
> >From: Araz Abishov 
> >Date: Tuesday, 18 October 2016 at 09:34
> >To: Sam Johnson , Alex Tumwesigye
> >, DHIS2 Developers 
>
> >Subject: Re: [Dhis2-devs] Event Capture 0.5.x - programs not showing up
> >if they have program rules
> >
> >
> >
> >Hi Sam,
> >
> >
> >
> >My apologies for slow response.
> >
> >
> >
> >We have already fixed compatibility issues with 2.25 and will release an
> >update today. I will update you as soon as it will be available on
> >GitHub.
> >
> >
> >
> >Best regards,
> >
> >
> >
> >‹
> >
> >Araz Abishov,
> >
> >Android developer, DHIS 2
> >
> >University of Oslo
> >
> >https://www.dhis2.org/
> >
> >
> >
> >On October 18, 2016 at 2:11:20 AM, Sam Johnson
> >(samuel.john...@qebo.co.uk) wrote:
> >
> >Hi Araz/Developers,
> >
> >
> >
> >Just following up on my query below. As per Alex¹s recommendation, I¹ve
> >just had a play with Android Event Capture 0.5.5, and it looks great ­
> >is there a timeline for fixing it (or any version, for that matter) to
> >work with 2.25?
> >
> >
> >
> >Regards, Sam.
> >
> >
> >
> >
> >
> >From: Dhis2-devs
> > on
> >behalf of Sam Johnson 
> >Date: Friday, 14 October 2016 at 12:25
> >To: Alex Tumwesigye , "a...@dhis2.org"
> >, DHIS2 Developers 
> >Subject: [Dhis2-devs] Event Capture 0.5.x - programs not showing up if
> >they have program rules
> >
> >
> >
> >This sender failed our fraud detection checks and may not be who they
> >appear to be. Learn about spoofing
> >
> >Feedback
> >
> >Hi Alex,
> >
> >
> >
> >That¹s great to hear, I¹ll definitely check out 0.5.5, and many thanks
> >also for the heads-up on that bug.
> >
> >
> >
> >We do actually rely on program rules to maintain data integrity in this
> >project, so that¹s a killer for us. But looking at Github, it sounds
> >like the program rules have already been implemented in 0.5.5 ­ so if the
> >problem is just a bug around the visibility of programs with rules,
> >should that be fairly easy to fix? (I do realise the reality may be a
> >little more complex than it sounds!)
> >
> >
> >
> >Devs/Araz, is this bug on your radar?
> >
> >
> >
> >Many thanks, Sam.
> >
> >
> >
> >
> >
> >From: Alex Tumwesigye 
> >Date: Friday, 14 October 2016 at 06:43
> >To: Sam Johnson 

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Uwe Wahser
Hi Neeraj,

not sure about the relevance of this detail: when I upgraded from 9.4 to 9.5 I
found out that there was a postgres parameter (wal_buffers) removed from the
current DHIS2 implementer's guide (relating to 9.5), which was still in there up
to 2.24 (relating to 9.4). Also I had the feeling that during the upgrade
process from 9.4 to 9.5 not all my old changes were migrated by the Ubuntu
upgrader. So better verify your postgresql.conf with the DHIS guide after
upgrading and don't just look for the parameters that are mentioned in the
guide, but also check if there are old parameters left from old configurations,
that are no longer present in the guide.

Upgrading reduced our time for aggregates by a third, but increased the time for
posting dataValues via api. Not yet sure about the reasons as I did an upgrade
from Ubuntu 14.4 to 16.4, PostgreSQL 9.4 to 9.5 and DHIS2.22 to DHIS2.24 at the
same time.

Maybe you also want to consider reading through a thread from last week:
https://lists.launchpad.net/dhis2-users/msg11529.html

Regards, Uwe

> Neeraj Gupta  hat am 19. Oktober 2016 um 10:35
> geschrieben:
> 
> 
> Thanks Knut and Brajesh,
> 
> Lars we are using 12 Core CPu with SSD and having 48GB RAM but using
> Postgres 9.4.
> 
> We will try with Postgres 9.5 now and let you know the results.
> Do you recommend anything else other than this?
> 
> Thanks,
> Neeraj
> 
> On Wed, Oct 19, 2016 at 12:35 PM, Knut Staring  wrote:
> 
> > Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so
> > perhaps you should try upgrading to 9.5 first.
> >
> > On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland 
> > wrote:
> >
> >>
> >> Hi Neeraj,
> >>
> >> what usually helps to improve runtime is to improve/increase:
> >>
> >> - ssd (read and write speed)
> >> - number of CPUs
> >> - using latest postgresql (9.6 claims to have even better indexing
> >> performance 
> >> than 9.5)
> >> - tuning
> >> 
> >> of postgresql
> >>
> >>
> >> regards,
> >>
> >> Lars
> >>
> >>
> >>
> >> --
> >> Lars Helge Øverland
> >> Lead developer, DHIS 2
> >> University of Oslo
> >> Skype: larshelgeoverland
> >> l...@dhis2.org
> >> http://www.dhis2.org 
> >>
> >>
> >> ___
> >> Mailing list: https://launchpad.net/~dhis2-users
> >> Post to : dhis2-us...@lists.launchpad.net
> >> Unsubscribe : https://launchpad.net/~dhis2-users
> >> More help   : https://help.launchpad.net/ListHelp
> >>
> >>
> >
> >
> > --
> > Knut Staring
> > Dept. of Informatics, University of Oslo
> > Norway: +4791880522
> > Skype: knutstar
> > http://dhis2.org
> >
> 
> 
> 
> -- 
> Thanks,
> Neeraj Gupta
> ___
> Mailing list: https://launchpad.net/~dhis2-users
> Post to : dhis2-us...@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] Event Capture 0.5.x - programs not showing up if they have program rules

2016-10-19 Thread Araz Abishov
Hi Knut, Mugisha

It seems gmail does not allow to send .apk files as attachments (it was
filtered out in my previous email). I have pushed new release to GitHub,
where you can download latest .apk file.

Release:
https://github.com/dhis2/dhis2-android-eventcapture/releases/tag/0.5.6

Mugisha,

That behaviour is intentional. We download only those organization units to
which user is directly assigned to.

Please, let me know if you have any issues.

Best regards,

—
Araz Abishov,
Android developer, DHIS 2
University of Oslo
https://www.dhis2.org/

On October 19, 2016 at 12:22:40 AM, Mugisha, Jean F. (
jm4...@cumc.columbia.edu) wrote:

Hi Araz,

Thank you for the information.

We have had similar issues as described by Sam (program rules). Could you
please share the updated version with us as well? When will it be released
on GitHub?

2nd Issue: I only have access to District Org Units (as options) even
though my user settings allow access to all sub-district units (facility
level). Sam have you experienced this issue? Araz is this a known bug?

Please let me know if you have any questions.

Best regards,

Jean Fabius Mugisha
ICAP - Columbia University
Mailman School of Public Health
60 Haven Ave, Floor B1
New York, NY 10032


On 10/18/16, 9:43 AM, "Dhis2-devs on behalf of Araz Abishov"
 wrote:

>Hi Sam,
>
>Could you please test updated version of event capture which I have
>attached to this email?
>
>Please, let me know if it does not work for you.
>
>Best regards,
>
>‹
>Araz Abishov,
>Android developer, DHIS 2
>University of Oslo
>https://www.dhis2.org/
>
>On October 18, 2016 at 12:39:41 PM, Sam Johnson
>(samuel.john...@qebo.co.uk) wrote:
>
>Hi Araz,
>
>
>
>That¹s great news, many thanks ­ I look forward to testing it as soon as
>it¹s released. J
>
>
>
>Cheers, Sam.
>
>
>
>
>
>From: Araz Abishov 
>Date: Tuesday, 18 October 2016 at 09:34
>To: Sam Johnson , Alex Tumwesigye
>, DHIS2 Developers 
>Subject: Re: [Dhis2-devs] Event Capture 0.5.x - programs not showing up
>if they have program rules
>
>
>
>Hi Sam,
>
>
>
>My apologies for slow response.
>
>
>
>We have already fixed compatibility issues with 2.25 and will release an
>update today. I will update you as soon as it will be available on
>GitHub.
>
>
>
>Best regards,
>
>
>
>‹
>
>Araz Abishov,
>
>Android developer, DHIS 2
>
>University of Oslo
>
>https://www.dhis2.org/
>
>
>
>On October 18, 2016 at 2:11:20 AM, Sam Johnson
>(samuel.john...@qebo.co.uk) wrote:
>
>Hi Araz/Developers,
>
>
>
>Just following up on my query below. As per Alex¹s recommendation, I¹ve
>just had a play with Android Event Capture 0.5.5, and it looks great ­
>is there a timeline for fixing it (or any version, for that matter) to
>work with 2.25?
>
>
>
>Regards, Sam.
>
>
>
>
>
>From: Dhis2-devs
> on
>behalf of Sam Johnson 
>Date: Friday, 14 October 2016 at 12:25
>To: Alex Tumwesigye , "a...@dhis2.org"
>, DHIS2 Developers 
>Subject: [Dhis2-devs] Event Capture 0.5.x - programs not showing up if
>they have program rules
>
>
>
>This sender failed our fraud detection checks and may not be who they
>appear to be. Learn about spoofing
>
>Feedback
>
>Hi Alex,
>
>
>
>That¹s great to hear, I¹ll definitely check out 0.5.5, and many thanks
>also for the heads-up on that bug.
>
>
>
>We do actually rely on program rules to maintain data integrity in this
>project, so that¹s a killer for us. But looking at Github, it sounds
>like the program rules have already been implemented in 0.5.5 ­ so if the
>problem is just a bug around the visibility of programs with rules,
>should that be fairly easy to fix? (I do realise the reality may be a
>little more complex than it sounds!)
>
>
>
>Devs/Araz, is this bug on your radar?
>
>
>
>Many thanks, Sam.
>
>
>
>
>
>From: Alex Tumwesigye 
>Date: Friday, 14 October 2016 at 06:43
>To: Sam Johnson 
>Cc: "Laura E. Lincks" , Simon Muyambo
>, DHIS2 Developers 
>Subject: Re: [Dhis2-devs] Event Capture - option set not working
>
>
>
>Dear Sam,
>
>
>
>The 0.5.x are far better than the google play release. We have been
>trying them here in Uganda and they should considered as an option.
>
>
>
>The known issue currently is that the app does not show up the program if
>the program has program rules unless that bug is fixed. But the 0.5.x
>version is worth trying.
>
>
>
>Alex
>
>On Friday, October 14, 2016, Sam Johnson 
>wrote:
>
>Hi all,
>
>
>
>Is there a version of the Event Capture app that works with 2.25? I¹ve
>just tested the official Event Capture Android app 

Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Neeraj Gupta
Thanks Knut and Brajesh,

Lars we are using 12 Core CPu with SSD and having 48GB RAM but using
Postgres 9.4.

We will try with Postgres 9.5 now and let you know the results.
Do you recommend anything else other than this?

Thanks,
Neeraj

On Wed, Oct 19, 2016 at 12:35 PM, Knut Staring  wrote:

> Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so
> perhaps you should try upgrading to 9.5 first.
>
> On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland 
> wrote:
>
>>
>> Hi Neeraj,
>>
>> what usually helps to improve runtime is to improve/increase:
>>
>> - ssd (read and write speed)
>> - number of CPUs
>> - using latest postgresql (9.6 claims to have even better indexing
>> performance 
>> than 9.5)
>> - tuning
>> 
>> of postgresql
>>
>>
>> regards,
>>
>> Lars
>>
>>
>>
>> --
>> Lars Helge Øverland
>> Lead developer, DHIS 2
>> University of Oslo
>> Skype: larshelgeoverland
>> l...@dhis2.org
>> http://www.dhis2.org 
>>
>>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to : dhis2-us...@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> Knut Staring
> Dept. of Informatics, University of Oslo
> Norway: +4791880522
> Skype: knutstar
> http://dhis2.org
>



-- 
Thanks,
Neeraj Gupta
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Brajesh Murari
Dear Neeraj,

The physical database size doesn't matter much, even the number of records
don't matter. In my experience the biggest problem that one can going to
run in to is not size, but the number of queries you can handle at a time
instance specially during analytic functionality execution. Most probably
you should going to have to move to a master/slave configuration of your
database, so that the read queries can run against the slaves and the write
queries run against the master. However, if you and your database
management team are not ready for this than, you can tweak your indexes for
the queries you are running to speed up the response times. Also there is a
lot of tweaking you can do to the network stack and kernel in Linux where
MySQL Server has been installed that will help.Perhaps, I would focus first
on your indexes, then have a server admin look at your OS, and if all that
doesn't help it might be time to implement a master/slave configuration.
The most important scalability factor is RAM. If the indexes of your tables
fit into memory and your queries are highly optimized in analytic
functionality, you can serve a reasonable amount of requests with a average
machine. The number of records do matter, depending of how your tables look
like. It's a difference to have a lot of varchar fields or only a couple of
ints or longs. The physical size of the database matters as well,  think of
backups, for instance. Depending on your engine, your physical db files on
grow, but don't shrink, for instance with innodb. So deleting a lot of
rows, doesn't help to shrink your physical files. Thus the database size
does matter. If you have more than one table with more than a million
records, then performance starts indeed to degrade. Indexig is one of the
important stand need to take care, If you hit one million records you will
get performance problems, if the indices are not set right (for example no
indices for fields in "WHERE statements" or "ON conditions" in joins). If
you hit 10 million records, you will start to get performance problems even
if you have all your indices right. Hardware upgrades - adding more memory
and more processor power, especially memory - often help to reduce the most
severe problems by increasing the performance again, at least to a certain
degree.

On Wed, Oct 19, 2016 at 12:35 PM, Knut Staring  wrote:

> Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so
> perhaps you should try upgrading to 9.5 first.
>
> On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland 
> wrote:
>
>>
>> Hi Neeraj,
>>
>> what usually helps to improve runtime is to improve/increase:
>>
>> - ssd (read and write speed)
>> - number of CPUs
>> - using latest postgresql (9.6 claims to have even better indexing
>> performance 
>> than 9.5)
>> - tuning
>> 
>> of postgresql
>>
>>
>> regards,
>>
>> Lars
>>
>>
>>
>> --
>> Lars Helge Øverland
>> Lead developer, DHIS 2
>> University of Oslo
>> Skype: larshelgeoverland
>> l...@dhis2.org
>> http://www.dhis2.org 
>>
>>
>> ___
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to : dhis2-us...@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> Knut Staring
> Dept. of Informatics, University of Oslo
> Norway: +4791880522
> Skype: knutstar
> http://dhis2.org
>
> ___
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to : dhis2-devs@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 
Best Regards,

Brajesh Murari,
Postgraduate, Department of Computer Science and Engineering,
Chaudhary Devi Lal University, Sirsa,
India.

The three basic dimensions of human development: a long and healthy life,
access to knowledge, and a decent standard of living.
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Knut Staring
Just a heads-up that there seems to be a JDBC issue with Postgres 9.6, so
perhaps you should try upgrading to 9.5 first.

On Wed, Oct 19, 2016 at 8:58 AM, Lars Helge Øverland  wrote:

>
> Hi Neeraj,
>
> what usually helps to improve runtime is to improve/increase:
>
> - ssd (read and write speed)
> - number of CPUs
> - using latest postgresql (9.6 claims to have even better indexing
> performance 
> than 9.5)
> - tuning
> 
> of postgresql
>
>
> regards,
>
> Lars
>
>
>
> --
> Lars Helge Øverland
> Lead developer, DHIS 2
> University of Oslo
> Skype: larshelgeoverland
> l...@dhis2.org
> http://www.dhis2.org 
>
>
> ___
> Mailing list: https://launchpad.net/~dhis2-users
> Post to : dhis2-us...@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 
Knut Staring
Dept. of Informatics, University of Oslo
Norway: +4791880522
Skype: knutstar
http://dhis2.org
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Neeraj Gupta
Thanks Lars, we will give this a try and let you know.
How much time do you expect to run for 100 GB database in ideal conditions?

Thanks,
Neeraj

On Wed, Oct 19, 2016 at 12:28 PM, Lars Helge Øverland 
wrote:

>
> Hi Neeraj,
>
> what usually helps to improve runtime is to improve/increase:
>
> - ssd (read and write speed)
> - number of CPUs
> - using latest postgresql (9.6 claims to have even better indexing
> performance 
> than 9.5)
> - tuning
> 
> of postgresql
>
>
> regards,
>
> Lars
>
>
>
> --
> Lars Helge Øverland
> Lead developer, DHIS 2
> University of Oslo
> Skype: larshelgeoverland
> l...@dhis2.org
> http://www.dhis2.org 
>
>


-- 
Thanks,
Neeraj Gupta
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Lars Helge Øverland
Hi Neeraj,

what usually helps to improve runtime is to improve/increase:

- ssd (read and write speed)
- number of CPUs
- using latest postgresql (9.6 claims to have even better indexing
performance 
than 9.5)
- tuning

of postgresql


regards,

Lars



-- 
Lars Helge Øverland
Lead developer, DHIS 2
University of Oslo
Skype: larshelgeoverland
l...@dhis2.org
http://www.dhis2.org 
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


Re: [Dhis2-devs] [Dhis2-users] 25 hours in completing Analytic

2016-10-19 Thread Lars Helge Øverland
Hi Neeraj,

what usually helps to improve runtime is:

- ssd ()
- number of CPUs
-




On Wed, Oct 19, 2016 at 7:13 AM, Neeraj Gupta  wrote:

> Dear team,
>
> In one of the Indian state we are using DHIS 2.23 and the database size is
> going around 100 GB and once we run analytic it reaches to 500 GB and
> analytic is taking around 25 hours to complete. We are using Postgres 9.4.
>
> Has anyone experienced the situation with 100 GB database or more?
> How did you deal with the time of analytic, Is there any way so that the
> time of analytic can be reduced?
>
> --
> Thanks,
> Neeraj Gupta
>
> ___
> Mailing list: https://launchpad.net/~dhis2-users
> Post to : dhis2-us...@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 
Lars Helge Øverland
Lead developer, DHIS 2
University of Oslo
Skype: larshelgeoverland
l...@dhis2.org
http://www.dhis2.org 
___
Mailing list: https://launchpad.net/~dhis2-devs
Post to : dhis2-devs@lists.launchpad.net
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp