Re: [Dhis2-users] Data Loss
Dear Juan, Furthermore, for another district "Bonthe" with organisation units (Bendu Cha, BMC, Bum Dema, Imperi, Jong, Kpanda Kemoh, Kwamabai Krim, Nongoba Bullum, Sittia, Sogbini, Yawbeko) From the query again, hmis=# SELECT period.startdate, period.enddate, organisationunit.name, count(datavalue.sourceid) FROM datavalue, period, organisationunit hmis-# WHERE datavalue.periodid = period.periodid AND datavalue.sourceid = organisationunit.organisationunitid hmis-# AND datavalue.dataelementid IN (SELECT dataelementid FROM dataelement WHERE uid IN hmis(# ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) hmis-# AND datavalue.sourceid IN (SELECT organisationunitid FROM organisationunit WHERE uid in ('WBbZ4IsR4fJ','KuGGNmQRNRG','ZNSxAuPYkmc','bAfHAdToWpH','JGXzvo6cui0','qgKbTso4uxs','BwLuMFCgNXY','gbBGavOWAOJ','pxCSw2YnJkG','eqvAT82OSZK','Rftqk5lhju2','bSeyZOqAPAo')) hmis-# GROUP BY period.startdate, period.enddate, organisationunit.name, datavalue.sourceid; startdate | enddate | name | count ++--+--- 2013-11-01 | 2013-11-30 | BMC | 6 (1 row) Please help me; i need to know why this is happening. As you can see we had been loosing data for quit awhile now on those data elements. On 9/7/15, gerald thomaswrote: > Dear Juan, > Sorry about the time lapse for this subject but i am currently in the > field trying to understand why we are having the data loss. One of our > district "Pujehun" is currently facing this issue. The data entry > clerk said he had successfully entered information for 2 months: > January & February and partially for March 2015 for one of his > organisation unit "Barri" which has the following sub organisation > units ( Bandasuma CHC, Konia MCHP, Njaluahun CHP, Potoru CHC, Saahun > (barri) MCHP, Tambeyama MCHP, Taninahun MCHP, Vaama MCHP, Waiima > MCHP). Barri and its sub-organisation unit have information for > February and March 2015 as per the following data elements: suspected > malaria; total head counts all services, etc but not January 2015. > > Using the query you gave me the last time i discovered the following: > > SELECT period.startdate, period.enddate, organisationunit.name, > count(datavalue.sourceid) FROM datavalue, period, organisationunit > WHERE datavalue.periodid = period.periodid AND datavalue.sourceid = > organisationunit.organisationunitid > AND datavalue.dataelementid IN (SELECT dataelementid FROM dataelement > WHERE uid IN > ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) > AND datavalue.sourceid IN (SELECT organisationunitid FROM > organisationunit WHERE uid in > ('TTcxkf1OGPx','BCnDvAuxUou','r6XG4nxlNxn','BKIrj3yjYJT','bqquAB6z7lS','xZGdhrCZjTn','hOQQ0w4iYio','qHuVAR7RvCa','qHuVAR7RvCa')) > GROUP BY period.startdate, period.enddate, organisationunit.name, > datavalue.sourceid; > > > > startdate | enddate |name | count > ++-+--- > 2014-09-01 | 2014-09-30 | Tambeyama MCHP |19 > 2013-02-01 | 2013-02-28 | Konia MCHP |19 > 2011-07-01 | 2011-07-31 | Njaluahun CHP |22 > 2013-10-01 | 2013-10-31 | Bandasuma CHC |33 > 2014-11-01 | 2014-11-30 | Tambeyama MCHP |20 > 2011-05-01 | 2011-05-31 | Taninahun MCHP |21 > 2011-11-01 | 2011-11-30 | Potoru CHC |24 > 2014-01-01 | 2014-01-31 | Saahun (barri) MCHP |12 > 2012-09-01 | 2012-09-30 | Bandasuma CHC |26 > 2011-08-01 | 2011-08-31 | Konia MCHP |20 > 2012-08-01 | 2012-08-31 | Njaluahun CHP |21 > 2013-01-01 | 2013-01-31 | Saahun (barri) MCHP | 5 > 2011-05-01 | 2011-05-31 | Tambeyama MCHP |14 > 2014-11-01 | 2014-11-30 | Taninahun MCHP |28 > 2013-12-01 | 2013-12-31 | Konia MCHP |22 > 2014-09-01 | 2014-09-30 | Taninahun MCHP |28 > 2015-02-01 | 2015-02-28 | Saahun (barri) MCHP |22 > 2013-05-01 | 2013-05-31 | Taninahun MCHP |20 > 2012-10-01 | 2012-10-31 | Potoru CHC |26 > 2012-03-01 | 2012-03-31 | Bandasuma CHC |22 > 2011-04-01 | 2011-04-30 | Tambeyama MCHP |13 > 2012-05-01 | 2012-05-31 | Tambeyama MCHP |20 > 2014-08-01 | 2014-08-31 | Tambeyama MCHP |20 > 2013-07-01 | 2013-07-31 | Bandasuma CHC |10 > 2013-02-01 | 2013-02-28 | Vaama MCHP |20 > 2015-03-01 | 2015-03-31 | Taninahun MCHP |33 > 2014-07-01 | 2014-07-31 | Bandasuma CHC |28 > 2014-05-01 | 2014-05-31 | Bandasuma CHC |33 > 2012-07-01 | 2012-07-31 | Tambeyama MCHP |20 > 2011-12-01 | 2011-12-31 |
Re: [Dhis2-users] Data Loss
Hello Gerald Have you checked the sharing settings of those data elements? Ir your users are not allowed to use those data elements the system will allow the data entry storing the information offline. Regards, JM El 07/09/2015, a las 02:51, gerald thomasescribió: > Dear Juan, > Furthermore, for another district "Bonthe" with organisation units > (Bendu Cha, BMC, Bum > Dema, Imperi, Jong, Kpanda Kemoh, Kwamabai Krim, Nongoba Bullum, > Sittia, Sogbini, Yawbeko) > > From the query again, > hmis=# SELECT period.startdate, period.enddate, organisationunit.name, > count(datavalue.sourceid) FROM datavalue, period, organisationunit > hmis-# WHERE datavalue.periodid = period.periodid AND > datavalue.sourceid = organisationunit.organisationunitid > hmis-# AND datavalue.dataelementid IN (SELECT dataelementid FROM > dataelement WHERE uid IN > hmis(# > ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) > hmis-# AND datavalue.sourceid IN (SELECT organisationunitid FROM > organisationunit WHERE uid in > ('WBbZ4IsR4fJ','KuGGNmQRNRG','ZNSxAuPYkmc','bAfHAdToWpH','JGXzvo6cui0','qgKbTso4uxs','BwLuMFCgNXY','gbBGavOWAOJ','pxCSw2YnJkG','eqvAT82OSZK','Rftqk5lhju2','bSeyZOqAPAo')) > hmis-# GROUP BY period.startdate, period.enddate, > organisationunit.name, datavalue.sourceid; > startdate | enddate | name | count > ++--+--- > 2013-11-01 | 2013-11-30 | BMC | 6 > (1 row) > > Please help me; i need to know why this is happening. As you can see > we had been loosing data for quit awhile now on those data elements. > > On 9/7/15, gerald thomas wrote: >> Dear Juan, >> Sorry about the time lapse for this subject but i am currently in the >> field trying to understand why we are having the data loss. One of our >> district "Pujehun" is currently facing this issue. The data entry >> clerk said he had successfully entered information for 2 months: >> January & February and partially for March 2015 for one of his >> organisation unit "Barri" which has the following sub organisation >> units ( Bandasuma CHC, Konia MCHP, Njaluahun CHP, Potoru CHC, Saahun >> (barri) MCHP, Tambeyama MCHP, Taninahun MCHP, Vaama MCHP, Waiima >> MCHP). Barri and its sub-organisation unit have information for >> February and March 2015 as per the following data elements: suspected >> malaria; total head counts all services, etc but not January 2015. >> >> Using the query you gave me the last time i discovered the following: >> >> SELECT period.startdate, period.enddate, organisationunit.name, >> count(datavalue.sourceid) FROM datavalue, period, organisationunit >> WHERE datavalue.periodid = period.periodid AND datavalue.sourceid = >> organisationunit.organisationunitid >> AND datavalue.dataelementid IN (SELECT dataelementid FROM dataelement >> WHERE uid IN >> ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) >> AND datavalue.sourceid IN (SELECT organisationunitid FROM >> organisationunit WHERE uid in >> ('TTcxkf1OGPx','BCnDvAuxUou','r6XG4nxlNxn','BKIrj3yjYJT','bqquAB6z7lS','xZGdhrCZjTn','hOQQ0w4iYio','qHuVAR7RvCa','qHuVAR7RvCa')) >> GROUP BY period.startdate, period.enddate, organisationunit.name, >> datavalue.sourceid; >> >> >> >> startdate | enddate |name | count >> ++-+--- >> 2014-09-01 | 2014-09-30 | Tambeyama MCHP |19 >> 2013-02-01 | 2013-02-28 | Konia MCHP |19 >> 2011-07-01 | 2011-07-31 | Njaluahun CHP |22 >> 2013-10-01 | 2013-10-31 | Bandasuma CHC |33 >> 2014-11-01 | 2014-11-30 | Tambeyama MCHP |20 >> 2011-05-01 | 2011-05-31 | Taninahun MCHP |21 >> 2011-11-01 | 2011-11-30 | Potoru CHC |24 >> 2014-01-01 | 2014-01-31 | Saahun (barri) MCHP |12 >> 2012-09-01 | 2012-09-30 | Bandasuma CHC |26 >> 2011-08-01 | 2011-08-31 | Konia MCHP |20 >> 2012-08-01 | 2012-08-31 | Njaluahun CHP |21 >> 2013-01-01 | 2013-01-31 | Saahun (barri) MCHP | 5 >> 2011-05-01 | 2011-05-31 | Tambeyama MCHP |14 >> 2014-11-01 | 2014-11-30 | Taninahun MCHP |28 >> 2013-12-01 | 2013-12-31 | Konia MCHP |22 >> 2014-09-01 | 2014-09-30 | Taninahun MCHP |28 >> 2015-02-01 | 2015-02-28 | Saahun (barri) MCHP |22 >> 2013-05-01 | 2013-05-31 | Taninahun MCHP |20 >> 2012-10-01 | 2012-10-31 | Potoru CHC |26 >> 2012-03-01 | 2012-03-31 | Bandasuma CHC |22 >> 2011-04-01 | 2011-04-30 | Tambeyama MCHP |13 >> 2012-05-01 | 2012-05-31 | Tambeyama MCHP |20 >> 2014-08-01 | 2014-08-31 | Tambeyama MCHP
Re: [Dhis2-users] Data Loss
Dear All, Any help with reference to the information i had provided? Please help me with ever necessary so that we could fixed this issue. Ola & Knut, If i want to remove all limitations (minimum and maximum) per data elements; what the procedures? Secondly, how can i disable dataset locked permanently? Because even when we unlock dataset; it is still saying dataset is lock. Thanks in advance for your cooperation. On 9/7/15, gerald thomaswrote: > Dear Juan, > Furthermore, for another district "Bonthe" with organisation units > (Bendu Cha, BMC, Bum > Dema, Imperi, Jong, Kpanda Kemoh, Kwamabai Krim, Nongoba Bullum, > Sittia, Sogbini, Yawbeko) > > From the query again, > hmis=# SELECT period.startdate, period.enddate, organisationunit.name, > count(datavalue.sourceid) FROM datavalue, period, organisationunit > hmis-# WHERE datavalue.periodid = period.periodid AND > datavalue.sourceid = organisationunit.organisationunitid > hmis-# AND datavalue.dataelementid IN (SELECT dataelementid FROM > dataelement WHERE uid IN > hmis(# > ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) > hmis-# AND datavalue.sourceid IN (SELECT organisationunitid FROM > organisationunit WHERE uid in > ('WBbZ4IsR4fJ','KuGGNmQRNRG','ZNSxAuPYkmc','bAfHAdToWpH','JGXzvo6cui0','qgKbTso4uxs','BwLuMFCgNXY','gbBGavOWAOJ','pxCSw2YnJkG','eqvAT82OSZK','Rftqk5lhju2','bSeyZOqAPAo')) > hmis-# GROUP BY period.startdate, period.enddate, > organisationunit.name, datavalue.sourceid; > startdate | enddate | name | count > ++--+--- > 2013-11-01 | 2013-11-30 | BMC | 6 > (1 row) > > Please help me; i need to know why this is happening. As you can see > we had been loosing data for quit awhile now on those data elements. > > On 9/7/15, gerald thomas wrote: >> Dear Juan, >> Sorry about the time lapse for this subject but i am currently in the >> field trying to understand why we are having the data loss. One of our >> district "Pujehun" is currently facing this issue. The data entry >> clerk said he had successfully entered information for 2 months: >> January & February and partially for March 2015 for one of his >> organisation unit "Barri" which has the following sub organisation >> units ( Bandasuma CHC, Konia MCHP, Njaluahun CHP, Potoru CHC, Saahun >> (barri) MCHP, Tambeyama MCHP, Taninahun MCHP, Vaama MCHP, Waiima >> MCHP). Barri and its sub-organisation unit have information for >> February and March 2015 as per the following data elements: suspected >> malaria; total head counts all services, etc but not January 2015. >> >> Using the query you gave me the last time i discovered the following: >> >> SELECT period.startdate, period.enddate, organisationunit.name, >> count(datavalue.sourceid) FROM datavalue, period, organisationunit >> WHERE datavalue.periodid = period.periodid AND datavalue.sourceid = >> organisationunit.organisationunitid >> AND datavalue.dataelementid IN (SELECT dataelementid FROM dataelement >> WHERE uid IN >> ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) >> AND datavalue.sourceid IN (SELECT organisationunitid FROM >> organisationunit WHERE uid in >> ('TTcxkf1OGPx','BCnDvAuxUou','r6XG4nxlNxn','BKIrj3yjYJT','bqquAB6z7lS','xZGdhrCZjTn','hOQQ0w4iYio','qHuVAR7RvCa','qHuVAR7RvCa')) >> GROUP BY period.startdate, period.enddate, organisationunit.name, >> datavalue.sourceid; >> >> >> >> startdate | enddate |name | count >> ++-+--- >> 2014-09-01 | 2014-09-30 | Tambeyama MCHP |19 >> 2013-02-01 | 2013-02-28 | Konia MCHP |19 >> 2011-07-01 | 2011-07-31 | Njaluahun CHP |22 >> 2013-10-01 | 2013-10-31 | Bandasuma CHC |33 >> 2014-11-01 | 2014-11-30 | Tambeyama MCHP |20 >> 2011-05-01 | 2011-05-31 | Taninahun MCHP |21 >> 2011-11-01 | 2011-11-30 | Potoru CHC |24 >> 2014-01-01 | 2014-01-31 | Saahun (barri) MCHP |12 >> 2012-09-01 | 2012-09-30 | Bandasuma CHC |26 >> 2011-08-01 | 2011-08-31 | Konia MCHP |20 >> 2012-08-01 | 2012-08-31 | Njaluahun CHP |21 >> 2013-01-01 | 2013-01-31 | Saahun (barri) MCHP | 5 >> 2011-05-01 | 2011-05-31 | Tambeyama MCHP |14 >> 2014-11-01 | 2014-11-30 | Taninahun MCHP |28 >> 2013-12-01 | 2013-12-31 | Konia MCHP |22 >> 2014-09-01 | 2014-09-30 | Taninahun MCHP |28 >> 2015-02-01 | 2015-02-28 | Saahun (barri) MCHP |22 >> 2013-05-01 | 2013-05-31 | Taninahun MCHP |20 >> 2012-10-01 | 2012-10-31 | Potoru CHC |26 >> 2012-03-01 |
Re: [Dhis2-users] Data Loss
Dear Juan, Sorry about the time lapse for this subject but i am currently in the field trying to understand why we are having the data loss. One of our district "Pujehun" is currently facing this issue. The data entry clerk said he had successfully entered information for 2 months: January & February and partially for March 2015 for one of his organisation unit "Barri" which has the following sub organisation units ( Bandasuma CHC, Konia MCHP, Njaluahun CHP, Potoru CHC, Saahun (barri) MCHP, Tambeyama MCHP, Taninahun MCHP, Vaama MCHP, Waiima MCHP). Barri and its sub-organisation unit have information for February and March 2015 as per the following data elements: suspected malaria; total head counts all services, etc but not January 2015. Using the query you gave me the last time i discovered the following: SELECT period.startdate, period.enddate, organisationunit.name, count(datavalue.sourceid) FROM datavalue, period, organisationunit WHERE datavalue.periodid = period.periodid AND datavalue.sourceid = organisationunit.organisationunitid AND datavalue.dataelementid IN (SELECT dataelementid FROM dataelement WHERE uid IN ('Uh0eZaSBoy1','EByDLRrUQQ7','t4cOzeDmRBS','oQstHNsrsJm','q22MFSRWNe8','wyMiVZXcDp4','mPNtI6rlJgx','CzFJu6gOT8a','H5lP3PsNGmn','gSDWcj0oWwb','US013EpQT09','MciaFRdH99E','wcO9l9VDdjm','GNPQd1JagxH','Ch6DcBg6c6o','M24QWMWyKhX')) AND datavalue.sourceid IN (SELECT organisationunitid FROM organisationunit WHERE uid in ('TTcxkf1OGPx','BCnDvAuxUou','r6XG4nxlNxn','BKIrj3yjYJT','bqquAB6z7lS','xZGdhrCZjTn','hOQQ0w4iYio','qHuVAR7RvCa','qHuVAR7RvCa')) GROUP BY period.startdate, period.enddate, organisationunit.name, datavalue.sourceid; startdate | enddate |name | count ++-+--- 2014-09-01 | 2014-09-30 | Tambeyama MCHP |19 2013-02-01 | 2013-02-28 | Konia MCHP |19 2011-07-01 | 2011-07-31 | Njaluahun CHP |22 2013-10-01 | 2013-10-31 | Bandasuma CHC |33 2014-11-01 | 2014-11-30 | Tambeyama MCHP |20 2011-05-01 | 2011-05-31 | Taninahun MCHP |21 2011-11-01 | 2011-11-30 | Potoru CHC |24 2014-01-01 | 2014-01-31 | Saahun (barri) MCHP |12 2012-09-01 | 2012-09-30 | Bandasuma CHC |26 2011-08-01 | 2011-08-31 | Konia MCHP |20 2012-08-01 | 2012-08-31 | Njaluahun CHP |21 2013-01-01 | 2013-01-31 | Saahun (barri) MCHP | 5 2011-05-01 | 2011-05-31 | Tambeyama MCHP |14 2014-11-01 | 2014-11-30 | Taninahun MCHP |28 2013-12-01 | 2013-12-31 | Konia MCHP |22 2014-09-01 | 2014-09-30 | Taninahun MCHP |28 2015-02-01 | 2015-02-28 | Saahun (barri) MCHP |22 2013-05-01 | 2013-05-31 | Taninahun MCHP |20 2012-10-01 | 2012-10-31 | Potoru CHC |26 2012-03-01 | 2012-03-31 | Bandasuma CHC |22 2011-04-01 | 2011-04-30 | Tambeyama MCHP |13 2012-05-01 | 2012-05-31 | Tambeyama MCHP |20 2014-08-01 | 2014-08-31 | Tambeyama MCHP |20 2013-07-01 | 2013-07-31 | Bandasuma CHC |10 2013-02-01 | 2013-02-28 | Vaama MCHP |20 2015-03-01 | 2015-03-31 | Taninahun MCHP |33 2014-07-01 | 2014-07-31 | Bandasuma CHC |28 2014-05-01 | 2014-05-31 | Bandasuma CHC |33 2012-07-01 | 2012-07-31 | Tambeyama MCHP |20 2011-12-01 | 2011-12-31 | Potoru CHC |25 2013-04-01 | 2013-04-30 | Bandasuma CHC |22 2012-04-01 | 2012-04-30 | Taninahun MCHP |26 2014-02-01 | 2014-02-28 | Bandasuma CHC |30 2012-07-01 | 2012-07-31 | Taninahun MCHP |23 2014-04-01 | 2014-04-30 | Saahun (barri) MCHP |22 2012-04-01 | 2012-04-30 | Tambeyama MCHP |13 2011-06-01 | 2011-06-30 | Njaluahun CHP |22 2013-12-01 | 2013-12-31 | Vaama MCHP |28 2014-10-01 | 2014-10-31 | Potoru CHC |38 2015-03-01 | 2015-03-31 | Tambeyama MCHP |21 2012-06-01 | 2012-06-30 | Potoru CHC |24 2011-08-01 | 2011-08-31 | Vaama MCHP |25 2012-05-01 | 2012-05-31 | Taninahun MCHP |24 2014-08-01 | 2014-08-31 | Taninahun MCHP |28 2012-12-01 | 2012-12-31 | Potoru CHC |25 2013-03-01 | 2013-03-31 | Saahun (barri) MCHP | 5 2011-04-01 | 2011-04-30 | Taninahun MCHP |16 2013-09-01 | 2013-09-30 | Saahun (barri) MCHP |16 2013-05-01 | 2013-05-31 | Tambeyama MCHP |18 2014-10-01 | 2014-10-31 | Konia MCHP |18 2012-02-01 | 2012-02-29 | Njaluahun CHP |25 2012-01-01 | 2012-01-31 | Njaluahun CHP |21 2012-03-01 | 2012-03-31 | Saahun (barri) MCHP | 6 2013-11-01 | 2013-11-30 | Tambeyama MCHP |20 2011-09-01 | 2011-09-30 | Taninahun MCHP |22 2012-06-01 | 2012-06-30 | Konia MCHP |22 2011-10-01 | 2011-10-31 | Njaluahun CHP |17 2013-07-01 | 2013-07-31 | Saahun (barri) MCHP | 4 2012-12-01 | 2012-12-31
Re: [Dhis2-users] Data Loss
Hi Gerald Did you check that there is not data missing for Oct, Nov, Dec 2014 for the same districts? I think we had a suspicion some time back that there was maybe a problem with the client PC date settings. So they thought they were entering for Oct 2014 but in fact it was Oct 2015. Hence it didn't appear in analytics and you ended up with future data in your database. Bob On 22 August 2015 at 21:37, gerald thomas gerald17...@gmail.com wrote: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31 2065151 |6 | 2020-01-01 | 2020-12-31 2072304 |3 | 2015-04-01 | 2015-04-30 2109802 |4 | 2015-04-01 | 2015-06-30 2115342 |3 | 2015-08-01 | 2015-08-31 2122928 | 292091 | 2015-03-01 | 2015-04-30 2129098 |2 | 2015-05-25 | 2015-05-31 2129099 |1 | 2015-12-31 | 2015-12-31 Please we need to fix this issue of data loss; can anyone out there help me. Please !!! On 8/20/15, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp
Re: [Dhis2-users] Data Loss
Dear Bob, It is good to here from you once more. We had tried that the last time but the situation is still the same. We had investigated the time of those data entry clerks' PCs and some of them had no issue with their time but it keeps happening. How can we stop it or fix the issue? On 8/25/15, Bob Jolliffe bobjolli...@gmail.com wrote: Hi Gerald Did you check that there is not data missing for Oct, Nov, Dec 2014 for the same districts? I think we had a suspicion some time back that there was maybe a problem with the client PC date settings. So they thought they were entering for Oct 2014 but in fact it was Oct 2015. Hence it didn't appear in analytics and you ended up with future data in your database. Bob On 22 August 2015 at 21:37, gerald thomas gerald17...@gmail.com wrote: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31 2065151 |6 | 2020-01-01 | 2020-12-31 2072304 |3 | 2015-04-01 | 2015-04-30 2109802 |4 | 2015-04-01 | 2015-06-30 2115342 |3 | 2015-08-01 | 2015-08-31 2122928 | 292091 | 2015-03-01 | 2015-04-30 2129098 |2 | 2015-05-25 | 2015-05-31 2129099 |1 | 2015-12-31 | 2015-12-31 Please we need to fix this issue of data loss; can anyone out there help me. Please !!! On 8/20/15, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp
Re: [Dhis2-users] Data Loss
Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31
Re: [Dhis2-users] Data Loss
El 24/08/2015, a las 08:00, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |
Re: [Dhis2-users] Data Loss
Dear Juan, Please find the attached updated combo query. On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, Noted!!! It is now generating resource table and i will keep you posted once it had been completed On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Select Update category option combinations and click on perform maintenance. After that finished select from the menu of the left Resource Table and click on Generate tables. Regards, JM El 24/08/2015, a las 08:00, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 |
Re: [Dhis2-users] Data Loss
Select Update category option combinations and click on perform maintenance. After that finished select from the menu of the left Resource Table and click on Generate tables. Regards, JM El 24/08/2015, a las 08:00, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 |
Re: [Dhis2-users] Data Loss
Dear Juan, Noted!!! It is now generating resource table and i will keep you posted once it had been completed On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Select Update category option combinations and click on perform maintenance. After that finished select from the menu of the left Resource Table and click on Generate tables. Regards, JM El 24/08/2015, a las 08:00, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1
Re: [Dhis2-users] Data Loss
Hello Gerald What was the result of the datavalue query? You should also check the sharing settings of the data elements that are giving you trouble. JM El 24/08/2015, a las 08:43, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Please find the attached updated combo query. On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, Noted!!! It is now generating resource table and i will keep you posted once it had been completed On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Select Update category option combinations and click on perform maintenance. After that finished select from the menu of the left Resource Table and click on Generate tables. Regards, JM El 24/08/2015, a las 08:00, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015
Re: [Dhis2-users] Data Loss
Dear Juan, I am still having issues with datavalue query. Please can you help me by checking the query again. It is still giving On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald What was the result of the datavalue query? You should also check the sharing settings of the data elements that are giving you trouble. JM El 24/08/2015, a las 08:43, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Please find the attached updated combo query. On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, Noted!!! It is now generating resource table and i will keep you posted once it had been completed On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Select Update category option combinations and click on perform maintenance. After that finished select from the menu of the left Resource Table and click on Generate tables. Regards, JM El 24/08/2015, a las 08:00, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Under Maintenance column i am seeing the following: Clear analytics tables Clear data mart Rebuild data mart index Clear zero values Clear data set completeness Prune periods Remove expired invitations Drop SQL views Create SQL views Update category option combinations What should I check for the performance maintenance before doing the query again? On 8/24/15, gerald thomas gerald17...@gmail.com wrote: Dear Juan, No!!! This is the holistic data from that query. Previously i only had the first part of the result. Do you want me to rebuild tables and run query again? On 8/24/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald This looks much different than the fist one you sent me and it's still missing a lot of names, did you rebuild resource tables? JM El 24/08/2015, a las 05:44, gerald thomas gerald17...@gmail.com escribió: Dear Juan, Thanks for your responses. Sorry i am only responding now but please find the attached category combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Sorry, I got distracted and hit send before completing the message. You should limit the query to show the values of the specific data elements that are giving you trouble, you'll need the uid of each of the data element., In case you don't know how to get that information, you can use the api (your_server_URL/api/dataElements?paging=false) or look at the information if each data element in data element management selecting show details from the contextual menu that appears when clocking on the name of each data element. Then add to the query the list of UIDs just before the semicolon. WHERE de.uid IN ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10') Please excuse me if you already know all of these things, since I don't have a way to know how much you know about the system and postgres queries I rather be detailed on what you have to do than leave you guessing. In addition to running maintenance to update category option combinations you should re-generate resource tables, you'll find that in Data Administration too. Regards, JM El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com escribió: Hi Gerald I see you are missing a few category option combo names, you should run the maintenance to Update category option combinations, you'll find this in Data Administration - maintenance I also don't see the option combinations of the data elements you highlighted in the excel you sent to the list. Which category combination are you using with those data elements? Run the query again after doing the maintenance. 15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, 49yrs About the out of memory error, I recommend that you use pgAdmin3 and try to run the query again. You should limit the query to show you the data El 23/08/2015, a las 15:39, gerald thomas gerald17...@gmail.com escribió: Dear Juan, For the datavalues query; i am getting Out of memory as result. Please find the attached result for the combo query. On 8/23/15, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Does data disappear only from data elements that use the default category combination? Since you are querying your database directly, I'm sending you here a couple of queries you can use to verify the existing values of the database and the category combinations. Check if you have more than one default option combination. Regards, JM El 23/08/2015, a las 11:36, gerald thomas gerald17...@gmail.com escribió: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37,
Re: [Dhis2-users] Data Loss
Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31 2065151 |6 | 2020-01-01 | 2020-12-31 2072304 |3 | 2015-04-01 | 2015-04-30 2109802 |4 | 2015-04-01 | 2015-06-30 2115342 |3 | 2015-08-01 | 2015-08-31 2122928 | 292091 | 2015-03-01 | 2015-04-30 2129098 |2 | 2015-05-25 | 2015-05-31 2129099 |1 | 2015-12-31 | 2015-12-31 Please we need to fix this issue of data loss; can anyone out there help me. Please !!! On 8/20/15, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp
Re: [Dhis2-users] Data Loss
Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31 2065151 |6 | 2020-01-01 | 2020-12-31 2072304 |3 | 2015-04-01 | 2015-04-30 2109802 |4 | 2015-04-01 | 2015-06-30 2115342 |3 | 2015-08-01 | 2015-08-31 2122928 | 292091 | 2015-03-01 | 2015-04-30 2129098 |2 | 2015-05-25 | 2015-05-31 2129099 |1 | 2015-12-31 | 2015-12-31 Please we need to fix this issue of data loss; can anyone out there help me. Please !!! On 8/20/15, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp
Re: [Dhis2-users] Data Loss
Hi Gerald, Could you please just clarify what exactly your question is? 1. You have provided a list from you period table. When data is captured or imported into DHIS2 and a period does not exist, then an entry is created in the period table. The period table does not contain data, only periods associated with data that has been captured. Are you concerned because periods exist with future dates? 2. The data is stored in the datavalue table if you are capturing aggregated data. You mention data loss? Has data been captured and you have verified that the data actually is stored in the datavalue table and then afterwards the data disappears when you do analysis? Or does it appear as if the data is physically captured but then never gets stored in the datavalue table? 3. The periodtypeid of 292091 is really odd - is it a custom period that you inserted into the period table yourself? I would suggest (based on the limited knowledge of what is going on at your site) that you follow the whole process and verify each step: Verify the data is captured correctly and completely and saved. Then verify that that specific piece of data exists in the datavalue table with the right dataelement, period and org unit. If the data gets lost between the data entry and the datavalue table, then there is a problem with the completion of the data capture transaction. If data does land up in the datavalue table, but subsequently disappears, then there might be a batch job running that cleans out your datavalue table, but that is most unlikely. If you can't see your data on the reporting side even though the data exists in the datavalue table, then the issue is with the reporting side where you need to specify the correct dataelements, periods and org units to see the data. And this is as much input as I can give with the information you have provided. Regards Regards Ant Snyman On 23 August 2015 at 18:36, gerald thomas gerald17...@gmail.com wrote: Juan, Thanks for your response but we are not using custom forms for data entry. Regards, Gerald On Aug 23, 2015 4:29 PM, Juan Manuel Alcantara Acosta jmalcanta...@gmail.com wrote: Hello Gerald Are you using custom forms for data entry? JM El 22/08/2015, a las 15:37, gerald thomas gerald17...@gmail.com escribió: Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31 2065151 |6 | 2020-01-01 | 2020-12-31 2072304 |3 | 2015-04-01 | 2015-04-30 2109802 |4 | 2015-04-01 | 2015-06-30 2115342 |3 | 2015-08-01 | 2015-08-31 2122928 | 292091 | 2015-03-01 | 2015-04-30 2129098 |2 | 2015-05-25 | 2015-05-31 2129099 |1 | 2015-12-31 | 2015-12-31 Please we need to fix this issue of data loss; can anyone out there help me. Please !!! On 8/20/15, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp -- *Ant Snyman* *Cell: 0824910449* *Landline: 028 2713242* Health Information Systems Program - SA -- *This message and any attachments are subject to a disclaimer
Re: [Dhis2-users] Data Loss
Dear dhis2-users, If someone cannot help me; can anyone explain why am i having data for October, November, December 2015 on my database? dhis=# select * from period where startdate '2015-01-01'; periodid | periodtypeid | startdate | enddate --+--++ 1121694 |6 | 2016-01-01 | 2016-12-31 2058605 |3 | 2015-11-01 | 2015-11-30 2058606 |3 | 2015-12-01 | 2015-12-31 2058607 |3 | 2015-10-01 | 2015-10-31 2058611 |1 | 2015-01-16 | 2015-01-16 2058619 |1 | 2015-01-26 | 2015-01-26 2058631 |1 | 2015-01-29 | 2015-01-29 2058632 |3 | 2015-09-01 | 2015-09-30 2058656 |3 | 2015-02-01 | 2015-02-28 2058727 |3 | 2015-06-01 | 2015-06-30 2058806 |3 | 2015-07-01 | 2015-07-31 2058811 |2 | 2015-03-02 | 2015-03-08 2058812 |3 | 2015-03-01 | 2015-03-31 2058814 |3 | 2015-05-01 | 2015-05-31 2065151 |6 | 2020-01-01 | 2020-12-31 2072304 |3 | 2015-04-01 | 2015-04-30 2109802 |4 | 2015-04-01 | 2015-06-30 2115342 |3 | 2015-08-01 | 2015-08-31 2122928 | 292091 | 2015-03-01 | 2015-04-30 2129098 |2 | 2015-05-25 | 2015-05-31 2129099 |1 | 2015-12-31 | 2015-12-31 Please we need to fix this issue of data loss; can anyone out there help me. Please !!! On 8/20/15, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp
Re: [Dhis2-users] Data Loss
I think it is the same problem I faced previously and I would like to share my experience. What I found was that the aggregation level of each data element was higher the organization unit level of data entry. So we chose the lowest organization unit level at aggregation level of each data element, then the data appeared in analysis. On Fri, Aug 21, 2015 at 3:03 AM, gerald thomas gerald17...@gmail.com wrote: Dear All, We are having a serious issues on our online server in Sierra Leone. Data are normally entered but during analysis these data normally got missing. This had been an issue i had raised before but the situation is still the same and it is even worst now. Please this is an urgent technical problem we need to fix for Sierra Leone and any help will be appreciated till we overcome this situation. Please help us! -- Regards, Gerald ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp -- Dr. Lwin Lwin Aung Health Information Division Department of Public Health Office No.(47), Nay Pyi Taw ___ Mailing list: https://launchpad.net/~dhis2-users Post to : dhis2-users@lists.launchpad.net Unsubscribe : https://launchpad.net/~dhis2-users More help : https://help.launchpad.net/ListHelp