Hi, Thanks for the response Paulo. I also like the SDMX-HD and dataValueSets (DXF) options, but am still interested to hear what the DHIS2 devs think.
Ciao, Pascal On 6 August 2013 15:45, Paulo Grácio <[email protected]> wrote: > Hi all,**** > > ** ** > > Please find my comments below. **** > > ** ** > > Regards,**** > > Paulo Grácio**** > > ** ** > > *From:* Pascal Brandt [mailto:[email protected]] > *Sent:* terça-feira, 6 de Agosto de 2013 14:56 > *To:* Paulo Grácio > *Cc:* Jason Pickering; DHIS 2 developers; Chris Seebregts; Carl Fourie; > Ryan Crichton > > *Subject:* Re: [Dhis2-devs] Interoperability question**** > > ** ** > > Hi all,**** > > ** ** > > This thread is important for at least two separate projects that Jembi is > working on.**** > > ** ** > > What we're looking for is a way to automatically import data into the > DHIS. It's not a once-off import, but it's also not transactional (DHIS2 > forms aren't being completed on a regular basis). For a once-off, we could > use CSV or DXF or one of the other options via the web interface and for > transactional we could use the Web API. > > What would be the recommended way to do this periodic bulk data load? I > see the following options:**** > > 1. Sending data values using > SDMX-HD<http://www.dhis2.org/doc/snapshot/en/user/html/ch25s08.html> > **** > 2. Sending large bulks of data > values<http://www.dhis2.org/doc/snapshot/en/user/html/ch25s09.html> > **** > 3. Integration > Engine<http://www.dhis2.org/doc/snapshot/en/user/html/ch26.html> > **** > > *[Paulo Grácio] IMHO option 1 is definitely the most appropriated. To > have it automatically loaded into DHIS2 the best solution might be to > implement an adapter that translates data to SDMX-HD before send it to > DHIS2. Using this approach you also isolate your application specific data > format from other systems, communication is always done using standard > format. * * * > > The main point is that needs to be automatic (no user interaction with the > UI) and we need to be able to initiate the process on an ad-hoc bases. Is > there a way to load CSV or DXF using the Web API? **** > > *[Paulo Grácio] Please have a look at section 25.6. Sending data values > of DHIS2 User Manual.* > > http://apps.dhis2.org/demo/api/dataValueSets**** > > * * > > Also, I'm having some trouble finding the documentation for the DXF > format, is it available somewhere?**** > > *[Paulo Grácio] By Morten Olav Hansen “This one is difficult, but we will > try and provide something. Our api is very much a moving target though, ane > because of some design choices we cannot just generate this.”* > > https://bugs.launchpad.net/dhis2/+bug/990783** > > ** ** > > Thanks for your help.**** > > ** ** > > Regards,**** > > Pascal**** > > ** ** > > ** ** > > On 1 August 2013 18:50, Paulo Grácio <[email protected]> wrote: > **** > > Hi Jason,**** > > **** > > Basically what we are trying to achieved is a way to simple export data > from a legacy system into dhis2. Once this system only generates excel > files as output we would like to import the generated file directly(without > modifications) to DHIS2 and have an import summary. **** > > **** > > We know that we can do it using several different approaches and we are > considering them J.**** > > **** > > Regards,**** > > Paulo Grácio**** > > **** > > *From:* Jason Pickering [mailto:[email protected]] > *Sent:* quinta-feira, 1 de Agosto de 2013 13:26 > *To:* Paulo Grácio**** > > > *Cc:* DHIS 2 developers > *Subject:* Re: [Dhis2-devs] Interoperability question**** > > **** > > Hi Paulo,**** > > I am not sure it would be worth it, but looks like it might work. Why > can't you just simply export CSV instead? Seems that given the structure of > your data, you could just simply use the CSV importer instead of setting up > an integration route?**** > > > Regards,**** > > Jason**** > > **** > > **** > > On Wed, Jul 31, 2013 at 7:03 PM, Paulo Grácio < > [email protected]> wrote:**** > > Hi all,**** > > **** > > We are wondering about the best form to import in DHIS2 data from legacy > applications.**** > > **** > > In chapter “26.4. Transforming data - a Java route” of the User Manual we > see that there is a way to do this integration using Java routes, but we > are having some difficulties in implementing a proof of concept.**** > > **** > > In our PoC scenario we have a XLS file sent by an external application > (DataValues.xls in attach). Our idea is to create a Java route in order to > import all data values that exist in that file.**** > > **** > > Following the tutorial “Customer 3: Excel via e-mail” presented in the > Apache Camel page - > http://camel.apache.org/tutorial-business-partners.html - we have been > able to transform the XLS file in a list of DataValue objects. **** > > **** > > Basically, we only had to create a XLSDataIn route and a > ExcelConverterBean (files in attach). The XLSDataIn takes an InputStream of > an XLS file and calls the ExcelConverterBean. The ExcelConverterBean > iterates through the file, and for each data value row, creates a new > DataValue object and adds that object to a list of DataValue objects.**** > > **** > > Now we are having some issues because we don’t know the best way to insert > these data values in DHIS2.**** > > **** > > The questions we are having are:**** > > 1. The approach that we have used to implement our PoC is the > correct one? I mean, XLS -> List<DataValue> -> import is correct or we > should use XLS -> CSV -> import?**** > > 2. How should we proceed, after the XLS file has been processed by > the ExcelConverterBean?**** > > **** > > **** > > Thanks for your support,**** > > *Paulo Grácio <*%20your-email%20*>* > *Technical Manager* > Skype: paulojrgracio**** > > *Critical Software Mozambique* <http://www.criticalsoftware.co.uk/> > *Dependable Technologies for Critical Systems***** > > Critical Software Mozambique is a subsidiary of Critical Software, a > CMMI® Level 5 rated Company <http://cmmiinstitute.com/> > CMMI® is registered in the USPTO by CMU <http://www.cmu.edu/>**** > > Rua Pereira Marinho, 179 > Bairro de Sommerchield > Maputo > Moçambique > Phone: (+258) 214 951 45 > Fax: (+258) 214 951 46**** > > DISCLAIMER: This message is confidential and may contain privileged > information. It is for use only by the people or entities to whom it is > addressed. If you are not an intended recipient, you should not disclose, > distribute, copy, print, rely on or otherwise make use of this message. If > an addressing or transmission error has misdirected it to you we would be > grateful if you would please notify the sender by return, before deleting > it from your system.**** > > **** > > **** > > > _______________________________________________ > Mailing list: https://launchpad.net/~dhis2-devs > Post to : [email protected] > Unsubscribe : https://launchpad.net/~dhis2-devs > More help : https://help.launchpad.net/ListHelp**** > > **** > > > _______________________________________________ > Mailing list: https://launchpad.net/~dhis2-devs > Post to : [email protected] > Unsubscribe : https://launchpad.net/~dhis2-devs > More help : https://help.launchpad.net/ListHelp**** > > > > **** > > ** ** > > -- > *Pascal Brandt > Senio**r Software Developer, Jembi Health Systems | SOUTH AFRICA > Mobile: +27 84 827 9342 | Office: +27 21 701 0939 | Skype: psbrandt > E-mail: [email protected]* **** > -- *Pascal Brandt Senio**r Software Developer, Jembi Health Systems | SOUTH AFRICA Mobile: +27 84 827 9342 | Office: +27 21 701 0939 | Skype: psbrandt E-mail: [email protected]*
_______________________________________________ Mailing list: https://launchpad.net/~dhis2-devs Post to : [email protected] Unsubscribe : https://launchpad.net/~dhis2-devs More help : https://help.launchpad.net/ListHelp
