Re: [Lazarus] ETL tool - make or use?

2012-03-26 Thread Marc Santhoff
Hi again, at first thanks for all the input. Summing up it boils down to hacking together some quick lines is the most used option - which I agree with in the end. Although those tasks pop up quite often in my todo list, it is still not enough to make something bigger and better. In the past I

Re: [Lazarus] ETL tool - make or use?

2012-03-26 Thread Marc Santhoff
Am Samstag, den 24.03.2012, 09:21 +0100 schrieb Andreas Schneider: On Friday, March 23, 2012 20:05 Michael Van Canneyt wrote: Always option 1. Because it always turns out you need to check for doubles and do updates; making self written code the most optimal tool. You always know your

Re: [Lazarus] ETL tool - make or use?

2012-03-26 Thread Marc Santhoff
Am Freitag, den 23.03.2012, 19:04 + schrieb Mark Morgan Lloyd: Marc Santhoff wrote: What do you use for ETL tasks? I'm a heretic: I tend to use Perl. I notice that somebody's embedded Perl in Delphi- I wonder if that would be portable to FPC? Ahh, now I read the bad word two

Re: [Lazarus] ETL tool - make or use?

2012-03-26 Thread Marc Santhoff
Am Montag, den 26.03.2012, 15:22 +0200 schrieb Marc Santhoff: If Java plus Swing is what they use - this is one really good way to go. That thingy can handle text file, relational databases, e-mails and services - I really do like it. As long as it works. ;) Oops, I wrote Swing all the time

Re: [Lazarus] ETL tool - make or use?

2012-03-24 Thread Andreas Schneider
On Friday, March 23, 2012 20:05 Michael Van Canneyt wrote: Always option 1. Because it always turns out you need to check for doubles and do updates; making self written code the most optimal tool. You always know your own data best of all. Michael. I can only confirm this. The

Re: [Lazarus] ETL tool - make or use?

2012-03-24 Thread Sven Barth
Am 23.03.2012 19:23 schrieb Marc Santhoff m.santh...@web.de: 1. whipping together minimal code that does it 2. make a more generic tool that can be used for all tasks, having to be extended when needed 3. use some tool already existing Since FPC has a dataset class for CSV files and also

Re: [Lazarus] ETL tool - make or use?

2012-03-24 Thread Marco van de Voort
On Fri, Mar 23, 2012 at 07:25:25PM +0100, Marc Santhoff wrote: loading CSV (aka SDF) data and pushing those records to a relational database and the like. I have the strong feeling that someone has already done something like that. ;) Options to solve this request are 1. whipping together

Re: [Lazarus] ETL tool - make or use?

2012-03-24 Thread Marco van de Voort
On Sat, Mar 24, 2012 at 05:51:34PM +0100, Marco van de Voort wrote: 3. use some tool already existing 1 and 2. Mostly (1) but to with generic internal format for which we had some tools and libraries of routines and help tables (e.g. zipcode to address/town mappings etc, encoding

[Lazarus] ETL tool - make or use?

2012-03-23 Thread Marc Santhoff
Der list members, does anyone of you know a tool for ETL[1] tasks? At best it would be written in object pascal and be open source. I'm currently charged with doing some simple data transfer actions like loading CSV (aka SDF) data and pushing those records to a relational database and the like.

Re: [Lazarus] ETL tool - make or use?

2012-03-23 Thread Michael Van Canneyt
On Fri, 23 Mar 2012, Marc Santhoff wrote: Der list members, does anyone of you know a tool for ETL[1] tasks? At best it would be written in object pascal and be open source. I'm currently charged with doing some simple data transfer actions like loading CSV (aka SDF) data and pushing those

Re: [Lazarus] ETL tool - make or use?

2012-03-23 Thread Mark Morgan Lloyd
Marc Santhoff wrote: Der list members, does anyone of you know a tool for ETL[1] tasks? At best it would be written in object pascal and be open source. I'm currently charged with doing some simple data transfer actions like loading CSV (aka SDF) data and pushing those records to a relational