On 10/11/07, Martin Honermeyer <[EMAIL PROTECTED]> wrote:
> Hello guys,
>
> I followed this project and the mailing list for a while. For me as a keen
> Rails developer, this sounds really interesting! Now it's time to get
> active - I am starting my first data warehousing project, building upon our
> business.
>
> I managed to get ActiveWarehouse and the ETL tool (both trunk versions) to
> work with Edge Rails and our MSSQL server. Since we have two operational
> systems with product and order data, I wonder if and how I can extract data
> from multiple differing sources into the same dimension, preferably in
> one .ctl file?
>
> Just setting up two sources works, but it seems they must have the same table
> structure (field names, values etc.). As I can have only one destination in
> my .ctl and I have to define the fields in there, I can't differentiate
> between sources. Is that right? Or is it possible to have different
> transforms, depending on the source, in order to unify operational source
> data?
You can have multiple sources *and* multiple destinations, and you can
mix and match as needed. All the sources do is essentially stick
values into a row that is represented as a Hash of name/value pairs.
Therefore you could have one source put the keys :name, :age, :sex and
then a second source could put the keys :favorite_color,
:favorite_animal into the row as well. At this point you can then
process as you need and ultimately write the values you want back to
the destination(s). You do this by specifying the fields to be written
using the :order option in the third argument of the destination
configuration. So for example, given the sources described above, your
destination might look something like this:
destination :out, {
:type => :database,
:target => :data_warehouse,
:database => 'etl_unittest',
:table => 'people',
},
{
:order => [:name, :age, :sex, :favorite_color, :favorite_animal]
}
HTH.
V/r
Anthony
--
Cell: 321 473-4966
Current Location: Honolulu, HI
Home Location: Melbourne, FL
_______________________________________________
Activewarehouse-discuss mailing list
Activewarehouse-discuss@rubyforge.org
http://rubyforge.org/mailman/listinfo/activewarehouse-discuss
