Presumably the reason for centralising the ETL tool is to share it and save
on licensing costs. Unfortunately you will fight the performance / cost
battle. Obviously this depends on how much work the ETL server will be
doing, how evenly that will be spread out across the day, how complex the
ETL processes are, etc. You may find that the solution works perfectly
well - or you may not.
In terms of the network connection being 100MBit... How much other traffic
is sharing that? If the servers are physically close it may even be
practical to use a cross-over cable directly between them. If not you
probably want a switch at least to cut the traffic down. We currently use
gigbit ethernet directly between our app and db servers for performance,
with 100 MBit cards connecting the rest of the world (figuratively
speaking).
Of course you could also consider reducing traffic slightly by turning the
ETL server into the Staging server for flat files if you have the capacity.
Hopefully the situation works out for you.
Mark.
paquette stephane
<stephane_paquette@ To: Multiple recipients of list
ORACLE-L <[EMAIL PROTECTED]>
yahoo.com> cc:
Sent by: Subject: Re: ETL architecture
[EMAIL PROTECTED]
17/10/2002 12:48
Please respond to
ORACLE-L
I've never see that approach. Last spring, I've worked
at a "rich" client where there was 23 Oracle
consultants and Oracle Warehouse Builder was installed
on several servers instead of being installed in a
central fashion.
I agree that the ETL tool should drive the whole show.
As for the network between the servers I think it's
100 megabits.
--- [EMAIL PROTECTED] a �crit : > This is a
common approach.
>
> Should be ok if:
>
> * transporting the ftp files is part of the ETL
> process
> * big fat pipe to the servers.
>
> Jared
>
>
>
>
>
>
> paquette stephane <[EMAIL PROTECTED]>
> Sent by: [EMAIL PROTECTED]
> 10/16/2002 11:25 AM
> Please respond to ORACLE-L
>
>
> To: Multiple recipients of list ORACLE-L
> <[EMAIL PROTECTED]>
> cc:
> Subject: ETL architecture
>
>
> Hi,
>
> On all DW project I've been, the ETL tool was on the
> database server containing the DW database.
>
> On the current project, the architecture team has
> decided that the ETL tool (Data Junction) will be on
> its own server (Windows) to service all projects
> needing ETL processing.
> We are the first client of this approach. All
> sources
> will ftp their files on the unix box where the
> staging/data integration database is.
> So that means that the the ETL tool on server A will
> read the files and the reference tables from server
> B,
> process that on server A and insert the cleansed
> data
> on server B.
>
> Somewhere I'm not confortable with that approach.
> Any comments ?
>
>
>
> =====
> St�phane Paquette
> DBA Oracle, consultant entrep�t de donn�es
> Oracle DBA, datawarehouse consultant
> [EMAIL PROTECTED]
>
>
__________________________________________________________
> L�che-vitrine ou l�che-�cran ?
> magasinage.yahoo.ca
> --
> Please see the official ORACLE-L FAQ:
> http://www.orafaq.com
> --
> Author: =?iso-8859-1?q?paquette=20stephane?=
> INET: [EMAIL PROTECTED]
>
> Fat City Network Services -- 858-538-5051
> http://www.fatcity.com
> San Diego, California -- Mailing list and web
> hosting services
>
---------------------------------------------------------------------
> To REMOVE yourself from this mailing list, send an
> E-Mail message
> to: [EMAIL PROTECTED] (note EXACT spelling of
> 'ListGuru') and in
> the message BODY, include a line containing: UNSUB
> ORACLE-L
> (or the name of mailing list you want to be removed
> from). You may
> also send the HELP command for other information
> (like subscribing).
>
>
>
> --
> Please see the official ORACLE-L FAQ:
> http://www.orafaq.com
> --
> Author:
> INET: [EMAIL PROTECTED]
>
> Fat City Network Services -- 858-538-5051
> http://www.fatcity.com
> San Diego, California -- Mailing list and web
> hosting services
>
---------------------------------------------------------------------
> To REMOVE yourself from this mailing list, send an
> E-Mail message
> to: [EMAIL PROTECTED] (note EXACT spelling of
> 'ListGuru') and in
> the message BODY, include a line containing: UNSUB
> ORACLE-L
> (or the name of mailing list you want to be removed
> from). You may
> also send the HELP command for other information
> (like subscribing).
=====
St�phane Paquette
DBA Oracle, consultant entrep�t de donn�es
Oracle DBA, datawarehouse consultant
[EMAIL PROTECTED]
__________________________________________________________
L�che-vitrine ou l�che-�cran ?
magasinage.yahoo.ca
--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: =?iso-8859-1?q?paquette=20stephane?=
INET: [EMAIL PROTECTED]
Fat City Network Services -- 858-538-5051 http://www.fatcity.com
San Diego, California -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from). You may
also send the HELP command for other information (like subscribing).
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<---->>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Privileged/Confidential information may be contained in this message.
If you are not the addressee indicated in this message
(or responsible for delivery of the message to such person),
you may not copy or deliver this message to anyone.
In such case, you should destroy this message and kindly notify the sender
by reply e-mail or by telephone on (61 3) 9612-6999.
Please advise immediately if you or your employer does not consent to
Internet e-mail for messages of this kind.
Opinions, conclusions and other information in this message
that do not relate to the official business of
Transurban City Link Ltd
shall be understood as neither given nor endorsed by it.
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<---->>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: Mark Richard
INET: [EMAIL PROTECTED]
Fat City Network Services -- 858-538-5051 http://www.fatcity.com
San Diego, California -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from). You may
also send the HELP command for other information (like subscribing).
