Oracle FAQ Your Portal to the Oracle Knowledge Grid
HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US
 

Home -> Community -> Mailing Lists -> Oracle-L -> RE: ETL architecture

RE: ETL architecture

From: Frank Pettinato <frankp_at_cableaz.com>
Date: Wed, 16 Oct 2002 11:30:07 -0800
Message-ID: <F001.004EB1C2.20021016113007@fatcity.com>


Stephane,
We used this approach (albiet on Windows) back in 97-98. We processed ETL from about 300 different customers including several large ones with files > 50MB weekly. We saw very good performance from the tool. If I had to pick a problem with this tool it would be the ability to detect errors and stop processing or use some type of exception handling. This was a few years ago, so it may have gotten better since then.

Hope this helps,
Frank

-----Original Message-----
stephane
Sent: Wednesday, October 16, 2002 11:26 AM To: Multiple recipients of list ORACLE-L

Hi,

On all DW project I've been, the ETL tool was on the database server containing the DW database.

On the current project, the architecture team has decided that the ETL tool (Data Junction) will be on its own server (Windows) to service all projects needing ETL processing.
We are the first client of this approach. All sources will ftp their files on the unix box where the staging/data integration database is.
So that means that the the ETL tool on server A will read the files and the reference tables from server B, process that on server A and insert the cleansed data on server B.

Somewhere I'm not confortable with that approach. Any comments ?



Stéphane Paquette
DBA Oracle, consultant entrepôt de données Oracle DBA, datawarehouse consultant
stephane_paquette_at_yahoo.com

Lèche-vitrine ou lèche-écran ?
magasinage.yahoo.ca
--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: =?iso-8859-1?q?paquette=20stephane?=
  INET: stephane_paquette_at_yahoo.com

Fat City Network Services    -- 858-538-5051 http://www.fatcity.com
San Diego, California        -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L

(or the name of mailing list you want to be removed from). You may
also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: Frank Pettinato INET: frankp_at_cableaz.com Fat City Network Services -- 858-538-5051 http://www.fatcity.com San Diego, California -- Mailing list and web hosting services --------------------------------------------------------------------- To REMOVE yourself from this mailing list, send an E-Mail message to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from). You may
also send the HELP command for other information (like subscribing).
Received on Wed Oct 16 2002 - 14:30:07 CDT

Original text of this message

HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US