| Oracle FAQ | Your Portal to the Oracle Knowledge Grid | |
 |
 | |||
| Oracle FAQ | Your Portal to the Oracle Knowledge Grid | |
|
| |||
Home -> Community -> Mailing Lists -> Oracle-L -> RE: ETL architecture
An example of what we have/do here.. Not that it's perfect-but it seems to
fit the "need"...
We use an ETL tool (Informatica....) from a central server. The scripts,etc will connect to the multiple datasources (oracle, db2, sybase, informaix,redbrick) to obtain the data based on the business rules and requirements... We also have the source systems extract and ftp to the ETL server as well. It's not the preferred method-but certain systems have a time critical issue when the extracts are ran..
Typically-if the business rules ask for 3 data elements. We get most of the important "stuff" from a table so we can extend the warehouse without going back to the source...
There is some "T" going on as it loads those misc. data sources into the Staging area (oracle with the ETL). Or it takes the data straight to the warehouse (teradata).
But multiple projects that require data for the different ?DW subject areas will use the same ETL infrastructure.
greg
-----Original Message-----
Sent: Wednesday, October 16, 2002 2:26 PM
To: Multiple recipients of list ORACLE-L
Hi,
On all DW project I've been, the ETL tool was on the database server containing the DW database.
On the current project, the architecture team has
decided that the ETL tool (Data Junction) will be on
its own server (Windows) to service all projects
needing ETL processing.
We are the first client of this approach. All sources
will ftp their files on the unix box where the
staging/data integration database is.
So that means that the the ETL tool on server A will
read the files and the reference tables from server B,
process that on server A and insert the cleansed data
on server B.
Somewhere I'm not confortable with that approach. Any comments ?
Fat City Network Services -- 858-538-5051 http://www.fatcity.com San Diego, California -- Mailing list and web hosting services ---------------------------------------------------------------------To REMOVE yourself from this mailing list, send an E-Mail message to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
Fat City Network Services -- 858-538-5051 http://www.fatcity.com San Diego, California -- Mailing list and web hosting services ---------------------------------------------------------------------To REMOVE yourself from this mailing list, send an E-Mail message to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). Received on Thu Oct 17 2002 - 09:39:34 CDT
 |
 |