etl approach [message #186734] |
Wed, 09 August 2006 04:51 |
rambo13
Messages: 3 Registered: June 2006
|
Junior Member |
|
|
Hi I am loading a ETL Process.
My requirement is like i have to pull data from some source schemas and put them in staging schema tables.For eg
Suppose i have 3 table emp,dept,jobwise salary in my source schema.I have 2 tables in my staging schema emp_dept and emp_sal.
Now i want to pull data based on some conditions between emp and dept tables and put it in emp_dept table.Similarly based on some conditions between emp and jobwise salary tables i have to pull data into emp_sal table.
Consider that almost 100,000 records are transferred into each table in staging schema.
What approach is best.Just insert into <table> select * from tables based on some conditions.Is this the best approach.In my real scenario i have to pull different data into different stagin tables.So should i write a script consisting of a number of such Insert into select * from tables or is there any other approach
|
|
|
Re: etl approach [message #187418 is a reply to message #186734] |
Sun, 13 August 2006 17:32 |
William Robertson
Messages: 1643 Registered: August 2003 Location: London, UK
|
Senior Member |
|
|
Yes INSERT...SELECT statements would be my first thought. However I would want them in a set of packaged PL/SQL procedures and not a script.
|
|
|