Home » SQL & PL/SQL » SQL & PL/SQL » etl approach
etl approach [message #186734] Wed, 09 August 2006 04:51 Go to next message
rambo13
Messages: 3
Registered: June 2006
Junior Member
Hi I am loading a ETL Process.

My requirement is like i have to pull data from some source schemas and put them in staging schema tables.For eg

Suppose i have 3 table emp,dept,jobwise salary in my source schema.I have 2 tables in my staging schema emp_dept and emp_sal.
Now i want to pull data based on some conditions between emp and dept tables and put it in emp_dept table.Similarly based on some conditions between emp and jobwise salary tables i have to pull data into emp_sal table.
Consider that almost 100,000 records are transferred into each table in staging schema.

What approach is best.Just insert into <table> select * from tables based on some conditions.Is this the best approach.In my real scenario i have to pull different data into different stagin tables.So should i write a script consisting of a number of such Insert into select * from tables or is there any other approach
Re: etl approach [message #187418 is a reply to message #186734] Sun, 13 August 2006 17:32 Go to previous message
William Robertson
Messages: 1643
Registered: August 2003
Location: London, UK
Senior Member
Yes INSERT...SELECT statements would be my first thought. However I would want them in a set of packaged PL/SQL procedures and not a script.
Previous Topic: help me to do this
Next Topic: Parallel execution of procedures
Goto Forum:
  


Current Time: Sat Dec 14 14:29:09 CST 2024