Sql-loader Perofrmance Question [message #11179] |
Wed, 10 March 2004 09:30 |
trusac
Messages: 1 Registered: March 2004
|
Junior Member |
|
|
Hi,
We are in the process of migrating data from AS/400 system on to Oracle.
We have to load flat data files into Staging schema on Oracle (8.1.6) Server. I believe Sqlloader will be the best approach to load these flat files. But we can't use the Direct mode option of sqlloader since we need to populate id fields corresponding to the code values that we have in the data files. We have Support tables which hold the id, code values.So We will have to use our user-defined functions within Sqlloader to populate the recids.
In one of the tables we have 20 different recid fields e.g state_cd_recid, line_of_business_recid, etc. Hence we will have to call 20 different functions within the sqlloader to populate these recids for every record.
We have 28 million records to load in this table.
Is the Sqlloader the best approach to load the data or is there any other better way to load ?
|
|
|
Re: Sql-loader Perofrmance Question [message #11185 is a reply to message #11179] |
Wed, 10 March 2004 15:42 |
Andrew
Messages: 144 Registered: March 1999
|
Senior Member |
|
|
Well, you could consider loading the data into a primary staging table in direct mode, index it and then use pl/sql to apply the functions to that.
You could also consider splitting your datafiles and parallelizing the job with multiple sqlldr jobs.
|
|
|