Home » SQL & PL/SQL » SQL & PL/SQL » Sql-loader Perofrmance Question
Sql-loader Perofrmance Question [message #11179] Wed, 10 March 2004 09:30 Go to next message
trusac
Messages: 1
Registered: March 2004
Junior Member
Hi,
   We are in the process of migrating data from AS/400 system on to Oracle.
    We have to load flat data files into Staging schema on Oracle (8.1.6) Server. I believe Sqlloader will be the best approach to load these flat files.  But we can't use the Direct mode option of sqlloader since we need to populate id fields corresponding to the code values that we have in the data files. We have Support tables which hold the id, code values.So We will have to use our user-defined functions within Sqlloader to populate the recids.

In one of the tables we have 20 different recid fields e.g state_cd_recid, line_of_business_recid, etc. Hence we will have to call 20 different functions within the sqlloader to populate these recids for every  record.

We have 28 million records to load in this table.

Is  the Sqlloader the best approach to load the data or is there any other better way to load ?

 
Re: Sql-loader Perofrmance Question [message #11185 is a reply to message #11179] Wed, 10 March 2004 15:42 Go to previous message
Andrew
Messages: 144
Registered: March 1999
Senior Member
Well, you could consider loading the data into a primary staging table in direct mode, index it and then use pl/sql to apply the functions to that.

You could also consider splitting your datafiles and parallelizing the job with multiple sqlldr jobs.
Previous Topic: Translating data
Next Topic: Ora06502 Why could not get data from table?
Goto Forum:
  


Current Time: Fri Mar 29 07:48:58 CDT 2024