Re: Oracle performance on Large loads.

Mike,
The bottleneck here is probably PL/SQL. I have found it to be very slow. I would be tempted to use a C program to pre-process the data into files - one per table, then use SQL Loader to load it. SQL Loader can load 800,000 rows in about an hour if there are no duplicates in the data.

The hardware may be a problem, but assuming that the database is on more that one disk drive, it probably is not.

Dale Ross

> We have several 250 MB Asci Text Files with snapshots of weekly data
> from another system
> that we would like to load into an oracle database. Each Text File
> contains around 800,000
> records and each record represents a fairly complicated relation between
> about 8 entities.
> Several records can also relate to each other.
>

> Does anyone have any experience with loading very large amounts of
> fairly complicated data
> and if so does 140 hours seem normal ? I've tried SQL Loader but because
> of the complexity
> of the relations in one record and the possible relations to other
> records it seems almost
> impossible to use.
>
Received on Tue Dec 10 1996 - 00:00:00 CET