Perl 5.003, DBI, DBD and Oracle problem

I have a question about a problem I have been running into using Perl 5.003 on a DEC Alpha machine w/UNIX 3.2C, DBI version 0.79 abd DBD::Oracle version 0.44 with Oracle 7.2.2.3.

My problem stems from trying to run perl scripts that read in large data files, process several edit checks on each data record, insert the record into a temporary oracle table with no constraints. Then perform validations of the primary and foreign key values in the temp table, and finally copy over all valid rows to the permanent database schema table.

I dont seem to have any problems when testing with a small amount of records, but when run with a large amount of records (25,000), the script crashes and gives an error ORA-04031, which states the database is unable to allocated enough memory to perform the indicated SQL statement.

Do I have a major flaw in design? Has anyone seen this problem before? Has anyone ever experienced memory problems when trying to run large sequential batch processes? The Oracle DBA indicates that the shared_memory_pool is set at more than enough to process large numbers of records and the problem lies in my code, but I am unsure. Any help would be most appreciated.

Any replies may be posted here or sent direct to me at aron_ceely_at_notes.pw.com

Thanks Received on Wed Sep 24 1997 - 00:00:00 CDT