Re: I am looking for C library addon to PRO C to handle start and restart situations

In article <AB2lSJsK42_at_protasov.kiev.ua>, oracle_at_protasov.kiev.ua wrote:

I am looking for a software package that automaticaaly tracks where I am in a flat file and where in my sql statments, so that in case of a failure(bug in program, disk problem, connectiviy problem, whatever), the software keeps track of excatly where I was and can automatically restart me from the point of the last file read/write/comitpoint.

That way, if I am reading a flat file with 200,000 records and something happens, I can fix the problem and just rerun the program, it will automatically restart from the last point a valid transaction occurred.

Our processing needs are large enough that i can't do just one coomit. Just one of the interfaces I am writing will be processing over 1,000,000 records a night. Even on a high speed Sun Server(10 CPUs, 2 gigs ram) if still takes several hours, just barely making it in the window we have for it.

>
>Hi,
>
>What kind of failures do you mean to restart after? Do you
>mean server is getting down? Or client side problems?
>Or network problems?
>
>Does it mean that you want to restart from the first non-
>commited record of your flat file aftrer ANY (server/network/
>client) failure?
>
>Quite simple method for me is to remove each file from file system
>after complete load. Other thing you should do is to write in
>the database the record number in the flat file for each loaded record.
>In the case of failure find maximum loaded record number for the
>file in the database and restart from the next record.
>
>But the most simple method is to load single file in one
>transaction with big rollback segment. Delete loaded file
>after commit and continue with next one.
>
>Andrew Protasov
>
>> We are creating programs in Pro C. We are looking to add restart
> capbabilites
>> to our code, so that in case of a failure we can have program restart from
>> last place.
>>
>> This is critical since we will be reading large flat files and loading them
>> into oracle, in addition to selects from other sources.
Received on Mon Nov 16 1998 - 08:23:02 CST