RE: Using functions in sqlldr cripples performance

From: Mercadante, Thomas F \(LABOR\) <Thomas.Mercadante_at_labor.state.ny.us>
Date: Wed, 7 Mar 2007 10:54:02 -0500
Message-ID: <ABB9D76E187C5146AB5683F5A07336FFE08BEE@EXCNYSM0A1AJ.nysemail.nyenet>

John,

Along with what others have said, have you considered using a post-process PL/SQL routine to clean the data once it is loaded into your table? Either you pay the price up front of cleaning the data while you load it, or pay the price by using an external table & cleaning the data as you process it, or load it as you are and run a sql script after the fact.

No matter what option you choose, there is a set amount of work that needs to be done to load the data. And you get to pick and test all three options and see which one works best for you.

Hope this helps.

Tom

This transmission may contain confidential, proprietary, or privileged information which is intended solely for use by the individual or entity to whom it is addressed. If you are not the intended recipient, you are hereby notified that any disclosure, dissemination, copying or distribution of this transmission or its attachments is strictly prohibited. In addition, unauthorized access to this transmission may violate federal or State law, including the Electronic Communications Privacy Act of 1985. If you have received this transmission in error, please notify the sender immediately by return e-mail and delete the transmission and its attachments.

From: oracle-l-bounce_at_freelists.org
[mailto:oracle-l-bounce_at_freelists.org] On Behalf Of John Dunn Sent: Wednesday, March 07, 2007 9:09 AM
To: oracle-l
Subject: Using functions in sqlldr cripples performance

I have a Oracle 9 direct load sqlldr routine which provides adequate performance but have now had a request to delete some characters from the data during the load and set some fields to upper case.

However tests show that using UPPER or TRANSLATE in the sqlldr control file has huge negative impact on performance of the load.

Anyone got a solution to this ?

John Dunn

Product Consultant

Sefas Innovation Limited

Direct Dial + 44 (0) 117 373 6122

www.sefas.com
<file:///C:\Documents%20and%20Settings\ransty\Application%20Data\Microso ft\Signatures\www.sefas.com>

Sefas Innovation Ltd, CityPoint, Temple Gate, Bristol BS1 6PL, UK. Tel: +44 (0) 117 373 6114 Fax: +44 (0) 117 373 6115

Sefas Innovation Limited. Registered No: 3769761 England. Registered Office: One New Street, Wells, Somerset, BA5 2LA, United Kingdom. VAT Registration No: GB 741 5377 32

Unless stated to be non-confidential, this email and any attachments are private and confidential and are for the addressee only. Sefas monitors e-mails to ensure its systems operate effectively and to minimize the risk of viruses. Whilst Sefas has taken reasonable steps to scan this email, it does not accept liability for any virus that may be contained in it.

Internet communications are not 100% secure and as such Sefas is not responsible for their abuse by 3rd parties, nor for any alteration or corruption in transmission.

--
http://www.freelists.org/webpage/oracle-l

Received on Wed Mar 07 2007 - 09:54:02 CST