Oracle FAQ Your Portal to the Oracle Knowledge Grid
HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US
 

Home -> Community -> Mailing Lists -> Oracle-L -> RE: Query results to .csv

RE: Query results to .csv

From: John Kanagaraj <john.kanagaraj_at_hds.com>
Date: Mon, 25 Aug 2003 16:54:26 -0800
Message-ID: <F001.005CD1C2.20030825165426@fatcity.com>


One caveat strikes my mind when considering Direct Load... Due to the fact that the buffer is constructed and written directly, the kernel can perform INSERTs only *above* the HWM. If the rate at which you perform Direct INSERTs is high (i.e. multiple runs in a day), then you may have an artificially large segment, most of which is empty. And your FTS will be reaching farther and farther... The situation can be compounded by parallel INSERT where you might acquire different 'start-to-insert' points in parallel.

All this is from memory - I think it is mentioned in the Concepts/Admin manual for Direct INSERT - and I might be wrong. Just cross-check this out before implementing...

John Kanagaraj

-----Original Message-----
Sent: Monday, August 25, 2003 5:09 PM
To: Multiple recipients of list ORACLE-L

Hi!

What about several insert /*+ APPEND NOLOGGING */ commands over database link run in parallel? (Possibly over dedicated network). This is fast and is easier (in case you don't hit any compatibility problems). If you happen to be running on Windows for some reason, you could try to use named pipes network protocol instead of TCP as well.

Tanel.

> Thanks Tanel
> We will undoubtedly use export/import for the many small tables. We are
> looking for alternatives that will perform even faster. The insert phase
> seems to be the slowest part, and that is where SQL*Loader in direct path
> really shines. Now the next issue is how to produce a CSV file as fast as
> possible, and so far it looks like Jared's Perl program is the clear
winner.
>
> Dennis Williams
> DBA, 80%OCP, 100% DBA
> Lifetouch, Inc.
> dwilliams_at_lifetouch.com
>
>
> -----Original Message-----
> Sent: Monday, August 25, 2003 1:05 PM
> To: Multiple recipients of list ORACLE-L
>
>
> Hi!
>
> Spooling from sqlplus is VERY slow.
> Is the source database Oracle? Then use export/import
> If not, is there an ODBC driver for source database? Then use Oracle
> heterogenous services and do your transfer directly, without any
> intermediate files.
> Or use some very expensive software for doing this simple job...
>
> Tanel.
> P.S. if you definitely want to spool to textfile fast, Sparky could be
what
> you want...
>
> ----- Original Message -----
> To: "Multiple recipients of list ORACLE-L" <ORACLE-L_at_fatcity.com>
> Sent: Monday, August 25, 2003 7:24 PM
>
>
> > Jared - Thanks for posting this. At the moment, we are preparing to move
> > large database to a new server. Based on the advice you posted several
> > months ago, we have been testing SQL*Loader and as you predicted, it is

> > indeed fast. But also as you predicted, using SQL*Plus to create a CSV
> isn't
> > very fast. Am I correct in assuming the dump.sql will not be the best
> choice
> > for large tables? We are installing perl since you mentioned that would
> > probably be much faster.
> >
> > Dennis Williams
> > DBA, 80%OCP, 100% DBA
> > Lifetouch, Inc.
> > dwilliams_at_lifetouch.com
> >
> >
> > -----Original Message-----
> > Sent: Monday, August 25, 2003 9:40 AM
> > To: Multiple recipients of list ORACLE-L
> >
> >
> > http://www.cybcon.com/~jkstill/util/dump/dump.html
> >
> > On Mon, 2003-08-25 at 05:39, Imran Ashraf wrote:
> > > Hi,
> > >
> > > Whats the best way to write the results of a SQL query to a CSV file?
> > >
> > > Thanks.
> > >
> > > _________________________________________________________________
> > > Hotmail messages direct to your mobile phone
> > http://www.msn.co.uk/msnmobile
> > >
> > > --
> > > Please see the official ORACLE-L FAQ: http://www.orafaq.net
> > > --
> > > Author: Imran Ashraf
> > > INET: imran9a_at_hotmail.com
> > >
> > > Fat City Network Services -- 858-538-5051 http://www.fatcity.com
> > > San Diego, California -- Mailing list and web hosting services
> > > ---------------------------------------------------------------------
> > > To REMOVE yourself from this mailing list, send an E-Mail message
> > > to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
> > > the message BODY, include a line containing: UNSUB ORACLE-L
> > > (or the name of mailing list you want to be removed from). You may
> > > also send the HELP command for other information (like subscribing).
> > >
> >
> >
> > --
> > Please see the official ORACLE-L FAQ: http://www.orafaq.net
> > --
> > Author: Jared Still
> > INET: jkstill_at_cybcon.com
> >
> > Fat City Network Services -- 858-538-5051 http://www.fatcity.com
> > San Diego, California -- Mailing list and web hosting services
> > ---------------------------------------------------------------------
> > To REMOVE yourself from this mailing list, send an E-Mail message
> > to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
> > the message BODY, include a line containing: UNSUB ORACLE-L
> > (or the name of mailing list you want to be removed from). You may
> > also send the HELP command for other information (like subscribing).
> > --
> > Please see the official ORACLE-L FAQ: http://www.orafaq.net
> > --
> > Author: DENNIS WILLIAMS
> > INET: DWILLIAMS_at_LIFETOUCH.COM
> >
> > Fat City Network Services -- 858-538-5051 http://www.fatcity.com
> > San Diego, California -- Mailing list and web hosting services
> > ---------------------------------------------------------------------
> > To REMOVE yourself from this mailing list, send an E-Mail message
> > to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
> > the message BODY, include a line containing: UNSUB ORACLE-L
> > (or the name of mailing list you want to be removed from). You may
> > also send the HELP command for other information (like subscribing).
> >
>
>
> --
> Please see the official ORACLE-L FAQ: http://www.orafaq.net
> --
> Author: Tanel Poder
> INET: tanel.poder.003_at_mail.ee
>
> Fat City Network Services -- 858-538-5051 http://www.fatcity.com
> San Diego, California -- Mailing list and web hosting services
> ---------------------------------------------------------------------
> To REMOVE yourself from this mailing list, send an E-Mail message
> to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
> the message BODY, include a line containing: UNSUB ORACLE-L
> (or the name of mailing list you want to be removed from). You may
> also send the HELP command for other information (like subscribing).
> --
> Please see the official ORACLE-L FAQ: http://www.orafaq.net
> --
> Author: DENNIS WILLIAMS
> INET: DWILLIAMS_at_LIFETOUCH.COM
>
> Fat City Network Services -- 858-538-5051 http://www.fatcity.com
> San Diego, California -- Mailing list and web hosting services
> ---------------------------------------------------------------------
> To REMOVE yourself from this mailing list, send an E-Mail message
> to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
> the message BODY, include a line containing: UNSUB ORACLE-L
> (or the name of mailing list you want to be removed from). You may
> also send the HELP command for other information (like subscribing).
>

-- 
Please see the official ORACLE-L FAQ: http://www.orafaq.net
-- 
Author: Tanel Poder
  INET: tanel.poder.003_at_mail.ee

Fat City Network Services    -- 858-538-5051 http://www.fatcity.com
San Diego, California        -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from).  You may
also send the HELP command for other information (like subscribing).
-- 
Please see the official ORACLE-L FAQ: http://www.orafaq.net
-- 
Author: John Kanagaraj
  INET: john.kanagaraj_at_hds.com

Fat City Network Services    -- 858-538-5051 http://www.fatcity.com
San Diego, California        -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from).  You may
also send the HELP command for other information (like subscribing).
Received on Mon Aug 25 2003 - 19:54:26 CDT

Original text of this message

HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US