| Oracle FAQ | Your Portal to the Oracle Knowledge Grid | |
 |
 | |||
| Oracle FAQ | Your Portal to the Oracle Knowledge Grid | |
|
| |||
Home -> Community -> Mailing Lists -> Oracle-L -> RE: Export of very big table. Solution?
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.
------_=_NextPart_001_01C07A4E.5939C590
Content-Type: text/plain;
charset="iso-8859-1"
what did you set the BS parameter to on the dd command?
I have found increasing benefits up to about 128K, then it hits a knee and improvement is essentially flat.
The default ( probably 2/4 K ) is too small.
hth
-----Original Message-----
From: eric.lansu_at_dutchtone.nl [mailto:eric.lansu_at_dutchtone.nl]
Sent: Tuesday, January 09, 2001 7:21 AM
To: Multiple recipients of list ORACLE-L
Subject: Export of very big table. Solution?
Hello Listers,
Some time ago I asked you how to export a very big file. The solution was in
piping and UNIX-split.
We did this before, but what we didn't do was dd-ing from the pipe to the
dump file. We piped it straight in. It looks like this solved our corruption
problem on compressed exports files.
The problem remains it's very slow. Our exports may be in order now, but there's no way we can use them anymore. Next thing we are investigating is 'select'-ing it to a comma-delimited file, and restore it with SQL*Loader. A regular select is very slow though! It takes 2 1/2 days to unload the tabel (22.500.000 records)
Does anyone know a faster way to create a flat-file of a table this size?
Eric Lansu
-- Please see the official ORACLE-L FAQ: http://www.orafaq.com -- Author: INET: eric.lansu_at_dutchtone.nl Fat City Network Services -- (858) 538-5051 FAX: (858) 538-5051 San Diego, California -- Public Internet access / Mailing Lists -------------------------------------------------------------------- To REMOVE yourself from this mailing list, send an E-Mail message to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing). ------_=_NextPart_001_01C07A4E.5939C590 Content-Type: text/html; charset="iso-8859-1"Received on Tue Jan 09 2001 - 09:10:48 CST
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<META NAME="Generator" CONTENT="MS Exchange Server version 5.5.2653.12">
<TITLE>RE: Export of very big table. Solution?</TITLE>
</HEAD>
<BODY>
<P><FONT SIZE=2>what did you set the BS parameter to on the dd command?</FONT>
</P>
<P><FONT SIZE=2>I have found increasing benefits up to about 128K, then</FONT>
<BR><FONT SIZE=2>it hits a knee and improvement is essentially flat. </FONT>
</P>
<P><FONT SIZE=2>The default ( probably 2/4 K ) is too small. </FONT>
</P>
<P><FONT SIZE=2>hth</FONT>
</P>
<P><FONT SIZE=2>-----Original Message-----</FONT>
<BR><FONT SIZE=2>From: eric.lansu_at_dutchtone.nl [<A HREF="mailto:eric.lansu_at_dutchtone.nl">mailto:eric.lansu_at_dutchtone.nl</A>]</FONT>
<BR><FONT SIZE=2>Sent: Tuesday, January 09, 2001 7:21 AM</FONT>
<BR><FONT SIZE=2>To: Multiple recipients of list ORACLE-L</FONT>
<BR><FONT SIZE=2>Subject: Export of very big table. Solution?</FONT>
</P>
<BR>
<P><FONT SIZE=2>Hello Listers,</FONT>
</P>
<P><FONT SIZE=2>Some time ago I asked you how to export a very big file. The solution was in</FONT>
<BR><FONT SIZE=2>piping and UNIX-split.</FONT>
<BR><FONT SIZE=2>We did this before, but what we didn't do was dd-ing from the pipe to the</FONT>
<BR><FONT SIZE=2>dump file. We piped it straight in. It looks like this solved our corruption</FONT>
<BR><FONT SIZE=2>problem on compressed exports files.</FONT>
</P>
<P><FONT SIZE=2>The problem remains it's very slow. Our exports may be in order now, but</FONT>
<BR><FONT SIZE=2>there's no way we can use them anymore. Next thing we are investigating is</FONT>
<BR><FONT SIZE=2>'select'-ing it to a comma-delimited file, and restore it with SQL*Loader. A</FONT>
<BR><FONT SIZE=2>regular select is very slow though! It takes 2 1/2 days to unload the tabel</FONT>
<BR><FONT SIZE=2>(22.500.000 records)</FONT>
</P>
<P><FONT SIZE=2>Does anyone know a faster way to create a flat-file of a table this size?</FONT>
</P>
<P><FONT SIZE=2>Eric Lansu</FONT>
<BR><FONT SIZE=2>-- </FONT>
<BR><FONT SIZE=2>Please see the official ORACLE-L FAQ: http://www.orafaq.com</FONT>
<BR><FONT SIZE=2>-- </FONT>
<BR><FONT SIZE=2>Author: </FONT>
<BR><FONT SIZE=2> INET: eric.lansu_at_dutchtone.nl</FONT>
</P>
<P><FONT SIZE=2>Fat City Network Services -- (858) 538-5051 FAX: (858) 538-5051</FONT>
<BR><FONT SIZE=2>San Diego, California -- Public Internet access / Mailing Lists</FONT>
<BR><FONT SIZE=2>--------------------------------------------------------------------</FONT>
<BR><FONT SIZE=2>To REMOVE yourself from this mailing list, send an E-Mail message</FONT>
<BR><FONT SIZE=2>to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in</FONT>
<BR><FONT SIZE=2>the message BODY, include a line containing: UNSUB ORACLE-L</FONT>
<BR><FONT SIZE=2>(or the name of mailing list you want to be removed from). You may</FONT>
<BR><FONT SIZE=2>also send the HELP command for other information (like subscribing).</FONT>
 |
 |