Oracle FAQ Your Portal to the Oracle Knowledge Grid
HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US
 

Home -> Community -> Mailing Lists -> Oracle-L -> RE: Fastest COPY method on Unix ?

RE: Fastest COPY method on Unix ?

From: Brian MacLean <bmaclean_at_homebid.com>
Date: Fri, 30 Jun 2000 16:48:34 -0700
Message-Id: <10544.111034@fatcity.com>


This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible.

------_=_NextPart_001_01BFE2ED.BA1C022C
Content-Type: text/plain;

        charset="windows-1252"

When your original posting came across I tried a few tests. I didn't post them because of the Digital platform requirement. On Solaris I found that "cp file1 file2" and "dd if=file1 of=file2 bs=131072" compared about the same using the "timex" command. This was on a single cpu box without a good 0+1 disk configuration. I would have thought "cp" would be slower but maybe the "memory map file" method is being used or something. How they will compare on your configuration requires your testing.

Something of interest but not something I can test is what you might be seeing with tar. If your on a multiple cpu box and have a good 0+1 disk configuration maybe tar would be faster in that each tar is running on a different cpu...

         "(cd /somedirectory; tar -cf - somefile) | (cd /someotherdirectory; tar -xf - )"

Under this scenario maybe "dd" with the "bs" option at say 128k just might be the ultimate solution.

        "(cd /somedirectory; dd bs=131072 if=somefile) | (cd
/someotherdirectory; dd bs=131072 of=somefile )"

BOL & let me know what happens.

Brian P. Mac Lean
Senior Oracle Database Administrator
OCPv8/Oracle Master
HomeBid.Com
8700 N. Gainey Center Drive
Scottsdale, AZ 85258

Tel:480.609.4624
Cel:602.617.6075
Fax:480.609.4646
Net:brian.maclean_at_homebid.com

----Original Message-----
From: Deepak Sharma [mailto:sharmakdeep_at_yahoo.com] Sent: Friday, June 30, 2000 10:04 AM
To: Multiple recipients of list ORACLE-L Subject: RE: Fastest COPY method on Unix ?

I tried testing with 1 Gig file and found TAR to be the fastest. I am looking for some command where you could specify a large BUFFER to copy file on DIsk (not on Tape). How does 'dd' perform ? Anyone ?


Oracle DBA,
Minneapolis, MN
USA

Do You Yahoo!?
Get Yahoo! Mail - Free email you can access from anywhere! http://mail.yahoo.com/
-- 
Author: Deepak Sharma
  INET: sharmakdeep_at_yahoo.com

Fat City Network Services    -- (858) 538-5051  FAX: (858) 538-5051
San Diego, California        -- Public Internet access / Mailing Lists
--------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from).  You may
also send the HELP command for other information (like subscribing).

------_=_NextPart_001_01BFE2ED.BA1C022C
Content-Type: text/html;
	charset="windows-1252"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dwindows-1252">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
5.5.2448.0">
<TITLE>RE: Fastest COPY method on Unix ?</TITLE>
</HEAD>
<BODY>
<BR>

<P><FONT SIZE=3D2 FACE=3D"Arial">When your original posting came across =
I tried a few tests.&nbsp; I didn't post them because of the Digital =
platform requirement.&nbsp; On Solaris I found that &quot;cp file1 =
file2&quot; and &quot;dd if=3Dfile1 of=3Dfile2 bs=3D131072&quot; =
compared about the same using the &quot;timex&quot; command.&nbsp; This =
was on a single cpu box without a good 0+1 disk configuration.&nbsp; I =
would have thought &quot;cp&quot; would be slower but maybe the =
&quot;memory map file&quot; method is being used or something.&nbsp; =
How they will compare on your configuration requires your =
testing.</FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Something of interest but not =
something I can test is what you might be seeing with tar.&nbsp; If =
your on a multiple cpu box and have a good 0+1 disk configuration maybe =
tar would be faster in that each tar is running on a different =
cpu...</FONT></P>

<P><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &quot;(cd =

/somedirectory; tar -cf - somefile) | (cd /someotherdirectory; tar -xf =
- )&quot;</FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">Under this scenario maybe = &quot;dd&quot; with the &quot;bs&quot; option at say 128k just might be = the ultimate solution. </FONT> </P> <P>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <FONT SIZE=3D2 = FACE=3D"Arial">&quot;(cd /somedirectory; dd bs=3D131072 if=3Dsomefile) = | (cd /someotherdirectory; dd bs=3D131072 of=3Dsomefile )&quot;</FONT> </P> <BR> <BR> <P><FONT SIZE=3D2 FACE=3D"Arial">BOL &amp; let me know what = happens.</FONT> </P> <BR> <P><B><FONT COLOR=3D"#0000FF" FACE=3D"Comic Sans MS">Brian P. Mac = Lean</FONT></B> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans MS">Senior = Oracle Database Administrator</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans = MS">OCPv8/Oracle Master</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans = MS">HomeBid.Com</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans MS">8700 N. = Gainey Center Drive</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans MS">Scottsdale, = AZ&nbsp; 85258</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans = MS">Tel:480.609.4624</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans = MS">Cel:602.617.6075</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans = MS">Fax:480.609.4646</FONT> <BR><FONT COLOR=3D"#808080" SIZE=3D1 FACE=3D"Comic Sans = MS">Net:brian.maclean_at_homebid.com</FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">----Original Message-----</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">From: Deepak Sharma [<A = HREF=3D"mailto:sharmakdeep_at_yahoo.com">mailto:sharmakdeep_at_yahoo.com</A>]<=
/FONT>
<BR><FONT SIZE=3D2 FACE=3D"Arial">Sent: Friday, June 30, 2000 10:04 = AM</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">To: Multiple recipients of list = ORACLE-L</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">Subject: RE: Fastest COPY method on = Unix ?</FONT> </P> <BR> <P><FONT SIZE=3D2 FACE=3D"Arial">I tried testing with 1 Gig file and = found TAR to be</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">the fastest. I am looking for some = command where you</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">could specify a large BUFFER to copy = file on DIsk (not</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">on Tape). How does 'dd' perform ? = Anyone ?</FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">-- Deepak</FONT> </P> <BR> <P><FONT SIZE=3D2 FACE=3D"Arial">--- &quot;Deshpande, Kirti&quot; = &lt;Kirti.Deshpande_at_gtedc.gte.com&gt;</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">wrote:</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; I think 'cp' will be the fastest = to copy files from</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; one FS to another on the</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; same machine. cpio or&nbsp; tar = will be an overkill for</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; such things, as you will</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; have to pipe the output to some = other command to</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; write to new location. It</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; will add more processing and = time.&nbsp;&nbsp; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; - Kirti</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; -----Original = Message-----</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; = From:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Deepak Sharma = [SMTP:sharmakdeep_at_yahoo.com]</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; = Sent:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Wednesday, June 28, 2000 5:08 = PM</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; To: Multiple recipients of = list ORACLE-L</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Subject:&nbsp;&nbsp;&nbsp; = Fastest COPY method on Unix ?</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Slightly off-topic = question. I am trying to find</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; the</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; quickest way to copy files = from one file system to</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; the</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; other on Digital Unix. It = does not matter what</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; command</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; is used (cp, cpio, tar, = vdump etc.) as long as I</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; have</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; a copy in the fastest = time.</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Thanks,</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Deepak</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; =3D=3D=3D=3D=3D</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Oracle DBA,</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Minneapolis, MN</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; USA</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; = __________________________________________________</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Do You Yahoo!?</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Get Yahoo! Mail - Free = email you can access from</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; anywhere!</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; <A = HREF=3D"http://mail.yahoo.com/" = TARGET=3D"_blank">http://mail.yahoo.com/</A></FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; -- </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Author: Deepak = Sharma</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt;&nbsp;&nbsp; INET: = sharmakdeep_at_yahoo.com</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; Fat City Network = Services&nbsp;&nbsp;&nbsp; -- (858) 538-5051 </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; FAX: (858) 538-5051</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; San Diego, = California&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -- Public = Internet</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; access / Mailing Lists</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt;</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt;</FONT> <BR><FONT SIZE=3D2 = FACE=3D"Arial">---------------------------------------------------------= -----------</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; To REMOVE yourself from = this mailing list, send an</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; E-Mail message</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; to: ListGuru_at_fatcity.com = (note EXACT spelling of</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; 'ListGuru') and in</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; the message BODY, include a = line containing: UNSUB</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; ORACLE-L</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; (or the name of mailing = list you want to be</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; removed from).&nbsp; You = may</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; &gt; also send the HELP command = for other information</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; (like subscribing).</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; -- </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; Author: Deshpande, Kirti</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt;&nbsp;&nbsp; INET: = Kirti.Deshpande_at_gtedc.gte.com</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; Fat City Network = Services&nbsp;&nbsp;&nbsp; -- (858) 538-5051&nbsp; FAX:</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; (858) 538-5051</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; San Diego, = California&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -- Public = Internet</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; access / Mailing Lists</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt;</FONT> <BR><FONT SIZE=3D2 = FACE=3D"Arial">---------------------------------------------------------= -----------</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; To REMOVE yourself from this = mailing list, send an</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; E-Mail message</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; to: ListGuru_at_fatcity.com (note = EXACT spelling of</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; 'ListGuru') and in</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; the message BODY, include a line = containing: UNSUB</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; ORACLE-L</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; (or the name of mailing list you = want to be removed</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; from).&nbsp; You may</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; also send the HELP command for = other information</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&gt; (like subscribing).</FONT> </P> <BR> <P><FONT SIZE=3D2 FACE=3D"Arial">=3D=3D=3D=3D=3D</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">Oracle DBA,</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">Minneapolis, MN</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">USA</FONT> </P> <P><FONT SIZE=3D2 = FACE=3D"Arial">__________________________________________________</FONT>= <BR><FONT SIZE=3D2 FACE=3D"Arial">Do You Yahoo!?</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">Get Yahoo! Mail - Free email you can = access from anywhere!</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial"><A HREF=3D"http://mail.yahoo.com/" = TARGET=3D"_blank">http://mail.yahoo.com/</A></FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">-- </FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">Author: Deepak Sharma</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">&nbsp; INET: = sharmakdeep_at_yahoo.com</FONT> </P> <P><FONT SIZE=3D2 FACE=3D"Arial">Fat City Network = Services&nbsp;&nbsp;&nbsp; -- (858) 538-5051&nbsp; FAX: (858) = 538-5051</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">San Diego, = California&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -- Public Internet = access / Mailing Lists</FONT> <BR><FONT SIZE=3D2 = FACE=3D"Arial">---------------------------------------------------------= -----------</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">To REMOVE yourself from this mailing = list, send an E-Mail message</FONT> <BR><FONT SIZE=3D2 FACE=3D"Arial">to: ListGuru_at_fatcity.com (note EXACT = spelling of 'ListGuru') and in</FONT>
Received on Fri Jun 30 2000 - 18:48:34 CDT

Original text of this message

HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US