RE: Daily job to populate table in another database

(stumbling out of my lurker corner)

Several years ago on a AIX Oracle 7.3 project, a co-DBA was tasked to do some performance testing for something similar, I saved his results. YMMV. Good luck.

Method KB/Sec Notes

SQL*Plus Copy		34.2 (arraysize=1000)
Truncate/Insert		30.2
Export/FTP/Import	      28.3
Drop/Create Table	      27.8 (unrecoverable)
Delete/Insert		25.9
SQL*Plus Copy		25.9 (arraysize=100)
Complete Snapshot	      21.9 (no log)
Unload/FTP/Load	      20.3 (direct path)
Unload/FTP/Load	      16.8 (conventional path)
Complete Snapshot	      16.8 (with log)
SQL*Plus Copy		7.4  (arraysize=15)
"Fast" Snapshot		4.6  (100% rows modified 1x@)
"Fast" Snapshot		4.4  (10% rows modified 10X@)

-----Original Message-----
Sent: Tuesday, December 10, 2002 6:05 PM To: Multiple recipients of list ORACLE-L

Hi,

There are a few options available - other people have already suggested replication, etc.

I think the decision depends slightly on data volume and personal preference:

• Certainly I have been in situations where database links are used to both pull and push data from one database to another.
• Another option is to use UTL_FILE to create a file (from within a package) and the SQL*Load that file on the other end - using parallel direct loads, etc I have seen high volumes of data moved using this technique.
• A slight variation is to use SQL*Plus to spool a file, instead of UTL_FILE. I have no figures or rules, but personal experience has shown this to be faster than using UTL_FILE.
• If the table is large and partitioned then you might be able to perform the above options on multiple partitions at the same time, or perhaps introduce some logic so that only modified partitions are copied each night.
• With regards to your manipulations, you may be able to perform them whilst creating the file or you might need to use a temporary table to first perform the manipulation and then dump this table to a file.
• Export / import is another option available - although I find it more awkward to implement than the other options typically.

Having said all of that - if you're only dealing with a small volume of data and performance is not absolutely critical than any option would be fine, including a database link.

Regards,

     Mark.  

                    "CHAN Chor

                    Ling Catherine       To:     Multiple recipients of
list ORACLE-L <ORACLE-L_at_fatcity.com>       
                    (CSC)"               cc:

                    <clchan_at_nie.ed       Subject:     Daily job to
populate table in another database              
                    u.sg>

                    Sent by:

                    root_at_fatcity.c

                    om

 

 

                    10/12/2002

                    20:28

                    Please respond

                    to ORACLE-L

 

 

Hi Gurus,

If you need to copy data (after some manipulations) from database A to another table in database B, how do you achieve that ? Our current practice is to use crontab (schedule daily job) and sqlplus (procedure to copy the data over to another database via dblink).

Do you think it's more efficient to use DBMS_JOB ? Can DBMS_JOB call the procedure at the same time daily ? Any sample? Please advise. Thanks.

Regds,
new bee

--
Please see the official ORACLE-L FAQ: http://www.orafaq.com
--
Author: CHAN Chor Ling Catherine (CSC)
  INET: clchan_at_nie.edu.sg

Fat City Network Services    -- 858-538-5051 http://www.fatcity.com
San Diego, California        -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the
message BODY, include a line containing: UNSUB ORACLE-L (or the name of
mailing list you want to be removed from).  You may also send the HELP
command for other information (like subscribing).




<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<---->>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>
   Privileged/Confidential information may be contained in this message.
          If you are not the addressee indicated in this message
       (or responsible for delivery of the message to such person),
            you may not copy or deliver this message to anyone. In such
case, you should destroy this message and kindly notify the sender
           by reply e-mail or by telephone on (61 3) 9612-6999.
   Please advise immediately if you or your employer does not consent to
                Internet e-mail for messages of this kind.
        Opinions, conclusions and other information in this message
              that do not relate to the official business of
                         Transurban City Link Ltd
         shall be understood as neither given nor endorsed by it.
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<---->>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>

-- 
Please see the official ORACLE-L FAQ: http://www.orafaq.com
-- 
Author: Mark Richard
  INET: mrichard_at_transurban.com.au

Fat City Network Services    -- 858-538-5051 http://www.fatcity.com
San Diego, California        -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in the
message BODY, include a line containing: UNSUB ORACLE-L (or the name of
mailing list you want to be removed from).  You may also send the HELP
command for other information (like subscribing).

-- 
Please see the official ORACLE-L FAQ: http://www.orafaq.com
-- 
Author: Grabowy, Chris
  INET: cgrabowy_at_fcg.com

Fat City Network Services    -- 858-538-5051 http://www.fatcity.com
San Diego, California        -- Mailing list and web hosting services
---------------------------------------------------------------------
To REMOVE yourself from this mailing list, send an E-Mail message
to: ListGuru_at_fatcity.com (note EXACT spelling of 'ListGuru') and in
the message BODY, include a line containing: UNSUB ORACLE-L
(or the name of mailing list you want to be removed from).  You may
also send the HELP command for other information (like subscribing).