Return-Path: Received: from ensim.rackshack.net (root@localhost) by orafaq.net (8.11.6/8.11.6) with ESMTP id h7VGF1c09119 for ; Sun, 31 Aug 2003 11:15:01 -0500 X-ClientAddr: 66.27.56.213 Received: from www2.fatcity.com (rrcs-west-66-27-56-213.biz.rr.com [66.27.56.213]) by ensim.rackshack.net (8.11.6/8.11.6) with ESMTP id h7VGF0309114 for ; Sun, 31 Aug 2003 11:15:00 -0500 Received: (from root@localhost) by www2.fatcity.com (8.11.6/8.11.6) id h7VDhL413596 for oracle-l@orafaq.net; Sun, 31 Aug 2003 06:43:21 -0700 Received: by fatcity.com (05-Jun-2003/v1.0g-b73/bab) via fatcity.com id 005CE55B; Sun, 31 Aug 2003 06:39:27 -0800 Message-ID: Date: Sun, 31 Aug 2003 06:39:27 -0800 To: Multiple recipients of list ORACLE-L X-Comment: Oracle RDBMS Community Forum X-Sender: "Jamadagni, Rajendra" Sender: ml-errors@fatcity.com Reply-To: ORACLE-L@fatcity.com Errors-To: ML-ERRORS@fatcity.com From: "Jamadagni, Rajendra" Subject: RE: has anyone used threads to parallelize bulk loads? Organization: Fat City Network Services, San Diego, California X-ListServer: v1.0g, build 73; ListGuru (c) 1996-2003 Bruce A. Bergman Precedence: bulk Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_NextPartTM-000-efa2620a-fb84-4a7a-8425-65ed531fae27" ------=_NextPartTM-000-efa2620a-fb84-4a7a-8425-65ed531fae27 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C36FC4.CAD0752D" ------_=_NextPart_001_01C36FC4.CAD0752D Content-Type: text/plain; charset="iso-8859-1" Ryan, one word ... dbms_alert ... you'll love it. Raj -----Original Message----- Sent: Saturday, August 30, 2003 5:54 PM To: Multiple recipients of list ORACLE-L id like the wait, notify because when parts of a load end, I need to kick off other parts. you know any good sources on this? we are using 8i at work. So I cant use the recommendations that tim made. whenever i do a google search on pthreads, I get a ton of results and cant find good ones with examples. any suggestions? ----- Original Message ----- To: Multiple recipients of list ORACLE-L Sent: Saturday, August 30, 2003 5:19 PM Why dbms_job at all? Just create as many sqlplus sessions as you want using nohup in your database and execute your procedures from there. You can still use dbms_lock, dbms_alert and dbms_pipe that way. Pthreads or IPC & stuff is probably overkill if you don't need synchronization outside the database. If you still want to go that way, then you'd probably want to ask this question in some programming related forums instead of sysadmin's or Oracles. Tanel. ----- Original Message ----- To: Multiple recipients of list ORACLE-L Sent: Saturday, August 30, 2003 11:54 PM I find this useful when I have large loads with alot of small to medium sized DML statements. Instead of running them serially I use DBMS_JOB and break them up into pieces. DBMS_JOB is limiting in that it can only do 36 at once per instance. If I want to do more, Id have to do it outside the database. I have read about unix 'pthreads'. These appear to have the same wait,notify,synchronize interface that java has. Im also on Solaris. Has anyone done anything like this? Any features on Solaris that I can use? I know solaris has some built-in low level C functions to handle locking(such as a mutex script). Any idea of some sources I can use to look this up? I dont need this for work right now, but I may need it in the future, so I want to play around with it. Or do I have to take this to a unix sys admin forum? If so anyone know any good ones? Threading interfaces seem to be very similiar across platforms. In oracle you achieve the same thing with dbms_job,dbms_lock,and dbms_alert. anyone got any scripts or experience with this? This is not essential. Im just playing around. ------_=_NextPart_001_01C36FC4.CAD0752D Content-Type: text/html; charset="iso-8859-1"
Ryan,
 
one word ... dbms_alert ... you'll love it.
 
Raj
-----Original Message-----
From: Ryan [mailto:rgaffuri@cox.net]
Sent: Saturday, August 30, 2003 5:54 PM
To: Multiple recipients of list ORACLE-L
Subject: Re: has anyone used threads to parallelize bulk loads?

id like the wait, notify because when parts of a load end, I  need to kick off other parts. you know any good sources on this?
we are using 8i at work. So I cant use the recommendations that tim made.
 
whenever i do a google search on pthreads, I get a ton of results and cant find good ones with examples. any suggestions?
----- Original Message -----
Sent: Saturday, August 30, 2003 5:19 PM
Subject: Re: has anyone used threads to parallelize bulk loads?

Why dbms_job at all? Just create as many sqlplus sessions as you want using nohup in your database and execute your procedures from there. You can still use dbms_lock, dbms_alert and dbms_pipe that way.
Pthreads or IPC & stuff is probably overkill if you don't need synchronization outside the database. If you still want to go that way, then you'd probably want to ask this question in some programming related forums instead of sysadmin's or Oracles.
 
Tanel.
----- Original Message -----
From: Ryan
Sent: Saturday, August 30, 2003 11:54 PM
Subject: has anyone used threads to parallelize bulk loads?

I find this useful when I have large loads with alot of small to medium sized DML statements. Instead of running them serially I use DBMS_JOB and break them up into pieces.
 
DBMS_JOB is limiting in that it can only do 36 at once per instance. If I want to do more, Id have to do it outside the database. I have read about unix 'pthreads'. These appear to have the same wait,notify,synchronize interface that java has. Im also on Solaris.
 
Has anyone done anything like this? Any features on Solaris that I can use? I know solaris has some built-in low level C functions to handle locking(such as a mutex script). Any idea of some sources I can use to look this up?
 
I dont need this for work right now, but I may need it in the future, so I want to play around with it. Or do I have to take this to a unix sys admin forum? If so anyone know any good ones?
 
Threading interfaces seem to be very similiar across platforms. In oracle you achieve the same thing with dbms_job,dbms_lock,and dbms_alert.
 
anyone got any scripts or experience with this? This is not essential. Im just playing around.
------_=_NextPart_001_01C36FC4.CAD0752D-- ------=_NextPartTM-000-efa2620a-fb84-4a7a-8425-65ed531fae27 Content-Type: text/plain; name="ESPN_Disclaimer.txt" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="ESPN_Disclaimer.txt" *********************************************************************This e-mail message is confidential, intended only for the named recipient(s) above and may contain information that is privileged, attorney work product or exempt from disclosure under applicable law. If you have received this message in error, or are not the named recipient(s), please immediately notify corporate MIS at (860) 766-2000 and delete this e-mail message from your computer, Thank you.*********************************************************************1 ------=_NextPartTM-000-efa2620a-fb84-4a7a-8425-65ed531fae27-- -- Please see the official ORACLE-L FAQ: http://www.orafaq.net -- Author: Jamadagni, Rajendra INET: Rajendra.Jamadagni@espn.com Fat City Network Services -- 858-538-5051 http://www.fatcity.com San Diego, California -- Mailing list and web hosting services --------------------------------------------------------------------- To REMOVE yourself from this mailing list, send an E-Mail message to: ListGuru@fatcity.com (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).