From oracle-l-bounce@freelists.org Thu Oct 27 10:07:24 2005 Return-Path: Received: from air891.startdedicated.com (root@localhost) by orafaq.com (8.12.10/8.12.10) with ESMTP id j9RF74aj012050 for ; Thu, 27 Oct 2005 10:07:14 -0500 X-ClientAddr: 206.53.239.180 Received: from turing.freelists.org (freelists-180.iquest.net [206.53.239.180]) by air891.startdedicated.com (8.12.10/8.12.10) with ESMTP id j9RF6GvX011792 for ; Thu, 27 Oct 2005 10:06:17 -0500 Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 953FA2114EA; Thu, 27 Oct 2005 10:06:09 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 25346-08; Thu, 27 Oct 2005 10:06:09 -0500 (EST) Received: from turing (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 1389C2114DE; Thu, 27 Oct 2005 10:06:09 -0500 (EST) Received: with ECARTIS (v1.0.0; list oracle-l); Thu, 27 Oct 2005 10:04:14 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 41BD02114EB for ; Thu, 27 Oct 2005 10:04:14 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 25006-07 for ; Thu, 27 Oct 2005 10:04:14 -0500 (EST) Received: from xproxy.gmail.com (xproxy.gmail.com [66.249.82.193]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id B867D2114DD for ; Thu, 27 Oct 2005 10:04:13 -0500 (EST) Received: by xproxy.gmail.com with SMTP id s8so785229wxc for ; Thu, 27 Oct 2005 08:04:13 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=MmA/w8EJQi7MInxykJH01Zttm5iwUpaDZZzSUK8p5T7DJgcf7eCWYzzDQaYdgsx0JSwfk4kYFOu7V7RghgyRrAACrD9DaHaSCe0BBCEyGyBz/ZBxszYOeiVAn+j7AGfXcQB5jvZ3RcJyNRwUu7xZ3nNHAFi3wmZcyW0dGVFy5Dw= Received: by 10.70.79.5 with SMTP id c5mr1014723wxb; Thu, 27 Oct 2005 08:04:12 -0700 (PDT) Received: by 10.70.11.13 with HTTP; Thu, 27 Oct 2005 08:04:12 -0700 (PDT) Message-ID: <5ea165840510270804t19f8abd2o1c3b96b3f3cd2d30@mail.gmail.com> Date: Thu, 27 Oct 2005 11:04:12 -0400 From: Magnus Andersen To: Igor Neyman Subject: Re: dbms_job failed to execute Cc: oracle-l@freelists.org In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_20528_12643824.1130425452040" References: X-archive-position: 27682 X-ecartis-version: Ecartis v1.0.0 Sender: oracle-l-bounce@freelists.org Errors-To: oracle-l-bounce@freelists.org X-original-sender: mag.andersen@gmail.com Precedence: normal Reply-To: mag.andersen@gmail.com X-list: oracle-l X-Virus-Scanned: by amavisd-new-20030616-p9 (Debian) at avenirtech.net X-mailscan-MailScanner-Information: Please contact the ISP for more information X-mailscan-MailScanner: Found to be clean X-MailScanner-From: oracle-l-bounce@freelists.org X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on air891.startdedicated.com X-Spam-Level: X-Spam-Status: No, hits=-4.7 required=5.0 tests=AWL,BAYES_00, HTML_FONTCOLOR_BLUE,HTML_MESSAGE autolearn=no version=2.63 ------=_Part_20528_12643824.1130425452040 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Igor, The database only goes down Saturday mornings for cold backup. I'm doing ho= t backups the rest of the week. I'm thinking about changing this to only to hot backups since I've read that there is no reason to do the cold, but tha= t is an other thread I might start to iron that out. My guess is that the problem started saturday, but I didn't catch the issue before Tuesday morning. The reason you see all the jobs executed this morning is that I ha= d to run them manually. We have several processes that are depending on these procedures being run. They do not execute on their own. Hope this makes sense. Magnus On 10/27/05, Igor Neyman wrote: > > Magnus, > When you are saying that jobs stopped executing on Tuesday, does it mean > that they were not executed since then? > Your output from dba_jobs shows that all your jobs were executed this > morning (probably when your instance was started) and they all are schedu= led > to be executed tomorrow at different times (probably, as they are suppose= d > to). > The reason they all were executed this morning right after instance > started is that most probably your instance was down at the time when the= y > were scheduled to be executed, and when oracle starts, it checks if it > missed to execute some jobs while the instance was down. > And if it finds such jobs that "missed" their scheduled time, it will > execute them immediately (not waiting for next scheduled time). > HTH > Igor > > ------------------------------ > *From:* oracle-l-bounce@freelists.org [mailto: > oracle-l-bounce@freelists.org] *On Behalf Of *Magnus Andersen > *Sent:* Thursday, October 27, 2005 10:17 AM > *Cc:* oracle-l@freelists.org > *Subject:* Re: dbms_job failed to execute > > I found two trace files with the same time stamp on them. These are the > closest to when I saw the problem. Could this have "hung" since the datab= ase > bounced? > > -- > Magnus Andersen > Systems Administrator / Oracle DBA > Walker & Associates, Inc. > > > Trace file information... > > Dump file /opt/oracle/ora92/rdbms/log /prd/bdump/prd_j000_9659.trc > Oracle9i Enterprise Edition Release 9.2.0.6.0 - Production > With the Partitioning, OLAP and Oracle Data Mining options > JServer Release 9.2.0.6.0 - Production > ORACLE_HOME =3D /opt/oracle/ora92 > System name: Linux > Node name: oraprd.walkerassoc.com > Release: 2.4.21-32.0.1.ELsmp > Version: #1 SMP Tue May 17 17:52:23 EDT 2005 > Machine: i686 > Instance name: prd > Redo thread mounted by this instance: 1 > Oracle process number: 28 > Unix process pid: 9659, image: oracle@oraprd.walkerassoc.com (J000) > > *** 2005-10-22 00:38:58.415 > *** SESSION ID:(27.52095) 2005-10-22 00:38:58.391 > OPIRIP: Uncaught error 1089. Error stack: > ORA-01089: immediate shutdown in progress - no operations are permitted > ORA-00448: normal completion of background process > -- Magnus Andersen Systems Administrator / Oracle DBA Walker & Associates, Inc. ------=_Part_20528_12643824.1130425452040 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Igor,

The database only goes down Saturday mornings for cold backup.  I'm doing hot backups the rest of the week.  I'm thinking about changing this to only to hot backups since I've read that there is no reason to do the cold, but that is an other thread I might start to iron that out.  My guess is that the problem started saturday, but I didn't catch the issue before Tuesday morning.  The reason you see all the jobs executed this morning is that I had to run them manually.  We have several processes that are depending on these procedures being run.  They do not execute on their own.

Hope this makes sense.

Magnus

On 10/27/05, Igor Neyman <ineyman@perceptron.com> wrote:
Magnus,
 
When you are saying that jobs stopped executing on Tuesday,=20 does it mean that they were not executed since then?
Your output from dba_jobs shows that all your jobs were=20 executed this morning (probably when your instance was started) and they al= l are=20 scheduled to be executed tomorrow at different times (probably, as they are= =20 supposed to).
 
The reason they all were executed this morning right after=20 instance started is that most probably your instance was down at the time w= hen=20 they were scheduled to be executed, and when oracle starts, it checks if it= =20 missed to execute some jobs while the instance was down.
And if it finds such jobs that "missed" their schedu= led=20 time, it will execute them immediately (not waiting for next scheduled=20 time).
 
HTH
Igor

From: oracle-l-bounce@freelists.org=20 [mailto:oracle-l-bounce@fr= eelists.org] On Behalf Of Magnus=20 Andersen
Sent: Thursday, October 27, 2005 10:17 AM
C= c:=20 oracle-l@freelists.org
= Subject: Re: dbms_job failed to=20 execute

I found two trace files with the same time stamp on them.  = These=20 are the closest to when I saw the problem.  Could this have "hung= " since=20 the database bounced?

--
Magnus=20 Andersen
Systems Administrator / Oracle DBA
Walker & Associates,= =20 Inc.


Trace file information...

Dump file=20 /opt/oracle/ora92/rdbms/log=20
/prd/bdump/prd_j000_9659.trc
Oracle9i Enterprise Edition Release=20 9.2.0.6.0 - Production
With the Partitioning, OLAP and Oracle Data Minin= g=20 options
JServer Release 9.2.0.6.0 - Production
ORACLE_HOME =3D=20 /opt/oracle/ora92
System name:    Linux
Node=20 name:      oraprd.walkerassoc.com
Release:     &nb= sp; =20 2.4.21-32.0.1.ELsmp
Version:        #= 1 SMP=20 Tue May 17 17:52:23 EDT=20 2005
Machine:        i686
Instance= =20 name: prd
Redo thread mounted by this instance: 1
Oracle process numb= er:=20 28
Unix process pid: 9659, image: oracle@oraprd.walkerassoc.com (J000)

*** 2005-10-22= =20 00:38:58.415
*** SESSION ID:(27.52095) 2005-10-22 00:38:58.391
OPIRIP= :=20 Uncaught error 1089. Error stack:
ORA-01089: immediate shutdown in progr= ess -=20 no operations are permitted
ORA-00448: normal completion of background= =20 process



--
Magnus And= ersen
Systems Administrator / Oracle DBA
Walker & Associates, Inc= . ------=_Part_20528_12643824.1130425452040-- -- http://www.freelists.org/webpage/oracle-l