Re: ORA-27086: skgfglk: unable to lock file - already in use -> Instance "BOCHUM", status BLOCKED

From: A. Farber <Alexander.Farber_at_gmail.com>
Date: Fri, 27 Jun 2008 03:06:24 -0700 (PDT)
Message-ID: <ca1a79a2-014f-427a-934b-756c23d0d98f@25g2000hsx.googlegroups.com>


On 27 , 11:55, "A. Farber" <Alexander.Far..._at_gmail.com> wrote:
> Now I have an even worse looking error message:
>
> SQL> startup
> ORACLE instance started.
>
> Total System Global Area 135336712 bytes
> Fixed Size 451336 bytes
> Variable Size 109051904 bytes
> Database Buffers 25165824 bytes
> Redo Buffers 667648 bytes
> Database mounted.
> ORA-01157: cannot identify/lock data file 1 - see DBWR trace file
> ORA-01110: data file 1: '/abl/apps/oracle/oradata/BOCHUM/system01.dbf'
>

The lsnrctl reports the "BOCHUM" database as ready:

oracle_at_ablora01:BOCHUM> lsnrctl status

LSNRCTL for Linux: Version 9.2.0.8.0 - Production on 27-JUN-2008 11:36:28

Copyright (c) 1991, 2006, Oracle Corporation. All rights reserved.

Connecting to (ADDRESS=(PROTOCOL=tcp)(PORT=1521)) STATUS of the LISTENER


Alias                     LISTENER
Version                   TNSLSNR for Linux: Version 9.2.0.8.0 -
Production
Start Date                27-JUN-2008 11:26:12
Uptime                    0 days 0 hr. 10 min. 15 sec
Trace Level               off
Security                  OFF
SNMP                      OFF
Listener Log File         /abl/apps/oracle/9.2/network/log/
listener.log
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)
(HOST=ablora01.internal.novero.com)(PORT=1521))) Services Summary...
Service "BOCHUM" has 1 instance(s).
  Instance "BOCHUM", status READY, has 1 handler(s) for this service...
The command completed successfully
  • but I'm worried about the error message:

> ORA-01157: cannot identify/lock data file 1 - see DBWR trace file
> ORA-01110: data file 1: '/abl/apps/oracle/oradata/BOCHUM/system01.dbf'

I've tried to shutdown/startup the BOCHUM database several times, the error message won't go away.

Why can't Oracle lock its data file?

In the /abl/apps/oracle/admin/BOCHUM/bdump/alert_BOCHUM.log I see:

Fri Jun 27 11:36:11 2008
Errors in file /abl/apps/oracle/admin/BOCHUM/bdump/ bochum_dbw0_29416.trc:
ORA-01157: cannot identify/lock data file 7 - see DBWR trace file ORA-01110: data file 7: '/abl/apps/oracle/oradata/BOCHUM/ td_db_storage_01.dbf'
ORA-27086: skgfglk: unable to lock file - already in use Linux Error: 11: Resource temporarily unavailable Additional information: 8
Fri Jun 27 11:36:11 2008
Errors in file /abl/apps/oracle/admin/BOCHUM/bdump/ bochum_dbw0_29416.trc:

ORA-01157: cannot identify/lock data file 201 - see DBWR trace file
ORA-01110: data file 201: '/abl/apps/oracle/oradata/BOCHUM/temp01.dbf'
ORA-27086: skgfglk: unable to lock file - already in use
Linux Error: 11: Resource temporarily unavailable Additional information: 8
ORA-1157 signalled during: ALTER DATABASE OPEN...

In the /abl/apps/oracle/admin/BOCHUM/bdump/bochum_dbw0_29416.trc I see repeatedly:

/abl/apps/oracle/admin/BOCHUM/bdump/bochum_dbw0_29416.trc Oracle9i Release 9.2.0.8.0 - Production
JServer Release 9.2.0.8.0 - Production
ORACLE_HOME = /abl/apps/oracle/9.2
System name: Linux

Node name:      ablora01.XXX.XXX.com
Release:        2.6.9-67.0.15.ELsmp
Version:        #1 SMP Thu May 8 10:52:19 EDT 2008
Machine:        i686

Instance name: BOCHUM
Redo thread mounted by this instance: 1
Oracle process number: 3
Unix process pid: 29416, image: oracle_at_ablora01.XXX.XXX.com (DBW0)
  • SESSION ID:(2.1) 2008-06-27 11:36:11.162 ORA-01157: cannot identify/lock data file 1 - see DBWR trace file ORA-01110: data file 1: '/abl/apps/oracle/oradata/BOCHUM/system01.dbf' ORA-27086: skgfglk: unable to lock file - already in use Linux Error: 11: Resource temporarily unavailable Additional information: 8 ORA-01157: cannot identify/lock data file 2 - see DBWR trace file ORA-01110: data file 2: '/abl/apps/oracle/oradata/BOCHUM/ undotbs01.dbf' ORA-27086: skgfglk: unable to lock file - already in use Linux Error: 11: Resource temporarily unavailable Additional information: 8

......repeats this again and again......

Regards
Alex

PS: More info:

oracle_at_ablora01:BOCHUM> /usr/sbin/lsof | fgrep -i .dbf oracle_at_ablora01:BOCHUM> /usr/sbin/lsof | fgrep -i .ctl oracle 29416 oracle 12u REG 0,25 1613824 20364956 / abl/apps/oracle/oradata/BOCHUM/control01.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29416 oracle 13u REG 0,25 1613824 20364957 / abl/apps/oracle/oradata/BOCHUM/control02.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29416 oracle 14u REG 0,25 1613824 20364958 / abl/apps/oracle/oradata/BOCHUM/control03.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29418 oracle 12u REG 0,25 1613824 20364956 / abl/apps/oracle/oradata/BOCHUM/control01.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29418 oracle 13u REG 0,25 1613824 20364957 / abl/apps/oracle/oradata/BOCHUM/control02.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29418 oracle 14u REG 0,25 1613824 20364958 / abl/apps/oracle/oradata/BOCHUM/control03.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29420 oracle 12uW REG 0,25 1613824 20364956 / abl/apps/oracle/oradata/BOCHUM/control01.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29420 oracle 13uW REG 0,25 1613824 20364957 / abl/apps/oracle/oradata/BOCHUM/control02.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle 29420 oracle 14uW REG 0,25 1613824 20364958 / abl/apps/oracle/oradata/BOCHUM/control03.ctl (ablnas02:/vol/ablapp01/ oracle)
oracle_at_ablora01:BOCHUM> ipcs

  • Shared Memory Segments -------- key shmid owner perms bytes nattch status 0x1aaa70c8 327680 oracle 640 140509184 8
  • Semaphore Arrays -------- key semid owner perms nsems 0xe408a284 1409024 oracle 640 154
  • Message Queues -------- key msqid owner perms used-bytes messages
Received on Fri Jun 27 2008 - 05:06:24 CDT

Original text of this message