Home » Server Options » Data Guard » Trying to add a physical standby using Grid failed with ORA-16000 (10.2.0.4 Solaris)
Trying to add a physical standby using Grid failed with ORA-16000 [message #406173] Tue, 02 June 2009 11:29 Go to next message
Orna
Messages: 62
Registered: November 2008
Member
Hi

I am trying to add a physical standby DB to a 10.2.0.4 database using the Grid control GUI.

It failed at the end on the 'Step: Create Standby Database'

This is the log for this step ( step #79 ) - after backing up and restoring and after the recoverDatabase step

Output log :

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:13:44 2009

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

SQL> SQL> Connected.
SQL> SQL> SQL> ORA-01109: database not open


Database dismounted.
ORACLE instance shut down.
SQL> SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:14:04 2009

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

SQL> SQL> Connected to an idle instance.
SQL> SQL> ORACLE instance started.

Total System Global Area 3221225472 bytes
Fixed Size 2044072 bytes
Variable Size 2315259736 bytes
Database Buffers 889192448 bytes
Redo Buffers 14729216 bytes
SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:14:08 2009


Copyright (c) 1982, 2007, Oracle. All Rights Reserved.


SQL> Connected.
SQL> SQL> 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
PL/SQL procedure successfully completed.


SQL> SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:14:08 2009

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

SQL> SQL> Connected.
SQL> SQL> SQL> ORA-01507: database not mounted


ORACLE instance shut down.
SQL> SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:14:14 2009

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

SQL> SQL> Connected to an idle instance.
SQL> SQL> ORACLE instance started.

Total System Global Area 3221225472 bytes
Fixed Size 2044072 bytes
Variable Size 2315259736 bytes
Database Buffers 889192448 bytes
Redo Buffers 14729216 bytes
Database mounted.
SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:14:22 2009

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

SQL> SQL> Connected.
SQL> SQL> SQL> ORA-01109: database not open


Database dismounted.
ORACLE instance shut down.
SQL> SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL*Plus: Release 10.2.0.4.0 - Production on Tue Jun 2 15:14:39 2009

Copyright (c) 1982, 2007, Oracle. All Rights Reserved.

SQL> SQL> Connected to an idle instance.
SQL> SQL> ORACLE instance started.

Total System Global Area 3221225472 bytes
Fixed Size 2044072 bytes
Variable Size 2315259736 bytes
Database Buffers 889192448 bytes
Redo Buffers 14729216 bytes
Database mounted.
SQL> Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u03/oradata/dg1/system011.dbf' to '/dg2/u04/oradata/dg2/system011.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u03/oradata/dg1/system011.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u03/oradata/dg1/undotbs011.dbf' to '/dg2/u04/oradata/dg2/undotbs011.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u03/oradata/dg1/undotbs011.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u03/oradata/dg1/sysaux011.dbf' to '/dg2/u04/oradata/dg2/sysaux011.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u03/oradata/dg1/sysaux011.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/users011.dbf' to '/dg2/u04/oradata/dg2/users011.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/users011.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/netrac_data01.dbf' to '/dg2/u04/oradata/dg2/netrac_data01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/netrac_data01.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/iview.dbf' to '/dg2/u04/oradata/dg2/iview.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/iview.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/VCADMIN01.dbf' to '/dg2/u04/oradata/dg2/VCADMIN01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/VCADMIN01.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/virt_cent_admin.dbf' to '/dg2/u04/oradata/dg2/virt_cent_admin.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/virt_cent_admin.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/testdir01.dbf' to '/dg2/u04/oradata/dg2/testdir01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/testdir01.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/sunopsis.dbf' to '/dg2/u04/oradata/dg2/sunopsis.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/sunopsis.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/xpedio02.dbf' to '/dg2/u04/oradata/dg2/xpedio02.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/xpedio02.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/xpedio01.dbf' to '/dg2/u04/oradata/dg2/xpedio01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/xpedio01.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/otis02.dbf' to '/dg2/u04/oradata/dg2/otis02.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/otis02.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/otis_data01.dbf' to '/dg2/u04/oradata/dg2/otis_data01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/otis_data01.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/ne_data.dbf' to '/dg2/u04/oradata/dg2/ne_data.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/ne_data.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/iboss_dt2.dbf' to '/dg2/u04/oradata/dg2/iboss_dt2.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/iboss_dt2.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/iboss_dt1.dbf' to '/dg2/u04/oradata/dg2/iboss_dt1.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/iboss_dt1.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/iboss_dt.dbf' to '/dg2/u04/oradata/dg2/iboss_dt.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/iboss_dt.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/ARSYSTEM3.dbf' to '/dg2/u04/oradata/dg2/ARSYSTEM3.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/ARSYSTEM3.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/ARSYSTEM2.dbf' to '/dg2/u04/oradata/dg2/ARSYSTEM2.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/ARSYSTEM2.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/ARSYSTEM1.dbf' to '/dg2/u04/oradata/dg2/ARSYSTEM1.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/ARSYSTEM1.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/users01.dbf' to '/dg2/u04/oradata/dg2/users01.dbf'
dgcreate.DGrenameFiles: SELECT STATUS FROM V$DATAFILE WHERE NAME = '/dg1/u04/oradata/dg1/users01.dbf'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u03/oradata/dg1/redo01.log' to '/dg2/u04/oradata/dg2/redo01.log'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u03/oradata/dg1/redo02.log' to '/dg2/u04/oradata/dg2/redo02.log'
dgcreate.DGrenameFiles: ALTER DATABASE RENAME FILE '/dg1/u03/oradata/dg1/redo03.log' to '/dg2/u04/oradata/dg2/redo03.log'
dgcreate.DGrenameFiles: ALTER DATABASE CLEAR LOGFILE GROUP 1
dgcreate.DGrenameFiles: ALTER DATABASE CLEAR LOGFILE GROUP 2
dgcreate.DGrenameFiles: ALTER DATABASE CLEAR LOGFILE GROUP 3
dgcreate.DGgetRecoverySCN: SELECT MAX(NEXT_CHANGE#) FROM V$ARCHIVED_LOG
dgcreate.DGrecoverStby: SELECT FILE#, NAME from v$tempfile
dgcreate.DGrecoverStby: ALTER DATABASE RENAME FILE '/dg1/u04/oradata/dg1/temp01.dbf' to '/tmp/temp16000'
dgcreate.DGrecoverStby: ALTER DATABASE TEMPFILE 3 DROP
dgcreate.DGrecoverStby: ALTER DATABASE RECOVER AUTOMATIC FROM '/dg2/u01/arch/dg2' STANDBY DATABASE UNTIL CHANGE 9210711497140
dgcreate.DGrecoverStby: ALTER DATABASE RECOVER CANCEL
dgcreate.DGrecoverStby: ALTER DATABASE OPEN READ ONLY
dgcreate.DGcreateSpfile: CREATE SPFILE FROM PFILE='/dg2/u01/app/oracle/product/10.2/dbs/initdg2.ora'
dgcreate.DGaddTempfiles: ALTER TABLESPACE TEMP ADD TEMPFILE '/dg2/u04/oradata/dg2/temp01.dbf' SIZE 1212416K REUSE AUTOEXTEND ON NEXT 640K MAXSIZE 33553408K
SQL Error: ORA-00604: error occurred at recursive SQL level 1
ORA-16000: database open for read-only access
ORA-06512: at line 26 (DBD ERROR: OCIStmtExecute)



the last line in the alert log were :

ALTER TABLESPACE TEMP ADD TEMPFILE '/dg2/u04/oradata/dg2/temp01.dbf' SIZE 1212416K REUSE AUTOEXTEND ON NEXT 640K MAXSIZE 33553408K
Completed: ALTER TABLESPACE TEMP ADD TEMPFILE '/dg2/u04/oradata/dg2/temp01.dbf' SIZE 1212416K REUSE AUTOEXTEND ON NEXT 640K MAXSIZE 33553408K
INSV started with pid=13, OS id=16351

and the tempfile was created successfully

Any ideas ?
How to debug ?

Orna
Re: Trying to add a physical standby using Grid failed with ORA-16000 [message #406206 is a reply to message #406173] Tue, 02 June 2009 15:37 Go to previous messageGo to next message
Orna
Messages: 62
Registered: November 2008
Member
Hi

Just a follow up :

the problem was with a DDL database trigger, that is not sensitive to the read only mode of the standby database
disabling the DDL trigger solved my problem

Orna
Re: Trying to add a physical standby using Grid failed with ORA-16000 [message #406544 is a reply to message #406206] Thu, 04 June 2009 09:17 Go to previous message
babuknb
Messages: 1729
Registered: December 2005
Location: NJ
Senior Member

Thanks for the feedback.

Babu
Previous Topic: In STB there is always one newer archive file more than in PRI
Next Topic: Setup Physical Standby Database
Goto Forum:
  


Current Time: Sat Aug 30 09:36:47 CDT 2014

Total time taken to generate the page: 0.09863 seconds