Home » Server Options » RAC & Failsafe » could not bring nod up (10g clusterware inux redhat 4)
could not bring nod up [message #429575] Wed, 04 November 2009 10:45 Go to next message
samiraly
Messages: 57
Registered: June 2009
Member

Hi
I am installing 2 nodes RAC so fare Clusterware installed , oracle software , companion CD and lestener confegured correctly
every thing was ok an output for checking lestenr was as folowing
$ hostname
Rac1
$ ps -ef | grep lsnr | grep -v 'grep' | grep -v 'ocfs' | awk '{print $9}'
LISTENER_rac1
=====================
$ hostname
rac2
$ ps -ef | grep lsnr | grep -v 'grep' | grep -v 'ocfs' | awk '{print $9}'
LISTENER_rac2


after that reboted both nodes and the when i tring to bring it up it erroes out the following error
[oracle@rac1 ~]$ srvctl start nodeapps -n rac1
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.gsd' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.ons' has placement error.
CRS-1028: Dependency analysis failed because of:
CRS-0223: Resource 'ora.rac1.LISTENER_RAC1.lsnr' has placement error.
[oracle@rac1 ~]$ 


usefule data
[oracle@rac1 ~]$ /etc/init.d/o2cb status
Module "configfs": Loaded
Filesystem "configfs": Mounted
Module "ocfs2_nodemanager": Loaded
Module "ocfs2_dlm": Loaded
Module "ocfs2_dlmfs": Loaded
Filesystem "ocfs2_dlmfs": Mounted
Checking O2CB cluster ocfs2: Online
Checking O2CB heartbeat: Active

Re: could not bring nod up [message #429591 is a reply to message #429575] Wed, 04 November 2009 12:48 Go to previous messageGo to next message
ebrian
Messages: 2794
Registered: April 2006
Senior Member
Can you start the processes manually outside of srvctl ?

Have you reviewed the crs logs for additional details ?
Re: could not bring nod up [message #429634 is a reply to message #429591] Wed, 04 November 2009 16:29 Go to previous messageGo to next message
babuknb
Messages: 1736
Registered: December 2005
Location: NJ
Senior Member

Also post your four digit cluster & database version.

Post your cluster status. (crs_stat -t)

- Babu
Re: could not bring nod up [message #429756 is a reply to message #429575] Thu, 05 November 2009 12:29 Go to previous messageGo to next message
samiraly
Messages: 57
Registered: June 2009
Member

hi
OCFS version is 
[oracle@rac1 ~]$ cat /proc/fs/ocfs2/version
OCFS2 1.2.3 Tue Oct 24 16:09:36 PDT 2006 (build 6b798aaadf626d3b137c3952809b2f38)
[oracle@rac1 ~]$ 


[oracle@rac1 bin]$ id 
uid=175(oracle) gid=115(dba) groups=115(dba) context=user_u:system_r:unconfined_t
[oracle@rac1 bin]$ pwd
/u01/app/oracle/product/crs/bin
[oracle@rac1 bin]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora....C1.lsnr application    ONLINE    UNKNOWN   rac1        
ora.rac1.gsd   application    ONLINE    UNKNOWN   rac1        
ora.rac1.ons   application    ONLINE    UNKNOWN   rac1        
ora.rac1.vip   application    ONLINE    ONLINE    rac1        
ora....C2.lsnr application    ONLINE    UNKNOWN   rac2        
ora.rac2.gsd   application    ONLINE    UNKNOWN   rac2        
ora.rac2.ons   application    ONLINE    UNKNOWN   rac2        
ora.rac2.vip   application    ONLINE    ONLINE    rac2        
[oracle@rac1 bin]$ 



[oracle@rac1 bin]$ sqlplus / as sysdba

SQL*Plus: Release 10.2.0.1.0 - Production on Sat Nov 7 14:51:02 2009

Copyright (c) 1982, 2005, Oracle.  All rights reserved.

Connected to an idle instance.

SQL> 


please note that cluster database not installed yet

could you pleasr tell me how to manually start the nodes?
Thanks alot
Re: could not bring nod up [message #429759 is a reply to message #429575] Thu, 05 November 2009 12:44 Go to previous messageGo to next message
samiraly
Messages: 57
Registered: June 2009
Member

Log file contents
[oracle@rac1 rac1]$ pwd
/u01/app/oracle/product/crs/log/rac1
[oracle@rac1 rac1]$ vi alertrac1.log

2009-11-03 02:43:11.151
[client(6200)]CRS-1006:The OCR location /u02/oradata/orcl/OCRF_mirror is inaccessible. Details in /u01/app/oracle/product/crs/log/rac1/client/ocrconfig_6200.log.
2009-11-03 02:43:16.368
[client(6200)]CRS-1001:The OCR was formatted using version 2.
2009-11-03 02:45:54.052
[client(6255)]CRS-1801:Cluster crs configured with nodes rac1 rac2 .
2009-11-03 02:48:20.036
[cssd(6808)]CRS-1605:CSSD voting file is online: /u02/oradata/orcl/CSSFile. Details in /u01/app/oracle/product/crs/log/rac1/cssd/ocssd.log.
2009-11-03 02:48:20.107
[cssd(6808)]CRS-1605:CSSD voting file is online: /u02/oradata/orcl/CSSFile_mirror1. Details in /u01/app/oracle/product/crs/log/rac1/cssd/ocssd.log.
2009-11-03 02:48:20.194
"alertrac1.log" 148L, 8744C                                 



[oracle@rac1 rac1]$ df -m
Filesystem           1M-blocks      Used Available Use% Mounted on
/dev/sda1                 6038      3957      1775  70% /
none                       345         0       345   0% /dev/shm
/dev/sda5                 1012       190       771  20% /tmp
/dev/sda2                10077      2744      6822  29% /u01
/dev/sdb1                 3068       297      2771  10% /u02/oradata/orcl
[oracle@rac1 rac1]$ mount
/dev/sda1 on / type ext3 (rw)
none on /proc type proc (rw)
none on /sys type sysfs (rw)
none on /dev/pts type devpts (rw,gid=5,mode=620)
none on /dev/shm type tmpfs (rw)
/dev/sda5 on /tmp type ext3 (rw)
/dev/sda2 on /u01 type ext3 (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
configfs on /config type configfs (rw)
ocfs2_dlmfs on /dlm type ocfs2_dlmfs (rw)
/dev/sdb1 on /u02/oradata/orcl type ocfs2 (rw,_netdev,datavolume,nointr,heartbeat=local)
oracleasmfs on /dev/oracleasm type oracleasmfs (rw)
[oracle@rac1 rac1]$ 
Re: could not bring nod up [message #429767 is a reply to message #429759] Thu, 05 November 2009 13:32 Go to previous messageGo to next message
ebrian
Messages: 2794
Registered: April 2006
Senior Member
Check Note: 844272.1
Re: could not bring nod up [message #429936 is a reply to message #429575] Fri, 06 November 2009 06:42 Go to previous messageGo to next message
samiraly
Messages: 57
Registered: June 2009
Member

Hello Babu first i would like to thank you for support , really appreciate that

i would like to inform you that issue resolved i did bounce the services and it works fine

[oracle@rac2 bin]$ srvctl stop nodeapps -n rac2
[oracle@rac1 admin]$ srvctl stop nodeapps -n rac1
[oracle@rac2 bin]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora....C1.lsnr application    OFFLINE   OFFLINE               
ora.rac1.gsd   application    OFFLINE   OFFLINE               
ora.rac1.ons   application    OFFLINE   OFFLINE               
ora.rac1.vip   application    OFFLINE   OFFLINE               
ora....C2.lsnr application    OFFLINE   OFFLINE               
ora.rac2.gsd   application    OFFLINE   OFFLINE               
ora.rac2.ons   application    OFFLINE   OFFLINE               
ora.rac2.vip   application    OFFLINE   OFFLINE      

[oracle@rac2 bin]$ srvctl start nodeapps -n rac1
[oracle@rac2 bin]$ srvctl start nodeapps -n rac2


[oracle@rac1 bin]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora....C1.lsnr application    ONLINE    ONLINE    rac1        
ora.rac1.gsd   application    ONLINE    ONLINE    rac1        
ora.rac1.ons   application    ONLINE    ONLINE    rac1        
ora.rac1.vip   application    ONLINE    ONLINE    rac1        
ora....C2.lsnr application    ONLINE    ONLINE    rac2        
ora.rac2.gsd   application    ONLINE    ONLINE    rac2        
ora.rac2.ons   application    ONLINE    ONLINE    rac2        
ora.rac2.vip   application    ONLINE    ONLINE    rac2        

[oracle@rac1 bin]$  ps -ef | grep lsnr | grep -v 'grep' | grep -v 'ocfs' | awk '{print $9}'
LISTENER_RAC1

[oracle@rac2 bin]$  ps -ef | grep lsnr | grep -v 'grep' | grep -v 'ocfs' | awk '{print $9}'
LISTENER_RAC2


issue resolved thanks alot

Re: could not bring nod up [message #429951 is a reply to message #429936] Fri, 06 November 2009 08:15 Go to previous message
babuknb
Messages: 1736
Registered: December 2005
Location: NJ
Senior Member

Thanks for your update.

-Babu
Previous Topic: problem installing clusterware
Next Topic: Transparent Application Failover issue
Goto Forum:
  


Current Time: Tue Mar 19 03:47:13 CDT 2024