Home » Server Options » RAC & Failsafe » Cluster starts with different interconnect ip's (RHEL 6.5 Oracle RDBMS 11.2.0.3)
Cluster starts with different interconnect ip's [message #630443] Sun, 28 December 2014 09:22 Go to next message
harish1102
Messages: 5
Registered: December 2014
Location: winston
Junior Member
Hi all,
Issue: when i start RAC(2 node) with srvctl cluster assigns 169.254.. for the both the nodes but when i start cluster node with sqlplus it assings my public ip i.e 10.200.. And When i start one instance with srvctl and other with sqlplus it would fail with errors(unable to assing ip errors from alert log) because one of the node already started with 169.254..sqlplus on another node not able to assign 169.254.. Apart from using cluster_interconnects initialization parameter can you guys pls suggest to troubleshoot the issue. Thanks a lot in advance.

Thank you
Re: Cluster starts with different interconnect ip's [message #630444 is a reply to message #630443] Sun, 28 December 2014 09:31 Go to previous messageGo to next message
John Watson
Messages: 8023
Registered: January 2010
Location: Global Village
Senior Member
Welcome to the forum. Please read our OraFAQ Forum Guide and How to use [code] tags and make your code easier to read

Harish, your post is very confused. For example, this "when i start cluster node with sqlplus" makes no sense: you cannot start a cluster node with SQL*Plus. Do you mean start the clusterware, or start a database instance? And this, "cluster assigns 169.254.. for the both the nodes" is equally confusing: the 169.x.x.x addresses are for HAIP, which is nothing to do with database instances. And this, "unable to assing ip errors from alert log" does not mean anything to me.
Can you describe the problem again, and use copy/paste to show what happens when you run various commands with SQL*Plus and srvctl.

And please do NOT forget to use the [code] tags when you copy/paste.

--update: typo

[Updated on: Sun, 28 December 2014 09:37]

Report message to a moderator

Re: Cluster starts with different interconnect ip's [message #630445 is a reply to message #630444] Sun, 28 December 2014 09:41 Go to previous messageGo to next message
BlackSwan
Messages: 26606
Registered: January 2009
Location: SoCal
Senior Member
>(RHEL 6.5 Oracle RDBMS 11.2.0.3)
is above a supported combination?
Re: Cluster starts with different interconnect ip's [message #630446 is a reply to message #630444] Sun, 28 December 2014 09:58 Go to previous messageGo to next message
harish1102
Messages: 5
Registered: December 2014
Location: winston
Junior Member
Thanks for the quick response watson and sorry for the confusion. Yes you understood correct for database instance inplace of node. I will get the log's inbetween i would like to explain my problem once again here.

scenario 1: Start clusterware using srvctl utility(srvctl start database -d orcl), i could able to start my RAC database(2 instances) with interconnect ip's assigned as 169.x.x.1 and 169.x.x.2.
scenario 2: Start clusterware single instance using srvctl (srvctl start instance -i orcl1 -d orcl), i could able to view my interconnect ip(v$cluster_interconnects) assigned as 169.x.x.1. With this when i wanted to start my 2nd db instance with SQL*plus it would fail to start.
scenario 3: Start database instance with SQL*PLUS (sql> startup;) interconnect ip assigned is (v$cluster_interconnects) 10.x.x.1. With this when i start my 2nd database instance on another node using SQL*plus (sql>startup;) interconnect ip assigned is 10.x.x.2.

Will post the alertlogs soon. Thanks again for your response.
Re: Cluster starts with different interconnect ip's [message #630447 is a reply to message #630446] Sun, 28 December 2014 10:00 Go to previous messageGo to next message
harish1102
Messages: 5
Registered: December 2014
Location: winston
Junior Member
I believe yes swan, checked in MOS. Thankyou
Re: Cluster starts with different interconnect ip's [message #630449 is a reply to message #630446] Sun, 28 December 2014 11:36 Go to previous messageGo to next message
John Watson
Messages: 8023
Registered: January 2010
Location: Global Village
Senior Member
I shall try again. This statement is rubbish:Quote:
Start clusterware using srvctl utility(srvctl start database -d orcl),
You start the clusterware with
crscrtl start cluster -all
whereas you appear to be describing starting database instances. You must be precise when describing problems.

And speaking of describing problems, you have not yet done so. I asked you to show what the problem is, using copy/paste from your SQL*Plus and srvctl session. Your statement that "it would fail to start" is useless.

[Updated on: Sun, 28 December 2014 11:37]

Report message to a moderator

icon2.gif  Re: Cluster starts with different interconnect ip's [message #630450 is a reply to message #630443] Sun, 28 December 2014 13:46 Go to previous messageGo to next message
harish1102
Messages: 5
Registered: December 2014
Location: winston
Junior Member
Last login: Wed Dec 24 10:52:07 2014 from 10.200.x.x
Profile set to Oracle 11.2.0.3 environment
syslab1:nothing:/home/oracle> ps -ef | grep pmon
grid 2400 1 0 Dec22 ? 00:04:32 asm_pmon_+ASM1
oracle 3185 1 0 Dec22 ? 00:05:41 ora_pmon_repo1
oracle 6641 6515 0 14:24 pts/0 00:00:00 grep pmon
oracle 14006 1 0 Dec23 ? 00:05:04 ora_pmon_orcl1
syslab1:nothing:/home/oracle> srvctl stop database -d orcl
syslab1:nothing:/home/oracle> orcl1
Profile set to Oracle 11.2.0.3 environment
syslab1:orcl1:/home/oracle> srvctl start instance -i orcl1 -d orcl
syslab1:orcl1:/home/oracle> ssh syslab2
Last login: Sun Dec 28 14:23:21 2014 from 10.200.x.x
Profile set to Oracle 11.2.0.3 environment
syslab2:nothing:/home/oracle> export ORACLE_SID=orcl2
syslab2:orcl2:/home/oracle> sqlplus / as sysdba

SQL*Plus: Release 11.2.0.3.0 Production on Sun Dec 28 14:28:47 2014

Copyright (c) 1982, 2011, Oracle. All rights reserved.

Connected to an idle instance.

SQL> startup;
ORA-03113: end-of-file on communication channel <=== orcl2 instance failed
SQL> exit
Disconnected
syslab2:orcl2:/home/oracle> exit
logout
Connection to syslab2 closed.
syslab1:orcl1:/home/oracle> sqlplus / as sysdba

SQL*Plus: Release 11.2.0.3.0 Production on Sun Dec 28 14:33:38 2014

Copyright (c) 1982, 2011, Oracle. All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> select * from gv$cluster_interconnects;

INST_ID NAME IP_ADDRESS IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
1 eth1:1 169.254.x.x NO

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
syslab1:orcl1:/home/oracle> srvctl stop instance -i orcl1 -d orcl
syslab1:orcl1:/home/oracle> sqlplus / as sysdba

SQL*Plus: Release 11.2.0.3.0 Production on Sun Dec 28 14:35:35 2014

Copyright (c) 1982, 2011, Oracle. All rights reserved.

Connected to an idle instance.

SQL> startup;
ORACLE instance started.

Total System Global Area 626327552 bytes
Fixed Size 2230952 bytes
Variable Size 503317848 bytes
Database Buffers 113246208 bytes
Redo Buffers 7532544 bytes
Database mounted.
Database opened.
SQL> select * from gv$cluster_interconnects;

INST_ID NAME IP_ADDRESS IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
1 eth0 10.200.x.x NO OS dependent software

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
syslab1:orcl1:/home/oracle> ssh syslab1
Last login: Sun Dec 28 14:25:25 2014 from 10.200.x.x
Profile set to Oracle 11.2.0.3 environment
syslab1:nothing:/home/oracle> orcl2
-bash: orcl2: command not found
syslab1:nothing:/home/oracle> exit
logout
Connection to syslab1 closed.
syslab1:orcl1:/home/oracle> ssh syslab2
Last login: Sun Dec 28 14:28:14 2014 from syslab1
Profile set to Oracle 11.2.0.3 environment
syslab2:nothing:/home/oracle> orcl2
Profile set to Oracle 11.2.0.3 environment
syslab2:orcl2:/home/oracle> sqlplus / as sysdba

SQL*Plus: Release 11.2.0.3.0 Production on Sun Dec 28 14:35:01 2014

Copyright (c) 1982, 2011, Oracle. All rights reserved.

Connected to an idle instance.

SQL> startup;
ORACLE instance started.

Total System Global Area 626327552 bytes
Fixed Size 2230952 bytes
Variable Size 469763416 bytes
Database Buffers 146800640 bytes
Redo Buffers 7532544 bytes
Database mounted.
Database opened.
SQL> select * from gv$cluster_interconnects;

INST_ID NAME IP_ADDRESS IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
2 eth0 10.200.x.x NO OS dependent software
1 eth0 10.200.x.x NO OS dependent software

Error message from syslab2 rdbms/orcl/orcl2/trace/alert.log

[USER(15531)]CRS-2304:GPnP profile signature verification failed. get-profile request aborted.
WARNING: No cluster interconnect has been specified. Depending on
the communication driver configured Oracle cluster traffic
may be directed to the public interface of this machine.
Oracle recommends that RAC clustered databases be configured
with a private interconnect for enhanced security and
performance.
Picked latch-free SCN scheme 3


Thank you Watson and others in advance.

[Updated on: Sun, 28 December 2014 13:48]

Report message to a moderator

Re: Cluster starts with different interconnect ip's [message #630451 is a reply to message #630450] Sun, 28 December 2014 13:53 Go to previous messageGo to next message
John Watson
Messages: 8023
Registered: January 2010
Location: Global Village
Senior Member
Your post is unreadable. Please use [code] tags to format it properly.
Re: Cluster starts with different interconnect ip's [message #631539 is a reply to message #630451] Wed, 14 January 2015 20:32 Go to previous message
harish1102
Messages: 5
Registered: December 2014
Location: winston
Junior Member
Found the issue.
Reason sqlplus utility taking public interconnect ip's was due to ora_crs_home enviornment variable was set incorrect under oracle user login.

Thank you
Previous Topic: What Oracle Version is Suitable
Next Topic: Should we delete grid infrastructure logs if it gets too big
Goto Forum:
  


Current Time: Mon Oct 21 05:20:07 CDT 2019