11.2.0.3 grid install problem on Oracle linux 6.1 VM

From: Gerald Cunningham <gcunningham_at_proteuseng.com>
Date: Tue, 6 Dec 2011 10:07:03 -0500
Message-ID: <68F9DD51BF61E943BFA45D744048A7A7292F55FC34_at_nbp-ex01.proteus-technologies.com>

Hi there,

I'm setting up a RAC cluster in two Oracle Linux 6.1 Vm's under Virtual Box (per http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOracleLinux6UsingVirtualBox.php)

Installing Oracle Grid Infrastructure on node #1 (ol6-112-rac1)

On the screen "Oracle Grid Infrastructure - Setting up Grid Infrastructure - Step 4 of 9", I have:

SCAN Name = ol6-112-scan

Public Hostname                       Virtual Hostname
ol6-112-rac1.localdomain       ol6-112-rac1-vip.localdomain
ol6-112-rac2.localdomain       ol6-112-rac2-vip.localdomain

SSH connectivity is working

Identify network interfaces...

   Interface Name      Subnet            Interface Type
   eth0                             192.168.0.0    Public
   eth1                             192.168.1.0    Private

Hit "OK"

When I click "Next", it gets to "Validating Public And Private Interfaces Across Cluster Nodes", then gives me this error:

[INS-41112] Specified network interface doesnt maintain connectivity across cluster nodes."

Details:

Cause�-�Installer has detected that network interface eth0 does not maintain connectivity on all cluster nodes.

Action�-�Ensure that the chosen interface has been configured across all cluster nodes.

Additional Information:
PRVF-7617 : Node connectivity between "ol6-112-rac1 : 192.168.0.111" and "ol6-112-rac2 : 192.168.0.112" failed

Summary of the failed nodes

ol6-112-rac2 
ol6-112-rac1 
ol6-112-rac1 : 192.168.0.111

===

I can't find any problems... what am I missing?

Thanks very much for any help!

Jerry

Excruciating details below...
===

[oracle_at_ol6-112-rac1 grid]$ more /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 # Public

192.168.0.111   ol6-112-rac1.localdomain          ol6-112-rac1
192.168.0.112   ol6-112-rac2.localdomain          ol6-112-rac2
# Private
192.168.1.111   ol6-112-rac1-priv.localdomain     ol6-112-rac1-priv
192.168.1.112   ol6-112-rac2-priv.localdomain     ol6-112-rac2-priv
# Virtual
192.168.0.113   ol6-112-rac1-vip.localdomain      ol6-112-rac1-vip
192.168.0.114   ol6-112-rac2-vip.localdomain      ol6-112-rac2-vip
# SCAN
192.168.0.115   ol6-112-scan.localdomain          ol6-112-scan
192.168.0.116   ol6-112-scan.localdomain          ol6-112-scan
192.168.0.117   ol6-112-scan.localdomain          ol6-112-scan

===

[oracle_at_ol6-112-rac2 ~]$ more /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 # Public

192.168.0.111   ol6-112-rac1.localdomain          ol6-112-rac1
192.168.0.112   ol6-112-rac2.localdomain          ol6-112-rac2
# Private
192.168.1.111   ol6-112-rac1-priv.localdomain     ol6-112-rac1-priv
192.168.1.112   ol6-112-rac2-priv.localdomain     ol6-112-rac2-priv
# Virtual
192.168.0.113   ol6-112-rac1-vip.localdomain      ol6-112-rac1-vip
192.168.0.114   ol6-112-rac2-vip.localdomain      ol6-112-rac2-vip
# SCAN
192.168.0.115   ol6-112-scan.localdomain          ol6-112-scan
192.168.0.116   ol6-112-scan.localdomain          ol6-112-scan
192.168.0.117   ol6-112-scan.localdomain          ol6-112-scan

===

[oracle_at_ol6-112-rac1 grid]$ cat /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=ol6-112-rac1.localdomain
GATEWAY=192.168.0.1 ===

[oracle_at_ol6-112-rac2 ~]$ cat /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=ol6-112-rac2.localdomain
GATEWAY=192.168.0.1 ===

[oracle_at_ol6-112-rac1 grid]$ ifconfig -a | grep eth

eth0      Link encap:Ethernet  HWaddr 08:00:27:C5:99:61  
eth1      Link encap:Ethernet  HWaddr 08:00:27:3E:93:E0

===

[oracle_at_ol6-112-rac2 ~]$ ifconfig -a |grep eth

eth0      Link encap:Ethernet  HWaddr 08:00:27:C3:D4:8D  
eth1      Link encap:Ethernet  HWaddr 08:00:27:9E:67:08

===

[oracle_at_ol6-112-rac1 grid]$ cat /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE="eth0"
NM_CONTROLLED="yes"
ONBOOT=yes
TYPE=Ethernet
BOOTPROTO=none
IPADDR=192.168.0.111
PREFIX=24
GATEWAY=192.168.0.1
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
HWADDR=08:00:27:C5:99:61
NAME="System eth0"
UUID=5fb06bd0-0bb0-7ffb-45f1-d6edd65f3e03

[oracle_at_ol6-112-rac1 grid]$ cat /etc/sysconfig/network-scripts/ifcfg-eth1
DEVICE="eth1"
NM_CONTROLLED="yes"
ONBOOT=yes
TYPE=Ethernet
BOOTPROTO=none
IPADDR=192.168.1.111
PREFIX=24
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
NAME="System eth1"
UUID=9c92fad9-6ecb-3e6c-eb4d-8a47c6f50c04 HWADDR=08:00:27:3E:93:E0
GATEWAY=192.168.0.1 ===

[oracle_at_ol6-112-rac2 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE="eth0"
NM_CONTROLLED="yes"
ONBOOT=yes
TYPE=Ethernet
BOOTPROTO=none
IPADDR=192.168.0.112
PREFIX=24
GATEWAY=192.168.0.1
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
NAME="System eth0"
HWADDR=08:00:27:C3:D4:8D
UUID=5fb06bd0-0bb0-7ffb-45f1-d6edd65f3e03

[oracle_at_ol6-112-rac2 ~]$ cat /etc/sysconfig/network-scripts/ifcfg-eth1
DEVICE="eth1"
NM_CONTROLLED="yes"
ONBOOT=yes
TYPE=Ethernet
BOOTPROTO=none
IPADDR=192.168.1.112
PREFIX=24
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
NAME="System eth1"
HWADDR=08:00:27:9E:67:08
GATEWAY=192.168.0.1
UUID=9c92fad9-6ecb-3e6c-eb4d-8a47c6f50c04

===

I can ping and ssh the public and private IP's from both VM's:

[oracle_at_ol6-112-rac1 logs]$ ping -c 1 ol6-112-rac2
PING ol6-112-rac2.localdomain (192.168.0.112) 56(84) bytes of data. 64 bytes from ol6-112-rac2.localdomain (192.168.0.112): icmp_seq=1 ttl=64 time=19.3 ms

ol6-112-rac2.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 19ms rtt min/avg/max/mdev = 19.309/19.309/19.309/0.000 ms

[oracle_at_ol6-112-rac1 logs]$ ping -c 1 ol6-112-rac2-priv
PING ol6-112-rac2-priv.localdomain (192.168.1.112) 56(84) bytes of data. 64 bytes from ol6-112-rac2-priv.localdomain (192.168.1.112): icmp_seq=1 ttl=64 time=22.2 ms

ol6-112-rac2-priv.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 25ms rtt min/avg/max/mdev = 22.238/22.238/22.238/0.000 ms

[oracle_at_ol6-112-rac1 logs]$ ssh ol6-112-rac2 hostname
ol6-112-rac2.localdomain

[oracle_at_ol6-112-rac1 logs]$ ssh ol6-112-rac2-priv hostname
ol6-112-rac2.localdomain

[oracle_at_ol6-112-rac2 ~]$ ping -c 1 ol6-112-rac1
PING ol6-112-rac1.localdomain (192.168.0.111) 56(84) bytes of data. 64 bytes from ol6-112-rac1.localdomain (192.168.0.111): icmp_seq=1 ttl=64 time=0.393 ms

ol6-112-rac1.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 0.393/0.393/0.393/0.000 ms

[oracle_at_ol6-112-rac2 ~]$ ping -c 1 ol6-112-rac1-priv
PING ol6-112-rac1-priv.localdomain (192.168.1.111) 56(84) bytes of data. 64 bytes from ol6-112-rac1-priv.localdomain (192.168.1.111): icmp_seq=1 ttl=64 time=0.686 ms

ol6-112-rac1-priv.localdomain ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 0.686/0.686/0.686/0.000 ms

[oracle_at_ol6-112-rac2 ~]$ ssh ol6-112-rac1 hostname
ol6-112-rac1.localdomain

[oracle_at_ol6-112-rac2 ~]$ ssh ol6-112-rac1-priv hostname
ol6-112-rac1.localdomain

===

here is the end of my log file:

INFO: Preparing to check passwordless SSH Connectivity between nodes: [ol6-112-rac1, ol6-112-rac2]
INFO: Testing passwordless SSH connectivity between the selected nodes. This may take several minutes, please wait...
INFO: OverallStatus of User Equivalence check using CVU is SUCCESSFUL
INFO: Finding passwordless SSH connectivity setup on remote nodes
INFO: Preparing remote commands to check passwordless SSH connectivity setup on remote nodes
INFO: Total number of remote commands to be executed is 2
INFO: Total time taken to complete verification is 230 ms.
INFO: All remote nodes are configured for passwordless SSH connectivity
INFO: Validating Public nodes for user equivalence
INFO: Validating Hostnames for nodes
INFO: Validating node readiness
INFO: Checking for node liveliness
INFO: Validating Public Hosts for User Equivalence
INFO: Validating for 9.2, 10gR1 or Local CSS
INFO: Gathering system details...
INFO: Setting public and VIP node info to the bean
INFO: Validating Public And Private Interfaces Across Cluster Nodes
INFO: Validating Node VIPs
INFO: Collecting interface information for node ol6-112-rac1
INFO: Collecting interface information for node ol6-112-rac2
INFO: Copying oifcfg to node ol6-112-rac2
INFO: Copied oifcfg to node ol6-112-rac2
INFO: Removing oifcfg from node ol6-112-rac2
INFO: Removed oifcfg from node ol6-112-rac2
INFO: Validating Network Interfaces
INFO: Validating interfaces for typical - nodes = [ol6-112-rac1, ol6-112-rac2]
INFO: Validating Interface name and subnet from the default list
INFO: Validating for NO Public interfaces
INFO: Validating if Public and Private lists have any common interface
INFO: Validating for no private interface provided
INFO: Flag oracle.install.crs.allowSingleNIC=false
INFO: Validating Cluster Node details

SEVERE: [FATAL] [INS-41112] Specified network interface doesnt maintain connectivity across cluster nodes.

CAUSE: Installer has detected that network interface eth0 does not maintain connectivity on all cluster nodes. ACTION: Ensure that the chosen interface has been configured across all cluster nodes. SEVERE: [FATAL] [INS-41112] Specified network interface doesnt maintain connectivity across cluster nodes.

CAUSE: Installer has detected that network interface eth1 does not maintain connectivity on all cluster nodes. ACTION: Ensure that the chosen interface has been configured across all cluster nodes.

INFO: Advice is ABORT
INFO: Adding ExitStatus INVALID_USER_INPUT to the exit status set
INFO: Completed validating state <ClusterInfoUI>
INFO: Terminating all background operations
INFO: Terminated all background operations
INFO: Transition aborted
INFO: Rolled back to state <ClusterInfoUI>
INFO: Pause Oracle Grid Infrastructure
INFO: Resume Oracle Grid Infrastructure
INFO: Adding ExitStatus USER_CANCELLED_INSTALL to the exit status set
INFO: Finding the most appropriate exit status for the current application
INFO: Exit Status is 4
INFO: Shutdown Oracle Grid Infrastructure

--
http://www.freelists.org/webpage/oracle-l

Received on Tue Dec 06 2011 - 09:07:03 CST

This message: [ Message body ]
Next message: info_at_go-faster.co.uk: "Re: Oracle Session commands"
Previous message: Remigiusz Sokolowski: "Re: Oracle Session commands"
Next in thread: Gerald Cunningham: "RE: 11.2.0.3 grid install problem on Oracle linux 6.1 VM"
Reply: Gerald Cunningham: "RE: 11.2.0.3 grid install problem on Oracle linux 6.1 VM"

Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ]

Original text of this message