Received: (qmail 26339 invoked from network); 28 Sep 2011 10:53:24 -0500 Received: from freelists-180.iquest.net (HELO turing.freelists.org) (206.53.239.180) by static-ip-85-25-126-90.inaddr.ip-pool.com with SMTP; 28 Sep 2011 10:53:13 -0500 Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id B664DE45B21; Wed, 28 Sep 2011 11:53:07 -0400 (EDT) X-Virus-Scanned: Debian amavisd-new at localhost.localdomain Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id cZGEbyNTT8qV; Wed, 28 Sep 2011 11:53:07 -0400 (EDT) Received: from turing.freelists.org (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 7D403E45AF4; Wed, 28 Sep 2011 11:52:23 -0400 (EDT) Received: with ECARTIS (v1.0.0; list oracle-l); Wed, 28 Sep 2011 11:51:41 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 6ED05E45ADD for ; Wed, 28 Sep 2011 11:51:41 -0400 (EDT) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 5bDsBxIweq1n for ; Wed, 28 Sep 2011 11:51:41 -0400 (EDT) Received: from pacdcimo01.cable.comcast.com (PacdcIMO01.cable.comcast.com [24.40.8.145]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 0097FE45A97 for ; Wed, 28 Sep 2011 11:51:40 -0400 (EDT) Received: from ([147.191.124.12]) by pacdcimo01.cable.comcast.com with ESMTP id 5503620.141404359; Wed, 28 Sep 2011 11:51:35 -0400 Received: from COPDCEXMB08.cable.comcast.com ([fe80::3011:502:d530:7d25]) by copdcexhub01.cable.comcast.com ([fe80::22:42f7:39c7:1328%10]) with mapi id 14.01.0289.001; Wed, 28 Sep 2011 09:51:35 -0600 From: "Walker, Jed S" To: "oracle-l@freelists.org" Subject: RACnode communication problem? Thread-Topic: RACnode communication problem? Date: Wed, 28 Sep 2011 15:51:35 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [165.137.32.103] Content-type: text/plain MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-archive-position: 38967 X-ecartis-version: Ecartis v1.0.0 Sender: oracle-l-bounce@freelists.org Errors-to: oracle-l-bounce@freelists.org X-original-sender: Jed_Walker@cable.comcast.com Precedence: normal Reply-To: Jed_Walker@cable.comcast.com List-help: List-unsubscribe: List-software: Ecartis version 1.0.0 List-Id: oracle-l X-List-ID: oracle-l List-subscribe: List-owner: List-post: List-archive: X-list: oracle-l Hi, I'm trying to install RAC 11.2.0 - Linux-x86-64, RedHat 5.3, oracle 11.2.0.3.0 (fyi - I also tried with 11.2.0.2.0 and got the same result) Has anyone seen this before, and have a solution? runcluvfy.sh and runInstaller complain that the nodes can't talk to each other, but I can ssh (passwordless) between them and oracle has even copied files from node1 to the other nodes in /tmp. I believe there is nothing wrong, but need to figure out why oracle suddenly thinks something is wrong. BTW, yesterday, it wasn't complaining at all, but the servers were rebooted last night. It works fine when I do things manually, but oracle doesn't seem to think it works. I'm hoping I'm either doing something "RAC newbie" or it is just a weird oracle thing Here is what runcluvfy says (and runInstaller) (note: yes, changed the a/b on network so I don't get in trouble) [oracle@flux-rac-node-wcdp-01 grid]$ ./runcluvfy.sh stage -pre crsinst -n flux-rac-node-wcdp-01,flux-rac-node-wcdp-02 Performing pre-checks for cluster services setup Checking node reachability... Node reachability check passed from node "flux-rac-node-wcdp-01" Checking user equivalence... User equivalence check passed for user "oracle" Checking node connectivity... Checking hosts config file... Verification of the hosts config file successful WARNING: Make sure IP address "bond0 : 99.99.230.195 [99.99.230.128] " is up and is a valid IP address on node "flux-rac-node-wcdp-02" WARNING: Make sure IP address "bond0 : 99.99.230.194 [99.99.230.128] " is up and is a valid IP address on node "flux-rac-node-wcdp-01" ERROR: PRVF-7616 : Node connectivity failed for subnet "99.99.230.128" between "flux-rac-node-wcdp-02 - bond0 : 99.99.230.195" and "flux-rac-node-wcdp-01 - bond0 : 99.99.230.194" Checking multicast communication... Checking subnet "99.99.230.128" for multicast communication with multicast group "230.0.1.0"... I've checked ifconfig and everything looks fine, and here you can see I can ssh between them (and yes, I've done it both ways). Also, the runcluvfy.sh apparently is able to connect over because when I run it, node2 gets oracle files created in /tmp. [oracle@flux-rac-node-wcdp-02 ~]$ ssh flux-rac-node-wcdp-02 ls -l /tmp WARNING: This system is solely for ... total 4 drwxr-xr-x 3 oracle dba 4096 Sep 28 15:36 CVU_11.2.0.3.0_oracle -- http://www.freelists.org/webpage/oracle-l