RE: Using multiple NICs for Oracle dNFS
Date: Wed, 28 Mar 2012 14:11:13 -0400
Message-ID: <304F58144267C5439E733532ABC9A3A114826715_at_USA0300MS02.na.xerox.net>
Thanks again Matt. Let me ask our NAS folks to make the change and then I will give you a feedback.
Appreciate it.
-----Original Message-----
From: Zito, Matthew [mailto:Matt_Zito_at_bmc.com]
Sent: Wednesday, March 28, 2012 2:06 PM
To: Hameed, Amir
Subject: RE: Using multiple NICs for Oracle dNFS
Ah-ah - here's your issue. Your NAS filer will also need a 10.9.101 IP, ideally one on a different NIC or trunk on the filer, but you could add it as an alias to the existing interface.
Matt
-----Original Message-----
From: Hameed, Amir [mailto:Amir.Hameed_at_xerox.com]
Sent: Wednesday, March 28, 2012 2:05 PM
To: Zito, Matthew
Subject: RE: Using multiple NICs for Oracle dNFS
Hi Matt,
I appreciate the feedback.
This is what I have:
ixgbe0 10.9.100.20 ixgbe2 10.9.101.20 NAS IP 10.9.100.16
Trace route from ixgbe0 to filer works fine:
traceroute -s 10.9.100.20 10.9.100.16
traceroute to 10.9.100.16 (10.9.100.16) from 10.9.100.20, 30 hops max,
40 byte packets
1 pn0300xd0708-nfsq (10.9.100.16) 0.314 ms 0.078 ms 0.066 ms
Trace route from ixgbe2 to filer does not work fine:
traceroute -s 10.9.101.20 10.9.100.16
traceroute to 10.9.100.16 (10.9.100.16) from 10.9.101.20, 30 hops max,
40 byte packets
1 * * * 2 * * * 3 * * * 4 * * *
I will forward this note to the DL.
Thanks
-----Original Message-----
From: Zito, Matthew [mailto:Matt_Zito_at_bmc.com]
Sent: Wednesday, March 28, 2012 1:58 PM
To: Hameed, Amir
Subject: RE: Using multiple NICs for Oracle dNFS
If you could forward my response to the list, I'd appreciate it, as somehow my posting to the list is broken.
The short answer is that they can be in the same VLAN, but different *logical* networks, or different VLANs and different networks.
The longer answer is that you need something like
Nic0 - 10.1.1.5/24
Nic1 - 10.1.2.5/24
And on the filer:
Nic0 - 10.1.1.6/24
Nic1 - 10.1.2.6/24
You can have them on the same VLAN or different, it doesn't really matter at this point. If they're on the same network, so, for example: 10.1.1.5/24 is nic0 and 10.1.1.4/24 is nic1, the box will not properly load balance traffic between the two networks.
When you say traceroute, what does the output look like? If you're expecting to get 10gb speeds, you really need to make sure that there are no routers in between your filers/NAS heads and your database machines.
Matt
--
Matthew Zito
Product Development Architect
BMC Software
-----Original Message-----
From: oracle-l-bounce_at_freelists.org
[mailto:oracle-l-bounce_at_freelists.org] On Behalf Of Hameed, Amir
Sent: Wednesday, March 28, 2012 1:52 PM
To: oracle-l_at_freelists.org
Subject: Using multiple NICs for Oracle dNFS
Folks,
When configuring multiple NICs (two in our case) for dNFS per RAC
server, do all NICs need to be in the same VLAN (assuming that private
dedicated VLANs are used) or does each NIC need to be in its own private
VLAN?
We have configured two 10GbE NICs in a private VLAN on each RAC node.
However, when I run trace-route (these are Solaris boxes) from the dNFS
NIC IPs to the NAS IP, trace-route works fine on one NIC and not on the
other and this behavior is consistent on all RAC nodes where trace-route
is working fine on one of the NICs and not on the other. Our networking
people are not able to figure out what is causing it. Our Unix people
believe that if multiple NICs are part of the same VLAN then the traffic
will go out (to NAS) only from one NIC but will be received by both NICs
(from NAS). I am not a networking expert and would appreciate if anyone
can provide some feedback.
Thanks
Amir
--
http://www.freelists.org/webpage/oracle-l
--
http://www.freelists.org/webpage/oracle-l
Received on Wed Mar 28 2012 - 13:11:13 CDT