Return-Path: Delivered-To: 2-oracle-l@orafaq.com Received: (qmail 6474 invoked from network); 12 Dec 2007 08:44:29 -0600 Received: from freelists-180.iquest.net (HELO turing.freelists.org) (206.53.239.180) by static-ip-69-64-49-119.inaddr.intergenia.de with SMTP; 12 Dec 2007 08:44:29 -0600 Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id D635B7D8420; Wed, 12 Dec 2007 09:44:29 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 01279-10; Wed, 12 Dec 2007 09:44:29 -0500 (EST) Received: from turing (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 4DF067D83FF; Wed, 12 Dec 2007 09:44:29 -0500 (EST) Received: with ECARTIS (v1.0.0; list oracle-l); Wed, 12 Dec 2007 08:57:04 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id E22EE7D801A for ; Wed, 12 Dec 2007 08:57:03 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 23782-06 for ; Wed, 12 Dec 2007 08:57:03 -0500 (EST) Received: from web35405.mail.mud.yahoo.com (web35405.mail.mud.yahoo.com [66.163.179.114]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with SMTP id 718887D73B4 for ; Wed, 12 Dec 2007 08:57:02 -0500 (EST) Received: (qmail 52161 invoked by uid 60001); 12 Dec 2007 13:57:02 -0000 X-YMail-OSG: RKS_hLEVM1l_2n6rUAPkExfylMrJzOyFawhsolU92MMDy5OrsxzecxAJBXJeAI0unUegZq7obw-- Received: from [67.90.115.78] by web35405.mail.mud.yahoo.com via HTTP; Wed, 12 Dec 2007 05:57:02 PST Date: Wed, 12 Dec 2007 05:57:02 -0800 (PST) From: Dan Norris Subject: Re: Linux NIC bonding To: exriscer@gmail.com Cc: Oracle L MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-203805582-1197467822=:52032" Message-ID: <297867.52032.qm@web35405.mail.mud.yahoo.com> X-archive-position: 3874 X-ecartis-version: Ecartis v1.0.0 Sender: oracle-l-bounce@freelists.org Errors-to: oracle-l-bounce@freelists.org X-original-sender: dannorris@dannorris.com Precedence: normal Reply-to: dannorris@dannorris.com List-help: List-unsubscribe: List-software: Ecartis version 1.0.0 List-Id: oracle-l X-List-ID: oracle-l List-subscribe: List-owner: List-post: List-archive: X-list: oracle-l X-Virus-Scanned: Debian amavisd-new at localhost.localdomain --0-203805582-1197467822=:52032 Content-Type: text/plain; charset=us-ascii As I mentioned, I use active-passive (aka active-backup). Sorry if my terminology confused you. Dan ----- Original Message ---- From: LS Cheng To: dannorris@dannorris.com Cc: Oracle L Sent: Wednesday, December 12, 2007 4:33:44 AM Subject: Re: Linux NIC bonding Hi Dan What mode do you use, 0, 1, 2.. etc? Sounds you have used 1 (active-backup). This is what kernel doc says about it: active-backup or 1 Active-backup policy: Only one slave in the bond is active. A different slave becomes active if, and only if, the active slave fails. The bond's MAC address is externally visible on only one port (network adapter) to avoid confusing the switch. In bonding version 2.6.2 or later, when a failover occurs in active-backup mode, bonding will issue one or more gratuitous ARPs on the newly active slave. One gratutious ARP is issued for the bonding master interface and each VLAN interfaces configured above it, provided that the interface has at least one IP address configured. Gratuitous ARPs issued for VLAN interfaces are tagged with the appropriate VLAN id. This mode provides fault tolerance. The primary option, documented below, affects the behavior of this mode. I have always used 0 in the past Thanks -- LSC On Dec 12, 2007 6:22 AM, Dan Norris wrote: I'm building a cluster using Oracle Clusterware and have configured redundant pairs of NICs on the Linux servers using the Linux bonding module (active-passive). I know how to configure the Linux end of things and that's working fine. However, the switches used by this customer (they're Dell branded--not sure who really makes the guts) have been getting "confused" by bonding and our simple ping tests lose about 50% of the packets when we plug the redundant pairs into the two separate (trunked) switches. This is only peripherally related to Oracle--it's really a networking and server config issue, but I'm hoping that someone with more networking background than I have can explain what switch configuration will enable this to work properly. The customer has stated that this will never work (though I have done it before at other sites and it worked fine). The customer has stated that the Linux configuration must be two active NICs with a virtual IP and virtual MAC. I imagine that will work, but I'm not familiar with that configuration and I don't think Linux has native support for it, so it'd probably be a Broadcom or Intel software package. It's questionable how Oracle would view that from a support perspective (if they care at all). So, the question: Is there some "magical" switch setting that would possibly be missing in a fairly "default" configuration that might enable this to work properly? I figure it's a long shot asking a networking question on the Oracle list, but thanks for any pointers. Dan --0-203805582-1197467822=:52032 Content-Type: text/html; charset=us-ascii
As I mentioned, I use active-passive (aka active-backup). Sorry if my terminology confused you.

Dan

----- Original Message ----
From: LS Cheng <exriscer@gmail.com>
To: dannorris@dannorris.com
Cc: Oracle L <oracle-l@freelists.org>
Sent: Wednesday, December 12, 2007 4:33:44 AM
Subject: Re: Linux NIC bonding

Hi Dan

What mode do you use, 0, 1, 2.. etc? Sounds you have used 1 (active-backup). This is what kernel doc says about it:

active-backup or 1

        Active-backup policy: Only one slave in the bond is
        active.  A different slave becomes active if, and only
        if, the active slave fails.  The bond's MAC address is
        externally visible on only one port (network adapter)
        to avoid confusing the switch.

        In bonding version 2.6.2 or later, when a failover
        occurs in active-backup mode, bonding will issue one
        or more gratuitous ARPs on the newly active slave.
        One gratutious ARP is issued for the bonding master
        interface and each VLAN interfaces configured above
        it, provided that the interface has at least one IP
        address configured.  Gratuitous ARPs issued for VLAN
        interfaces are tagged with the appropriate VLAN id.

        This mode provides fault tolerance.  The primary
        option, documented below, affects the behavior of this
        mode.

I have always used 0 in the past

Thanks

--
LSC


On Dec 12, 2007 6:22 AM, Dan Norris <dannorris@dannorris.com > wrote:
I'm building a cluster using Oracle Clusterware and have configured redundant pairs of NICs on the Linux servers using the Linux bonding module (active-passive). I know how to configure the Linux end of things and that's working fine. However, the switches used by this customer (they're Dell branded--not sure who really makes the guts) have been getting "confused" by bonding and our simple ping tests lose about 50% of the packets when we plug the redundant pairs into the two separate (trunked) switches.

This is only peripherally related to Oracle--it's really a networking and server config issue, but I'm hoping that someone with more networking background than I have can explain what switch configuration will enable this to work properly. The customer has stated that this will never work (though I have done it before at other sites and it worked fine). The customer has stated that the Linux configuration must be two active NICs
 with a virtual IP and virtual MAC. I imagine that will work, but I'm not familiar with that configuration and I don't think Linux has native support for it, so it'd probably be a Broadcom or Intel software package. It's questionable how Oracle would view that from a support perspective (if they care at all).

So, the question: Is there some "magical" switch setting that would possibly be missing in a fairly "default" configuration that might enable this to work properly? I figure it's a long shot asking a networking question on the Oracle list, but thanks for any pointers.

Dan


--0-203805582-1197467822=:52032-- -- http://www.freelists.org/webpage/oracle-l