Return-Path: Delivered-To: 2-oracle-l@orafaq.com Received: (qmail 17357 invoked from network); 12 Dec 2007 05:20:42 -0600 Received: from freelists-180.iquest.net (HELO turing.freelists.org) (206.53.239.180) by static-ip-69-64-49-119.inaddr.intergenia.de with SMTP; 12 Dec 2007 05:20:41 -0600 Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 55EB87D632A; Wed, 12 Dec 2007 06:20:42 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 28607-10; Wed, 12 Dec 2007 06:20:42 -0500 (EST) Received: from turing (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id B78292547; Wed, 12 Dec 2007 06:20:41 -0500 (EST) Received: with ECARTIS (v1.0.0; list oracle-l); Wed, 12 Dec 2007 05:33:45 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 301607D7F50 for ; Wed, 12 Dec 2007 05:33:45 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19991-10 for ; Wed, 12 Dec 2007 05:33:45 -0500 (EST) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.227]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id CA8067D7C81 for ; Wed, 12 Dec 2007 05:33:44 -0500 (EST) Received: by wr-out-0506.google.com with SMTP id c49so116869wra.1 for ; Wed, 12 Dec 2007 02:33:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; bh=i9N1t9q6npFTgSrKeKDVH7HI2+Zft58vXUA6ONiB8NM=; b=TzqjANlr3xH/4iiv33cFpIvAbgUmgnIrk5IH7fhFUsBntRvlkT0wDzS+JzcnbiOiqZZw4rbjz98rM6qUDfCed/s6aII1dVo8hUw+AU7ri1cDTWgFo3eLav+1rCSRtR8KVHOXphcOPqpMlOUqF56EcgHjoUBzYK/lKhTahqx0HrQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=GTLr4iccLRUMhcCmvKIs84g0MU0vE0MoG7AA9cp7ddCk19IgCU4nuZG30psa/6XEV6wyuGirgl2yGNjChTq3DpyCvnyKW0Za6hKrTQNRXqVYi0EoE6NTDOdVkIQd3AIY9mAyQ7BMaNbc0dPt6V9mMiwsjenWCXOPxMhw1fmnm7Q= Received: by 10.150.178.6 with SMTP id a6mr135978ybf.91.1197455624297; Wed, 12 Dec 2007 02:33:44 -0800 (PST) Received: by 10.150.143.21 with HTTP; Wed, 12 Dec 2007 02:33:44 -0800 (PST) Message-ID: <6e9345580712120233y36112f2ey11f1a100e48e30e0@mail.gmail.com> Date: Wed, 12 Dec 2007 11:33:44 +0100 From: "LS Cheng" To: dannorris@dannorris.com Subject: Re: Linux NIC bonding Cc: "Oracle L" In-Reply-To: <389254.73262.qm@web35414.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_8333_3331294.1197455624280" References: <389254.73262.qm@web35414.mail.mud.yahoo.com> X-archive-position: 3867 X-ecartis-version: Ecartis v1.0.0 Sender: oracle-l-bounce@freelists.org Errors-to: oracle-l-bounce@freelists.org X-original-sender: exriscer@gmail.com Precedence: normal Reply-to: exriscer@gmail.com List-help: List-unsubscribe: List-software: Ecartis version 1.0.0 List-Id: oracle-l X-List-ID: oracle-l List-subscribe: List-owner: List-post: List-archive: X-list: oracle-l X-Virus-Scanned: Debian amavisd-new at localhost.localdomain ------=_Part_8333_3331294.1197455624280 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi Dan What mode do you use, 0, 1, 2.. etc? Sounds you have used 1 (active-backup). This is what kernel doc says about it: active-backup or 1 Active-backup policy: Only one slave in the bond is active. A different slave becomes active if, and only if, the active slave fails. The bond's MAC address is externally visible on only one port (network adapter) to avoid confusing the switch. In bonding version 2.6.2 or later, when a failover occurs in active-backup mode, bonding will issue one or more gratuitous ARPs on the newly active slave. One gratutious ARP is issued for the bonding master interface and each VLAN interfaces configured above it, provided that the interface has at least one IP address configured. Gratuitous ARPs issued for VLAN interfaces are tagged with the appropriate VLAN id. This mode provides fault tolerance. The primary option, documented below, affects the behavior of this mode. I have always used 0 in the past Thanks -- LSC On Dec 12, 2007 6:22 AM, Dan Norris wrote: > I'm building a cluster using Oracle Clusterware and have configured > redundant pairs of NICs on the Linux servers using the Linux bonding module > (active-passive). I know how to configure the Linux end of things and that's > working fine. However, the switches used by this customer (they're Dell > branded--not sure who really makes the guts) have been getting "confused" by > bonding and our simple ping tests lose about 50% of the packets when we plug > the redundant pairs into the two separate (trunked) switches. > > This is only peripherally related to Oracle--it's really a networking and > server config issue, but I'm hoping that someone with more networking > background than I have can explain what switch configuration will enable > this to work properly. The customer has stated that this will never work > (though I have done it before at other sites and it worked fine). The > customer has stated that the Linux configuration must be two active NICs > with a virtual IP and virtual MAC. I imagine that will work, but I'm not > familiar with that configuration and I don't think Linux has native support > for it, so it'd probably be a Broadcom or Intel software package. It's > questionable how Oracle would view that from a support perspective (if they > care at all). > > So, the question: Is there some "magical" switch setting that would > possibly be missing in a fairly "default" configuration that might enable > this to work properly? I figure it's a long shot asking a networking > question on the Oracle list, but thanks for any pointers. > > Dan > ------=_Part_8333_3331294.1197455624280 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi Dan

What mode do you use, 0, 1, 2.. etc? Sounds you have used 1 (active-backup). This is what kernel doc says about it:

active-backup or 1

        Active-backup policy: Only one slave in the bond is
        active.  A different slave becomes active if, and only
        if, the active slave fails.  The bond's MAC address is
        externally visible on only one port (network adapter)
        to avoid confusing the switch.

        In bonding version 2.6.2 or later, when a failover
        occurs in active-backup mode, bonding will issue one
        or more gratuitous ARPs on the newly active slave.
        One gratutious ARP is issued for the bonding master
        interface and each VLAN interfaces configured above
        it, provided that the interface has at least one IP
        address configured.  Gratuitous ARPs issued for VLAN
        interfaces are tagged with the appropriate VLAN id.

        This mode provides fault tolerance.  The primary
        option, documented below, affects the behavior of this
        mode.

I have always used 0 in the past

Thanks

--
LSC


On Dec 12, 2007 6:22 AM, Dan Norris <dannorris@dannorris.com > wrote:
I'm building a cluster using Oracle Clusterware and have configured redundant pairs of NICs on the Linux servers using the Linux bonding module (active-passive). I know how to configure the Linux end of things and that's working fine. However, the switches used by this customer (they're Dell branded--not sure who really makes the guts) have been getting "confused" by bonding and our simple ping tests lose about 50% of the packets when we plug the redundant pairs into the two separate (trunked) switches.

This is only peripherally related to Oracle--it's really a networking and server config issue, but I'm hoping that someone with more networking background than I have can explain what switch configuration will enable this to work properly. The customer has stated that this will never work (though I have done it before at other sites and it worked fine). The customer has stated that the Linux configuration must be two active NICs
 with a virtual IP and virtual MAC. I imagine that will work, but I'm not familiar with that configuration and I don't think Linux has native support for it, so it'd probably be a Broadcom or Intel software package. It's questionable how Oracle would view that from a support perspective (if they care at all).

So, the question: Is there some "magical" switch setting that would possibly be missing in a fairly "default" configuration that might enable this to work properly? I figure it's a long shot asking a networking question on the Oracle list, but thanks for any pointers.

Dan

------=_Part_8333_3331294.1197455624280-- -- http://www.freelists.org/webpage/oracle-l