Re: 10g RAC using SAN for storage
From: DA Morgan <damorgan_at_psoug.org>
Date: Fri, 26 Sep 2008 22:13:10 -0700
Message-ID: <1222492387.11162@bubbleator.drizzle.com>
>
> When you state "Two double port NIC cards and two dual channel
> HBAs" ...... do you mean in total? (ie, 1 double-port NIC and 1 dual-
> channel HBA per node?)
> Also, for a completely prototype/testing/learning effort, what are the
> drawbacks to using a single-channel HBA per node?
>
> Thanks again!!!!!
>
> (section 2.1.4 of OracleŽ Database High Availability Best Practices is
> the only applicable search result reference to "HBA" in the online
> documentation that I found.)
Date: Fri, 26 Sep 2008 22:13:10 -0700
Message-ID: <1222492387.11162@bubbleator.drizzle.com>
macdba321 wrote:
> On Sep 16, 6:10 pm, DA Morgan <damor..._at_psoug.org> wrote:
>> macdba321 wrote: >>> On Sep 15, 4:52 pm, DA Morgan <damor..._at_psoug.org> wrote: >>>> macdba321 wrote: >>>>> On Sep 12, 9:29 pm, DA Morgan <damor..._at_psoug.org> wrote: >>>>>> macdba321 wrote: >>>>>>> On Sep 12, 9:35 am, DA Morgan <damor..._at_psoug.org> wrote: >>>>>>>> macdba321 wrote: >>>>>>>>> I am testing a 2 node RAC setup and want to try using a SAN for the >>>>>>>>> dedicated storage (instead of a dedicated local storage disk array >>>>>>>>> located within the same frame). >>>>>>>>> Are there any "gotchas" that I should be aware of when using the SAN >>>>>>>>> for storage as opposed to a typical storage array? >>>>>>>>> Thanks! >>>>>>>> How did you use "dedicated local storage disk" and make it shared >>>>>>>> everything? >>>>>>>> You've said nothing of CFS or ASM or RAW. Why? >>>>>>>> The biggest potential issue with a SAN is labeling the disks used >>>>>>>> for the voting disk and OCR so that they are mounted in the correct >>>>>>>> order by the O/S. >>>>>>>> -- >>>>>>>> Daniel A. Morgan >>>>>>>> Oracle Ace Director & Instructor >>>>>>>> University of Washington >>>>>>>> damor..._at_x.washington.edu (replace x with u to respond) >>>>>>>> Puget Sound Oracle Users Groupwww.psoug.org >>>>>>> Thanks for the reply. >>>>>>> I plan to use ASM over raw devices. (Again, this is purely for test/ >>>>>>> learning, not a production application.) >>>>>>> Please correct me if I'm wrong, but I'm assuming that I'll need HBAs >>>>>>> for both nodes to connect to the same LUNs on the SAN? (There's no way >>>>>>> to do it without the HBA is there?) >>>>>>> Thanks. >>>>>> Not with a SAN unless you have an antique with fibre protocol over >>>>>> copper and can find drivers for it. Another possibility is to use >>>>>> iSCSI drivers. >>>>>> -- >>>>>> Daniel A. Morgan >>>>>> Oracle Ace Director & Instructor >>>>>> University of Washington >>>>>> damor..._at_x.washington.edu (replace x with u to respond) >>>>>> Puget Sound Oracle Users Groupwww.psoug.org >>>>> Thanks again for the reply. I will proceed with acquiring HBAs for >>>>> each node. >>>>> A related question if I may: Why would one require a single-channel >>>>> Vs. dual-channel HBA in each node? >>>>> Thanks again! >>>> Dual channel cards are good for bonding to obtain higher bandwidth. >>>> I like to have two cards, bonded, so that if one card fails it does >>>> not become a single point of failure. >>>> -- >>>> Daniel A. Morgan >>>> Oracle Ace Director & Instructor >>>> University of Washington >>>> damor..._at_x.washington.edu (replace x with u to respond) >>>> Puget Sound Oracle Users Groupwww.psoug.org >>> Thanks again. >>> For a prototype effort though, I could proceed with single channel >>> HBAs on each node, correct? >>> One additional question, if the nodes have multiple NIC cards, would >>> they serve as the "dedicated high-speed interconnect" that rac >>> requires? >>> Thanks! >> You should have a minimum of four interfaces. >> Two double port NIC cards and two dual channel HBAs. >> Again, bond so that you have two paths to public, two paths for cache >> fusion and two paths for storage (HBA). >> -- >> Daniel A. Morgan >> Oracle Ace Director & Instructor >> University of Washington >> damor..._at_x.washington.edu (replace x with u to respond) >> Puget Sound Oracle Users Groupwww.psoug.org
>
> When you state "Two double port NIC cards and two dual channel
> HBAs" ...... do you mean in total? (ie, 1 double-port NIC and 1 dual-
> channel HBA per node?)
> Also, for a completely prototype/testing/learning effort, what are the
> drawbacks to using a single-channel HBA per node?
>
> Thanks again!!!!!
>
> (section 2.1.4 of OracleŽ Database High Availability Best Practices is
> the only applicable search result reference to "HBA" in the online
> documentation that I found.)
No. I mean TWO dual-port NIC cards for a total of four RJ45 connections plus TWO single or dual port HBA cards.
-- Daniel A. Morgan Oracle Ace Director & Instructor University of Washington damorgan_at_x.washington.edu (replace x with u to respond) Puget Sound Oracle Users Group www.psoug.orgReceived on Sat Sep 27 2008 - 00:13:10 CDT