Re: 10g RAC using SAN for storage

From: DA Morgan <damorgan_at_psoug.org>
Date: Fri, 26 Sep 2008 22:13:10 -0700
Message-ID: <1222492387.11162@bubbleator.drizzle.com>


macdba321 wrote:
> On Sep 16, 6:10 pm, DA Morgan <damor..._at_psoug.org> wrote:

>> macdba321 wrote:
>>> On Sep 15, 4:52 pm, DA Morgan <damor..._at_psoug.org> wrote:
>>>> macdba321 wrote:
>>>>> On Sep 12, 9:29 pm, DA Morgan <damor..._at_psoug.org> wrote:
>>>>>> macdba321 wrote:
>>>>>>> On Sep 12, 9:35 am, DA Morgan <damor..._at_psoug.org> wrote:
>>>>>>>> macdba321 wrote:
>>>>>>>>> I am testing a 2 node RAC setup and want to try using a SAN for the
>>>>>>>>> dedicated storage (instead of a dedicated local storage disk array
>>>>>>>>> located within the same frame).
>>>>>>>>> Are there any "gotchas" that I should be aware of when using the SAN
>>>>>>>>> for storage as opposed to a typical storage array?
>>>>>>>>> Thanks!
>>>>>>>> How did you use "dedicated local storage disk" and make it shared
>>>>>>>> everything?
>>>>>>>> You've said nothing of CFS or ASM or RAW. Why?
>>>>>>>> The biggest potential issue with a SAN is labeling the disks used
>>>>>>>> for the voting disk and OCR so that they are mounted in the correct
>>>>>>>> order by the O/S.
>>>>>>>> --
>>>>>>>> Daniel A. Morgan
>>>>>>>> Oracle Ace Director & Instructor
>>>>>>>> University of Washington
>>>>>>>> damor..._at_x.washington.edu (replace x with u to respond)
>>>>>>>> Puget Sound Oracle Users Groupwww.psoug.org
>>>>>>> Thanks for the reply.
>>>>>>> I plan to use ASM over raw devices. (Again, this is purely for test/
>>>>>>> learning, not a production application.)
>>>>>>> Please correct me if I'm wrong, but I'm assuming that I'll need HBAs
>>>>>>> for both nodes to connect to the same LUNs on the SAN? (There's no way
>>>>>>> to do it without the HBA is there?)
>>>>>>> Thanks.
>>>>>> Not with a SAN unless you have an antique with fibre protocol over
>>>>>> copper and can find drivers for it. Another possibility is to use
>>>>>> iSCSI drivers.
>>>>>> --
>>>>>> Daniel A. Morgan
>>>>>> Oracle Ace Director & Instructor
>>>>>> University of Washington
>>>>>> damor..._at_x.washington.edu (replace x with u to respond)
>>>>>> Puget Sound Oracle Users Groupwww.psoug.org
>>>>> Thanks again for the reply. I will proceed with acquiring HBAs for
>>>>> each node.
>>>>> A related question if I may: Why would one require a single-channel
>>>>> Vs. dual-channel HBA in each node?
>>>>> Thanks again!
>>>> Dual channel cards are good for bonding to obtain higher bandwidth.
>>>> I like to have two cards, bonded, so that if one card fails it does
>>>> not become a single point of failure.
>>>> --
>>>> Daniel A. Morgan
>>>> Oracle Ace Director & Instructor
>>>> University of Washington
>>>> damor..._at_x.washington.edu (replace x with u to respond)
>>>> Puget Sound Oracle Users Groupwww.psoug.org
>>> Thanks again.
>>> For a prototype effort though, I could proceed with single channel
>>> HBAs on each node, correct?
>>> One additional question, if the nodes have multiple NIC cards, would
>>> they serve as the "dedicated high-speed interconnect" that rac
>>> requires?
>>> Thanks!
>> You should have a minimum of four interfaces.
>> Two double port NIC cards and two dual channel HBAs.
>> Again, bond so that you have two paths to public, two paths for cache
>> fusion and two paths for storage (HBA).
>> --
>> Daniel A. Morgan
>> Oracle Ace Director & Instructor
>> University of Washington
>> damor..._at_x.washington.edu (replace x with u to respond)
>> Puget Sound Oracle Users Groupwww.psoug.org

>
> When you state "Two double port NIC cards and two dual channel
> HBAs" ...... do you mean in total? (ie, 1 double-port NIC and 1 dual-
> channel HBA per node?)
> Also, for a completely prototype/testing/learning effort, what are the
> drawbacks to using a single-channel HBA per node?
>
> Thanks again!!!!!
>
> (section 2.1.4 of OracleŽ Database High Availability Best Practices is
> the only applicable search result reference to "HBA" in the online
> documentation that I found.)

No. I mean TWO dual-port NIC cards for a total of four RJ45 connections plus TWO single or dual port HBA cards.

-- 
Daniel A. Morgan
Oracle Ace Director & Instructor
University of Washington
damorgan_at_x.washington.edu (replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Received on Sat Sep 27 2008 - 00:13:10 CDT

Original text of this message