Oracle FAQ Your Portal to the Oracle Knowledge Grid
HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US
 

Home -> Community -> Usenet -> c.d.o.server -> Re: Voting disks on NFS

Re: Voting disks on NFS

From: DA Morgan <damorgan_at_psoug.org>
Date: Sat, 24 Feb 2007 11:33:22 -0800
Message-ID: <1172345601.666978@bubbleator.drizzle.com>


Andreas Sheriff wrote:
> Here's the problem I'm having.
>
> I'm running Oracle RAC 10.2.0.3.0 Standard Edition RAC on two nodes.
>
> Each node has a gigabit interface for the interconnect and iSCSI over
> gigabit on two Promise shared arrays. Each node has 8gb memory and a single
> dual core chip.
> Two of the voting disks are on each of the Promise arrays, respectively, and
> a third voting disk is configured on an external machine implementing iSCSI.
>
> One day this external machine failed, consequently causing the voting disk
> to fail. Doing a crsctl query crs votedisk shows the last voting disk
> without a path.
>
> [root@ ~]# crsctl query css votedisk
> 0. 0 /dev/raw/raw3
> 1. 0 /dev/raw/raw1
> 2. 0
>
> I brought the machine containing the votedisk back up, but it wasn't
> reflected using crsctl.
>
> I tried deleting this erroneous voting disk, but there's no way to refer to
> a blank path.
> Adding the voting disk back just added an extra voting disk, totaling four.
> I exported the ocr and saw the following values for the voting disks:
>
> [SYSTEM.css.diskfile]
>
> ORATEXT : /dev/raw/raw3
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile1]
>
> ORATEXT : /dev/raw/raw1
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2.0]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2.0.3]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
>
>
> As you can see, there are extra values past diskfile2.
>
>
>
> I've submitted a SR to Oracle and they're working on it, but the sys admins
> want to bring down one of the Promise arrays. I'd like to create two more
> voting disks on NFS so that if they take down one of the Promise arrays I'll
> still have three out of five voting disks active and the cluster will remain
> up.
>
>
> "DA Morgan" <damorgan_at_psoug.org> wrote in message
> news:1172266839.994641_at_bubbleator.drizzle.com...

>> Andreas Sheriff wrote:
>>> Hi All,
>>>
>>> Please reference the following whitepaper:
>>> http://www.oracle.com/technology/products/database/clustering/pdf/thirdvoteonnfs.pdf
>>>
>>> On 10.2.0.2.0 + version of Oracle (RAC) it became possible to configure 
>>> votedisks on NFS.
>>>
>>> I was wondering if anyone tried this and what their experience was with 
>>> this technique?
>>>
>>> Thanks,
>>>
>>> Andreas Sheriff
>> Not had hany problem doing so.
>>
>> Here's a sample of what I use in fstab:
>>
>> ntap270a:/vol/alpha /u01 nfs 
>> rw,bg,intr,hard,rsize=32768,wsize=32768,noac,nolock,tcp,vers=3 0 0
>> -- 
>> Daniel A. Morgan
>> University of Washington
>> damorgan_at_x.washington.edu
>> (replace x with u to respond)
>> Puget Sound Oracle Users Group
>> www.psoug.org 

Contact me off-line and I can put you in touch with someone that should be able to help.

-- 
Daniel A. Morgan
University of Washington
damorgan_at_x.washington.edu
(replace x with u to respond)
Puget Sound Oracle Users Group
www.psoug.org
Received on Sat Feb 24 2007 - 13:33:22 CST

Original text of this message

HOME | ASK QUESTION | ADD INFO | SEARCH | E-MAIL US