Re: Voting disks on NFS

"Andreas Sheriff" <spamtrap_at_iion.com> wrote in message news:sMPDh.341983$qy.275541_at_newsfe16.lga...
> Here's the problem I'm having.
>
> I'm running Oracle RAC 10.2.0.3.0 Standard Edition RAC on two nodes.
>
> Each node has a gigabit interface for the interconnect and iSCSI over
> gigabit on two Promise shared arrays. Each node has 8gb memory and a
> single dual core chip.
> Two of the voting disks are on each of the Promise arrays, respectively,
> and a third voting disk is configured on an external machine implementing
> iSCSI.
>
> One day this external machine failed, consequently causing the voting disk
> to fail. Doing a crsctl query crs votedisk shows the last voting disk
> without a path.
>
> [root@ ~]# crsctl query css votedisk
> 0. 0 /dev/raw/raw3
> 1. 0 /dev/raw/raw1
> 2. 0
>
> I brought the machine containing the votedisk back up, but it wasn't
> reflected using crsctl.
>
> I tried deleting this erroneous voting disk, but there's no way to refer
> to a blank path.
> Adding the voting disk back just added an extra voting disk, totaling
> four. I exported the ocr and saw the following values for the voting
> disks:
>
> [SYSTEM.css.diskfile]
>
> ORATEXT : /dev/raw/raw3
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile1]
>
> ORATEXT : /dev/raw/raw1
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2.0]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2.0.3]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
>
>
> As you can see, there are extra values past diskfile2.
>
>
>
> I've submitted a SR to Oracle and they're working on it, but the sys
> admins want to bring down one of the Promise arrays. I'd like to create
> two more voting disks on NFS so that if they take down one of the Promise
> arrays I'll still have three out of five voting disks active and the
> cluster will remain up.
>
>
> "DA Morgan" <damorgan_at_psoug.org> wrote in message
> news:1172266839.994641_at_bubbleator.drizzle.com...
>> Andreas Sheriff wrote:
>>> Hi All,
>>>
>>> Please reference the following whitepaper:
>>> http://www.oracle.com/technology/products/database/clustering/pdf/thirdvoteonnfs.pdf
>>>
>>> On 10.2.0.2.0 + version of Oracle (RAC) it became possible to configure
>>> votedisks on NFS.
>>>
>>> I was wondering if anyone tried this and what their experience was with
>>> this technique?
>>>
>>> Thanks,
>>>
>>> Andreas Sheriff
>>
>> Not had hany problem doing so.
>>
>> Here's a sample of what I use in fstab:
>>
>> ntap270a:/vol/alpha /u01 nfs
>> rw,bg,intr,hard,rsize=32768,wsize=32768,noac,nolock,tcp,vers=3 0 0
>> --
>> Daniel A. Morgan
>> University of Washington
>> damorgan_at_x.washington.edu
>> (replace x with u to respond)
>> Puget Sound Oracle Users Group
>> www.psoug.org
>
>

Sorry for top posting. I forgot to copy and paste. :-( Received on Fri Feb 23 2007 - 23:24:07 CST