Oracle FAQ | Your Portal to the Oracle Knowledge Grid |
Home -> Community -> Usenet -> c.d.o.server -> Re: Voting disks on NFS
Andreas Sheriff wrote:
> Here's the problem I'm having.
>
> I'm running Oracle RAC 10.2.0.3.0 Standard Edition RAC on two nodes.
>
> Each node has a gigabit interface for the interconnect and iSCSI over
> gigabit on two Promise shared arrays. Each node has 8gb memory and a single
> dual core chip.
> Two of the voting disks are on each of the Promise arrays, respectively, and
> a third voting disk is configured on an external machine implementing iSCSI.
>
> One day this external machine failed, consequently causing the voting disk
> to fail. Doing a crsctl query crs votedisk shows the last voting disk
> without a path.
>
> [root@ ~]# crsctl query css votedisk
> 0. 0 /dev/raw/raw3
> 1. 0 /dev/raw/raw1
> 2. 0
>
> I brought the machine containing the votedisk back up, but it wasn't
> reflected using crsctl.
>
> I tried deleting this erroneous voting disk, but there's no way to refer to
> a blank path.
> Adding the voting disk back just added an extra voting disk, totaling four.
> I exported the ocr and saw the following values for the voting disks:
>
> [SYSTEM.css.diskfile]
>
> ORATEXT : /dev/raw/raw3
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile1]
>
> ORATEXT : /dev/raw/raw1
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2.0]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
> [SYSTEM.css.diskfile2.2.0.3]
>
> UNDEF :
>
> SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION :
> PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME :
> root}
>
>
>
> As you can see, there are extra values past diskfile2.
>
>
>
> I've submitted a SR to Oracle and they're working on it, but the sys admins
> want to bring down one of the Promise arrays. I'd like to create two more
> voting disks on NFS so that if they take down one of the Promise arrays I'll
> still have three out of five voting disks active and the cluster will remain
> up.
>
>
> "DA Morgan" <damorgan_at_psoug.org> wrote in message
> news:1172266839.994641_at_bubbleator.drizzle.com...
>> Andreas Sheriff wrote: >>> Hi All, >>> >>> Please reference the following whitepaper: >>> http://www.oracle.com/technology/products/database/clustering/pdf/thirdvoteonnfs.pdf >>> >>> On 10.2.0.2.0 + version of Oracle (RAC) it became possible to configure >>> votedisks on NFS. >>> >>> I was wondering if anyone tried this and what their experience was with >>> this technique? >>> >>> Thanks, >>> >>> Andreas Sheriff >> Not had hany problem doing so. >> >> Here's a sample of what I use in fstab: >> >> ntap270a:/vol/alpha /u01 nfs >> rw,bg,intr,hard,rsize=32768,wsize=32768,noac,nolock,tcp,vers=3 0 0 >> -- >> Daniel A. Morgan >> University of Washington >> damorgan_at_x.washington.edu >> (replace x with u to respond) >> Puget Sound Oracle Users Group >> www.psoug.org
Contact me off-line and I can put you in touch with someone that should be able to help.
-- Daniel A. Morgan University of Washington damorgan_at_x.washington.edu (replace x with u to respond) Puget Sound Oracle Users Group www.psoug.orgReceived on Sat Feb 24 2007 - 13:33:22 CST