Re: Voting disks on NFS

Here's the problem I'm having.

I'm running Oracle RAC 10.2.0.3.0 Standard Edition RAC on two nodes.

Each node has a gigabit interface for the interconnect and iSCSI over gigabit on two Promise shared arrays. Each node has 8gb memory and a single dual core chip.
Two of the voting disks are on each of the Promise arrays, respectively, and a third voting disk is configured on an external machine implementing iSCSI.

One day this external machine failed, consequently causing the voting disk to fail. Doing a crsctl query crs votedisk shows the last voting disk without a path.

[root@ ~]# crsctl query css votedisk

 0.     0    /dev/raw/raw3
 1.     0    /dev/raw/raw1
 2.     0

I brought the machine containing the votedisk back up, but it wasn't reflected using crsctl.

I tried deleting this erroneous voting disk, but there's no way to refer to a blank path.
Adding the voting disk back just added an extra voting disk, totaling four. I exported the ocr and saw the following values for the voting disks:

[SYSTEM.css.diskfile]

ORATEXT : /dev/raw/raw3

SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root}

[SYSTEM.css.diskfile1]

ORATEXT : /dev/raw/raw1

SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_READ, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root}

[SYSTEM.css.diskfile2]

UNDEF : SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME : root}

[SYSTEM.css.diskfile2.2]

UNDEF : SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME : root}

[SYSTEM.css.diskfile2.2.0]

UNDEF : SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME : root}

[SYSTEM.css.diskfile2.2.0.3]

UNDEF : SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_NONE, OTHER_PERMISSION : PROCR_NONE, USER_NAME : root, GROUP_NAME : root}

As you can see, there are extra values past diskfile2.

I've submitted a SR to Oracle and they're working on it, but the sys admins want to bring down one of the Promise arrays. I'd like to create two more voting disks on NFS so that if they take down one of the Promise arrays I'll still have three out of five voting disks active and the cluster will remain up.

"DA Morgan" <damorgan_at_psoug.org> wrote in message news:1172266839.994641_at_bubbleator.drizzle.com...
> Andreas Sheriff wrote:
>> Hi All,
>>
>> Please reference the following whitepaper:
>> http://www.oracle.com/technology/products/database/clustering/pdf/thirdvoteonnfs.pdf
>>
>> On 10.2.0.2.0 + version of Oracle (RAC) it became possible to configure
>> votedisks on NFS.
>>
>> I was wondering if anyone tried this and what their experience was with
>> this technique?
>>
>> Thanks,
>>
>> Andreas Sheriff
>
> Not had hany problem doing so.
>
> Here's a sample of what I use in fstab:
>
> ntap270a:/vol/alpha /u01 nfs
> rw,bg,intr,hard,rsize=32768,wsize=32768,noac,nolock,tcp,vers=3 0 0
> --
> Daniel A. Morgan
> University of Washington
> damorgan_at_x.washington.edu
> (replace x with u to respond)
> Puget Sound Oracle Users Group
> www.psoug.org
Received on Fri Feb 23 2007 - 23:04:34 CST