Re: Powerpath and ASM w/o ASMLib

From: Andrew Kerber <andrew.kerber_at_gmail.com>
Date: Thu, 2 Jan 2020 15:38:36 -0600
Message-ID: <CAJvnOJZ7iSe6kfEtVw+Xxm9h+ydB_5BxN8trD33XZhf7h+ZveQ_at_mail.gmail.com>



Try doing something like I did in my blog to generate the udev rules.

https://dbakerber.wordpress.com/2019/10/16/udev-rules-for-oracle-storage/

On Thu, Jan 2, 2020 at 3:36 PM David Barbour <david.barbour1_at_gmail.com> wrote:

> [root_at_685925-db6 by-path]# /sbin/udevadm info --query=property --name
> /dev/emcpoweree
> UDEV_LOG=3
> DEVPATH=/devices/virtual/block/emcpoweree
> MAJOR=120
> MINOR=2144
> DEVNAME=/dev/emcpoweree
> DEVTYPE=disk
> SUBSYSTEM=block
> ID_PART_TABLE_TYPE=dos
> LVM_SBIN_PATH=/sbin
> DEVLINKS=/dev/block/120:2144
>
>
> On Thu, Jan 2, 2020 at 3:27 PM Andrew Kerber <andrew.kerber_at_gmail.com>
> wrote:
>
>> See what you get with this:
>> udevadm info –query=property –name /dev/emcpoweree
>>
>>
>> On Thu, Jan 2, 2020 at 2:41 PM David Barbour <david.barbour1_at_gmail.com>
>> wrote:
>>
>>> The udev piece seems to be what's missing. I usually use multipath with
>>> the device name in multipath.conf. On this setup however, multipath is not
>>> an active service and multipath.conf does not exist. The wwid and or scsi
>>> device do not show up in /dev/disk/by-id:
>>>
>>>
>>> *[root_at_685925-db6 by-id]# ls -al |grep
>>> 60060160E6914D00ADF8F35D73CD831D[root_at_685925-db6 by-id]#*
>>>
>>> The LUNs SHOULD show up in /dev/ora in accordance with the stanza in
>>> */etc/udev/rules.d/99-oracle-grid.rules* - but alas, they do not.
>>>
>>> The asm_diskstring is set to:
>>>
>>>
>>>
>>>
>>> *SQL> show parameter asm_diskstringNAME
>>> TYPE VALUE------------------------------------ -----------
>>> ------------------------------asm_diskstring string
>>> /dev/ora/**
>>>
>>>
>>> On Thu, Jan 2, 2020 at 2:15 PM Harel Safra <harel.safra_at_gmail.com>
>>> wrote:
>>>
>>>> Are the new devices created by udev?
>>>> Did you set ASM_DISKTRING (
>>>> https://docs.oracle.com/en/database/oracle/oracle-database/12.2/refrn/ASM_DISKSTRING.html)
>>>> to search that location?
>>>>
>>>> Harel
>>>>
>>>> On Thu, Jan 2, 2020 at 9:35 PM David Barbour <david.barbour1_at_gmail.com>
>>>> wrote:
>>>>
>>>>> Happy New Year!
>>>>>
>>>>> We are changing SANs from an EMC VNX to an EMC UNITY. The servers and
>>>>> SANs are hosted at a third-party site. We are on RHEL 6.8. We are not
>>>>> using ASMLib.
>>>>>
>>>>> When I was informed that the LUNs had been presented to the servers
>>>>> (it's a 2-node RAC) I re-scanned the hosts and the Powerpath devices showed
>>>>> up. Using parted I partitioned each LUN as a full primary partition. I
>>>>> added the WWID to udev rules, but no matter what I try, the LUNs are not
>>>>> showing up in the ASM search path. Generally I don't use Powerpath, so I'm
>>>>> hoping I don't have to reboot the server to get these to show up.
>>>>>
>>>>> *Here's what I see (using one LUN as an example):*
>>>>>
>>>>>
>>>>>
>>>>> *[root_at_685925-db6 dev]# ls -al |grep emcpowereebrw-rw---- 1 root
>>>>> disk 120, 2144 Jan 2 12:32 emcpowereebrw-rw---- 1 root disk 120,
>>>>> 2145 Jan 2 12:08 emcpoweree1*
>>>>>
>>>>>
>>>>> *[root_at_685925-db6 dev]# parted /dev/emcpoweree*
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> *Disk /dev/emcpoweree: 859GBSector size (logical/physical):
>>>>> 512B/512BPartition Table: msdosNumber Start End Size Type File
>>>>> system Flags 1 4194kB 859GB 859GB primary*
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> *[root_at_685925-db6 dev]# powermt display dev=emcpowereePseudo
>>>>> name=emcpowereeUnity ID=APM00193839645 [Host_5]Logical device
>>>>> ID=60060160E6914D00ADF8F35D73CD831D
>>>>> [863648-685926-800GB-Pool1-RAC_Cluster-56]state=alive; policy=CLAROpt;
>>>>> queued-IOs=0Owner: default=SP A, current=SP A Array failover mode:
>>>>> 4==============================================================================---------------
>>>>> Host --------------- - Stor - -- I/O Path -- -- Stats ---### HW Path
>>>>> I/O Paths Interf. Mode State Q-IOs
>>>>> Errors==============================================================================
>>>>> 1 bfa sdtq SP B3 active alive 0
>>>>> 0 1 bfa sdrj SP A2 active alive 0
>>>>> 0 2 bfa sdpc SP A3 active alive 0
>>>>> 0 2 bfa sdmv SP B2 active alive
>>>>> 0 0*
>>>>>
>>>>>
>>>>>
>>>>> *[root_at_685925-db6 by-id]# ls -al |grep
>>>>> 60060160E6914D00ADF8F35D73CD831D[root_at_685925-db6 by-id]#*
>>>>>
>>>>> *Here's the stanza in /udev/rules.d/99-oracle-grid.rules:*
>>>>>
>>>>>
>>>>>
>>>>> *#emcpoweree#[863648-685926-800GB-Pool1-RAC_Cluster-56] ACTION=="add|change",
>>>>> KERNEL=="emcpower[a-z][a-z]?", SUBSYSTEM=="block", PROGRAM="/sbin/scsi_id
>>>>> --whitelisted --replace-whitespace /dev/$parent",
>>>>> RESULT=="360060160E6914D00ADF8F35D73CD831D", OWNER="grid",
>>>>> GROUP="asmadmin", MODE="0660", NAME="/dev/ora/ORA-ACTIVE101p%n"*
>>>>>
>>>>> I've tried rescanning the host(s), /sbin/udevadm control
>>>>> --reload-rules with /sbin/udevadm trigger --type=devices --action=change
>>>>> and powermt save and powermt config.
>>>>>
>>>>> Nothing.
>>>>>
>>>>> Do I need to reboot or is there some way to get these to show up?
>>>>>
>>>>> *David A. Barbour*
>>>>>
>>>>> *dbarbour_at_istation.com <dbarbour_at_istation.com>*
>>>>>
>>>>> *(214) 292-4096*
>>>>>
>>>>> Istation
>>>>>
>>>>> 8150 North Central Expressway, Suite 2000
>>>>>
>>>>> Dallas, TX 75206
>>>>>
>>>>> www.Istation.com <http://www.istation.com/>
>>>>>
>>>>>
>>>>>
>>>>> CONFIDENTIALITY / PROPRIETARY NOTICE:
>>>>>
>>>>> The information contained in this e-mail, including any attachment(s),
>>>>> is confidential information that may be privileged and exempt from
>>>>> disclosure under applicable law. If the reader of this message is not the
>>>>> intended recipient, or if you received this message in error, then any
>>>>> direct or indirect disclosure, distribution or copying of this message is
>>>>> strictly prohibited. If you have received this message in error, please
>>>>> notify Istation by calling 866-883-7323 immediately and by sending a
>>>>> return e-mail; delete this message; and destroy all copies, including
>>>>> attachments.
>>>>>
>>>>> Thank you.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>
>> --
>> Andrew W. Kerber
>>
>> 'If at first you dont succeed, dont take up skydiving.'
>>
>

-- 
Andrew W. Kerber

'If at first you dont succeed, dont take up skydiving.'

--
http://www.freelists.org/webpage/oracle-l
Received on Thu Jan 02 2020 - 22:38:36 CET

Original text of this message