Re: Powerpath and ASM w/o ASMLib

From: David Barbour <david.barbour1_at_gmail.com>
Date: Thu, 2 Jan 2020 15:35:27 -0600
Message-ID: <CAFH+ifd5DaTT959eRr86qk1tSLBCDzFDKA=mp0SQkf1JwHy-Pg_at_mail.gmail.com>



[root_at_685925-db6 by-path]# /sbin/udevadm info --query=property --name /dev/emcpoweree
UDEV_LOG=3
DEVPATH=/devices/virtual/block/emcpoweree MAJOR=120
MINOR=2144
DEVNAME=/dev/emcpoweree
DEVTYPE=disk
SUBSYSTEM=block
ID_PART_TABLE_TYPE=dos
LVM_SBIN_PATH=/sbin
DEVLINKS=/dev/block/120:2144

On Thu, Jan 2, 2020 at 3:27 PM Andrew Kerber <andrew.kerber_at_gmail.com> wrote:

> See what you get with this:
> udevadm info –query=property –name /dev/emcpoweree
>
>
> On Thu, Jan 2, 2020 at 2:41 PM David Barbour <david.barbour1_at_gmail.com>
> wrote:
>
>> The udev piece seems to be what's missing. I usually use multipath with
>> the device name in multipath.conf. On this setup however, multipath is not
>> an active service and multipath.conf does not exist. The wwid and or scsi
>> device do not show up in /dev/disk/by-id:
>>
>>
>> *[root_at_685925-db6 by-id]# ls -al |grep
>> 60060160E6914D00ADF8F35D73CD831D[root_at_685925-db6 by-id]#*
>>
>> The LUNs SHOULD show up in /dev/ora in accordance with the stanza in
>> */etc/udev/rules.d/99-oracle-grid.rules* - but alas, they do not.
>>
>> The asm_diskstring is set to:
>>
>>
>>
>>
>> *SQL> show parameter asm_diskstringNAME
>> TYPE VALUE------------------------------------ -----------
>> ------------------------------asm_diskstring string
>> /dev/ora/**
>>
>>
>> On Thu, Jan 2, 2020 at 2:15 PM Harel Safra <harel.safra_at_gmail.com> wrote:
>>
>>> Are the new devices created by udev?
>>> Did you set ASM_DISKTRING (
>>> https://docs.oracle.com/en/database/oracle/oracle-database/12.2/refrn/ASM_DISKSTRING.html)
>>> to search that location?
>>>
>>> Harel
>>>
>>> On Thu, Jan 2, 2020 at 9:35 PM David Barbour <david.barbour1_at_gmail.com>
>>> wrote:
>>>
>>>> Happy New Year!
>>>>
>>>> We are changing SANs from an EMC VNX to an EMC UNITY. The servers and
>>>> SANs are hosted at a third-party site. We are on RHEL 6.8. We are not
>>>> using ASMLib.
>>>>
>>>> When I was informed that the LUNs had been presented to the servers
>>>> (it's a 2-node RAC) I re-scanned the hosts and the Powerpath devices showed
>>>> up. Using parted I partitioned each LUN as a full primary partition. I
>>>> added the WWID to udev rules, but no matter what I try, the LUNs are not
>>>> showing up in the ASM search path. Generally I don't use Powerpath, so I'm
>>>> hoping I don't have to reboot the server to get these to show up.
>>>>
>>>> *Here's what I see (using one LUN as an example):*
>>>>
>>>>
>>>>
>>>> *[root_at_685925-db6 dev]# ls -al |grep emcpowereebrw-rw---- 1 root disk
>>>> 120, 2144 Jan 2 12:32 emcpowereebrw-rw---- 1 root disk 120, 2145
>>>> Jan 2 12:08 emcpoweree1*
>>>>
>>>>
>>>> *[root_at_685925-db6 dev]# parted /dev/emcpoweree*
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> *Disk /dev/emcpoweree: 859GBSector size (logical/physical):
>>>> 512B/512BPartition Table: msdosNumber Start End Size Type File
>>>> system Flags 1 4194kB 859GB 859GB primary*
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> *[root_at_685925-db6 dev]# powermt display dev=emcpowereePseudo
>>>> name=emcpowereeUnity ID=APM00193839645 [Host_5]Logical device
>>>> ID=60060160E6914D00ADF8F35D73CD831D
>>>> [863648-685926-800GB-Pool1-RAC_Cluster-56]state=alive; policy=CLAROpt;
>>>> queued-IOs=0Owner: default=SP A, current=SP A Array failover mode:
>>>> 4==============================================================================---------------
>>>> Host --------------- - Stor - -- I/O Path -- -- Stats ---### HW Path
>>>> I/O Paths Interf. Mode State Q-IOs
>>>> Errors==============================================================================
>>>> 1 bfa sdtq SP B3 active alive 0
>>>> 0 1 bfa sdrj SP A2 active alive 0
>>>> 0 2 bfa sdpc SP A3 active alive 0
>>>> 0 2 bfa sdmv SP B2 active alive
>>>> 0 0*
>>>>
>>>>
>>>>
>>>> *[root_at_685925-db6 by-id]# ls -al |grep
>>>> 60060160E6914D00ADF8F35D73CD831D[root_at_685925-db6 by-id]#*
>>>>
>>>> *Here's the stanza in /udev/rules.d/99-oracle-grid.rules:*
>>>>
>>>>
>>>>
>>>> *#emcpoweree#[863648-685926-800GB-Pool1-RAC_Cluster-56] ACTION=="add|change",
>>>> KERNEL=="emcpower[a-z][a-z]?", SUBSYSTEM=="block", PROGRAM="/sbin/scsi_id
>>>> --whitelisted --replace-whitespace /dev/$parent",
>>>> RESULT=="360060160E6914D00ADF8F35D73CD831D", OWNER="grid",
>>>> GROUP="asmadmin", MODE="0660", NAME="/dev/ora/ORA-ACTIVE101p%n"*
>>>>
>>>> I've tried rescanning the host(s), /sbin/udevadm control --reload-rules
>>>> with /sbin/udevadm trigger --type=devices --action=change and powermt save
>>>> and powermt config.
>>>>
>>>> Nothing.
>>>>
>>>> Do I need to reboot or is there some way to get these to show up?
>>>>
>>>> *David A. Barbour*
>>>>
>>>> *dbarbour_at_istation.com <dbarbour_at_istation.com>*
>>>>
>>>> *(214) 292-4096*
>>>>
>>>> Istation
>>>>
>>>> 8150 North Central Expressway, Suite 2000
>>>>
>>>> Dallas, TX 75206
>>>>
>>>> www.Istation.com <http://www.istation.com/>
>>>>
>>>>
>>>>
>>>> CONFIDENTIALITY / PROPRIETARY NOTICE:
>>>>
>>>> The information contained in this e-mail, including any attachment(s),
>>>> is confidential information that may be privileged and exempt from
>>>> disclosure under applicable law. If the reader of this message is not the
>>>> intended recipient, or if you received this message in error, then any
>>>> direct or indirect disclosure, distribution or copying of this message is
>>>> strictly prohibited. If you have received this message in error, please
>>>> notify Istation by calling 866-883-7323 immediately and by sending a
>>>> return e-mail; delete this message; and destroy all copies, including
>>>> attachments.
>>>>
>>>> Thank you.
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>
> --
> Andrew W. Kerber
>
> 'If at first you dont succeed, dont take up skydiving.'
>

--
http://www.freelists.org/webpage/oracle-l
Received on Thu Jan 02 2020 - 22:35:27 CET

Original text of this message