Configuring EMC w/o ASMIB on RHEL 7.6

From: David Barbour <david.barbour1_at_gmail.com>
Date: Tue, 2 Jun 2020 11:27:30 -0500
Message-ID: <CAFH+iffXh7K1=-e=Kh7rnWRsVxjL4PG07gui9bLYi8=jsgzcLg_at_mail.gmail.com>



Good Morning,

Any EMC PowerPath folks out there? We are adding a new node to our RAC. cluvfy from an existing node cannot recognize the disk on the new node.

The new node is third-party hosted and they have set up the storage.

On the current nodes we see simply the powerpath device without a partition in /dev - such as emcpowerbx and it's owned by root:disk. The entry in /etc/udev/rules.d/99-oracle-grid-rules for this device is:

KERNEL=="emcpower[a-z][a-z]?", SUBSYSTEM=="block", PROGRAM="/sbin/scsi_id --whitelisted --replace-whitespace /dev/$parent", RESULT=="360060160e6914d00e1f3f35dba6676d8", OWNER="grid", GROUP="asmadmin", MODE="0660", NAME="ora/ORA-OCRVTG101"

which results in an entry in /dev/ora (the asm_diskstring) of 'ORA-OCRVTG101' owned by grid:asmadmin.

The new node is showing the powerpath devices WITH partitions. So we see emcpowerbx and emcpowerbx1. The new rule on that server sets up a symlink to the partition and the partition in /dev is owned by grid:asmadmin.

This just isn't working. If we use the rules from the old nodes, nothing shows up in /dev/ora. If we use the new rules - which look like this:

ACTION=="add|change", SUBSYSTEM=="block", KERNEL=="emcpower[a-z][a-z]?", PROGRAM="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace /dev/$parent", RESULT=="360060160e6914d00e1f3f35dba6676d8", OWNER="grid", GROUP="asmadmin", MODE="0660", SYMLINK+="ora/ORA-OCRVTG101"

we get this when running cluvfy:

$ cluvfy comp ssa -n 685921-db5,1103477-db7 -s /dev/emcpowerbx

Verifying Shared Storage Accessibility:/dev/emcpowerbx ...FAILED (PRVG-0806)

Verification of shared storage accessibility was unsuccessful on all the specified nodes.

Failures were encountered during execution of CVU verification request
"shared storage accessibility".

Verifying Shared Storage Accessibility:/dev/emcpowerbx ...FAILED PRVG-0806 : Signature for storage path "/dev/emcpowerbx" is inconsistent across
the nodes.
Signature was found as "" on nodes: "1103477-db7". Signature was found as "360060160e6914d00e1f3f35dba6676d8|" on nodes:
"685921-db5".

Appreciate any insight. So far it's a no-go with RedHat, Rackspace (the third party cloud vendor) and of course Oracle support.

The original nodes are not using asmlib. I'm wondering if that might be an answer here. I am a multipath guy. Really do not appreciate the additional level of abstraction. But I am teachable.

Help!

<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon> Virus-free.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

--
http://www.freelists.org/webpage/oracle-l
Received on Tue Jun 02 2020 - 18:27:30 CEST

Original text of this message