Home » Infrastructure » Linux » Help me configuring udev rule for raw disks (oracle grid 11.2.0.3 on oel 5.8)
Help me configuring udev rule for raw disks [message #573642] Tue, 01 January 2013 13:45 Go to next message
saikat891
Messages: 11
Registered: April 2012
Location: MUMBAI
Junior Member

I am using oel 5.8, oracle 11.2.0.3. The raw disk permissions are getting changed when the node gets rebooted.I am trying to use udev rule to change the permission permanently but its not working. Please help.

[root@VM-PAGRAC3 rules.d]# more 99-asm.rules
KERNEL=="sd", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",*
RESULT=="SATA_VBOX_HARDDISK_VB7a29b7ae-de673b56_",
NAME+="oracleasm/disks/DSK1#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VB36f5d134-4e0e4c43_",
NAME+="oracleasm/disks/DSK2#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VB09058e05-3d6b153f_",
NAME+="oracleasm/disks/DSK3#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VBb2df757a-5661a9e0_",
NAME+="oracleasm/disks/DSK4#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VB7c5c71cc-19173dcb_",
NAME+="oracleasm/disks/DSK5#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VB2efbb6dc-1096a916_",
NAME+="oracleasm/disks/DSK6#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VB74bd75c4-457561a7_",
NAME+="oracleasm/disks/DSK7#" OWNER="grid"
GROUP="asmadmin" MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT=="SATA_VBOX_HARDDISK_VBf5489a0d-4dcd1683_",
NAME+="oracleasm/disks/DSK8#" OWNER="grid"
GROUP="asmadmin" MODE="0660"



But Only one disk is showing up. Why other 7 disks are not showing? Whats wrong with the udev rule file?

[root@VM-PAGRAC3 disks]# start_udev
Starting udev: [ OK ]
[root@VM-PAGRAC3 disks]# ls -alh
total 0
drwxr-xr-x 1 root root 0 Jan 1 22:54 .
drwxr-xr-x 4 root root 0 Jan 1 19:55 ..
brw-r----- 1 root root 8, 32 Jan 1 20:05 DISK1
brw-rw---- 1 grid asmadmin 8, 17 Jan 1 22:54 DSK1#
[root@VM-PAGRAC3 disks]# cd /dev/oracleasm/disks
[root@VM-PAGRAC3 disks]# start_udev
Starting udev: [ OK ]
[root@VM-PAGRAC3 disks]# ls -alh
total 0
drwxr-xr-x 1 root root 0 Jan 1 22:54 .
drwxr-xr-x 4 root root 0 Jan 1 19:55 ..
brw-r----- 1 root root 8, 32 Jan 1 20:05 DISK1
brw-rw---- 1 grid asmadmin 8, 17 Jan 1 22:54 DSK1#
[root@VM-PAGRAC3 disks]


Regards,
Saikat
Re: Help me configuring udev rule for raw disks [message #573644 is a reply to message #573642] Tue, 01 January 2013 16:43 Go to previous messageGo to next message
BlackSwan
Messages: 22845
Registered: January 2009
Senior Member
http://docs.oracle.com/cd/E11882_01/install.112/e24169/storage.htm#sthref558
Re: Help me configuring udev rule for raw disks [message #573659 is a reply to message #573642] Wed, 02 January 2013 01:49 Go to previous messageGo to next message
John Watson
Messages: 4612
Registered: January 2010
Location: Global Village
Senior Member
This is a very simple rule, but it works:
db121a orcl$ cat 99-oracle-asmdevices.rules
KERNEL=="sdb5", OWNER="oracle", GROUP="dba", MODE="660", ACTION=="add|change"
KERNEL=="sdb6", OWNER="oracle", GROUP="dba", MODE="660", ACTION=="add|change"
KERNEL=="sdb7", OWNER="oracle", GROUP="dba", MODE="660", ACTION=="add|change"



db121a orcl$ ls -l /dev/sdb*
brw-r----- 1 root   disk 8, 16 Dec 31 14:36 /dev/sdb
brw-r----- 1 root   disk 8, 17 Dec 31 14:36 /dev/sdb1
brw-rw---- 1 oracle dba  8, 21 Jan  2 07:44 /dev/sdb5
brw-rw---- 1 oracle dba  8, 22 Jan  2 07:44 /dev/sdb6
brw-rw---- 1 oracle dba  8, 23 Jan  2 07:44 /dev/sdb7
brw-r----- 1 root   disk 8, 24 Dec 31 16:23 /dev/sdb8
db121a orcl$
And in ASM,
+ASM> select path from v$asm_disk;

PATH
--------------------------------------------------------------------------------
/dev/sdb5
/dev/sdb6
/dev/sdb7

+ASM> sho parameter asm_d

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
asm_diskgroups                       string      CWFILES, MYGROUP
asm_diskgroups2                      string
asm_diskgroups3                      string
asm_diskgroups4                      string
asm_diskstring                       string      /dev/sd*
+ASM>
I wouldn't suggest that rules like this would be suitable for a production system, if only because I think it will fail if a new disk is added, but it works for a simple VirtualBox setup.
Re: Help me configuring udev rule for raw disks [message #573718 is a reply to message #573659] Wed, 02 January 2013 12:54 Go to previous messageGo to next message
saikat891
Messages: 11
Registered: April 2012
Location: MUMBAI
Junior Member

Hi,

Thanks for your reply.

I also tried to use asmlib drivers to eliminate the permission issue.

It gave me the following errorwhile running root.sh in first node itself.Please help.

[root@VM-PAGRAC3 grid]# ./root.sh
Performing root user operation for Oracle 11g

The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/app/11.2.0/grid/crs/install/crsconfig_params
User ignored Prerequisites during installation
OLR initialization - successful
Adding Clusterware entries to inittab
CRS-2672: Attempting to start 'ora.mdnsd' on 'vm-pagrac3'
CRS-2676: Start of 'ora.mdnsd' on 'vm-pagrac3' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'vm-pagrac3'
CRS-2676: Start of 'ora.gpnpd' on 'vm-pagrac3' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'vm-pagrac3'
CRS-2672: Attempting to start 'ora.gipcd' on 'vm-pagrac3'
CRS-2676: Start of 'ora.cssdmonitor' on 'vm-pagrac3' succeeded
CRS-2676: Start of 'ora.gipcd' on 'vm-pagrac3' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'vm-pagrac3'
CRS-2672: Attempting to start 'ora.diskmon' on 'vm-pagrac3'
CRS-2676: Start of 'ora.diskmon' on 'vm-pagrac3' succeeded
CRS-2676: Start of 'ora.cssd' on 'vm-pagrac3' succeeded

ASM created and started successfully.

Disk Group OCVD created successfully.

Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Errors in file :
ORA-27091: unable to queue I/O
ORA-15081: failed to submit an I/O operation to a disk
ORA-06512: at line 4
Failed to create Oracle Cluster Registry configuration, rc 255
Oracle Grid Infrastructure Repository configuration failed at /oracle/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 6769.
/oracle/app/11.2.0/grid/perl/bin/perl -I/oracle/app/11.2.0/grid/perl/lib -I/oracle/app/11.2.0/grid/crs/install /oracle/app/11.2.0/grid/crs/install/rootcrs.pl execution failed
[root@VM-PAGRAC3 grid]


I referred doc id:-955550.1., althought 11.2.0.3 is not the addressed version in the doc.

I have configured oracleasm as follow:-

# /etc/init.d/oracleasm configure
Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting without typing an
answer will keep that current value. Ctrl-C will abort.

Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver: [ OK ]
Scanning the system for Oracle ASMLib disks: [ OK



I am running runinstaller as oracle user. I tried changing the user,group of asmlib to oracle,dba respectively on both the nodes.Still facing same error. Please help.

Regards,
Saikat
Re: Help me configuring udev rule for raw disks [message #573719 is a reply to message #573718] Wed, 02 January 2013 13:15 Go to previous messageGo to next message
John Watson
Messages: 4612
Registered: January 2010
Location: Global Village
Senior Member
I have given you a solution. You have not tried it. Perhaps you would prefer a solution from someone else?

Re: Help me configuring udev rule for raw disks [message #573720 is a reply to message #573642] Wed, 02 January 2013 13:51 Go to previous message
saikat891
Messages: 11
Registered: April 2012
Location: MUMBAI
Junior Member

Hi,

Actually I was unable to access the forum due to restriction in internet access in office. Thus tried asmlib and..faced the error. Thought might learn something from you regarding the issue.


Tomorrow I will definitely apply the udev rule you gave.


Thanks a lot for your solution.

Regards,
Saikat

[Updated on: Wed, 02 January 2013 14:00]

Report message to a moderator

Previous Topic: "INIT: Id "x" respawning too fast
Next Topic: Xlib: No protocol specified
Goto Forum:
  


Current Time: Thu Oct 02 11:57:37 CDT 2014

Total time taken to generate the page: 0.11367 seconds