User http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnCentos4UsingVMware.php for installing on VMWARE 1. installation of linux 2. locating for dependent RPMs a. rpm -Uvh setarch-1* b. rpm -Uvh compat-libstdc++-33-3* c. rpm -Uvh make-3* d. rpm -Uvh glibc-2* e. rpm -Uvh openmotif-2* f. rpm -Uvh compat-db-4* g. rpm -Uvh gcc-3* h. rpm -Uvh libaio-0* i. rpm -Uvh rsh-* j. rpm -Uvh compat-gcc-32-3* k. rpm -Uvh compat-gcc-32-c++-3* l. rpm -Uvh openmotif21* 3. Add/Modify Kernel parameter by using sysctl a. Edit /etc/sysctl.conf file add/modify below i. kernel.shmall = 2097152 ii. kernel.shmmax = 2147483648 iii. kernel.shmmni = 4096 iv. # semaphores: semmsl, semmns, semopm, semmni v. kernel.sem = 250 32000 100 128 vi. fs.file-max = 65536 vii. net.ipv4.ip_local_port_range = 1024 65000 viii. net.core.rmem_default=262144 ix. net.core.rmem_max=262144 x. net.core.wmem_default=262144 xi. net.core.wmem_max=262144 4. modify etc/security/limits.conf a. * soft nproc 2047 b. * hard nproc 16384 c. * soft nofile 1024 d. * hard nofile 65536 5. Modify /etc/pam.d/login file a. session required pam_limits.so 6. Disable secure linux by editing the /etc/selinux/config file a. SELINUX=disabled 7. edited the hangcheck kernel module parameters by adding the following line to the /etc/modprobe.conf file. Test this by using modprobe -v hangcheck-timer a. options hangcheck-timer hangcheck_tick=30 hangcheck_margin=180 8. Create group oinstall, dba, oper a. groupadd oinstall b. groupadd dba c. groupadd oper 9. Create user oracle with group oinstall a. useradd -g oinstall -G dba –m –d /home/oracle oracle b. passwd oracle 10. Enable remote login by using RSH and RSH-Server a. chkconfig rsh on b. chkconfig rlogin on c. service xinetd reload 11. Create the /etc/hosts.equiv file as the root user. a. touch /etc/hosts.equiv b. chmod 600 /etc/hosts.equiv c. chown root:root /etc/hosts.equiv 12. Edit the /etc/hosts.equiv file to include all the RAC nodes: a. +lindb1 oracle b. +lindb2 oracle c. +lindb1-priv oracle d. +lindb2-priv oracle e. +lindb1-vip oracle f. +lindb2-vip oracle 13. For VMWARE install its tool. Go to Guest OS and execute "vmware-config-tools.pl" 14. In VMWARE add 5 SCSI disk to the OS for SAN Storage. 15. Use fdisk to partition a. fdisk /dev/sdX (follow n, p, 1, return, return, p, w sequence) b. fdisk –l 16. Configure raw device by a. /bin/raw /dev/raw/raw1 /dev/sdb1. It will return major and minor user this number to modify /etc/udev/rules.d/60-raw.rules file. Add below two lines i. ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N" ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="17", RUN+="/bin/raw /dev/raw/raw1 %M %m" ii. ACTION=="add", KERNEL=="sdc1", RUN+="/bin/raw /dev/raw/raw2 %N" ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="33", RUN+="/bin/raw /dev/raw/raw2 %M %m" iii. ACTION=="add", KERNEL=="sdd1", RUN+="/bin/raw /dev/raw/raw3 %N" ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="49", RUN+="/bin/raw /dev/raw/raw3 %M %m" iv. ACTION=="add", KERNEL=="sde1", RUN+="/bin/raw /dev/raw/raw4 %N" ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="65", RUN+="/bin/raw /dev/raw/raw4 %M %m" v. ACTION=="add", KERNEL=="sdf1", RUN+="/bin/raw /dev/raw/raw5 %N" ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="81", RUN+="/bin/raw /dev/raw/raw5 %M %m" 17. Create directory a. mkdir -p /u01/crs/oracle/product/10.2.0/crs b. mkdir -p /u01/app/oracle/product/10.2.0/db_1 c. mkdir -p /u01/oradata d. chown -R oracle.oinstall /u01 18. Create some symbolic links to the raw devices. This is not really necessary, but it acts as a reminder of the true locatons. a. ln -s /dev/raw/raw1 /u01/oradata/ocr b. ln -s /dev/raw/raw2 /u01/oradata/votingdisk c. ln -s /dev/raw/raw3 /u01/oradata/asm1 d. ln -s /dev/raw/raw4 /u01/oradata/asm2 e. ln -s /dev/raw/raw5 /u01/oradata/asm3 f. chown oracle:oinstall /dev/raw/raw1 g. chown oracle:oinstall /dev/raw/raw2 h. chown oracle:oinstall /dev/raw/raw3 i. chown oracle:oinstall /dev/raw/raw4 j. chown oracle:oinstall /dev/raw/raw5 k. chmod 600 /dev/raw/raw1 l. chmod 600 /dev/raw/raw2 m. chmod 600 /dev/raw/raw3 n. chmod 600 /dev/raw/raw4 o. chmod 600 /dev/raw/raw5 19. shutdown –h now 20. copy os folder and change the display name to lindb2 21. add this folder into vmware 22. start both the machine one by one 23. configure IP Address on both the machin 24. change /etc/hosts as below # Public i. 192.168.1.121 lindb1.localdomain lindb1 ii. 192.168.1.122 lindb2.localdomain lindb2 #Private iii. 192.168.1.131 lindb1-priv.localdomain lindb1-priv iv. 192.168.1.132 lindb2-priv.localdomain lindb2-priv #Virtual v. 192.168.1.141 lindb1-vip.localdomain lindb1-vip vi. 192.168.1.142 lindb2-vip.localdomain lindb2-vip 25. Configure SSH as below (Use Null(Press Enter) for Enter passphrase (empty for no passphrase) a. Ssh-keygent –t rsa b. Ssh-keygent –t dsa The output will be like below a@A:~> ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/home/a/.ssh/id_rsa): Created directory '/home/a/.ssh'. Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/a/.ssh/id_rsa. Your public key has been saved in /home/a/.ssh/id_rsa.pub. The key fingerprint is: 3e:4f:05:79:3a:9f:96:7c:3b:ad:e9:58:37:bc:37:e4 a@A c. cat .ssh/id_rsa.pub >> .ssh/authorized_keys d. cat .ssh/id_dsa.pub >> .ssh/authorized_keys e. cat .ssh/id_rsa.pub |ssh lindb2 ‘cat >> .ssh/authorized_keys’[from lindb1] f. cat .ssh/id_dsa.pub |ssh lindb2 ‘cat >> .ssh/authorized_keys’[from lindb1] g. cat .ssh/id_rsa.pub |ssh lindb1 ‘cat >> .ssh/authorized_keys’[from lindb2] h. cat .ssh/id_dsa.pub |ssh lindb1 ‘cat >> .ssh/authorized_keys’[from lindb2] 26. YOUR SETUP OF SYSTEM IS NOW COMPLETE. NOW YOU CAN START INSTALLING CLUSTERWARE 27. mount clusterware CD to lindb1 28. run runcluvfy.sh with command a. sh /media/../clusterware/runcluvfy.sh stage -pre crsinst -n lindb11,lindb2 > crsstatus.chk b. Check entries if status is failed. Update system config/ system’s RPM as said in the log c. Run again to till status is passed 29. Start CRS Installation