DBA Blogs

How to find all Mondays between two dates?

Tom Kyte - Thu, 2018-08-02 13:26
I have to find all mondays between two date range which can be parameterized or coming from two different columns of a table. Also need to generate a sql to get next 20 mondays from sysdate. can you please help me to get sql query for these 2 r...
Categories: DBA Blogs

Partner Webcast – Building event driven microservices with Oracle Event Hub CS

If we are about to pick one word which would characterize the microservice approach, it would probably be the word freedom. It is all about freedom to change, freedom to deploy at any time, finally...

We share our skills to maximize your revenue!
Categories: DBA Blogs

Procedure having OUT parameter vs Function

Tom Kyte - Wed, 2018-08-01 19:06
Thanks for taking up this question. Are there any guidelines regarding when to use a procedure(OUT parameter) vs Function. Both structures can be used to achieve the same objective in specific situation. I have created a function F1 and a procedu...
Categories: DBA Blogs

returning top 10 records based on previous records counts

Tom Kyte - Tue, 2018-07-31 06:26
Hi, I have an ordered table of products and customers as follows: <code>rn product customer 1 859274 A 2 859267 A 3 859250 A 4 863592 B 5 862250 B 6 862700 B 7 862694 B 8 862120 B 9 863592 C 10 862250 C 11 862120 D 12 86...
Categories: DBA Blogs

Library Cache Locks and Compiling New PL/SQL Code

Tom Kyte - Tue, 2018-07-31 06:26
Hello! I have a friend that told me that compiling a new piece of Pl/SQL code will put library cache locks on the dependent objects, and that there's a risk for database contention when new code is deployed. In other words, if I go out to a datab...
Categories: DBA Blogs

How to install Oracle RAC 18c in silent mode on Oracle Linux 7.5 with VirtualBox – Part 2

Pierre Forstmann Oracle Database blog - Tue, 2018-07-31 00:19

Both posts document how to install a 2-node Oracle RAC cluster with Oracle 18c on Oracle Linux 7.5 (OL7) with VirtualBox (VBOX).

Part 1 details Oracle Linux installation and configuration and part 2 details Oracle software installation (Grid Infrastructure (GI), Oracle Database) and database creation.
In this article GIMR stands for Grid Infrastructure Management Repository.

Disclaimer: this is only an example that can be used to setup a lab or test system: it is not designed to be used for production purpose.

Grid Infrastructure silent installation

I have created ORACLE_BASE and ORACLE_HOME target directories on both nodes:

# mkdir -p /u01/base
# chown oracle:dba /u01/base
# mkdir /u01/gi18c
# chown oracle:oinstall /u01/gi18c
# chmod -R 775 /u01 

I have created /etc/oraInst.loc to define Oracle Inventory location on both nodes:

# cat /etc/oraInst.loc
inventory_loc=/u01/orainv
inst_group=oinstall
# mkdir  /u01/orainv
# chown oracle:oinstall /u01/orainv

I have unzipped GI media on first cluster node:

$ cd /u01/gi18c
$ unzip -q /stage/LINUX.X64_180000_grid_home.zip 

I have installed cvuqdisk RPM on both nodes. I have run on ol7decn1:

# rpm -iv /u01/gi18c/cv/rpm/cvuqdisk-1.0.10-1.rpm
Preparing packages...
cvuqdisk-1.0.10-1.x86_64

I have run on ol7decn2:

# scp root@ol7decn1:/u01/gi18c/cv/rpm/cvuqdisk-1.0.10-1.rpm .
The authenticity of host 'ol7decn1 (192.168.56.138)' can't be established.
ECDSA key fingerprint is SHA256:xo4lc6xkmEsFroCbIFcGUuWa2yuF7OUzPLVedKhk5dU.
ECDSA key fingerprint is MD5:d2:ef:bc:d9:b7:2a:e5:1f:91:e5:78:42:1b:a5:6e:3a.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'ol7decn1,192.168.56.138' (ECDSA) to the list of known hosts.
root@ol7decn1's password: 
cvuqdisk-1.0.10-1.rpm                                                                             100% 8860     4.5MB/s   00:00    
# rpm -iv cvuqdisk-1.0.10-1.rpm
Preparing packages...
cvuqdisk-1.0.10-1.x86_64
# 

I have labeled ASM disks for ASMFD on ol7decn1:

# export ORACLE_HOME=/u01/gi18c
# export ORACLE_BASE=/u01/base
# /u01/gi18c/bin/asmcmd afd_label OCRVD /dev/sdb1 --init
# /u01/gi18c/bin/asmcmd afd_label GIMR  /dev/sdc1 --init
# /u01/gi18c/bin/asmcmd afd_label DATA  /dev/sdd1 --init
# /u01/gi18c/bin/asmcmd afd_label RECO  /dev/sde1 --init

In order to avoid following error when installing GI … :

[FATAL] [INS-32250] ADR setup (diagsetup) tool failed. Check the install log for more details.
*ADDITIONAL INFORMATION:*
 - DiagSetup-00010: Diag Setup Usage error: unable to perform create directory operation
 - DiagSetup-00010: Diag Setup Usage error: unable to perform create directory operation
 - Error creating ADR directory
 - DiagSetup-00010: Diag Setup Usage error: unable to perform create directory operation
 - oracle.diagfw.adr.diagsetup.DiagSetupException: DiagSetup-00010: Diag Setup Usage error: unable to perform create directory operation
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.createAdrDir(DiagSetup.java:578)
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.createDirsLocal(DiagSetup.java:418)
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.createDirs(DiagSetup.java:329)
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.executeMain(DiagSetup.java:297)
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.main(DiagSetup.java:260)
 - DiagSetup-00010: Diag Setup Usage error: unable to perform create directory operation
 - oracle.diagfw.adr.diagsetup.DiagSetupException: DiagSetup-00010: Diag Setup Usage error: unable to perform create directory operation
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.createDirs(DiagSetup.java:345)
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.executeMain(DiagSetup.java:297)
 -  at oracle.diagfw.adr.diagsetup.DiagSetup.main(DiagSetup.java:260)

… I have removed following directory created by asmcmd afd_label instructions:

# rm -rf /u01/base/diag

I have created following silent installation script for GI:


cd /u01/gi18c
DISTRIB=$(pwd)
/u01/gi18c/gridSetup.sh -silent                              \
       -responseFile $DISTRIB/install/response/gridsetup.rsp   \
       inventory_location=/u01/orainv                          \
       selected_languages=en                                   \
       oracle.install.option=CRS_CONFIG                        \
       oracle_base=/u01/base/                                  \
       oracle.install.asm.OSDBA=dba                            \
       oracle.install.asm.OSOPER=dba                           \
       oracle.install.asm.OSASM=dba                            \
       oracle.install.crs.config.gpnp.scanName=ol7dec-scan.localdomain \
       oracle.install.crs.config.gpnp.scanPort=1521            \
       oracle.install.crs.config.clusterName=ol7decn           \
       oracle.install.crs.config.gpnp.configureGNS=false       \
       oracle.install.crs.config.clusterNodes=ol7decn1:ol7decn1-vip:HUB,ol7decn2:ol7decn2-vip:HUB \
       oracle.install.crs.config.networkInterfaceList=enp0s8:192.168.56.0:1,enp0s9:192.168.43.0:5 \
       oracle.install.crs.config.storageOption=FLEX_ASM_STORAGE \
       oracle.install.asm.configureGIMRDataDG=true             \
       oracle.install.crs.config.useIPMI=false                 \
       oracle.install.asm.SYSASMPassword=oracle                \
       oracle.install.asm.configureAFD=true                    \
       oracle.install.asm.storageOption=ASM                    \
       oracle.install.asm.diskGroup.diskDiscoveryString=/dev/sdb1,/dev/sdc1 \
       oracle.install.asm.diskGroup.name=OCRVD                 \
       oracle.install.asm.diskGroup.disks=/dev/sdb1            \
       oracle.install.asm.diskGroup.redundancy=EXTERNAL        \
       oracle.install.asm.monitorPassword=oracle               \
       oracle.install.asm.gimrDG.name=GIMR                     \
       oracle.install.asm.gimrDG.disks=/dev/sdc1               \
       oracle.install.asm.gimrDG.redundancy=EXTERNAL           

The above script is using following variables defined in ./install/response/gridsetup.rsp response file:

parameter name description inventory_location Directory where Oracle Inventory will be stored. Must match /etc/oraInst.loc contents. oracle.install.option Must be set to CRS_CONFIG for Grid Infrastructure for cluster. oracle.install.crs.config.gpnp.scanName Must be set to DNS alias for the 3 SCAN listener adresses. oracle.install.crs.config.gpnp.scanPort Must be to set to TCP port to be used by SCAN listener. oracle.install.crs.config.clusterName No dependency for this name. oracle.install.crs.config.gpnp.configureGNS Must be set to FALSE to not use Grid Naming Service (GNS). oracle.install.crs.config.clusterNodes Must be set to public-hostname:vip-hostname:HUB comma separated host name list (for STANDALONE cluster type). oracle.install.crs.config.networkInterfaceList Must be set to network-interface:network-interface-subnet:network-interface_type comma separated strings
where network-interface_type must be set to 1 for public interface and to 5 for private interface (interconnect). oracle.install.crs.config.storageOption Set to FLEX_ASM_STORAGE for OCR and voting disk. oracle.install.asm.configureGIMRDataDG must be set to true to use a separate disk for GIMR database oracle.install.crs.config.useIPMI Must be set to FALSE to not use Intelligent Power Management Interface. oracle.install.asm.configureAFD must be set to TRUE to use ASMFD oracle.install.asm.SYSASMPassword Must be set to SYS password for ASM instance. oracle.install.asm.diskGroup.diskDiscoveryString Used to set ASM instance ASM_DISKSTRING parameter for OCR/voting disk disk group and GIMR disk group oracle.install.asm.diskGroup.name Name of ASM disk group used for OCR and voting disk oracle.install.asm.diskGroup.disks Comma separated ASM disk names list to be used for OCR and voting disk group. oracle.install.asm.diskGroup.redundancy Disk group redundancy used by above ASM disk group. oracle.install.asm.monitorPassword Must be set to ASMSNMP password for ASM instance. oracle.install.asm.gimrDG.name Name of ASM disk group used for GIMR database. oracle.install.asm.gimrDG.diskGroup.disks Comma separated ASM disk names list to be used for GIMR disk group. oracle.install.asm.gimrDG.diskGroup.redundancy Disk group redundancy used by GIMR disk group.

Running this script has generated following output:

Launching Oracle Grid Infrastructure Setup Wizard...

[WARNING] [INS-30011] The SYS password entered does not conform to the Oracle recommended standards.
   CAUSE: Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
   ACTION: Provide a password that conforms to the Oracle recommended standards.
[WARNING] [INS-30011] The ASMSNMP password entered does not conform to the Oracle recommended standards.
   CAUSE: Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
   ACTION: Provide a password that conforms to the Oracle recommended standards.
[WARNING] [INS-41808] Possible invalid choice for OSASM Group.
   CAUSE: The name of the group you selected for the OSASM group is commonly used to grant other system privileges (For example: asmdba, asmoper, dba, oper).
   ACTION: Oracle recommends that you designate asmadmin as the OSASM group.
[WARNING] [INS-41809] Possible invalid choice for OSDBA Group.
   CAUSE: The group name you selected as the OSDBA for ASM group is commonly used for Oracle Database administrator privileges.
   ACTION: Oracle recommends that you designate asmdba as the OSDBA for ASM group, and that the group should not be the same group as an Oracle Database OSDBA group.
[WARNING] [INS-41810] Possible invalid choice for OSOPER Group.
   CAUSE: The group name you selected as the OSOPER for ASM group is commonly used for Oracle Database administrator privileges.
   ACTION: Oracle recommends that you designate asmoper as the OSOPER for ASM group, and that the group should not be the same group as an Oracle Database OSOPER group.
[WARNING] [INS-41813] OSDBA for ASM, OSOPER for ASM, and OSASM are the same OS group.
   CAUSE: The group you selected for granting the OSDBA for ASM group for database access, and the OSOPER for ASM group for startup and shutdown of Oracle ASM, is the same group as the OSASM group, whose members have SYSASM privileges on Oracle ASM.
   ACTION: Choose different groups as the OSASM, OSDBA for ASM, and OSOPER for ASM groups.
[WARNING] [INS-13014] Target environment does not meet some optional requirements.
   CAUSE: Some of the optional prerequisites are not met. See logs for details. /u01/orainv/logs/GridSetupActions2018-07-28_05-28-26PM/gridSetupActions2018-07-28_05-28-26PM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /u01/orainv/logs/GridSetupActions2018-07-28_05-28-26PM/gridSetupActions2018-07-28_05-28-26PM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.
The response file for this session can be found at:
 /u01/gi18c/install/response/grid_2018-07-28_05-28-26PM.rsp

You can find the log of this install session at:
 /u01/orainv/logs/GridSetupActions2018-07-28_05-28-26PM/gridSetupActions2018-07-28_05-28-26PM.log
OUI-10053:Unable to generate temporary script: /u01/oraInventory/orainstRoot.sh. Unable to continue install.

As a root user, execute the following script(s):
	1. /u01/orainv/orainstRoot.sh
	2. /u01/gi18c/root.sh

Execute /u01/orainv/orainstRoot.sh on the following nodes: 
[ol7decn2]
Execute /u01/gi18c/root.sh on the following nodes: 
[ol7decn1, ol7decn2]

Run the script on the local node first. After successful completion, you can start the script in parallel on all other nodes.

Successfully Setup Software with warning(s).
As install user, execute the following command to complete the configuration.

I did not find any root cause for following error message which looks like a bug:

OUI-10053:Unable to generate temporary script: /u01/oraInventory/orainstRoot.sh. Unable to continue install.

I have ignored following failed prerequisites:

INFO:  [Jul 28, 2018 5:00:37 PM] ------------------List of failed Tasks------------------
INFO:  [Jul 28, 2018 5:00:37 PM] *********************************************
INFO:  [Jul 28, 2018 5:00:37 PM] Physical Memory: This is a prerequisite condition to test whether the system has at least 8GB (8388608.0KB) of total physical memory.
INFO:  [Jul 28, 2018 5:00:37 PM] Severity:IGNORABLE
INFO:  [Jul 28, 2018 5:00:37 PM] OverallStatus:VERIFICATION_FAILED
INFO:  [Jul 28, 2018 5:00:37 PM] -----------------End of failed Tasks List----------------

On second cluster node I have run orainstRoot.sh:

# /u01/orainv/orainstRoot.sh
Changing permissions of /u01/orainv.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/orainv to oinstall.
The execution of the script is complete.

On first cluster node I have run root.sh:

# /u01/gi18c/root.sh 
Check /u01/gi18c/install/root_ol7decn1.localdomain_2018-07-28_17-46-43-041313489.log for the output of root script

Corresponding log is:

cat /u01/gi18c/install/root_ol7decn1.localdomain_2018-07-28_17-46-43-041313489.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/gi18c
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/gi18c/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/base/crsdata/ol7decn1/crsconfig/rootcrs_ol7decn1_2018-07-28_05-46-55PM.log
2018/07/28 17:47:16 CLSRSC-594: Executing installation step 1 of 20: 'SetupTFA'.
2018/07/28 17:47:16 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2018/07/28 17:47:49 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2018/07/28 17:47:49 CLSRSC-594: Executing installation step 2 of 20: 'ValidateEnv'.
2018/07/28 17:47:49 CLSRSC-363: User ignored prerequisites during installation
2018/07/28 17:47:49 CLSRSC-594: Executing installation step 3 of 20: 'CheckFirstNode'.
2018/07/28 17:47:51 CLSRSC-594: Executing installation step 4 of 20: 'GenSiteGUIDs'.
2018/07/28 17:47:56 CLSRSC-594: Executing installation step 5 of 20: 'SaveParamFile'.
2018/07/28 17:48:14 CLSRSC-594: Executing installation step 6 of 20: 'SetupOSD'.
2018/07/28 17:48:14 CLSRSC-594: Executing installation step 7 of 20: 'CheckCRSConfig'.
2018/07/28 17:48:14 CLSRSC-594: Executing installation step 8 of 20: 'SetupLocalGPNP'.
2018/07/28 17:48:54 CLSRSC-594: Executing installation step 9 of 20: 'CreateRootCert'.
2018/07/28 17:49:04 CLSRSC-594: Executing installation step 10 of 20: 'ConfigOLR'.
2018/07/28 17:49:22 CLSRSC-594: Executing installation step 11 of 20: 'ConfigCHMOS'.
2018/07/28 17:49:22 CLSRSC-594: Executing installation step 12 of 20: 'CreateOHASD'.
2018/07/28 17:49:34 CLSRSC-594: Executing installation step 13 of 20: 'ConfigOHASD'.
2018/07/28 17:49:34 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2018/07/28 17:50:59 CLSRSC-594: Executing installation step 14 of 20: 'InstallAFD'.
2018/07/28 17:51:52 CLSRSC-594: Executing installation step 15 of 20: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol7decn1'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol7decn1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2018/07/28 17:52:52 CLSRSC-594: Executing installation step 16 of 20: 'InstallKA'.
2018/07/28 17:53:01 CLSRSC-594: Executing installation step 17 of 20: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol7decn1'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol7decn1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.driver.afd' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.evmd' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol7decn1'
CRS-2676: Start of 'ora.driver.afd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol7decn1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.evmd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol7decn1'
CRS-2676: Start of 'ora.gpnpd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ol7decn1'
CRS-2676: Start of 'ora.gipcd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol7decn1'
CRS-2676: Start of 'ora.diskmon' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol7decn1' succeeded

[INFO] [DBT-30161] Disk label(s) created successfully. Check /u01/base/cfgtoollogs/asmca/asmca-180728PM055408.log for details.
[INFO] [DBT-30001] Disk groups created successfully. Check /u01/base/cfgtoollogs/asmca/asmca-180728PM055408.log for details.


2018/07/28 17:55:25 CLSRSC-482: Running command: '/u01/gi18c/bin/ocrconfig -upgrade oracle oinstall'
CRS-2672: Attempting to start 'ora.crf' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.storage' on 'ol7decn1'
CRS-2676: Start of 'ora.storage' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.crf' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol7decn1'
CRS-2676: Start of 'ora.crsd' on 'ol7decn1' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 79df663311604f1ebfe81344216c1d46.
Successfully replaced voting disk group with +OCRVD.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   79df663311604f1ebfe81344216c1d46 (AFD:OCRVD) [OCRVD]
Located 1 voting disk(s).
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.crsd' on 'ol7decn1'
CRS-2677: Stop of 'ora.crsd' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.crf' on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'ol7decn1'
CRS-2677: Stop of 'ora.crf' on 'ol7decn1' succeeded
CRS-2677: Stop of 'ora.storage' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ol7decn1'
CRS-2677: Stop of 'ora.drivers.acfs' on 'ol7decn1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'ol7decn1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ol7decn1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.evmd' on 'ol7decn1'
CRS-2677: Stop of 'ora.evmd' on 'ol7decn1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ol7decn1'
CRS-2677: Stop of 'ora.cssd' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.driver.afd' on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.gipcd' on 'ol7decn1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'ol7decn1'
CRS-2677: Stop of 'ora.driver.afd' on 'ol7decn1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'ol7decn1' succeeded
CRS-2677: Stop of 'ora.gipcd' on 'ol7decn1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol7decn1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2018/07/28 17:59:38 CLSRSC-594: Executing installation step 18 of 20: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol7decn1'
CRS-2676: Start of 'ora.evmd' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol7decn1'
CRS-2676: Start of 'ora.gpnpd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ol7decn1'
CRS-2676: Start of 'ora.gipcd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol7decn1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.cssd' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol7decn1'
CRS-2676: Start of 'ora.diskmon' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.crf' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.ctssd' on 'ol7decn1'
CRS-2676: Start of 'ora.ctssd' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol7decn1'
CRS-2676: Start of 'ora.asm' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'ol7decn1'
CRS-2676: Start of 'ora.storage' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol7decn1'
CRS-2676: Start of 'ora.crsd' on 'ol7decn1' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: ol7decn1
CRS-6016: Resource auto-start has completed for server ol7decn1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2018/07/28 18:02:51 CLSRSC-343: Successfully started Oracle Clusterware stack
2018/07/28 18:02:51 CLSRSC-594: Executing installation step 19 of 20: 'ConfigNode'.
CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'ol7decn1'
CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol7decn1'
CRS-2676: Start of 'ora.asm' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.OCRVD.dg' on 'ol7decn1'
CRS-2676: Start of 'ora.OCRVD.dg' on 'ol7decn1' succeeded
2018/07/28 18:05:23 CLSRSC-594: Executing installation step 20 of 20: 'PostConfig'.

[INFO] [DBT-30161] Disk label(s) created successfully. Check /u01/base/cfgtoollogs/asmca/asmca-180728PM060527.log for details.
[INFO] [DBT-30001] Disk groups created successfully. Check /u01/base/cfgtoollogs/asmca/asmca-180728PM060527.log for details.


2018/07/28 18:08:45 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

I have checked cluster resources with:

$ export ORACLE_SID=+ASM1
$ PATH=/u01/gi18c/bin:$PATH
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
ora.GIMR.GHCHKPT.advm
               OFFLINE OFFLINE      ol7decn1                 STABLE
ora.GIMR.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
ora.gimr.ghchkpt.acfs
               OFFLINE OFFLINE      ol7decn1                 volume /opt/oracle/r
                                                             hp_images/chkbase is
                                                             unmounted,STABLE
ora.helper
               OFFLINE OFFLINE      ol7decn1                 STABLE
ora.net1.network
               ONLINE  ONLINE       ol7decn1                 STABLE
ora.ons
               ONLINE  ONLINE       ol7decn1                 STABLE
ora.proxy_advm
               OFFLINE OFFLINE      ol7decn1                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.MGMTLSNR
      1        OFFLINE OFFLINE                               STABLE
ora.asm
      1        ONLINE  ONLINE       ol7decn1                 Started,STABLE
      2        OFFLINE OFFLINE                               STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.ol7decn1.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.qosmserver
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.rhpserver
      1        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
--------------------------------------------------------------------------------

I have run root.sh on second cluster node:

# /u01/gi18c/root.sh 
Check /u01/gi18c/install/root_ol7decn2.localdomain_2018-07-28_18-27-02-937964448.log for the output of root script

Corresponding log is:

Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/gi18c
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
	LANGUAGE = (unset),
	LC_ALL = (unset),
	LC_PAPER = "fr_FR.UTF-8",
	LC_MONETARY = "fr_FR.UTF-8",
	LC_NUMERIC = "fr_FR.UTF-8",
	LC_MEASUREMENT = "fr_FR.UTF-8",
	LC_TIME = "fr_FR.UTF-8",
	LANG = "en_EN"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
Using configuration parameter file: /u01/gi18c/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/base/crsdata/ol7decn2/crsconfig/rootcrs_ol7decn2_2018-07-28_06-27-39PM.log
2018/07/28 18:27:46 CLSRSC-594: Executing installation step 1 of 20: 'SetupTFA'.
2018/07/28 18:27:46 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.
2018/07/28 18:28:28 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2018/07/28 18:28:28 CLSRSC-594: Executing installation step 2 of 20: 'ValidateEnv'.
2018/07/28 18:28:28 CLSRSC-363: User ignored prerequisites during installation
2018/07/28 18:28:28 CLSRSC-594: Executing installation step 3 of 20: 'CheckFirstNode'.
2018/07/28 18:28:30 CLSRSC-594: Executing installation step 4 of 20: 'GenSiteGUIDs'.
2018/07/28 18:28:30 CLSRSC-594: Executing installation step 5 of 20: 'SaveParamFile'.
2018/07/28 18:28:33 CLSRSC-594: Executing installation step 6 of 20: 'SetupOSD'.
2018/07/28 18:28:33 CLSRSC-594: Executing installation step 7 of 20: 'CheckCRSConfig'.
2018/07/28 18:28:34 CLSRSC-594: Executing installation step 8 of 20: 'SetupLocalGPNP'.
2018/07/28 18:28:35 CLSRSC-594: Executing installation step 9 of 20: 'CreateRootCert'.
2018/07/28 18:28:35 CLSRSC-594: Executing installation step 10 of 20: 'ConfigOLR'.
2018/07/28 18:28:38 CLSRSC-594: Executing installation step 11 of 20: 'ConfigCHMOS'.
2018/07/28 18:28:38 CLSRSC-594: Executing installation step 12 of 20: 'CreateOHASD'.
2018/07/28 18:28:39 CLSRSC-594: Executing installation step 13 of 20: 'ConfigOHASD'.
2018/07/28 18:28:40 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2018/07/28 18:29:52 CLSRSC-594: Executing installation step 14 of 20: 'InstallAFD'.
2018/07/28 18:30:33 CLSRSC-594: Executing installation step 15 of 20: 'InstallACFS'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol7decn2'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol7decn2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
2018/07/28 18:31:28 CLSRSC-594: Executing installation step 16 of 20: 'InstallKA'.
2018/07/28 18:31:30 CLSRSC-594: Executing installation step 17 of 20: 'InitConfig'.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol7decn2'
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol7decn2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol7decn2'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ol7decn2'
CRS-2677: Stop of 'ora.drivers.acfs' on 'ol7decn2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol7decn2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
2018/07/28 18:31:43 CLSRSC-594: Executing installation step 18 of 20: 'StartCluster'.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.evmd' on 'ol7decn2'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol7decn2'
CRS-2676: Start of 'ora.evmd' on 'ol7decn2' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol7decn2'
CRS-2676: Start of 'ora.gpnpd' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ol7decn2'
CRS-2676: Start of 'ora.gipcd' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol7decn2'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'ol7decn2'
CRS-2672: Attempting to start 'ora.cssd' on 'ol7decn2'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol7decn2'
CRS-2676: Start of 'ora.diskmon' on 'ol7decn2' succeeded
CRS-2676: Start of 'ora.crf' on 'ol7decn2' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ol7decn2'
CRS-2672: Attempting to start 'ora.ctssd' on 'ol7decn2'
CRS-2676: Start of 'ora.ctssd' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol7decn2'
CRS-2676: Start of 'ora.crsd' on 'ol7decn2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol7decn2'
CRS-2676: Start of 'ora.asm' on 'ol7decn2' succeeded
CRS-6017: Processing resource auto-start for servers: ol7decn2
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.ons' on 'ol7decn2'
CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'ol7decn2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'ol7decn1' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'ol7decn1'
CRS-2677: Stop of 'ora.scan1.vip' on 'ol7decn1' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'ol7decn2'
CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol7decn2'
CRS-2676: Start of 'ora.scan1.vip' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'ol7decn2'
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'ol7decn2' succeeded
CRS-2676: Start of 'ora.ons' on 'ol7decn2' succeeded
CRS-2676: Start of 'ora.asm' on 'ol7decn2' succeeded
CRS-2672: Attempting to start 'ora.proxy_advm' on 'ol7decn1'
CRS-2672: Attempting to start 'ora.proxy_advm' on 'ol7decn2'
CRS-2676: Start of 'ora.proxy_advm' on 'ol7decn1' succeeded
CRS-2676: Start of 'ora.proxy_advm' on 'ol7decn2' succeeded
CRS-6016: Resource auto-start has completed for server ol7decn2
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2018/07/28 18:34:41 CLSRSC-343: Successfully started Oracle Clusterware stack
2018/07/28 18:34:41 CLSRSC-594: Executing installation step 19 of 20: 'ConfigNode'.
2018/07/28 18:35:02 CLSRSC-594: Executing installation step 20 of 20: 'PostConfig'.
2018/07/28 18:35:35 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

I have checked cluster resources:

$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.GIMR.GHCHKPT.advm
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.GIMR.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.gimr.ghchkpt.acfs
               OFFLINE OFFLINE      ol7decn1                 volume /opt/oracle/r
                                                             hp_images/chkbase is
                                                             unmounted,STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.helper
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 IDLE,STABLE
ora.net1.network
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.proxy_advm
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.MGMTLSNR
      1        OFFLINE OFFLINE                               STABLE
ora.asm
      1        ONLINE  ONLINE       ol7decn1                 Started,STABLE
      2        ONLINE  ONLINE       ol7decn2                 Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.ol7decn1.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.ol7decn2.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.qosmserver
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.rhpserver
      1        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
--------------------------------------------------------------------------------

I have checked ASMFD disks:

$ export ORACLE_BASE=/u01/base
$ asmcmd afd_lsdsk
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
GIMR                        ENABLED   /dev/sdc1
OCRVD                       ENABLED   /dev/sdb1

I have run the last GI configuration script with oracle user account:

set -x
cd /u01/gi18c
DISTRIB=$(pwd)
/u01/gi18c/gridSetup.sh -silent -executeConfigTools            \
       -responseFile $DISTRIB/install/response/gridsetup.rsp   \
       inventory_location=/u01/orainv                          \
       selected_languages=en                                   \
       oracle.install.option=CRS_CONFIG                        \
       oracle_base=/u01/base/                                  \
       oracle.install.asm.OSDBA=dba                            \
       oracle.install.asm.OSOPER=dba                           \
       oracle.install.asm.OSASM=dba                            \
       oracle.install.crs.config.gpnp.scanName=ol7dec-scan.localdomain \
       oracle.install.crs.config.gpnp.scanPort=1521            \
       oracle.install.crs.config.clusterName=ol7decn           \
       oracle.install.crs.config.gpnp.configureGNS=false       \
       oracle.install.crs.config.clusterNodes=ol7decn1:ol7decn1-vip:HUB,ol7decn2:ol7decn2-vip:HUB \
       oracle.install.crs.config.networkInterfaceList=enp0s8:192.168.56.0:1,enp0s9:192.168.43.0:5 \
       oracle.install.crs.config.storageOption=FLEX_ASM_STORAGE \
       oracle.install.asm.configureGIMRDataDG=true             \
       oracle.install.crs.config.useIPMI=false                 \
       oracle.install.asm.SYSASMPassword=oracle                \
       oracle.install.asm.configureAFD=true                    \
       oracle.install.asm.storageOption=ASM                    \
       oracle.install.asm.diskGroup.diskDiscoveryString=/dev/sdb1,/dev/sdc1 \
       oracle.install.asm.diskGroup.name=OCRVD                 \
       oracle.install.asm.diskGroup.disks=/dev/sdb1            \
       oracle.install.asm.diskGroup.redundancy=EXTERNAL        \
       oracle.install.asm.monitorPassword=oracle               \
       oracle.install.asm.gimrDG.name=GIMR                     \
       oracle.install.asm.gimrDG.disks=/dev/sdc1               \
       oracle.install.asm.gimrDG.redundancy=EXTERNAL           

Running this script has generated following output:

Launching Oracle Grid Infrastructure Setup Wizard...

You can find the logs of this session at:
/u01/orainv/logs/GridSetupActions2018-07-28_06-48-32PM

Successfully Configured Software.

I have checked cluster resources with:

$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.GIMR.GHCHKPT.advm
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.GIMR.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.chad
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.gimr.ghchkpt.acfs
               OFFLINE OFFLINE      ol7decn1                 volume /opt/oracle/r
                                                             hp_images/chkbase is
                                                             unmounted,STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.helper
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 IDLE,STABLE
ora.net1.network
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.proxy_advm
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol7decn1                 169.254.26.6 192.168
                                                             .43.138,STABLE
ora.asm
      1        ONLINE  ONLINE       ol7decn1                 Started,STABLE
      2        ONLINE  ONLINE       ol7decn2                 Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol7decn1                 Open,STABLE
ora.ol7decn1.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.ol7decn2.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.qosmserver
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.rhpserver
      1        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
--------------------------------------------------------------------------------

Note that GIMR database (ora.mgmtdb resource) is now created and started.

I have checked OCR:

$ ocrcheck
Status of Oracle Cluster Registry is as follows :
	 Version                  :          4
	 Total space (kbytes)     :     491684
	 Used space (kbytes)      :      84888
	 Available space (kbytes) :     406796
	 ID                       : 1283070023
	 Device/File Name         :     +OCRVD
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

	 Cluster registry integrity check succeeded

	 Logical corruption check bypassed due to non-privileged user

I have checked voting disk:

$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   79df663311604f1ebfe81344216c1d46 (AFD:OCRVD) [OCRVD]
Located 1 voting disk(s).

I have checked ASM disk groups:

 asmcmd lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512             512   4096  1048576     40959    15761                0           15761              0             N  GIMR/
MOUNTED  EXTERN  N         512             512   4096  1048576      2047     1748                0            1748              0             Y  OCRVD/

I have checked GIMR resource:

$ srvctl config mgmtdb
Database unique name: _mgmtdb
Database name: 
Oracle home: 
Oracle user: oracle
Spfile: +GIMR/_MGMTDB/PARAMETERFILE/spfile.270.982696243
Password file: 
Domain: 
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Type: Management
PDB name: GIMR_DSCREP_10
PDB service: GIMR_DSCREP_10
Cluster name: ol7decn
Database instance: -MGMTDB

I have checked GI patch level with:

$ crsctl query crs softwareversion
Oracle Clusterware version on node [ol7decn1] is [18.0.0.0.0]
$ $ORACLE_HOME/OPatch/opatch lspatches
27908644;UPDATE 18.3 DATABASE CLIENT JDK IN ORACLE HOME TO JDK8U171
27923415;OJVM RELEASE UPDATE: 18.3.0.0.180717 (27923415)
28256701;TOMCAT RELEASE UPDATE 18.3.0.0.0 (28256701)
28090564;DBWLM RELEASE UPDATE 18.3.0.0.0 (28090564)
28090557;ACFS RELEASE UPDATE 18.3.0.0.0 (28090557)
28090553;OCW RELEASE UPDATE 18.3.0.0.0 (28090553)
28090523;Database Release Update : 18.3.0.0.180717 (28090523)

OPatch succeeded.
$ 

I have added ASM instance names in /etc/oratab because GI installation has not done it on both nodes.
On ol7decn1:

+ASM1:/u01/gi18c:N

On ol7decn2:

+ASM2:/u01/gi18c:N
Oracle Database silent installation

I have created Oracle Home directory on both nodes:

# mkdir /u01/db18c
# chown oracle:dba /u01/db18c

I have unzipped media file:

$ cd /u01/db18c
$ unzip -q /stage/LINUX.X64_180000_db_home.zip 

On first node I have run following script:

$ cd /u01/db18c 
export DISTRIB=`pwd`
./runInstaller -silent \
-responseFile $DISTRIB/install/response/db_install.rsp \
oracle.install.option=INSTALL_DB_SWONLY             \
oracle.install.db.CLUSTER_NODES=ol7decn1,ol7decn2   \
UNIX_GROUP_NAME=oinstall                            \
SELECTED_LANGUAGES=en                               \
ORACLE_HOME=/u01/db18c                              \
ORACLE_BASE=/u01/base                               \
oracle.install.db.InstallEdition=EE                 \
oracle.install.db.isCustomInstall=false             \
oracle.install.db.OSDBA_GROUP=dba                   \
oracle.install.db.OSBACKUPDBA_GROUP=dba             \
oracle.install.db.OSDGDBA_GROUP=dba                 \
oracle.install.db.OSKMDBA_GROUP=dba                 \
oracle.install.db.OSRACDBA_GROUP=dba                \
SECURITY_UPDATES_VIA_MYORACLESUPPORT=false          \
DECLINE_SECURITY_UPDATES=true                       \
-waitForCompletion

I have ignored following warnings:

INFO:  [Jul 30, 2018 6:37:48 AM] ------------------List of failed Tasks------------------
INFO:  [Jul 30, 2018 6:37:48 AM] *********************************************
INFO:  [Jul 30, 2018 6:37:48 AM] Physical Memory: This is a prerequisite condition to test whether the system has at least 8GB (8388608.0KB) of total physical memory.
INFO:  [Jul 30, 2018 6:37:48 AM] Severity:IGNORABLE
INFO:  [Jul 30, 2018 6:37:48 AM] OverallStatus:VERIFICATION_FAILED
INFO:  [Jul 30, 2018 6:37:48 AM] *********************************************
INFO:  [Jul 30, 2018 6:37:48 AM] Oracle base: /u01/base: This task verifies the writability of the Oracle base /u01/base
INFO:  [Jul 30, 2018 6:37:48 AM] Severity:CRITICAL
INFO:  [Jul 30, 2018 6:37:48 AM] OverallStatus:WARNING
INFO:  [Jul 30, 2018 6:37:48 AM] *********************************************
INFO:  [Jul 30, 2018 6:37:48 AM] '/u01/base':
INFO:  [Jul 30, 2018 6:37:48 AM] Severity:CRITICAL
INFO:  [Jul 30, 2018 6:37:48 AM] OverallStatus:WARNING
INFO:  [Jul 30, 2018 6:37:48 AM] -----------------End of failed Tasks List----------------

Running this script has produced following output:

Launching Oracle Database Setup Wizard...

[WARNING] [INS-13014] Target environment does not meet some optional requirements.
   CAUSE: Some of the optional prerequisites are not met. See logs for details. /u01/orainv/logs/InstallActions2018-07-30_06-33-01AM/installActions2018-07-30_06-33-01AM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /u01/orainv/logs/InstallActions2018-07-30_06-33-01AM/installActions2018-07-30_06-33-01AM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.
The response file for this session can be found at:
 /u01/db18c/install/response/db_2018-07-30_06-33-01AM.rsp

You can find the log of this install session at:
 /u01/orainv/logs/InstallActions2018-07-30_06-33-01AM/installActions2018-07-30_06-33-01AM.log

As a root user, execute the following script(s):
	1. /u01/db18c/root.sh

Execute /u01/db18c/root.sh on the following nodes: 
[ol7decn1, ol7decn2]


Successfully Setup Software with warning(s).

I have run root.sh on first node …:

# /u01/db18c/root.sh
Check /u01/db18c/install/root_ol7decn1.localdomain_2018-07-30_07-04-22-677276940.log for the output of root script
# cat /u01/db18c/install/root_ol7decn1.localdomain_2018-07-30_07-04-22-677276940.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/db18c
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
# 

… and on second node:

# /u01/db18c/root.sh
Check /u01/db18c/install/root_ol7decn2.localdomain_2018-07-30_07-04-47-261594066.log for the output of root script
# cat /u01/db18c/install/root_ol7decn2.localdomain_2018-07-30_07-04-47-261594066.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/db18c
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
# 

I have checked patch level on first node:

$ export ORACLE_HOME=/u01/db18c
$ export PATH=$ORACLE_HOME/bin:$PATH
$ sqlplus -v

SQL*Plus: Release 18.0.0.0.0 - Production
Version 18.3.0.0.0

$ $ORACLE_HOME/OPatch/opatch lspatches
27908644;UPDATE 18.3 DATABASE CLIENT JDK IN ORACLE HOME TO JDK8U171
27923415;OJVM RELEASE UPDATE: 18.3.0.0.180717 (27923415)
28090553;OCW RELEASE UPDATE 18.3.0.0.0 (28090553)
28090523;Database Release Update : 18.3.0.0.180717 (28090523)

OPatch succeeded.
Fast Recovery Area (FRA) and database group disk creation

I have first modified ASMFD to discover the 2 additional disks:

$ asmcmd afd_dsget
AFD discovery string: /dev/sdb1,/dev/sdc1
$ asmcmd afd_dsset '/dev/sd*'
$ asmcmd afd_dsget
AFD discovery string: /dev/sd*

I have checked that ASMFD is now able to see all ASM disks:

$ asmcmd afd_lsdsk               
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
DATA                        ENABLED   /dev/sdd1
GIMR                        ENABLED   /dev/sdc1
OCRVD                       ENABLED   /dev/sdb1
RECO                        ENABLED   /dev/sde1
$ 

I have also modified ASMFD configuration on second node to make sure ASM disks are usable on both cluster nodes:

$ asmcmd afd_scan  
$ asmcmd afd_lsdsk
--------------------------------------------------------------------------------
Label                     Filtering   Path
================================================================================
DATA                        ENABLED   /dev/sdd1
GIMR                        ENABLED   /dev/sdc1
OCRVD                       ENABLED   /dev/sdb1
RECO                        ENABLED   /dev/sde1
$ 

I have created new ASM disk groups with:

$ . oraenv
ORACLE_SID = [+ASM1] ? +ASM1
The Oracle base remains unchanged with value /u01/base
$ sqlplus / as sysasm

SQL*Plus: Release 18.0.0.0.0 - Production on Mon Jul 30 22:06:41 2018
Version 18.3.0.0.0

Copyright (c) 1982, 2018, Oracle.  All rights reserved.


Connected to:
Oracle Database 18c Enterprise Edition Release 18.0.0.0.0 - Production
Version 18.3.0.0.0

SYS@+ASM1>select name, label, path, header_status from v$asm_disk;

NAME	   LABEL      PATH		   HEADER_STATU
---------- ---------- -------------------- ------------
	   DATA       AFD:DATA		   PROVISIONED
	   RECO       AFD:RECO		   PROVISIONED
OCRVD	   OCRVD      AFD:OCRVD 	   MEMBER
GIMR	   GIMR       AFD:GIMR		   MEMBER

SYS@+ASM1>create diskgroup DATA external redundancy disk 'AFD:DATA';

Diskgroup created.

SYS@+ASM1>create diskgroup RECO external redundancy disk 'AFD:RECO';

Diskgroup created.

I have started disk groups on second cluster node:

$ srvctl start diskgroup -diskgroup DATA -n ol7decn2
$ srvctl start diskgroup -diskgroup RECO -n ol7decn2

I have checked that both disk group resources have been added to OCR:

$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.DATA.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.GIMR.GHCHKPT.advm
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.GIMR.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.RECO.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.chad
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.gimr.ghchkpt.acfs
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.helper
               OFFLINE OFFLINE      ol7decn1                 IDLE,STABLE
               OFFLINE OFFLINE      ol7decn2                 IDLE,STABLE
ora.net1.network
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.proxy_advm
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol7decn1                 169.254.26.6 192.168
                                                             .43.138,STABLE
ora.asm
      1        ONLINE  ONLINE       ol7decn1                 Started,STABLE
      2        ONLINE  ONLINE       ol7decn2                 Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol7decn1                 Open,STABLE
ora.ol7decn1.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.ol7decn2.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.qosmserver
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.rhpserver
      1        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
--------------------------------------------------------------------------------

I have changed DATA disk group compatibility to make sure that I can create a 18c database and avoid following error:

[FATAL] [DBT-05802] Creating password file on diskgroup (DATA) would fail since it requires compatible.asm of version (12.1.0.0.0) or higher. Current compatible.asm version is '11.2.0.2.0'.
ACTION: Choose a diskgroup with correct value for compatible.asm attribute.

I have run:

$ sqlplus / as sysasm

SQL*Plus: Release 18.0.0.0.0 - Production on Mon Jul 30 20:27:18 2018
Version 18.3.0.0.0

Copyright (c) 1982, 2018, Oracle.  All rights reserved.


Connected to:
Oracle Database 18c Enterprise Edition Release 18.0.0.0.0 - Production
Version 18.3.0.0.0

SYS@+ASM1>alter diskgroup DATA set attribute 'compatible.asm'='12.1.0.0';

Diskgroup altered.

RAC database creation

I have created a RAC database with following script:

/u01/db18c/bin/dbca \
 -silent \
 -nodelist ol7decn1,ol7decn2 \
 -createDatabase \
 -templateName General_Purpose.dbc   \
 -gdbName CDBRAC \
 -createAsContainerDatabase true \
 -numberOfPdbs 1 \
 -pdbName pdb \
 -pdbadminUsername pdba \
 -pdbadminPassword oracle \
 -SysPassword oracle \
 -SystemPassword oracle \
 -emConfiguration NONE \
 -storageType ASM \
 -asmSysPassword oracle \
 -diskGroupName DATA \
 -characterSet AL32UTF8 \
 -totalMemory 1024 \
 -recoveryGroupName RECO 

This script has printed following output:

WARNING] [DBT-06208] The 'SYS' password entered does not conform to the Oracle recommended standards.
   CAUSE: 
a. Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
b.The password entered is a keyword that Oracle does not recommend to be used as password
   ACTION: Specify a strong password. If required refer Oracle documentation for guidelines.
[WARNING] [DBT-06208] The 'SYSTEM' password entered does not conform to the Oracle recommended standards.
   CAUSE: 
a. Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
b.The password entered is a keyword that Oracle does not recommend to be used as password
   ACTION: Specify a strong password. If required refer Oracle documentation for guidelines.
[WARNING] [DBT-06208] The 'PDBADMIN' password entered does not conform to the Oracle recommended standards.
   CAUSE: 
a. Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
b.The password entered is a keyword that Oracle does not recommend to be used as password
   ACTION: Specify a strong password. If required refer Oracle documentation for guidelines.
Prepare for db operation
7% complete
Copying database files
27% complete
Creating and starting Oracle instance
28% complete
31% complete
35% complete
37% complete
40% complete
Creating cluster database views
41% complete
53% complete
Completing Database Creation
57% complete
59% complete
60% complete
Creating Pluggable Databases
64% complete
80% complete
Executing Post Configuration Actions
100% complete
Database creation complete. For details check the logfiles at:
 /u01/base/cfgtoollogs/dbca/CDBRAC.
Database Information:
Global Database Name:CDBRAC
System Identifier(SID) Prefix:CDBRAC
Look at the log file "/u01/base/cfgtoollogs/dbca/CDBRAC/CDBRAC.log" for further details.

I have fixed /etc/oratab on both nodes to add missing instance names.
On first node:

$ tail -n 1 /etc/oratab
CDBRAC1:/u01/db18c:N
$ 

On second node:

$ tail -n 1 /etc/oratab
CDBRAC2:/u01/db18c:N
$ 

I have connected to database instance and run some checks:

SYS@CDBRAC2>select name, cdb from v$database;

NAME	  CDB
--------- ---
CDBRAC	  YES

SYS@CDBRAC2>show pdbs

    CON_ID CON_NAME			  OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
	 2 PDB$SEED			  READ ONLY  NO
	 3 PDB				  READ WRITE NO
SYS@CDBRAC2>select comp_name, version, status from dba_registry;

COMP_NAME				 VERSION	      STATUS
---------------------------------------- -------------------- ----------
Oracle Database Catalog Views		 18.0.0.0.0	      VALID
Oracle Database Packages and Types	 18.0.0.0.0	      VALID
Oracle Real Application Clusters	 18.0.0.0.0	      VALID
JServer JAVA Virtual Machine		 18.0.0.0.0	      VALID
Oracle XDK				 18.0.0.0.0	      VALID
Oracle Database Java Packages		 18.0.0.0.0	      VALID
OLAP Analytic Workspace 		 18.0.0.0.0	      VALID
Oracle XML Database			 18.0.0.0.0	      VALID
Oracle Workspace Manager		 18.0.0.0.0	      VALID
Oracle Text				 18.0.0.0.0	      VALID
Oracle Multimedia			 18.0.0.0.0	      VALID

COMP_NAME				 VERSION	      STATUS
---------------------------------------- -------------------- ----------
Spatial 				 18.0.0.0.0	      VALID
Oracle OLAP API 			 18.0.0.0.0	      VALID
Oracle Label Security			 18.0.0.0.0	      VALID
Oracle Database Vault			 18.0.0.0.0	      VALID

15 rows selected.

SYS@CDBRAC2>select patch_id, action, description, status, action_time from dba_registry_sqlpatch;

  PATCH_ID ACTION	   DESCRIPTION							STATUS	   ACTION_TIME
---------- --------------- ------------------------------------------------------------ ---------- ------------------------------
  28090523 APPLY	   Database Release Update : 18.3.0.0.180717 (28090523) 	SUCCESS    30-JUL-18 08.55.00.839070 PM
  27923415 APPLY	   OJVM RELEASE UPDATE: 18.3.0.0.180717 (27923415)		SUCCESS    30-JUL-18 08.55.00.843547 PM

SYS@CDBRAC2>

I have checked database configuration in OCR:

$ srvctl config database -d CDBRAC
Database unique name: CDBRAC
Database name: CDBRAC
Oracle home: /u01/db18c
Oracle user: oracle
Spfile: +DATA/CDBRAC/PARAMETERFILE/spfile.272.982876093
Password file: +DATA/CDBRAC/PASSWORD/pwdcdbrac.256.982874473
Domain: 
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: 
Disk Groups: RECO,DATA
Mount point paths: 
Services: 
Type: RAC
Start concurrency: 
Stop concurrency: 
OSDBA group: dba
OSOPER group: oper
Database instances: CDBRAC1,CDBRAC2
Configured nodes: ol7decn1,ol7decn2
CSS critical: no
CPU count: 0
Memory target: 0
Maximum memory: 0
Default network number for database services: 
Database is administrator managed

I have also checked that crsctl displays now all resources including the new database:

$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.DATA.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.GIMR.GHCHKPT.advm
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.GIMR.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.RECO.dg
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.chad
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.gimr.ghchkpt.acfs
               OFFLINE OFFLINE      ol7decn1                 STABLE
               OFFLINE OFFLINE      ol7decn2                 STABLE
ora.helper
               OFFLINE OFFLINE      ol7decn1                 IDLE,STABLE
               OFFLINE OFFLINE      ol7decn2                 IDLE,STABLE
ora.net1.network
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
ora.proxy_advm
               ONLINE  ONLINE       ol7decn1                 STABLE
               ONLINE  ONLINE       ol7decn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol7decn1                 169.254.26.6 192.168
                                                             .43.138,STABLE
ora.asm
      1        ONLINE  ONLINE       ol7decn1                 Started,STABLE
      2        ONLINE  ONLINE       ol7decn2                 Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cdbrac.db
      1        ONLINE  ONLINE       ol7decn1                 Open,HOME=/u01/db18c
                                                             ,STABLE
      2        ONLINE  ONLINE       ol7decn2                 Open,HOME=/u01/db18c
                                                             ,STABLE
ora.cvu
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol7decn1                 Open,STABLE
ora.ol7decn1.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.ol7decn2.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.qosmserver
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.rhpserver
      1        OFFLINE OFFLINE                               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol7decn2                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol7decn1                 STABLE
--------------------------------------------------------------------------------
$ 

The 2-node RAC 18c cluster is now ready.

Conclusion

Comparing with a 12.2.0.1 installation, it is now possible to create directly GIMR database in a dedicated disk group.

I note new default local cluster resources and currently not really documented:

– ora.GIMR.GHCHKPT.advm

– ora.gimr.ghchkpt.acfs

– ora.proxy_advm

– ora.helper

I note also one new cluster resource: ora.rhpserver.

In general I find installations elapsted time quite slow, possibly due to many unexpected short lived depmod processes using a lot of CPU …

Categories: DBA Blogs

Performance Tuning: Tracing Over a DB Link

Tom Kyte - Mon, 2018-07-30 12:06
hi Team, currenlty in our environment i see many query execute on dblink . we face performacne problem over their , can you let us know how we can trace sqlid of those sql's which are running remotely and how to figure out their bind variables...
Categories: DBA Blogs

CLOB and BLOB datatypes !

Tom Kyte - Mon, 2018-07-30 12:06
Hi Tom, How are you ? My Question to you is as follows :- If you have a column of type CLOB or BLOB in a table Is it possible to view the contents of this column in the select statement ? Is it possible to insert data into these col...
Categories: DBA Blogs

Iterating Logic

Tom Kyte - Mon, 2018-07-30 12:06
Hi I am trying to write a SQL query that computes the values of a column(mmwl) as follows. For the DDL and DML scripts please check the livesql link <code> create table t (y date, value_pvt int, mmwl int); --sample data to generate a rec...
Categories: DBA Blogs

Hierarchical Design Patterns

Tom Kyte - Mon, 2018-07-30 12:06
There are several Database design patterns floating around for various application usages. Tree and Hierarchy Patterns are one of those. I see most of the hierarchy patterns implemented as a self referencing table. There are also other implementa...
Categories: DBA Blogs

FAQ: Webinars for “Oracle Indexing Internals and Best Practices”

Richard Foote - Mon, 2018-07-30 05:01
I’ve been somewhat inundated with questions regarding the “Oracle Indexing Internals and Best Practices” webinar series I’ll be running in October and November since I announced both webinar series last week. So I’ve compiled the following list of frequently asked questions which I’m hoping will address most of those asked. If you have any additional […]
Categories: DBA Blogs

Partner Webcast – Enforcing in-depth Data protection & privacy with Database Security ...

Databases continue to be the most attractive targets for attackers because they are the information store with all the sensitive data. Oracle Databases hold the majority of the world’s...

We share our skills to maximize your revenue!
Categories: DBA Blogs

Network Slowness Caused Database Contention That Caused Goldengate Lag

Pakistan's First Oracle Blog - Mon, 2018-07-30 00:55
I got paged for a goldengate extract lagging behind. Checked the extract configuration and it was normal extract and it seemed stuck without giving any error in the ggserr.log or anywhere else. It wasn't abended either and was in running state.


Tried stopping and restating it, but still it remained in running state while doing nothing and lag was increasing. So the issue was clearly outside of goldengate. Checked the database by starting from alert log and didn't see any errors there either.

Jumped into the database and ran some queries to see which sessions were active and what they were running. After going through various active sessions, turned out that few of them were doing long transactions over a dblink and these sessions were several hours old and seemed stuck. These sessions were also inducing widespread delay on the temp tablespace and were blocking other sessions. Due to undersized temp plus these stuck long running transactions, database performance was also slower than usual.

Ran a select statement over that dblink and it was very slow. Used tnsping to ping that database remotely and it returned with delay. Then used network commands like ping, tracert, etc to check network status and it all was pointing to delay in network.

Killed the long running transaction as it was going nowhere, and that eased the pressure on temp tablespace, which in return enabled extract to finish off the lag.
Categories: DBA Blogs

Log Buffer #546: A Carnival Of The Vanities For DBAs

Pakistan's First Oracle Blog - Mon, 2018-07-30 00:38
This Log Buffer Edition covers Cloud, Oracle, and PostgreSQL.
Cloud:
Google Maps platform now integrated with the GCP Console
Getting more value from your Stackdriver logs with structured data
Improving application availability with Alias IPs, now with hot standby
Performing a large-scale principal component analysis faster using Amazon SageMaker
Optimized TensorFlow 1.8 now available in the AWS: deep learning AMIs to accelerate training on Amazon EC2 C5 and P3 instances


Oracle:
Using GoldenGate LogDump to find bad data
Partition-Wise Operations: new features in 12c and 18c
SOA Suite 12c in Docker containers: only a couple of commands, no installers, no third party scripts
Checking if the current user is logged into Application Builder
PostgreSQL:
Let’s start out with some fun! I really enjoyed Wendy Kuhn‘s article on May 5 about the history of PostgreSQL. She starts out by relaying the importance of learning the history behind new technical tools & concepts when you’re learning. I couldn’t agree more.
Speaking of history, I’ve been waiting for the right time to mention this fun article from August 2016. Now is the time, because it relates to the previous article and because I saw a few retweets last week mentioning it. Did you ever wonder why the PostgreSQL logo is an elephant? Or what his name is?? Or even better – did turtles or cheetahs ever represent PostgreSQL???? Patrycja Dybka answers these questions and more. Check it out!
Ok, moving on to the serious stuff. :) First off, we’ve got a new round of minor releases of PostgreSQL. Version 10.4, 9.6.9, etc, were released on May 10. Time to start planning those upgrade cycles!
Next up, JD posted a nice summary of PGConf US in New Jersey on May 7. I saw a lot of familiar faces in his pictures! One quick call-out: I heard good things about the speed mentoring at the career fair. I think that was a great idea. (Among many at PGConf.)
Another interesting thing JD touched on in his blog post was the growing role of larger companies in the community. He gave a few specific examples related to Google and Microsoft. Back on April 17, Pivotalpublished an article listing a number of specific ways they contribute to PostgreSQL development, as well.
Speaking of cloud companies, who doesn’t like a nice rowdy comparison? Over on the SeveralNines blog, we got exactly that on May 1: a quick side-by-side comparison of a few of the many cloud providers who ship PostgreSQL. There are a bunch more – feel free to leave comments on their blog post with the providers they left out!
As long as we’re doing comparisons, I saw this old website on Twitter last week, and it’s fun enough to pass along. Thomas Kellerer from Germany wrote a nice open-source tool called SQL Workbench/J. In the process of supporting many different databases, he’s learned a lot about the differences between them. And his website has a really detailed list. Check out this list of SQL features by database – PostgreSQL is looking good!
I always enjoy a good story. Singapore-based Ashnik recently published a new case study about a global insurance company who deployed a bank data exchange system on PostgreSQL: a fine example of the serious business that runs on PostgreSQL every day.
Moving into the technology space, infrastructure company Datrium has recently published a series of interesting articles about the benchmarking and heavyweight workloads they’re throwing at PostgreSQL. The most recent article on April 25 discusses PostgreSQL on bare metal and it has links to many previous articles.
In the category of query tuning, how would you like to make a small tweak to your schema and SQL, then experience a 290x speedup? That’s exactly what happened to Yulia Oletskaya! She writes about it in this article on May 7.
“What’s common between DBA and detective? They both solve murder and mystery while trying to make sense of the nonsense.” That’s the first sentence of Alexey Lesovsky’s April 17 article about troubleshooting a PostgreSQL crash.
Going a little deeper, I have a handful of recent articles about specific database features in PostgreSQL.
First, how about a demonstration of PostgreSQL’s top-notch built-in support for full-text search? What better example than analyzing the public email of PostgreSQL contributor Tom Lane to find what his waking hours are? Turns out that he’s very consistent. In fact, it turns out you can use Tom Lane’s consistent email habits to spot server timezone misconfigurations.
Citus also published a nice article back at the beginning of April about row-level security. I didn’t include it last month but it’s worth mentioning now. PostgreSQL’s capabilities here are quite nice.
My past newsletters have been following Dimitri Fontaine’s series on PostgreSQL data types. We’ve got three new ones this time around: JSONEnum and Point types.
A big selling point for PostgreSQL is its extensibility. On May 8, Luca Ferrari from Italy published an article in BSD magazine which walked through the process of building a customer extension to provide a new foreign data wrapper that connects the database directly to a file system data source.
Our friends at Timescale put out an article about streaming replication on May 3. Lee Hampton gives one of the best descriptions of this critical HA concept that I’ve seen anywhere.
Finally, can a week go by without new articles about vacuum in PostgreSQL? It seems not!
On Apr 30, Jorge Torralba published an article on DZone about tuning autovacuum. He has a specific focus on bloat, which is an important reason for vacuuming. There are some nice examples here.
And back on April 3, Emily Chang from Datadog published perhaps one of the most detailed articles about vacuum that I’ve seen. Well worth reviewing.
To close up this edition: something a little different. This year marks the 15th anniversary of pgpool. And Tatsuo Ishii reminded us with a blog post on April 15.
So in honor of the 15th aniversary, let’s collect a few recent links *just* about pgpool!
Tatsuo also published two other articles in April about various features of pgpool:
And Vladimir Svedov at severalnines published a two-part series on pgpool in April as well.
And that’s a wrap for this week. Likely more content than you’ll have time for, as usual! My job here is done. :)

Originally posted at https://blog.pythian.com/log-buffer-546-carnival-vanities-dbas/
Categories: DBA Blogs

How to install Oracle RAC 18c in silent mode on Oracle Linux 7.5 with VirtualBox – Part 1

Pierre Forstmann Oracle Database blog - Sun, 2018-07-29 14:04

Both posts document how to install a 2-node Oracle RAC cluster with Oracle 18c on Oracle Linux 7.5 (OL7) with VirtualBox.

Part 1 details Linux installation and configuration and part 2 details Oracle software installation (Grid Infrastructure + Oracle Database) and database creation.

Disclaimer: this is only an example that can be used to setup a lab or test system: it is not designed to be used for production purpose.

Overview

Each RAC node must:

  • have access to shared storage to be used by the RAC database because a RAC database is a shared everything database.
  • have network connectivity with a dedicated private network (also named RAC interconnect) to other cluster nodes.
  • The cluster should have also 3 differents virtual IP adresses (VIP) to be used only by the SCAN listener: this single name should be resolved by 3 differents adresses.

    The following table gives the SCAN network configuration used for this installation:

    SCAN VIP 1 VIP 2 VIP 3 ol7dec-scan 192.168.56.148 192.168.56.149 192.168.56.150

    A 2-node Oracle RAC cluster needs actually 3 machines (if you dedicate DNS server to a different virtual machine (VM)):

  • 2 cluster nodes that are hosting the 2 database instances of the single RAC database
  • another machine to host a Domain Name System (DNS) for the SCAN listener VIPs.
  • One of the very first thing to do is to choose hostnames and network IP addresses.

    The following table gives the cluster network configuration needed for this Oracle installation:

    ol7dns03: DNS server ol7decn1: RAC node 1 ol7decn2: RAC node 2 network interface NAT 10.0.2.15 10.0.2.15 10.0.2.15 enp0s3 Public IP 192.168.56.143 192.168.56.138 192.168.56.139 enp0s8 Private IP N/A 192.168.43.138 192.168.43.139 enp0s9 Virtual IP (VIP) N/A 192.168.56.246 192.168.56.247 assigned by OUI

    Note that Oracle Universal Installer (OUI) will assign network interface for cluster node virtual IP address (VIP) during Grid Infrastructure installation.

    The NAT interface is only needed to be able to connect to Oracle YUM servers to download RPM packages: strictly speaking it is not direclty required by Oracle software installation (Grid Infrastructure or Oracle Database).

    The main steps of this system/network/storage installation and configuration part are the following:

    1. configure DNS server machine

    2. configure first cluster node with shared storage

    3. clone first cluster node to second cluster node

    4. install Oracle 18c preinstallation RPM on both nodes and configure passwordless ssh

    5. run Cluster Verification Utility (CLUVFY) to make sure both cluster nodes are ready for Oracle sofware installation.

    All commands with ‘#” prompt must be entered with root user account while all command with ‘$’ prompt must be entered with oracle user account.

    DNS machine configuration

    I have created first VBOX VM with following configuration(this VM is running Oracle Linux 7 (OL7)):
    RAM: 1 GB

  • one 12 GB hardisk attached to SATA controller
  • 2 network interfaces (the first one attached to NAT and the second one attached to Host-Only Adapter)
  • When installing Oracle Linux 7 I have chosen in following order:

    1. the right timezone for my country (Paris, France)

    2. the right keyboard for my host system (French)

    3. Infrastructure Server for “Base Environment” and DNS Name Server for “Add-Ons For Selected Environment”

    4. Automatic configure partitioning in Installation Destination

    5. to set only hostname to ol7dns03.localdomain (no network configuration)

    6. to set root password.

    After OL7 installation and VM reboot, I have used system console to configure public network interface:

    # nmcli connection add type ethernet con-name enp0s8 ifname enp0s8 ip4 192.168.56.143/24
    

    Now I can connect to ol7dns02 using SSH and check network configuration:

    # ip addr
    1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group default 
        link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        inet 127.0.0.1/8 scope host lo
           valid_lft forever preferred_lft forever
        inet6 ::1/128 scope host 
           valid_lft forever preferred_lft forever
    2: enp0s3:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:d6:99:79 brd ff:ff:ff:ff:ff:ff
    3: enp0s8:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:8e:18:3a brd ff:ff:ff:ff:ff:ff
        inet 192.168.56.143/24 brd 192.168.56.255 scope global noprefixroute enp0s8
           valid_lft forever preferred_lft forever
        inet6 fe80::17e4:6618:27f8:9a76/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    # 
    

    I have configured NAT network interface with (10.0.2.15 is the related IP address and 10.0.2.2 the related gateway IP address):

    # nmcli connection add type ethernet con-name enp0s3 ifname enp0s3 ip4 10.0.2.15/8 gw4 10.0.2.2
    Connection 'enp0s3' (6818d165-506a-40d6-95c3-e2077a79f974) successfully added.
    

    I have added my internet box IP address to /etc/resolv.conf:

    # cat /etc/resolv.conf 
    nameserver 192.168.1.254
    

    I have checked that I have internet access from ol7dns03:

    # ping -c 1 www.oracle.com
    PING e870.dscx.akamaiedge.net (104.93.247.134) 56(84) bytes of data.
    64 bytes from a104-93-247-134.deploy.static.akamaitechnologies.com (104.93.247.134): icmp_seq=1 ttl=63 time=33.1 ms
    
    --- e870.dscx.akamaiedge.net ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 33.104/33.104/33.104/0.000 ms
    

    This OL7 installation is using about 1.3 GB of disk space:

    # df -h
    Filesystem           Size  Used Avail Use% Mounted on
    devtmpfs             476M     0  476M   0% /dev
    tmpfs                496M     0  496M   0% /dev/shm
    tmpfs                496M  6.8M  489M   2% /run
    tmpfs                496M     0  496M   0% /sys/fs/cgroup
    /dev/mapper/ol-root  9.8G  1.4G  8.5G  14% /
    /dev/sda1           1014M  169M  846M  17% /boot
    tmpfs                100M     0  100M   0% /run/user/0
    
    DNS configuration

    DNS server is not configured by default:

    # systemctl status named
    ● named.service - Berkeley Internet Name Domain (DNS)
       Loaded: loaded (/usr/lib/systemd/system/named.service; disabled; vendor preset: disabled)
       Active: inactive (dead
    

    Here is my /etc/named.conf:

    # cat named.conf
    //
    // named.conf
    //
    // Provided by Red Hat bind package to configure the ISC BIND named(8) DNS
    // server as a caching only nameserver (as a localhost DNS resolver only).
    //
    // See /usr/share/doc/bind*/sample/ for example named configuration files.
    //
    // See the BIND Administrator's Reference Manual (ARM) for details about the
    // configuration located in /usr/share/doc/bind-{version}/Bv9ARM.html
    
    options {
    	listen-on port 53 { 127.0.0.1;192.168.56.143; };
    	listen-on-v6 port 53 { ::1; };
    	directory 	"/var/named";
    	dump-file 	"/var/named/data/cache_dump.db";
    	statistics-file "/var/named/data/named_stats.txt";
    	memstatistics-file "/var/named/data/named_mem_stats.txt";
    	allow-query     { localhost; };
    
    	/* 
    	 - If you are building an AUTHORITATIVE DNS server, do NOT enable recursion.
    	 - If you are building a RECURSIVE (caching) DNS server, you need to enable 
    	   recursion. 
    	 - If your recursive DNS server has a public IP address, you MUST enable access 
    	   control to limit queries to your legitimate users. Failing to do so will
    	   cause your server to become part of large scale DNS amplification 
    	   attacks. Implementing BCP38 within your network would greatly
    	   reduce such attack surface 
    	*/
    	recursion yes;
    
    	dnssec-enable yes;
    	dnssec-validation yes;
    
    	/* Path to ISC DLV key */
    	bindkeys-file "/etc/named.iscdlv.key";
    
    	managed-keys-directory "/var/named/dynamic";
    
    	pid-file "/run/named/named.pid";
    	session-keyfile "/run/named/session.key";
    };
    
    logging {
            channel default_debug {
                    file "data/named.run";
                    severity dynamic;
            };
    };
    
    zone "localdomain." IN {
            type master;
            file "localdomain.zone";
            allow-update { none; };
            allow-query { any; };
    };
    
    zone "56.168.192.in-addr.arpa." IN {
            type master;
            file "56.168.192.in-addr.arpa";
            allow-update { none; };
    };
    
    zone "." IN {
    	type hint;
    	file "named.ca";
    };
    
    include "/etc/named.rfc1912.zones";
    include "/etc/named.root.key";
    
    

    Note that I have added the following sections to default /etc/named.conf for localdomain.com:

    zone "localdomain." IN {
            type master;
            file "localdomain.zone";
            allow-update { none; };
            allow-query { any; };
    };
    
    
    zone "56.168.192.in-addr.arpa." IN {
            type master;
            file "56.168.192.in-addr.arpa";
            allow-update { none; };
    };
    

    and I have added VM IP 192.168.56.143 address to:

    listen-on port 53 { 127.0.0.1;192.168.56.143; };
    

    I have created the file /var/named/localdomain.zone which contains:

  • the 3 IP adresses for the SCAN listener (rh7ttc-scan)
  • each cluster node public IP address (ol7decn1 and ol7decn2)
  • 
    # cat localdomain.zone 
    $TTL    86400
    @               IN SOA  localhost root.localhost (
                                            42              ; serial (d. adams)
                                            3H              ; refresh
                                            15M             ; retry
                                            1W              ; expiry
                                            1D )            ; minimum
                    IN NS           localhost
    localhost       IN A            127.0.0.1
    ol7dec-scan     IN A    192.168.56.148 
    ol7dec-scan     IN A    192.168.56.149
    ol7dec-scan     IN A    192.168.56.150
    ol7decn1        IN A    192.168.56.138
    ol7decn2        IN A    192.168.56.139
    #
    

    I have also created /var/named/56.168.192.in-addr.arpa:

    # cat 56.168.192.in-addr.arpa
    $ORIGIN 56.168.192.in-addr.arpa.
    $TTL 1H
    @       IN      SOA     d12.localdomain.     d12.localdomain. (      2
                                                    3H
                                                    1H
                                                    1W
                                                    1H )
    56.168.192.in-addr.arpa.         IN NS      d12.localdomain.
    
    148    IN PTR  ol7dec-scan.localdomain.
    149    IN PTR  ol7dec-scan.localdomain.
    150    IN PTR  ol7dec-scan.localdomain.
    138    IN PTR  ol7decn1.localdomain.
    139    IN PTR  ol7decn2.localdomain.
    

    I have started named service with:

    # systemctl status named
    ● named.service - Berkeley Internet Name Domain (DNS)
       Loaded: loaded (/usr/lib/systemd/system/named.service; disabled; vendor preset: disabled)
       Active: active (running) since Sat 2018-07-14 18:44:36 CEST; 6s ago
      Process: 29241 ExecStart=/usr/sbin/named -u named -c ${NAMEDCONF} $OPTIONS (code=exited, status=0/SUCCESS)
      Process: 29238 ExecStartPre=/bin/bash -c if [ ! "$DISABLE_ZONE_CHECKING" == "yes" ]; then /usr/sbin/named-checkconf -z "$NAMEDCONF"; else echo "Checking of zone files is disabled"; fi (code=exited, status=0/SUCCESS)
     Main PID: 29244 (named)
       CGroup: /system.slice/named.service
               └─29244 /usr/sbin/named -u named -c /etc/named.conf
    
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: zone 1.0.0.127.in-addr.arpa/IN: loaded serial 0
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: zone 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.ip6.arpa/IN: loaded serial 0
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: zone 56.168.192.in-addr.arpa/IN: loaded serial 2
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: zone localhost/IN: loaded serial 0
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: zone localdomain/IN: loaded serial 42
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: all zones loaded
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: running
    Jul 14 18:44:36 ol7dns03.localdomain systemd[1]: Started Berkeley Internet Name Domain (DNS).
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: error (network unreachable) resolving './DNSKEY/IN': 2001:503:ba3e::2:30#53
    Jul 14 18:44:36 ol7dns03.localdomain named[29244]: error (network unreachable) resolving './NS/IN': 2001:503:ba3e::2:30#53
    

    I have tested that DNS is working locally after modifying /etc/resolv.conf:

    # cat /etc/resolv.conf
    search localdomain
    nameserver 192.168.56.143
    nameserver 192.168.1.254
    
    # nslookup ol7dec-scan
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.148
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.150
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.149
    
    # nslookup ol7decn1   
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7decn1.localdomain
    Address: 192.168.56.138
    
    # nslookup ol7decn2
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7decn2.localdomain
    Address: 192.168.56.139
    
    #
    

    I have enabled automatic named service start by Linux boot with:

    # systemctl is-enabled named
    disabled
    # systemctl enable named
    Created symlink from /etc/systemd/system/multi-user.target.wants/named.service to /usr/lib/systemd/system/named.service.
    # 
    

    And I have tested that after VM reboot …

    # systemctl reboot
    

    … named service has been automatically restarted:

    # systemctl  status named
    ● named.service - Berkeley Internet Name Domain (DNS)
       Loaded: loaded (/usr/lib/systemd/system/named.service; enabled; vendor preset: disabled)
       Active: active (running) since Sat 2018-07-14 18:47:48 CEST; 14s ago
      Process: 1125 ExecStart=/usr/sbin/named -u named -c ${NAMEDCONF} $OPTIONS (code=exited, status=0/SUCCESS)
      Process: 1093 ExecStartPre=/bin/bash -c if [ ! "$DISABLE_ZONE_CHECKING" == "yes" ]; then /usr/sbin/named-checkconf -z "$NAMEDCONF"; else echo "Checking of zone files is disabled"; fi (code=exited, status=0/SUCCESS)
     Main PID: 1141 (named)
       CGroup: /system.slice/named.service
               └─1141 /usr/sbin/named -u named -c /etc/named.conf
    
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone 0.in-addr.arpa/IN: loaded serial 0
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone 1.0.0.127.in-addr.arpa/IN: loaded serial 0
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone 56.168.192.in-addr.arpa/IN: loaded serial 2
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone localhost/IN: loaded serial 0
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone 1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.ip6.arpa/IN: loaded serial 0
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone localhost.localdomain/IN: loaded serial 0
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: zone localdomain/IN: loaded serial 42
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: all zones loaded
    Jul 14 18:47:48 ol7dns03.localdomain systemd[1]: Started Berkeley Internet Name Domain (DNS).
    Jul 14 18:47:48 ol7dns03.localdomain named[1141]: running
    # nslookup ol7dec-scan
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.150
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.149
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.148
    
    

    I have also disabled some firewall settings for ol7dns03 so that cluster nodes will be able to query DNS:

    # firewall-cmd --zone=public --add-port=53/tcp --add-port=53/udp
    success
    # firewall-cmd --permanent --zone=public --add-port=53/tcp --add-port=53/udp
    success
    # 
    
    Oracle RAC cluster node configuration

    I have created first cluster node VM with following configuration:

  • RAM: 8 GB
  • one 40 GB hardisk attached to SATA controller
  • 3 network interfaces (the first one attached to NAT and the second and third one attached to Host-Only Adapter)
  • When installing OL7 I have chosen in the following order:

    1. English as installation language

    2. the right timezone for my country (Paris, France)

    3. the right keyboard for my host system (French)

    4. manual partitioning only to set / file system size to 30 GB and swap space size to 8 GB

    6. to only set hostname to ol7decn1.localdomain (no network configuration)

    7. to set root password.

    I have left Software Selection to default value “minimal installation”.

    After OL7 installation and VM reboot, I have used system console to configure public network interface:

    #  nmcli connection add type ethernet con-name enp0s8 ifname enp0s8 ip4 192.168.56.138/24
    

    Now I connect with ssh to ol7decn1 and check network confoguration:

    # ip addr
    1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group default 
        link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        inet 127.0.0.1/8 scope host lo
           valid_lft forever preferred_lft forever
        inet6 ::1/128 scope host 
           valid_lft forever preferred_lft forever
    2: enp0s3:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:31:3d:db brd ff:ff:ff:ff:ff:ff
    3: enp0s8:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:34:9d:cb brd ff:ff:ff:ff:ff:ff
        inet 192.168.56.138/24 brd 192.168.56.255 scope global noprefixroute enp0s8
           valid_lft forever preferred_lft forever
        inet6 fe80::ff11:58c8:a1ae:b6e0/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    4: enp0s9:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:4a:e5:1a brd ff:ff:ff:ff:ff:ff
    

    I have configured NAT network interface with 10.0.2.15 as IP address and 10.0.2.2 as related gateway IP address:

    # nmcli connection add type ethernet con-name enp0s3 ifname enp0s3 ip4 10.0.2.15/8 gw4 10.0.2.2
    Connection 'enp0s3' (1971852d-ee58-48c1-a247-518d2dbf75aa) successfully added.
    

    I have also configured third network interface for the RAC interconnect:

    #  nmcli connection add type ethernet con-name enp0s9 ifname enp0s9 ip4 192.168.43.138/24
    Warning: There is another connection with the name 'enp0s9'. Reference the connection by its uuid 'ed848ab9-5f78-4c0f-a629-2aaac20287c2'
    Connection 'enp0s9' (ed848ab9-5f78-4c0f-a629-2aaac20287c2) successfully added.
    

    I have checked with ip command the current network configuration:

    # ip addr
    1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group default 
        link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        inet 127.0.0.1/8 scope host lo
           valid_lft forever preferred_lft forever
        inet6 ::1/128 scope host 
           valid_lft forever preferred_lft forever
    2: enp0s3:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:31:3d:db brd ff:ff:ff:ff:ff:ff
        inet 10.0.2.15/8 brd 10.255.255.255 scope global noprefixroute enp0s3
           valid_lft forever preferred_lft forever
        inet6 fe80::29ab:3073:bbe8:acd/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    3: enp0s8:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:34:9d:cb brd ff:ff:ff:ff:ff:ff
        inet 192.168.56.138/24 brd 192.168.56.255 scope global noprefixroute enp0s8
           valid_lft forever preferred_lft forever
        inet6 fe80::ff11:58c8:a1ae:b6e0/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    4: enp0s9:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:4a:e5:1a brd ff:ff:ff:ff:ff:ff
        inet 192.168.43.138/24 brd 192.168.43.255 scope global noprefixroute enp0s9
           valid_lft forever preferred_lft forever
        inet6 fe80::905d:a529:4f0b:78ef/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    #
    

    I have modified /etc/resolv.conf for DNS server and internet access:

    nameserver 192.168.56.143
    search localdomain
    nameserver 192.168.1.254
    

    I have checked internet access:

    # ping -c 1 www.oracle.com
    PING e870.dscx.akamaiedge.net (104.85.40.158) 56(84) bytes of data.
    64 bytes from a104-85-40-158.deploy.static.akamaitechnologies.com (104.85.40.158): icmp_seq=1 ttl=63 time=33.2 ms
    
    --- e870.dscx.akamaiedge.net ping statistics ---
    1 packets transmitted, 1 received, 0% packet loss, time 0ms
    rtt min/avg/max/mdev = 33.222/33.222/33.222/0.000 ms
    

    I have installed bind-utils package for nslookup:

    # yum install bind-utils
    Failed to set locale, defaulting to C
    Loaded plugins: ulninfo
    ol7_UEKR4                                                | 1.2 kB     00:00     
    ol7_latest                                               | 1.4 kB     00:00     
    (1/5): ol7_UEKR4/x86_64/updateinfo                         | 196 kB   00:01     
    (2/5): ol7_latest/x86_64/updateinfo                        | 518 kB   00:01     
    (3/5): ol7_latest/x86_64/group                             | 659 kB   00:02     
    (4/5): ol7_latest/x86_64/primary                           | 5.8 MB   00:07     
    (5/5): ol7_UEKR4/x86_64/primary                            |  39 MB   00:32     
    ol7_UEKR4                                                               711/711
    ol7_latest                                                            8151/8151
    Resolving Dependencies
    --> Running transaction check
    ---> Package bind-utils.x86_64 32:9.9.4-61.el7 will be installed
    --> Processing Dependency: bind-libs = 32:9.9.4-61.el7 for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Processing Dependency: libisccc.so.90()(64bit) for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Processing Dependency: liblwres.so.90()(64bit) for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Processing Dependency: libbind9.so.90()(64bit) for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Processing Dependency: libisc.so.95()(64bit) for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Processing Dependency: libdns.so.100()(64bit) for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Processing Dependency: libisccfg.so.90()(64bit) for package: 32:bind-utils-9.9.4-61.el7.x86_64
    --> Running transaction check
    ---> Package bind-libs.x86_64 32:9.9.4-61.el7 will be installed
    --> Finished Dependency Resolution
    
    Dependencies Resolved
    
    ================================================================================
     Package           Arch          Version                Repository         Size
    ================================================================================
    Installing:
     bind-utils        x86_64        32:9.9.4-61.el7        ol7_latest        204 k
    Installing for dependencies:
     bind-libs         x86_64        32:9.9.4-61.el7        ol7_latest        1.0 M
    
    Transaction Summary
    ================================================================================
    Install  1 Package (+1 Dependent package)
    
    Total download size: 1.2 M
    Installed size: 3.0 M
    Is this ok [y/d/N]: y
    Downloading packages:
    warning: /var/cache/yum/x86_64/7Server/ol7_latest/packages/bind-utils-9.9.4-61.el7.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
    Public key for bind-utils-9.9.4-61.el7.x86_64.rpm is not installed
    (1/2): bind-utils-9.9.4-61.el7.x86_64.rpm                  | 204 kB   00:00     
    (2/2): bind-libs-9.9.4-61.el7.x86_64.rpm                   | 1.0 MB   00:01     
    --------------------------------------------------------------------------------
    Total                                              847 kB/s | 1.2 MB  00:01     
    Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
    Importing GPG key 0xEC551F03:
     Userid     : "Oracle OSS group (Open Source Software group) "
     Fingerprint: 4214 4123 fecf c55b 9086 313d 72f9 7b74 ec55 1f03
     Package    : 7:oraclelinux-release-7.5-1.0.3.el7.x86_64 (@anaconda/7.5)
     From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
    Is this ok [y/N]: y
    Running transaction check
    Running transaction test
    Transaction test succeeded
    Running transaction
      Installing : 32:bind-libs-9.9.4-61.el7.x86_64                             1/2 
      Installing : 32:bind-utils-9.9.4-61.el7.x86_64                            2/2 
      Verifying  : 32:bind-utils-9.9.4-61.el7.x86_64                            1/2 
      Verifying  : 32:bind-libs-9.9.4-61.el7.x86_64                             2/2 
    
    Installed:
      bind-utils.x86_64 32:9.9.4-61.el7                                             
    
    Dependency Installed:
      bind-libs.x86_64 32:9.9.4-61.el7                                              
    
    Complete!
    

    I have modified /etc/resolv.conf:

    # cat /etc/resolv.conf
    nameserver 192.168.56.143
    search localdomain
    nameserver 192.168.1.254
    

    I have checked DNS:

    # nslookup ol7dec-scan
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.148
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.149
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.150
    
    # 
    
    # nslookup ol7decn1
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7decn1.localdomain
    Address: 192.168.56.138
    
    # nslookup ol7decn2
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7decn2.localdomain
    Address: 192.168.56.139
    
    # ip route
    default via 10.0.2.2 dev enp0s3 proto static metric 101 
    10.0.0.0/8 dev enp0s3 proto kernel scope link src 10.0.2.15 metric 101 
    192.168.43.0/24 dev enp0s9 proto kernel scope link src 192.168.43.138 metric 102 
    192.168.56.0/24 dev enp0s8 proto kernel scope link src 192.168.56.138 metric 100 
    # 
    

    I have updated /etc/hosts with both cluster nodes IP addresses:

    127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
    ::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
    #
    # Public
    192.168.56.138 ol7decn1 ol7decn1.localdomain
    192.168.56.139 ol7decn2 ol7decn2.localdomain
    # Private
    192.168.43.138 ol7decn1-priv ol7decn1-priv.localdomain
    192.168.43.139 ol7decn2-priv ol7decn2-priv.localdomain
    # VIP
    192.168.56.246 ol7decn1-vip ol7decn1-vip.localdomain^M
    192.168.56.247 ol7decn2-vip ol7decn2-vip.localdomain^M
    #
    192.168.56.148 ol7de-scan.localdomain
    192.168.56.149 ol7de-scan.localdomain
    192.168.56.150 ol7de-scan.localdomain
    #
    
    Shared storage configuration

    I have decided to use ASM Filter Driver (ASMFD) to manage ASM disk devices.

    Even if I currently have only one cluster node I can start to configure shared storage because configuration will be kept by cloning first cluster node VM to second cluster node VM.

    On my host system, I have created 4 virtual disks for 4 ASM disk groups:

  • one for OCR and voting disk (2 GB)
  • one for the Grid Infrastructure Management Repository (GIMR) database mandatory (40 GB)
  • one for databases files (40 GB)
  • one for the fast recovery area (FRA – 20 GB)
  • $ vboxmanage createhd --filename /mnt/wdz/vm/ol7decn1.ol7decn2.sata.1.vdi --size=2048 -format=VDI --variant=fixed
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    Medium created. UUID: 8cbfb2a8-e92d-4dc0-bb42-e7984a365160
    $ vboxmanage createhd --filename /mnt/wdz/vm/ol7decn1.ol7decn2.sata.2.vdi --size=40960 -format=VDI --variant=fixed
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    Medium created. UUID: c11b8d7f-d5a3-4089-9014-bec5c14a6145
    $ vboxmanage createhd --filename /mnt/wdz/vm/ol7decn1.ol7decn2.sata.3.vdi --size=40960 -format=VDI --variant=fixed
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    Medium created. UUID: 55e9d135-466e-4422-b4d1-c0399ebf79db
    $ vboxmanage createhd --filename /mnt/wdz/vm/ol7decn1.ol7decn2.sata.4.vdi --size=20480 -format=VDI --variant=fixed
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    Medium created. UUID: 3f119c92-6095-43f0-9a18-d288f428f907
    

    I have shutdown ol7decn1 VM and run following commands to attach the virtual disks and make them shareable:

    $ vboxmanage controlvm ol7decn1 poweroff
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    $ vboxmanage storageattach ol7decn1 --storagectl "SATA" --port 1 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.1.vdi
    $ vboxmanage storageattach ol7decn1 --storagectl "SATA" --port 2 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.2.vdi
    $ vboxmanage storageattach ol7decn1 --storagectl "SATA" --port 3 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.3.vdi
    $ vboxmanage storageattach ol7decn1 --storagectl "SATA" --port 4 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.4.vdi
    
    $ vboxmanage modifyhd /mnt/wdz/vm/ol7decn1.ol7decn2.sata.1.vdi -type shareable
    $ vboxmanage modifyhd /mnt/wdz/vm/ol7decn1.ol7decn2.sata.2.vdi -type shareable
    $ vboxmanage modifyhd /mnt/wdz/vm/ol7decn1.ol7decn2.sata.3.vdi -type shareable
    $ vboxmanage modifyhd /mnt/wdz/vm/ol7decn1.ol7decn2.sata.4.vdi -type shareable
     
    

    I have restarted ol7decn1 VM …

    $ vboxmanage startvm ol7decn1 
    Waiting for VM "ol7decn1" to power on...
    VM "ol7decn1" has been successfully started.
    

    … and created a single partition on each disk:

    # fdisk /dev/sdb
    Welcome to fdisk (util-linux 2.23.2).
    
    Changes will remain in memory only, until you decide to write them.
    Be careful before using the write command.
    
    Device does not contain a recognized partition table
    Building a new DOS disklabel with disk identifier 0xe9ec650a.
    
    Command (m for help): n
    Partition type:
       p   primary (0 primary, 0 extended, 4 free)
       e   extended
    Select (default p): 
    Using default response p
    Partition number (1-4, default 1): 
    First sector (2048-4194303, default 2048): 
    Using default value 2048
    Last sector, +sectors or +size{K,M,G} (2048-4194303, default 4194303): 
    Using default value 4194303
    Partition 1 of type Linux and of size 2 GiB is set
    
    Command (m for help): w
    The partition table has been altered!
    
    Calling ioctl() to re-read partition table.
    Syncing disks.
    # fdisk /dev/sdc
    Welcome to fdisk (util-linux 2.23.2).
    
    Changes will remain in memory only, until you decide to write them.
    Be careful before using the write command.
    
    Device does not contain a recognized partition table
    Building a new DOS disklabel with disk identifier 0xa47c41e8.
    
    Command (m for help): n
    Partition type:
       p   primary (0 primary, 0 extended, 4 free)
       e   extended
    Select (default p): 
    Using default response p
    Partition number (1-4, default 1): 
    First sector (2048-83886079, default 2048): 
    Using default value 2048
    Last sector, +sectors or +size{K,M,G} (2048-83886079, default 83886079): 
    Using default value 83886079
    Partition 1 of type Linux and of size 40 GiB is set
    
    Command (m for help): w
    The partition table has been altered!
    
    Calling ioctl() to re-read partition table.
    Syncing disks.
    # fdisk /dev/sdd
    Welcome to fdisk (util-linux 2.23.2).
    
    Changes will remain in memory only, until you decide to write them.
    Be careful before using the write command.
    
    Device does not contain a recognized partition table
    Building a new DOS disklabel with disk identifier 0x40f31e60.
    
    Command (m for help): n
    Partition type:
       p   primary (0 primary, 0 extended, 4 free)
       e   extended
    Select (default p): 
    Using default response p
    Partition number (1-4, default 1): 
    First sector (2048-83886079, default 2048): 
    Using default value 2048
    Last sector, +sectors or +size{K,M,G} (2048-83886079, default 83886079): 
    Using default value 83886079
    Partition 1 of type Linux and of size 40 GiB is set
    
    Command (m for help): w
    The partition table has been altered!
    
    Calling ioctl() to re-read partition table.
    Syncing disks.
    # fdisk /dev/sde
    Welcome to fdisk (util-linux 2.23.2).
    
    Changes will remain in memory only, until you decide to write them.
    Be careful before using the write command.
    
    Device does not contain a recognized partition table
    Building a new DOS disklabel with disk identifier 0x44bce253.
    
    Command (m for help): n
    Partition type:
       p   primary (0 primary, 0 extended, 4 free)
       e   extended
    Select (default p):  
    Using default response p
    Partition number (1-4, default 1): 
    First sector (2048-41943039, default 2048): 
    Using default value 2048
    Last sector, +sectors or +size{K,M,G} (2048-41943039, default 41943039): 
    Using default value 41943039
    Partition 1 of type Linux and of size 20 GiB is set
    
    Command (m for help): w
    The partition table has been altered!
    
    Calling ioctl() to re-read partition table.
    Syncing disks.
    
    # lsblk
    NAME                 MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
    sda                    8:0    0   40G  0 disk 
    |-sda1                 8:1    0    1G  0 part /boot
    `-sda2                 8:2    0   38G  0 part 
      |-ol_ol7decn1-root 249:0    0   30G  0 lvm  /
      `-ol_ol7decn1-swap 249:1    0    8G  0 lvm  [SWAP]
    sdb                    8:16   0    2G  0 disk 
    `-sdb1                 8:17   0    2G  0 part 
    sdc                    8:32   0   40G  0 disk 
    `-sdc1                 8:33   0   40G  0 part 
    sdd                    8:48   0   40G  0 disk 
    `-sdd1                 8:49   0   40G  0 part 
    sde                    8:64   0   20G  0 disk 
    `-sde1                 8:65   0   20G  0 part 
    sr0                   11:0    1 1024M  0 rom  
    

    I have retrieved SCSI unique identifiers for the 4 disks:

    # /lib/udev/scsi_id -g -u -d /dev/sdb
    1ATA_VBOX_HARDDISK_VB8cbfb2a8-6051364a
    # /lib/udev/scsi_id -g -u -d /dev/sdc
    1ATA_VBOX_HARDDISK_VBc11b8d7f-45614ac1
    # /lib/udev/scsi_id -g -u -d /dev/sdd
    1ATA_VBOX_HARDDISK_VB55e9d135-db79bf9e
    # /lib/udev/scsi_id -g -u -d /dev/sde
    1ATA_VBOX_HARDDISK_VB3f119c92-07f928f4
    # 
    

    I have created UDEV script /etc/udev/rules.d/99-oracle-asmdevices.rules (because ASMFD will be used udev does not create new device names: this will be managed by ASMFD):

    # cat /etc/udev/rules.d/99-oracle-asmdevices.rules
    KERNEL=="sd?1", OWNER="oracle", GROUP="dba", MODE="0660", PROGRAM="/lib/udev/scsi_id -g -u /dev/$parent", RESULT=="1ATA_VBOX_HARDDISK_VB8cbfb2a8-6051364a"
    KERNEL=="sd?1", OWNER="oracle", GROUP="dba", MODE="0660", PROGRAM="/lib/udev/scsi_id -g -u /dev/$parent", RESULT=="1ATA_VBOX_HARDDISK_VBc11b8d7f-45614ac1"
    KERNEL=="sd?1", OWNER="oracle", GROUP="dba", MODE="0660", PROGRAM="/lib/udev/scsi_id -g -u /dev/$parent", RESULT=="1ATA_VBOX_HARDDISK_VB55e9d135-db79bf9e"
    KERNEL=="sd?1", OWNER="oracle", GROUP="dba", MODE="0660", PROGRAM="/lib/udev/scsi_id -g -u /dev/$parent", RESULT=="1ATA_VBOX_HARDDISK_VB3f119c92-07f928f4"
    

    I have rebooted …:

    # systemctl reboot
    

    … and checked disk device names:

    # ls -al /dev/sd*
    brw-rw----. 1 root disk 8,  0 Jul 15 10:50 /dev/sda
    brw-rw----. 1 root disk 8,  1 Jul 15 10:50 /dev/sda1
    brw-rw----. 1 root disk 8,  2 Jul 15 10:50 /dev/sda2
    brw-rw----. 1 root disk 8, 16 Jul 15 10:50 /dev/sdb
    brw-rw----. 1 root root 8, 17 Jul 15 10:50 /dev/sdb1
    brw-rw----. 1 root disk 8, 32 Jul 15 10:50 /dev/sdc
    brw-rw----. 1 root root 8, 33 Jul 15 10:50 /dev/sdc1
    brw-rw----. 1 root disk 8, 48 Jul 15 10:50 /dev/sdd
    brw-rw----. 1 root root 8, 49 Jul 15 10:50 /dev/sdd1
    brw-rw----. 1 root disk 8, 64 Jul 15 10:50 /dev/sde
    brw-rw----. 1 root root 8, 65 Jul 15 10:50 /dev/sde1
    
    Clone first cluster node to second cluster node

    I have shutdown ol7decn1 and I have first cloned ol7decn1 system disk:

    $ vboxmanage controlvm ol7decn1 poweroff
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    $  vboxmanage clonehd  /mnt/wdz/vm/ol7decn1.vdi.sata.0.vdi /mnt/wdz/vm/ol7decn2.vdi.sata.0.vdi
    0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
    Clone medium created in format 'VDI'. UUID: 05b9cae1-b69d-41ef-bf19-dcd14ffe979a
    

    Using VBOX GUI I have created a new VM named ol7decn2 using ol7decn2.sata.0.vdi as system disk.

    I have set the same properties for ol7decn2 as for ol7decn1:

  • RAM: 8GB
  • 3 network interfaces (the first one attached to NAT and the second and third one attached to Host-Only Adapter).
  • I have attached the 4 shared disks to ol7decn2:

    $ vboxmanage storageattach  ol7decn2 --storagectl "SATA" --port 1 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.1.vdi  --mtype shareable
    $ vboxmanage storageattach  ol7decn2 --storagectl "SATA" --port 2 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.2.vdi  --mtype shareable
    $ vboxmanage storageattach  ol7decn2 --storagectl "SATA" --port 3 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.3.vdi  --mtype shareable
    $ vboxmanage storageattach  ol7decn2 --storagectl "SATA" --port 4 --device 0 --type hdd --medium /mnt/wdz/vm/ol7decn1.ol7decn2.sata.4.vdi  --mtype shareable
    $ 
    

    I have started ol7decn2 and from the console modified the hostname:

    # cat /etc/hostname
    ol7decn2.localdomain
    #
    

    From the console I have reconfigured the public network interface and the interconnect network interface:

    # nmcli con del enp0s8
    # nmcli connection add type ethernet con-name enp0s8 ifname enp0s8 ip4 192.168.56.139/24
    # nmcli con del enp0s9
    # nmcli connection add type ethernet con-name enp0s9 ifname enp0s9 ip4 192.168.43.139/24
    

    Now I can connect with SSH and check network configuration:

    # ip addr
    1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group default 
        link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        inet 127.0.0.1/8 scope host lo
           valid_lft forever preferred_lft forever
        inet6 ::1/128 scope host 
           valid_lft forever preferred_lft forever
    2: enp0s3:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:97:01:43 brd ff:ff:ff:ff:ff:ff
        inet 10.0.2.15/8 brd 10.255.255.255 scope global noprefixroute enp0s3
           valid_lft forever preferred_lft forever
        inet6 fe80::29ab:3073:bbe8:acd/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    3: enp0s8:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:21:c2:65 brd ff:ff:ff:ff:ff:ff
        inet 192.168.56.139/24 brd 192.168.56.255 scope global noprefixroute enp0s8
           valid_lft forever preferred_lft forever
        inet6 fe80::bef4:a06f:aacb:d0ad/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    4: enp0s9:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:bc:d0:50 brd ff:ff:ff:ff:ff:ff
        inet 192.168.43.139/24 brd 192.168.43.255 scope global noprefixroute enp0s9
           valid_lft forever preferred_lft forever
        inet6 fe80::a745:1d47:77de:b3bb/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    # nmcli dev status
    DEVICE  TYPE      STATE      CONNECTION 
    enp0s3  ethernet  connected  enp0s3     
    enp0s8  ethernet  connected  enp0s8     
    enp0s9  ethernet  connected  enp0s9     
    lo      loopback  unmanaged  --         
    

    Note that there is no need to reconfigure the NAT network interface.

    I have rebooted ol7decn2 …

    # systemctl reboot
    

    … and checked that network interfaces are up and that DNS is OK:

    1: lo:  mtu 65536 qdisc noqueue state UNKNOWN group default 
        link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        inet 127.0.0.1/8 scope host lo
           valid_lft forever preferred_lft forever
        inet6 ::1/128 scope host 
           valid_lft forever preferred_lft forever
    2: enp0s3:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:97:01:43 brd ff:ff:ff:ff:ff:ff
        inet 10.0.2.15/8 brd 10.255.255.255 scope global noprefixroute enp0s3
           valid_lft forever preferred_lft forever
        inet6 fe80::29ab:3073:bbe8:acd/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    3: enp0s8:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:21:c2:65 brd ff:ff:ff:ff:ff:ff
        inet 192.168.56.139/24 brd 192.168.56.255 scope global noprefixroute enp0s8
           valid_lft forever preferred_lft forever
        inet6 fe80::bef4:a06f:aacb:d0ad/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    4: enp0s9:  mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 08:00:27:bc:d0:50 brd ff:ff:ff:ff:ff:ff
        inet 192.168.43.139/24 brd 192.168.43.255 scope global noprefixroute enp0s9
           valid_lft forever preferred_lft forever
        inet6 fe80::a745:1d47:77de:b3bb/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    # ip route
    default via 10.0.2.2 dev enp0s3 proto static metric 100 
    10.0.0.0/8 dev enp0s3 proto kernel scope link src 10.0.2.15 metric 100 
    192.168.43.0/24 dev enp0s9 proto kernel scope link src 192.168.43.139 metric 102 
    192.168.56.0/24 dev enp0s8 proto kernel scope link src 192.168.56.139 metric 101 
    # nslookup ol7dec-scan
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.149
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.150
    Name:	ol7dec-scan.localdomain
    Address: 192.168.56.148
    # nslookup ol7decn1
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7decn1.localdomain
    Address: 192.168.56.138
    
    # nslookup ol7decn2
    Server:		192.168.56.143
    Address:	192.168.56.143#53
    
    Name:	ol7decn2.localdomain
    Address: 192.168.56.139
    
    preinstallation RPM installation and SSH configuration

    On both nodes I have enabled ol7_u5_base YUM repository for 18c preinstallation RPM in /etc/yum.repos.d/public-yum-ol7.repo:

    [ol7_u5_base]
    name=Oracle Linux $releasever Update 5 installation media copy ($basearch)
    baseurl=https://yum.oracle.com/repo/OracleLinux/OL7/5/base/$basearch/
    gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
    gpgcheck=1
    enabled=1
    

    On both nodes I have installed the 18c preinstallation RPM with root account:

    # yum install -y oracle-database-preinstall-18c
    

    I have configured passwordless ssh between the 2 cluster nodes for oracle account.

    First I have set oracle password on both nodes (note that oracle account has been created by the preinstallation RPM):

    # id oracle
    uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),54322(dba),54323(oper),54324(backupdba),54325(dgdba),54326(kmdba),54330(racdba)
    # passwd oracle
    Changing password for user oracle.
    New password:
    BAD PASSWORD: The password is shorter than 8 characters
    Retype new password:
    passwd: all authentication tokens updated successfully.
    #
    

    I have run with oracle account on first cluster node:

    $ ssh-keygen
    Generating public/private rsa key pair.
    Enter file in which to save the key (/home/oracle/.ssh/id_rsa): 
    Created directory '/home/oracle/.ssh'.
    Enter passphrase (empty for no passphrase): 
    Enter same passphrase again: 
    Your identification has been saved in /home/oracle/.ssh/id_rsa.
    Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
    The key fingerprint is:
    SHA256:EMJjdVtnyc5qyYwg6+9D76QTy3qzIxQZim40S9cxa3s oracle@ol7decn1.localdomain
    The key's randomart image is:
    +---[RSA 2048]----+
    |   ...o . ..o.   |
    |    =+ o o oo    |
    | . o.+= .  o     |
    |.+..++..    o    |
    |+ + .+..S+ o     |
    | +  o.oE. *      |
    |.  o o.+..       |
    |    o Oo.        |
    |    .*=B.        |
    +----[SHA256]-----+
    $ ssh-copy-id ol7decn2
    /bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/home/oracle/.ssh/id_rsa.pub"
    /bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
    /bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
    oracle@ol7decn2's password: 
    
    Number of key(s) added: 1
    
    Now try logging into the machine, with:   "ssh 'ol7decn2'"
    and check to make sure that only the key(s) you wanted were added.
    
    

    I have run with oracle account on cluster node 2 ol7decn2:

    $ ssh-keygen
    Generating public/private rsa key pair.
    Enter file in which to save the key (/home/oracle/.ssh/id_rsa): 
    Created directory '/home/oracle/.ssh'.
    Enter passphrase (empty for no passphrase): 
    Enter same passphrase again: 
    Your identification has been saved in /home/oracle/.ssh/id_rsa.
    Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
    The key fingerprint is:
    SHA256:WLm1YGfQA4vx9JgCZIVTl+d/6Z/Llnl7PaDfAbJi1DY oracle@ol7decn2.localdomain
    The key's randomart image is:
    +---[RSA 2048]----+
    |   .+++ =+       |
    |   .o. *.B+      |
    |     .o Xo=.     |
    |       = *o.     |
    |      . S..E . . |
    |        . . =.+  |
    |         o ..o..+|
    |        . ..  +=*|
    |            ...BB|
    +----[SHA256]-----+
    $ ssh-copy-id ol7decn1
    /bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/home/oracle/.ssh/id_rsa.pub"
    The authenticity of host 'ol7decn1 (192.168.56.138)' can't be established.
    ECDSA key fingerprint is SHA256:xo4lc6xkmEsFroCbIFcGUuWa2yuF7OUzPLVedKhk5dU.
    ECDSA key fingerprint is MD5:d2:ef:bc:d9:b7:2a:e5:1f:91:e5:78:42:1b:a5:6e:3a.
    Are you sure you want to continue connecting (yes/no)? yes
    /bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
    /bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
    oracle@ol7decn1's password: 
    
    Number of key(s) added: 1
    
    Now try logging into the machine, with:   "ssh 'ol7decn1'"
    and check to make sure that only the key(s) you wanted were added.
    

    I have checked that I can connect to each remote node without password.

    From ol7decn1 to ol7decn2:

    $ ssh ol7decn2
    Last failed login: Sat Jul 28 15:22:39 CEST 2018 from ol7decn1 on ssh:notty
    There was 1 failed login attempt since the last successful login.
    Last login: Sat Jul 28 15:19:27 2018
    $ logout
    Connection to ol7decn2 closed.
    

    From ol7decn2 to ol7decn1:

    $ ssh ol7decn1
    Last login: Sat Jul 28 15:21:09 2018
    $ logout
    Connection to ol7decn1 closed.
    

    I have also enabled passwordless ssh on each node with local ssh connection (i.e. from ol7decn1 to ol7decn1 and from ol7decn2 to ol7decn2):

    $ ssh-copy-id ol7decn1
    /bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/home/oracle/.ssh/id_rsa.pub"
    The authenticity of host 'ol7decn1 (192.168.56.138)' can't be established.
    ECDSA key fingerprint is SHA256:xo4lc6xkmEsFroCbIFcGUuWa2yuF7OUzPLVedKhk5dU.
    ECDSA key fingerprint is MD5:d2:ef:bc:d9:b7:2a:e5:1f:91:e5:78:42:1b:a5:6e:3a.
    Are you sure you want to continue connecting (yes/no)? yes
    /bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
    /bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
    oracle@ol7decn1's password: 
    
    Number of key(s) added: 1
    
    Now try logging into the machine, with:   "ssh 'ol7decn1'"
    and check to make sure that only the key(s) you wanted were added.
    

    and:

    $ ssh-copy-id ol7decn2
    /bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/home/oracle/.ssh/id_rsa.pub"
    The authenticity of host 'ol7decn2 (192.168.56.139)' can't be established.
    ECDSA key fingerprint is SHA256:xo4lc6xkmEsFroCbIFcGUuWa2yuF7OUzPLVedKhk5dU.
    ECDSA key fingerprint is MD5:d2:ef:bc:d9:b7:2a:e5:1f:91:e5:78:42:1b:a5:6e:3a.
    Are you sure you want to continue connecting (yes/no)? yes
    /bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
    /bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
    oracle@ol7decn2's password: 
    
    Number of key(s) added: 1
    
    Now try logging into the machine, with:   "ssh 'ol7decn2'"
    and check to make sure that only the key(s) you wanted were added.
    

    I have checked that I connect locally on each node without password:

    $ ssh ol7decn1 hostname
    ol7decn1.localdomain
    

    and:

    $ ssh ol7decn2 hostname
    ol7decn2.localdomain
    
    CLUVFY step

    I have uploaded Grid Infrastructure 18c media to first cluster node after creating /stage directory:

    # mkdir /stage
    # chown oracle:dba /stage
    

    I have run with oracle account:

    $ cd /stage
    $ unzip LINUX.X64_180000_grid_home.zip 
    

    I have run CLUVFY :

    ./runcluvfy.sh stage -pre crsinst -n "ol7decn1,ol7decn2"
    
    ERROR: 
    PRVG-10467 : The default Oracle Inventory group could not be determined.
    
    Verifying Physical Memory ...FAILED (PRVF-7530)
    Verifying Available Physical Memory ...PASSED
    Verifying Swap Size ...PASSED
    Verifying Free Space: ol7decn2:/usr,ol7decn2:/var,ol7decn2:/etc,ol7decn2:/sbin,ol7decn2:/tmp ...PASSED
    Verifying Free Space: ol7decn1:/usr,ol7decn1:/var,ol7decn1:/etc,ol7decn1:/sbin,ol7decn1:/tmp ...PASSED
    Verifying User Existence: oracle ...
      Verifying Users With Same UID: 54321 ...PASSED
    Verifying User Existence: oracle ...PASSED
    Verifying Group Existence: asmadmin ...FAILED (PRVG-10461)
    Verifying Group Existence: asmdba ...FAILED (PRVG-10461)
    Verifying Group Membership: asmadmin ...FAILED (PRVG-10460)
    Verifying Group Membership: asmdba ...FAILED (PRVG-10460)
    Verifying Run Level ...PASSED
    Verifying Hard Limit: maximum open file descriptors ...PASSED
    Verifying Soft Limit: maximum open file descriptors ...PASSED
    Verifying Hard Limit: maximum user processes ...PASSED
    Verifying Soft Limit: maximum user processes ...PASSED
    Verifying Soft Limit: maximum stack size ...PASSED
    Verifying Architecture ...PASSED
    Verifying OS Kernel Version ...PASSED
    Verifying OS Kernel Parameter: semmsl ...PASSED
    Verifying OS Kernel Parameter: semmns ...PASSED
    Verifying OS Kernel Parameter: semopm ...PASSED
    Verifying OS Kernel Parameter: semmni ...PASSED
    Verifying OS Kernel Parameter: shmmax ...PASSED
    Verifying OS Kernel Parameter: shmmni ...PASSED
    Verifying OS Kernel Parameter: shmall ...PASSED
    Verifying OS Kernel Parameter: file-max ...PASSED
    Verifying OS Kernel Parameter: ip_local_port_range ...PASSED
    Verifying OS Kernel Parameter: rmem_default ...PASSED
    Verifying OS Kernel Parameter: rmem_max ...PASSED
    Verifying OS Kernel Parameter: wmem_default ...PASSED
    Verifying OS Kernel Parameter: wmem_max ...PASSED
    Verifying OS Kernel Parameter: aio-max-nr ...PASSED
    Verifying OS Kernel Parameter: panic_on_oops ...PASSED
    Verifying Package: binutils-2.23.52.0.1 ...PASSED
    Verifying Package: compat-libcap1-1.10 ...PASSED
    Verifying Package: libgcc-4.8.2 (x86_64) ...PASSED
    Verifying Package: libstdc++-4.8.2 (x86_64) ...PASSED
    Verifying Package: libstdc++-devel-4.8.2 (x86_64) ...PASSED
    Verifying Package: sysstat-10.1.5 ...PASSED
    Verifying Package: ksh ...PASSED
    Verifying Package: make-3.82 ...PASSED
    Verifying Package: glibc-2.17 (x86_64) ...PASSED
    Verifying Package: glibc-devel-2.17 (x86_64) ...PASSED
    Verifying Package: libaio-0.3.109 (x86_64) ...PASSED
    Verifying Package: libaio-devel-0.3.109 (x86_64) ...PASSED
    Verifying Package: nfs-utils-1.2.3-15 ...PASSED
    Verifying Package: smartmontools-6.2-4 ...PASSED
    Verifying Package: net-tools-2.0-0.17 ...PASSED
    Verifying Port Availability for component "Oracle Notification Service (ONS)" ...PASSED
    Verifying Port Availability for component "Oracle Cluster Synchronization Services (CSSD)" ...PASSED
    Verifying Users With Same UID: 0 ...PASSED
    Verifying Current Group ID ...PASSED
    Verifying Root user consistency ...PASSED
    Verifying Package: cvuqdisk-1.0.10-1 ...FAILED (PRVG-11550)
    Verifying Host name ...PASSED
    Verifying Node Connectivity ...
      Verifying Hosts File ...PASSED
      Verifying Check that maximum (MTU) size packet goes through subnet ...PASSED
      Verifying subnet mask consistency for subnet "10.0.0.0" ...PASSED
      Verifying subnet mask consistency for subnet "192.168.56.0" ...PASSED
      Verifying subnet mask consistency for subnet "192.168.43.0" ...PASSED
    Verifying Node Connectivity ...FAILED (PRVG-1172, PRVG-11067, PRVG-11095)
    Verifying Multicast or broadcast check ...PASSED
    Verifying Network Time Protocol (NTP) ...
      Verifying '/etc/ntp.conf' ...PASSED
      Verifying '/etc/chrony.conf' ...PASSED
      Verifying '/var/run/ntpd.pid' ...PASSED
      Verifying '/var/run/chronyd.pid' ...PASSED
    Verifying Network Time Protocol (NTP) ...PASSED
    Verifying Same core file name pattern ...PASSED
    Verifying User Mask ...PASSED
    Verifying User Not In Group "root": oracle ...PASSED
    Verifying Time zone consistency ...PASSED
    Verifying Time offset between nodes ...PASSED
    Verifying resolv.conf Integrity ...FAILED (PRVG-10048)
    Verifying DNS/NIS name service ...PASSED
    Verifying Domain Sockets ...PASSED
    Verifying /boot mount ...PASSED
    Verifying Daemon "avahi-daemon" not configured and running ...PASSED
    Verifying Daemon "proxyt" not configured and running ...PASSED
    Verifying User Equivalence ...PASSED
    Verifying /dev/shm mounted as temporary file system ...PASSED
    Verifying File system mount options for path /var ...PASSED
    Verifying zeroconf check ...PASSED
    Verifying ASM Filter Driver configuration ...PASSED
    
    Pre-check for cluster services setup was unsuccessful on all the nodes. 
    
    
    Failures were encountered during execution of CVU verification request "stage -pre crsinst".
    
    Verifying Physical Memory ...FAILED
    ol7decn2: PRVF-7530 : Sufficient physical memory is not available on node
              "ol7decn2" [Required physical memory = 8GB (8388608.0KB)]
    
    ol7decn1: PRVF-7530 : Sufficient physical memory is not available on node
              "ol7decn1" [Required physical memory = 8GB (8388608.0KB)]
    
    Verifying Group Existence: asmadmin ...FAILED
    ol7decn2: PRVG-10461 : Group "asmadmin" selected for privileges "OSASM" does
              not exist on node "ol7decn2".
    
    ol7decn1: PRVG-10461 : Group "asmadmin" selected for privileges "OSASM" does
              not exist on node "ol7decn1".
    
    Verifying Group Existence: asmdba ...FAILED
    ol7decn2: PRVG-10461 : Group "asmdba" selected for privileges "OSDBA" does not
              exist on node "ol7decn2".
    
    ol7decn1: PRVG-10461 : Group "asmdba" selected for privileges "OSDBA" does not
              exist on node "ol7decn1".
    
    Verifying Group Membership: asmadmin ...FAILED
    ol7decn2: PRVG-10460 : User "oracle" does not belong to group "asmadmin"
              selected for privileges "OSASM" on node "ol7decn2".
    
    ol7decn1: PRVG-10460 : User "oracle" does not belong to group "asmadmin"
              selected for privileges "OSASM" on node "ol7decn1".
    
    Verifying Group Membership: asmdba ...FAILED
    ol7decn2: PRVG-10460 : User "oracle" does not belong to group "asmdba" selected
              for privileges "OSDBA" on node "ol7decn2".
    
    ol7decn1: PRVG-10460 : User "oracle" does not belong to group "asmdba" selected
              for privileges "OSDBA" on node "ol7decn1".
    
    Verifying Package: cvuqdisk-1.0.10-1 ...FAILED
    ol7decn2: PRVG-11550 : Package "cvuqdisk" is missing on node "ol7decn2"
    
    ol7decn1: PRVG-11550 : Package "cvuqdisk" is missing on node "ol7decn1"
    
    Verifying Node Connectivity ...FAILED
    PRVG-1172 : The IP address "10.0.2.15" is on multiple interfaces "enp0s3" on
    nodes "ol7decn2,ol7decn1"
    
    ol7decn2: PRVG-11067 : TCP connectivity from node "ol7decn2": "10.0.2.15" to
              node "ol7decn2": "10.0.2.15" failed.
              PRVG-11095 : The TCP system call "connect" failed with error "111"
              while executing exectask on node "ol7decn2"
              Connection refused
    ol7decn2: PRVG-11067 : TCP connectivity from node "ol7decn2": "10.0.2.15" to
              node "ol7decn1": "10.0.2.15" failed.
              PRVG-11095 : The TCP system call "connect" failed with error "111"
              while executing exectask on node "ol7decn2"
              Connection refused
    
    Verifying resolv.conf Integrity ...FAILED
    ol7decn2: PRVG-10048 : Name "ol7decn2" was not resolved to an address of the
              specified type by name servers o"192.168.1.254".
    
    ol7decn1: PRVG-10048 : Name "ol7decn1" was not resolved to an address of the
              specified type by name servers o"192.168.1.254".
    
    
    CVU operation performed:      stage -pre crsinst
    Date:                         Jul 28, 2018 3:48:26 PM
    CVU home:                     /stage/
    User:                         oracle
    $
    

    I have ignored all warnings.

    The 2 cluster nodes are now ready for Grid Infrastructure installation.

    Categories: DBA Blogs

    Improve INSERT speed for loading volume sample data

    Tom Kyte - Sat, 2018-07-28 05:06
    Hi Team At the time of writing this, on LiveSQL I get "500 Internal Server Error", so will just paste the re-producible code here. I'm building sample application data for testing using PL/SQL. For loading 10M data in USERS_MAPPING table, cur...
    Categories: DBA Blogs

    SQL question with compass points

    Tom Kyte - Sat, 2018-07-28 05:06
    Hi sir, I have one dought is given below How to write select statement for bitmap index For example North is decode as 1 remains 0 West is decode as 1 remains 0 East is decode as 1 remains 0 South is decode as 1 remains 0 Output...
    Categories: DBA Blogs

    function-based index issue

    Tom Kyte - Fri, 2018-07-27 10:46
    Hi Tom, I have table with 1 755 001 rows and functional-based index as follows: <code> create table OC_YKB.TAB_TEST3 (guid number(16), pan varchar2(19 byte)); create sequence oc_ykb.sq_test3; INSERT /*+ APPEND */ INTO OC_YKB.TAB_TEST3 sele...
    Categories: DBA Blogs

    RMAN Backup

    Tom Kyte - Fri, 2018-07-27 10:46
    Hi, I have few clarifications needed regarding RMAN. 1. During Incremental RMAN backup - How does Oracle handles the uncommitted transactions? 2. If a backup is running for a long time (10-20 hrs) - How Oracle handles the backup process - wh...
    Categories: DBA Blogs

    Need to create dynamic columns in the report

    Tom Kyte - Fri, 2018-07-27 10:46
    Hi Tom, I am new to SQL and PLSQL, I have a requirement to create a report, which includes dynamic column for month based on number of months from Program duration. I actually tried to create scripts in LiveSQL, but right now it is not accessib...
    Categories: DBA Blogs

    Pages

    Subscribe to Oracle FAQ aggregator - DBA Blogs