2017-01-27 10:58:47: Checking parameters from paramfile /opt/local/grid/crs/install/crsconfig_params to validate installer variables 2017-01-27 10:58:47: The configuration parameter file /opt/local/grid/crs/install/crsconfig_params is valid 2017-01-27 10:58:47: ### Printing the configuration values from files: 2017-01-27 10:58:47: /opt/local/grid/crs/install/crsconfig_params 2017-01-27 10:58:47: /opt/local/grid/crs/install/s_crsconfig_defs 2017-01-27 10:58:47: ASM_AU_SIZE=1 2017-01-27 10:58:47: ASM_CONFIG= 2017-01-27 10:58:47: ASM_CREDENTIALS= 2017-01-27 10:58:47: ASM_DISCOVERY_STRING= 2017-01-27 10:58:47: ASM_DISKS= 2017-01-27 10:58:47: ASM_DISK_GROUP= 2017-01-27 10:58:47: ASM_REDUNDANCY= 2017-01-27 10:58:47: ASM_SPFILE= 2017-01-27 10:58:47: ASM_UPGRADE=false 2017-01-27 10:58:47: BIG_CLUSTER=false 2017-01-27 10:58:47: CLSCFG_MISSCOUNT= 2017-01-27 10:58:47: CLUSTER_GUID= 2017-01-27 10:58:47: CLUSTER_NAME=test-cluster 2017-01-27 10:58:47: CRFHOME="/opt/local/grid" 2017-01-27 10:58:47: CRS_LIMIT_CORE=unlimited 2017-01-27 10:58:47: CRS_LIMIT_MEMLOCK=unlimited 2017-01-27 10:58:47: CRS_LSNR_STACK=10240 2017-01-27 10:58:47: CRS_NODEVIPS='nodei-vip.example.net/255.255.255.0/bond0,nodeii-vip.example.net/255.255.255.0/bond0' 2017-01-27 10:58:47: CRS_STORAGE_OPTION=2 2017-01-27 10:58:47: CSS_LEASEDURATION=400 2017-01-27 10:58:47: DIRPREFIX= 2017-01-27 10:58:47: DISABLE_OPROCD=0 2017-01-27 10:58:47: EXTERNAL_ORACLE=/opt/oracle 2017-01-27 10:58:47: EXTERNAL_ORACLE_BIN=/opt/oracle/bin 2017-01-27 10:58:47: GNS_ADDR_LIST= 2017-01-27 10:58:47: GNS_ALLOW_NET_LIST= 2017-01-27 10:58:47: GNS_CONF=false 2017-01-27 10:58:47: GNS_CREDENTIALS= 2017-01-27 10:58:47: GNS_DENY_ITF_LIST= 2017-01-27 10:58:47: GNS_DENY_NET_LIST= 2017-01-27 10:58:47: GNS_DOMAIN_LIST= 2017-01-27 10:58:47: GNS_TYPE= 2017-01-27 10:58:47: GPNPCONFIGDIR=/opt/local/grid 2017-01-27 10:58:47: GPNPGCONFIGDIR=/opt/local/grid 2017-01-27 10:58:47: GPNP_PA= 2017-01-27 10:58:47: HOST_NAME_LIST=nodei,nodeii 2017-01-27 10:58:47: HUB_NODE_LIST= 2017-01-27 10:58:47: HUB_NODE_VIPS= 2017-01-27 10:58:47: HUB_SIZE=-1 2017-01-27 10:58:47: ID=/etc/init.d 2017-01-27 10:58:47: INIT=/sbin/init 2017-01-27 10:58:47: INITCTL=/sbin/initctl 2017-01-27 10:58:47: INSTALL_NODE=nodei.example.net 2017-01-27 10:58:47: ISROLLING=true 2017-01-27 10:58:47: IT=/etc/inittab 2017-01-27 10:58:47: JLIBDIR=/opt/local/grid/jlib 2017-01-27 10:58:47: JREDIR=/opt/local/grid/jdk/jre/ 2017-01-27 10:58:47: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8 2017-01-27 10:58:47: LISTENER_USERNAME=oracle 2017-01-27 10:58:47: MGMT_DB=true 2017-01-27 10:58:47: MSGFILE=/var/adm/messages 2017-01-27 10:58:47: NETWORKS="bond0"/192.168.1.0:public,"bond1"/192.168.2.0:cluster_interconnect 2017-01-27 10:58:47: NEW_HOST_NAME_LIST= 2017-01-27 10:58:47: NEW_NODEVIPS='nodei-vip.example.net/255.255.255.0/bond0,nodeii-vip.example.net/255.255.255.0/bond0' 2017-01-27 10:58:47: NEW_NODE_NAME_LIST= 2017-01-27 10:58:47: NEW_PRIVATE_NAME_LIST= 2017-01-27 10:58:47: NODELIST=nodei,nodeii 2017-01-27 10:58:47: NODE_NAME_LIST=nodei,nodeii 2017-01-27 10:58:47: OCRCONFIG=/etc/oracle/ocr.loc 2017-01-27 10:58:47: OCRCONFIGDIR=/etc/oracle 2017-01-27 10:58:47: OCRID= 2017-01-27 10:58:47: OCRLOC=ocr.loc 2017-01-27 10:58:47: OCR_LOCATIONS=/opt/nfsshare/storage/ocr1,/opt/nfsshare/storage/ocr2,/opt/nfsshare/storage/ocr3 2017-01-27 10:58:47: OLASTGASPDIR=/etc/oracle/lastgasp 2017-01-27 10:58:47: OLD_CRS_HOME= 2017-01-27 10:58:47: OLRCONFIG=/etc/oracle/olr.loc 2017-01-27 10:58:47: OLRCONFIGDIR=/etc/oracle 2017-01-27 10:58:47: OLRLOC=olr.loc 2017-01-27 10:58:47: OPROCDCHECKDIR=/etc/oracle/oprocd/check 2017-01-27 10:58:47: OPROCDDIR=/etc/oracle/oprocd 2017-01-27 10:58:47: OPROCDFATALDIR=/etc/oracle/oprocd/fatal 2017-01-27 10:58:47: OPROCDSTOPDIR=/etc/oracle/oprocd/stop 2017-01-27 10:58:47: ORACLE_BASE=/opt/local/oracle 2017-01-27 10:58:47: ORACLE_HOME=/opt/local/grid 2017-01-27 10:58:47: ORACLE_OWNER=oracle 2017-01-27 10:58:47: ORA_ASM_GROUP=oinstall 2017-01-27 10:58:47: ORA_DBA_GROUP=oinstall 2017-01-27 10:58:47: PING_TARGETS= 2017-01-27 10:58:47: PRIVATE_NAME_LIST= 2017-01-27 10:58:47: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d 2017-01-27 10:58:47: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d 2017-01-27 10:58:47: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d 2017-01-27 10:58:47: RC_KILL=K15 2017-01-27 10:58:47: RC_KILL_OLD=K96 2017-01-27 10:58:47: RC_KILL_OLD2=K19 2017-01-27 10:58:47: RC_START=S96 2017-01-27 10:58:47: REUSEDG=false 2017-01-27 10:58:47: RIM_NODE_LIST= 2017-01-27 10:58:47: SCAN_NAME=rac-scan 2017-01-27 10:58:47: SCAN_PORT=1521 2017-01-27 10:58:47: SCRBASE=/etc/oracle/scls_scr 2017-01-27 10:58:47: SILENT=false 2017-01-27 10:58:47: SO_EXT=so 2017-01-27 10:58:47: SRVCFGLOC=srvConfig.loc 2017-01-27 10:58:47: SRVCONFIG=/var/opt/oracle/srvConfig.loc 2017-01-27 10:58:47: SRVCONFIGDIR=/var/opt/oracle 2017-01-27 10:58:47: SYSTEMCTL=/usr/bin/systemctl 2017-01-27 10:58:47: SYSTEMD_SYSTEM_DIR=/etc/systemd/system 2017-01-27 10:58:47: TZ=America/New_York 2017-01-27 10:58:47: UPSTART_INIT_DIR=/etc/init 2017-01-27 10:58:47: USER_IGNORED_PREREQ=true 2017-01-27 10:58:47: VNDR_CLUSTER=false 2017-01-27 10:58:47: VOTING_DISKS=/opt/nfsshare/storage/vdsk1,/opt/nfsshare/storage/vdsk2,/opt/nfsshare/storage/vdsk3 2017-01-27 10:58:47: ### Printing other configuration values ### 2017-01-27 10:58:47: CLSCFG_EXTRA_PARMS= 2017-01-27 10:58:47: HAS_GROUP=oinstall 2017-01-27 10:58:47: HAS_USER=root 2017-01-27 10:58:47: HOST=nodeii 2017-01-27 10:58:47: OLR_DIRECTORY=/opt/local/grid/cdata 2017-01-27 10:58:47: OLR_LOCATION=/opt/local/grid/cdata/nodeii.olr 2017-01-27 10:58:47: ORA_CRS_HOME=/opt/local/grid 2017-01-27 10:58:47: SIHA=0 2017-01-27 10:58:47: SUCC_REBOOT=0 2017-01-27 10:58:47: SUPERUSER=root 2017-01-27 10:58:47: addfile=/opt/local/grid/crs/install/crsconfig_addparams 2017-01-27 10:58:47: cluutil_trc_suff_pp=0 2017-01-27 10:58:47: crscfg_trace=1 2017-01-27 10:58:47: crscfg_trace_file=/opt/local/grid/cfgtoollogs/crsconfig/rootcrs_nodeii_2017-01-27_10-58-47AM.log 2017-01-27 10:58:47: old_nodevips= 2017-01-27 10:58:47: osdfile=/opt/local/grid/crs/install/s_crsconfig_defs 2017-01-27 10:58:47: parameters_valid=1 2017-01-27 10:58:47: paramfile=/opt/local/grid/crs/install/crsconfig_params 2017-01-27 10:58:47: platform_family=unix 2017-01-27 10:58:47: pp_srvctl_trc_suff=0 2017-01-27 10:58:47: srvctl_trc_suff=0 2017-01-27 10:58:47: srvctl_trc_suff_pp=0 2017-01-27 10:58:47: stackStartLevel=11 2017-01-27 10:58:47: user_is_superuser=1 2017-01-27 10:58:47: ### Printing of configuration values complete ### 2017-01-27 10:58:47: Performing few checks before running scripts 2017-01-27 10:58:47: Attempt to get current working directory 2017-01-27 10:58:47: Running as user oracle: pwd 2017-01-27 10:58:47: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; pwd ' 2017-01-27 10:58:47: Removing file /tmp/filegR1nSV 2017-01-27 10:58:47: Successfully removed file: /tmp/filegR1nSV 2017-01-27 10:58:47: pipe exit code: 0 2017-01-27 10:58:47: /bin/su successfully executed 2017-01-27 10:58:47: The current working directory: /opt/local/grid 2017-01-27 10:58:47: Pre-checkes for running scripts passed 2017-01-27 10:58:47: Instantiating scripts in GI home: /opt/local/grid 2017-01-27 10:58:47: SRC FILE: /opt/local/grid/crs/sbs/crsconfig_dirs.sbs; DST PATH: /opt/local/grid/crs/utl/nodeii/crsconfig_dirs 2017-01-27 10:58:47: SRC FILE: /opt/local/grid/crs/sbs/crsconfig_fileperms.sbs; DST PATH: /opt/local/grid/crs/utl/nodeii/crsconfig_fileperms 2017-01-27 10:58:48: Set CRS_ADR_DISABLE to stop CLSB initializing ADR 2017-01-27 10:58:48: Enable CLSB to initialize ADR 2017-01-27 10:58:48: Checking if OCR is on ASM 2017-01-27 10:58:48: Retrieving OCR main disk location 2017-01-27 10:58:48: Opening file /etc/oracle/ocr.loc 2017-01-27 10:58:48: Value () is set for key=ocrconfig_loc 2017-01-27 10:58:48: Retrieving OCR mirror disk location 2017-01-27 10:58:48: Opening file /etc/oracle/ocr.loc 2017-01-27 10:58:48: Value () is set for key=ocrmirrorconfig_loc 2017-01-27 10:58:48: Retrieving OCR loc3 disk location 2017-01-27 10:58:48: Opening file /etc/oracle/ocr.loc 2017-01-27 10:58:48: Value () is set for key=ocrconfig_loc3 2017-01-27 10:58:48: Retrieving OCR loc4 disk location 2017-01-27 10:58:48: Opening file /etc/oracle/ocr.loc 2017-01-27 10:58:48: Value () is set for key=ocrconfig_loc4 2017-01-27 10:58:48: Retrieving OCR loc5 disk location 2017-01-27 10:58:48: Opening file /etc/oracle/ocr.loc 2017-01-27 10:58:48: Value () is set for key=ocrconfig_loc5 2017-01-27 10:58:48: OCR config does not exist 2017-01-27 10:58:48: set owner/group of OCR path 2017-01-27 10:58:48: saving current owner/permisssios of parent dir of /opt/nfsshare/storage 2017-01-27 10:58:48: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: Getting file permissions for /opt/nfsshare/storage 2017-01-27 10:58:48: Getting file permissions for /opt/nfsshare 2017-01-27 10:58:48: Getting file permissions for /opt 2017-01-27 10:58:48: writing /opt/nfsshare/storage:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: writing /opt/nfsshare:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: writing /opt:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: set owner/group of OCR path 2017-01-27 10:58:48: saving current owner/permisssios of parent dir of /opt/nfsshare/storage 2017-01-27 10:58:48: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: loading... /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: Getting file permissions for /opt/nfsshare/storage 2017-01-27 10:58:48: Getting file permissions for /opt/nfsshare 2017-01-27 10:58:48: Getting file permissions for /opt 2017-01-27 10:58:48: set owner/group of OCR path 2017-01-27 10:58:48: saving current owner/permisssios of parent dir of /opt/nfsshare/storage 2017-01-27 10:58:48: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: loading... /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: Getting file permissions for /opt/nfsshare/storage 2017-01-27 10:58:48: Getting file permissions for /opt/nfsshare 2017-01-27 10:58:48: Getting file permissions for /opt 2017-01-27 10:58:48: saving current owner/permisssios of parent dir of /opt/local 2017-01-27 10:58:48: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: loading... /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: Getting file permissions for /opt/local 2017-01-27 10:58:48: Getting file permissions for /opt 2017-01-27 10:58:48: Removing file /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: Successfully removed file: /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: writing /opt/nfsshare/storage:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: writing /opt/nfsshare:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: writing /opt:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: writing /opt/local:root:oinstall:0755 to /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:58:48: Running /opt/local/grid/bin/acfsdriverstate installed -s 2017-01-27 10:58:48: Executing cmd: /opt/local/grid/bin/acfsdriverstate installed -s 2017-01-27 10:58:48: acfs is not installed 2017-01-27 10:58:48: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 4001 2017-01-27 10:58:49: Command output: > CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. >End Command output 2017-01-27 10:58:49: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 4001 2017-01-27 10:58:49: Command output: > CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. >End Command output 2017-01-27 10:58:49: CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector. 2017-01-27 10:58:49: Executing cmd: /opt/local/grid/crs/install/tfa_setup -silent -crshome /opt/local/grid 2017-01-27 10:59:23: Command output: > > Starting TFA installation > > Not able to find TFA binaries. > Using JAVA_HOME : /opt/local/grid/jdk/jre > > Running Auto Setup for TFA as user root... > > Installing TFA now... > > > TFA Will be Installed on nodeii... > > TFA will scan the following Directories > ++++++++++++++++++++++++++++++++++++++++++++ > > .-------------------------------------------------------. > | nodeii | > +--------------------------------------------+----------+ > | Trace Directory | Resource | > +--------------------------------------------+----------+ > | /opt/local/grid/OPatch/crs/log | CRS | > | /opt/local/grid/cfgtoollogs | CFGTOOLS | > | /opt/local/grid/crs/log | CRS | > | /opt/local/grid/cv/log | CRS | > | /opt/local/grid/evm/admin/log | CRS | > | /opt/local/grid/evm/admin/logger | CRS | > | /opt/local/grid/evm/log | CRS | > | /opt/local/grid/install | INSTALL | > | /opt/local/grid/log | CRS | > | /opt/local/grid/network/log | CRS | > | /opt/local/grid/oc4j/j2ee/home/log | DBWLM | > | /opt/local/grid/opmn/logs | CRS | > | /opt/local/grid/racg/log | CRS | > | /opt/local/grid/rdbms/log | ASM | > | /opt/local/grid/scheduler/log | CRS | > | /opt/local/grid/srvm/log | CRS | > | /opt/local/oraInventory/ContentsXML | INSTALL | > | /opt/local/oraInventory/logs | INSTALL | > | /opt/local/oracle/crsdata/nodeii/acfs | ACFS | > | /opt/local/oracle/crsdata/nodeii/core | CRS | > | /opt/local/oracle/crsdata/nodeii/crsconfig | CRS | > | /opt/local/oracle/crsdata/nodeii/crsdiag | CRS | > | /opt/local/oracle/crsdata/nodeii/cvu | CRS | > | /opt/local/oracle/crsdata/nodeii/evm | CRS | > | /opt/local/oracle/crsdata/nodeii/output | CRS | > | /opt/local/oracle/crsdata/nodeii/trace | CRS | > '--------------------------------------------+----------' > > > Installing TFA on nodeii: > HOST: nodeii TFA_HOME: /opt/local/grid/tfa/nodeii/tfa_home > > .----------------------------------------------------------------------------. > | Host | Status of TFA | PID | Port | Version | Build ID | > +--------+---------------+--------+------+------------+----------------------+ > | nodeii | RUNNING | 105275 | 5000 | 12.1.2.0.0 | 12120020140619094932 | > | nodei | RUNNING | 57669 | 5000 | 12.1.2.0.0 | 12120020140619094932 | > '--------+---------------+--------+------+------------+----------------------' > > Running Inventory in All Nodes... > > Enabling Access for Non-root Users on nodeii... > > Adding default users and groups to TFA Access list... > > Summary of TFA Installation: > .-----------------------------------------------------------. > | nodeii | > +---------------------+-------------------------------------+ > | Parameter | Value | > +---------------------+-------------------------------------+ > | Install location | /opt/local/grid/tfa/nodeii/tfa_home | > | Repository location | /opt/local/oracle/tfa/repository | > | Repository usage | 0 MB out of 10240 MB | > '---------------------+-------------------------------------' > > > Installing oratop extension.. > > > TFA is successfully installed... > > > Usage : /opt/local/grid/bin/tfactl [options] > = > start Starts TFA > stop Stops TFA > enable Enable TFA Auto restart > disable Disable TFA Auto restart > print Print requested details > access Add or Remove or List TFA Users and Groups > purge Delete collections from TFA repository > directory Add or Remove or Modify directory in TFA > host Add or Remove host in TFA > diagcollect Collect logs from across nodes in cluster > analyze List events summary and search strings in alert logs. > set Turn ON/OFF or Modify various TFA features > uninstall Uninstall TFA from this node > > For help with a command: /opt/local/grid/bin/tfactl -help > > >End Command output 2017-01-27 10:59:23: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 4002 2017-01-27 10:59:23: Command output: > CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. >End Command output 2017-01-27 10:59:23: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 4002 2017-01-27 10:59:23: Command output: > CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. >End Command output 2017-01-27 10:59:23: CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector. 2017-01-27 10:59:23: Executing cmd: /opt/local/grid/bin/sqlplus -V 2017-01-27 10:59:23: Command output: > > SQL*Plus: Release 12.1.0.2.0 Production > >End Command output 2017-01-27 10:59:23: Got CRS release version: 12.1.0.2.0 2017-01-27 10:59:23: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK 2017-01-27 10:59:23: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK" 2017-01-27 10:59:23: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil1.log 2017-01-27 10:59:23: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK 2017-01-27 10:59:23: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK ' 2017-01-27 10:59:23: Removing file /tmp/filecmSXUz 2017-01-27 10:59:23: Successfully removed file: /tmp/filecmSXUz 2017-01-27 10:59:23: pipe exit code: 0 2017-01-27 10:59:23: /bin/su successfully executed 2017-01-27 10:59:23: checkpoint ROOTCRS_STACK does not exist 2017-01-27 10:59:23: Oracle clusterware configuration has started 2017-01-27 10:59:23: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state START" 2017-01-27 10:59:23: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil2.log 2017-01-27 10:59:23: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state START 2017-01-27 10:59:23: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state START ' 2017-01-27 10:59:24: Removing file /tmp/fileo5Fese 2017-01-27 10:59:24: Successfully removed file: /tmp/fileo5Fese 2017-01-27 10:59:24: pipe exit code: 0 2017-01-27 10:59:24: /bin/su successfully executed 2017-01-27 10:59:24: Succeeded in writing the checkpoint:'ROOTCRS_STACK' with status:START 2017-01-27 10:59:24: Install node: nodei 2017-01-27 10:59:24: Current first node: nodei 2017-01-27 10:59:24: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -pname VERSION -pvalue 12.1.0.2.0" 2017-01-27 10:59:24: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil3.log 2017-01-27 10:59:24: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -pname VERSION -pvalue 12.1.0.2.0 2017-01-27 10:59:24: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -pname VERSION -pvalue 12.1.0.2.0 ' 2017-01-27 10:59:24: Removing file /tmp/fileu0QAdU 2017-01-27 10:59:24: Successfully removed file: /tmp/fileu0QAdU 2017-01-27 10:59:24: pipe exit code: 0 2017-01-27 10:59:24: /bin/su successfully executed 2017-01-27 10:59:24: Succeeded to add (property/value):('VERSION/'12.1.0.2.0') for checkpoint:ROOTCRS_STACK 2017-01-27 10:59:24: USER_IGNORED_PREREQ is set to 1 2017-01-27 10:59:24: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 363 2017-01-27 10:59:24: Command output: > CLSRSC-363: User ignored prerequisites during installation >End Command output 2017-01-27 10:59:24: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 363 2017-01-27 10:59:24: Command output: > CLSRSC-363: User ignored prerequisites during installation >End Command output 2017-01-27 10:59:24: CLSRSC-363: User ignored prerequisites during installation 2017-01-27 10:59:24: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status" 2017-01-27 10:59:24: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil4.log 2017-01-27 10:59:24: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status 2017-01-27 10:59:24: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status ' 2017-01-27 10:59:25: Removing file /tmp/filePZbsYB 2017-01-27 10:59:25: Successfully removed file: /tmp/filePZbsYB 2017-01-27 10:59:25: pipe exit code: 0 2017-01-27 10:59:25: /bin/su successfully executed 2017-01-27 10:59:25: The 'ROOTCRS_STACK' status is START 2017-01-27 10:59:25: Saving the configuration parameter file data 2017-01-27 10:59:25: checkpoint status of ROOTCRS_STACK is START 2017-01-27 10:59:25: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM 2017-01-27 10:59:25: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM" 2017-01-27 10:59:25: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil5.log 2017-01-27 10:59:25: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM 2017-01-27 10:59:25: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM ' 2017-01-27 10:59:26: Removing file /tmp/fileQTOdwl 2017-01-27 10:59:26: Successfully removed file: /tmp/fileQTOdwl 2017-01-27 10:59:26: pipe exit code: 0 2017-01-27 10:59:26: /bin/su successfully executed 2017-01-27 10:59:26: checkpoint ROOTCRS_PARAM does not exist 2017-01-27 10:59:26: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -state START" 2017-01-27 10:59:26: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil6.log 2017-01-27 10:59:26: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -state START 2017-01-27 10:59:26: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -state START ' 2017-01-27 10:59:26: Removing file /tmp/fileG1V3Q6 2017-01-27 10:59:26: Successfully removed file: /tmp/fileG1V3Q6 2017-01-27 10:59:26: pipe exit code: 0 2017-01-27 10:59:26: /bin/su successfully executed 2017-01-27 10:59:26: Succeeded in writing the checkpoint:'ROOTCRS_PARAM' with status:START 2017-01-27 10:59:26: Install node: nodei 2017-01-27 10:59:26: Current first node: nodei 2017-01-27 10:59:26: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM 2017-01-27 10:59:26: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM" 2017-01-27 10:59:26: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil7.log 2017-01-27 10:59:26: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM 2017-01-27 10:59:26: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM ' 2017-01-27 10:59:27: Removing file /tmp/fileCpl2KT 2017-01-27 10:59:27: Successfully removed file: /tmp/fileCpl2KT 2017-01-27 10:59:27: pipe exit code: 0 2017-01-27 10:59:27: /bin/su successfully executed 2017-01-27 10:59:27: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM -status" 2017-01-27 10:59:27: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil8.log 2017-01-27 10:59:27: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM -status 2017-01-27 10:59:27: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_PARAM -status ' 2017-01-27 10:59:27: Removing file /tmp/fileHGP8aI 2017-01-27 10:59:27: Successfully removed file: /tmp/fileHGP8aI 2017-01-27 10:59:27: pipe exit code: 0 2017-01-27 10:59:27: /bin/su successfully executed 2017-01-27 10:59:27: The 'ROOTCRS_PARAM' is either in START/FAILED state 2017-01-27 10:59:27: inside rootcrs_param 2017-01-27 10:59:27: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -pfile /opt/local/grid/crs/install/crsconfig_params" 2017-01-27 10:59:27: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil9.log 2017-01-27 10:59:27: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -pfile /opt/local/grid/crs/install/crsconfig_params 2017-01-27 10:59:27: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -pfile /opt/local/grid/crs/install/crsconfig_params ' 2017-01-27 10:59:27: Removing file /tmp/filehUlKTx 2017-01-27 10:59:27: Successfully removed file: /tmp/filehUlKTx 2017-01-27 10:59:27: pipe exit code: 0 2017-01-27 10:59:27: /bin/su successfully executed 2017-01-27 10:59:27: write contents of pfile :/opt/local/grid/crs/install/crsconfig_params for checkpoint:ROOTCRS_PARAM succeeded 2017-01-27 10:59:27: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -state SUCCESS" 2017-01-27 10:59:27: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil10.log 2017-01-27 10:59:27: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -state SUCCESS 2017-01-27 10:59:27: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_PARAM -state SUCCESS ' 2017-01-27 10:59:28: Removing file /tmp/filehtGRSo 2017-01-27 10:59:28: Successfully removed file: /tmp/filehtGRSo 2017-01-27 10:59:28: pipe exit code: 0 2017-01-27 10:59:28: /bin/su successfully executed 2017-01-27 10:59:28: Succeeded in writing the checkpoint:'ROOTCRS_PARAM' with status:SUCCESS 2017-01-27 10:59:28: Install node: nodei 2017-01-27 10:59:28: Current first node: nodei 2017-01-27 10:59:28: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP 2017-01-27 10:59:28: Resetting cluutil_trc_suff_pp to 0 2017-01-27 10:59:28: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP" 2017-01-27 10:59:28: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil0.log 2017-01-27 10:59:28: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP 2017-01-27 10:59:28: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP ' 2017-01-27 10:59:28: Removing file /tmp/filegtguZg 2017-01-27 10:59:28: Successfully removed file: /tmp/filegtguZg 2017-01-27 10:59:28: pipe exit code: 0 2017-01-27 10:59:28: /bin/su successfully executed 2017-01-27 10:59:28: checkpoint ROOTCRS_OSDSETUP does not exist 2017-01-27 10:59:28: Writing a checkpoint for platform specific OSD setup 2017-01-27 10:59:28: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OSDSETUP -state START" 2017-01-27 10:59:28: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil1.log 2017-01-27 10:59:28: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OSDSETUP -state START 2017-01-27 10:59:28: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OSDSETUP -state START ' 2017-01-27 10:59:28: Removing file /tmp/file393G59 2017-01-27 10:59:28: Successfully removed file: /tmp/file393G59 2017-01-27 10:59:28: pipe exit code: 0 2017-01-27 10:59:28: /bin/su successfully executed 2017-01-27 10:59:28: Succeeded in writing the checkpoint:'ROOTCRS_OSDSETUP' with status:START 2017-01-27 10:59:28: Install node: nodei 2017-01-27 10:59:28: Current first node: nodei 2017-01-27 10:59:28: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP -status" 2017-01-27 10:59:28: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil2.log 2017-01-27 10:59:28: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP -status 2017-01-27 10:59:28: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OSDSETUP -status ' 2017-01-27 10:59:29: Removing file /tmp/fileRYGq63 2017-01-27 10:59:29: Successfully removed file: /tmp/fileRYGq63 2017-01-27 10:59:29: pipe exit code: 0 2017-01-27 10:59:29: /bin/su successfully executed 2017-01-27 10:59:29: The 'ROOTCRS_OSDSETUP' is either in START/FAILED state 2017-01-27 10:59:29: AFD is not supported on this platform. 2017-01-27 10:59:29: Platform specific setup actions are done 2017-01-27 10:59:29: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OSDSETUP -state SUCCESS" 2017-01-27 10:59:29: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil3.log 2017-01-27 10:59:29: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OSDSETUP -state SUCCESS 2017-01-27 10:59:29: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OSDSETUP -state SUCCESS ' 2017-01-27 10:59:29: Removing file /tmp/fileOy4TcZ 2017-01-27 10:59:29: Successfully removed file: /tmp/fileOy4TcZ 2017-01-27 10:59:29: pipe exit code: 0 2017-01-27 10:59:29: /bin/su successfully executed 2017-01-27 10:59:29: Succeeded in writing the checkpoint:'ROOTCRS_OSDSETUP' with status:SUCCESS 2017-01-27 10:59:29: Install node: nodei 2017-01-27 10:59:29: Current first node: nodei 2017-01-27 10:59:29: Checking if OCR is on ASM 2017-01-27 10:59:29: Retrieving OCR main disk location 2017-01-27 10:59:29: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:29: Value () is set for key=ocrconfig_loc 2017-01-27 10:59:29: Retrieving OCR mirror disk location 2017-01-27 10:59:29: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:29: Value () is set for key=ocrmirrorconfig_loc 2017-01-27 10:59:29: Retrieving OCR loc3 disk location 2017-01-27 10:59:29: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:29: Value () is set for key=ocrconfig_loc3 2017-01-27 10:59:29: Retrieving OCR loc4 disk location 2017-01-27 10:59:29: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:29: Value () is set for key=ocrconfig_loc4 2017-01-27 10:59:29: Retrieving OCR loc5 disk location 2017-01-27 10:59:29: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:29: Value () is set for key=ocrconfig_loc5 2017-01-27 10:59:29: OCR config does not exist 2017-01-27 10:59:29: set owner/group of OCR path 2017-01-27 10:59:29: saving current owner/permisssios of parent dir of /opt/nfsshare/storage 2017-01-27 10:59:29: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:59:29: loading... /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:59:29: Getting file permissions for /opt/nfsshare/storage 2017-01-27 10:59:29: Getting file permissions for /opt/nfsshare 2017-01-27 10:59:29: Getting file permissions for /opt 2017-01-27 10:59:29: set owner/group of OCR path 2017-01-27 10:59:29: saving current owner/permisssios of parent dir of /opt/nfsshare/storage 2017-01-27 10:59:29: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:59:29: loading... /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:59:29: Getting file permissions for /opt/nfsshare/storage 2017-01-27 10:59:29: Getting file permissions for /opt/nfsshare 2017-01-27 10:59:29: Getting file permissions for /opt 2017-01-27 10:59:29: set owner/group of OCR path 2017-01-27 10:59:29: saving current owner/permisssios of parent dir of /opt/nfsshare/storage 2017-01-27 10:59:29: saving parent dir ACLs in /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:59:29: loading... /opt/local/grid/crs/install/ParentDirPerm_nodeii.txt 2017-01-27 10:59:29: Getting file permissions for /opt/nfsshare/storage 2017-01-27 10:59:29: Getting file permissions for /opt/nfsshare 2017-01-27 10:59:29: Getting file permissions for /opt 2017-01-27 10:59:29: Oracle CRS home = /opt/local/grid 2017-01-27 10:59:29: Host name = nodeii 2017-01-27 10:59:29: CRS user = oracle 2017-01-27 10:59:29: Oracle CRS home = /opt/local/grid 2017-01-27 10:59:29: GPnP host = nodeii 2017-01-27 10:59:29: Oracle GPnP home = /opt/local/grid/gpnp 2017-01-27 10:59:29: Oracle GPnP local home = /opt/local/grid/gpnp/nodeii 2017-01-27 10:59:29: GPnP directories verified. 2017-01-27 10:59:29: Checking to see if Oracle CRS stack is already configured 2017-01-27 10:59:29: Oracle CRS stack is not configured yet 2017-01-27 10:59:29: ---Checking local gpnp setup... 2017-01-27 10:59:29: The setup file "/opt/local/grid/gpnp/nodeii/profiles/peer/profile.xml" does not exist 2017-01-27 10:59:29: The setup file "/opt/local/grid/gpnp/nodeii/wallets/peer/cwallet.sso" does not exist 2017-01-27 10:59:29: The setup file "/opt/local/grid/gpnp/nodeii/wallets/prdr/cwallet.sso" does not exist 2017-01-27 10:59:29: chk gpnphome /opt/local/grid/gpnp/nodeii: profile_ok 0 wallet_ok 0 r/o_wallet_ok 0 2017-01-27 10:59:29: chk gpnphome /opt/local/grid/gpnp/nodeii: INVALID (bad profile/wallet) 2017-01-27 10:59:29: ---Checking cluster-wide gpnp setup... 2017-01-27 10:59:29: chk gpnphome /opt/local/grid/gpnp: profile_ok 1 wallet_ok 1 r/o_wallet_ok 1 2017-01-27 10:59:29: gpnptool: run /opt/local/grid/bin/gpnptool verify -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -w="file:/opt/local/grid/gpnp/wallets/peer" -wu=peer 2017-01-27 10:59:29: Running as user oracle: /opt/local/grid/bin/gpnptool verify -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -w="file:/opt/local/grid/gpnp/wallets/peer" -wu=peer 2017-01-27 10:59:29: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/gpnptool verify -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -w="file:/opt/local/grid/gpnp/wallets/peer" -wu=peer ' 2017-01-27 10:59:30: Removing file /tmp/fileHCS9DW 2017-01-27 10:59:30: Successfully removed file: /tmp/fileHCS9DW 2017-01-27 10:59:30: pipe exit code: 0 2017-01-27 10:59:30: /bin/su successfully executed 2017-01-27 10:59:30: gpnptool: rc=0 2017-01-27 10:59:30: gpnptool output: Profile signature is valid. 2017-01-27 10:59:30: Profile "/opt/local/grid/gpnp/profiles/peer/profile.xml" signature is VALID for wallet "file:/opt/local/grid/gpnp/wallets/peer" 2017-01-27 10:59:30: gpnptool: run /opt/local/grid/bin/gpnptool verify -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -w="file:/opt/local/grid/gpnp/wallets/prdr" -wu=peer 2017-01-27 10:59:30: Running as user oracle: /opt/local/grid/bin/gpnptool verify -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -w="file:/opt/local/grid/gpnp/wallets/prdr" -wu=peer 2017-01-27 10:59:30: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/gpnptool verify -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -w="file:/opt/local/grid/gpnp/wallets/prdr" -wu=peer ' 2017-01-27 10:59:30: Removing file /tmp/fileCEh3tU 2017-01-27 10:59:30: Successfully removed file: /tmp/fileCEh3tU 2017-01-27 10:59:30: pipe exit code: 0 2017-01-27 10:59:30: /bin/su successfully executed 2017-01-27 10:59:30: gpnptool: rc=0 2017-01-27 10:59:30: gpnptool output: Profile signature is valid. 2017-01-27 10:59:30: Profile "/opt/local/grid/gpnp/profiles/peer/profile.xml" signature is VALID for wallet "file:/opt/local/grid/gpnp/wallets/prdr" 2017-01-27 10:59:30: chk gpnphome /opt/local/grid/gpnp: OK 2017-01-27 10:59:30: gpnptool: run /opt/local/grid/bin/gpnptool getpval -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -o="/tmp/filels0pHS" -prf_cn -prf_cid -prf_sq -prf_pa 2017-01-27 10:59:30: Running as user oracle: /opt/local/grid/bin/gpnptool getpval -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -o="/tmp/filels0pHS" -prf_cn -prf_cid -prf_sq -prf_pa 2017-01-27 10:59:30: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/gpnptool getpval -p="/opt/local/grid/gpnp/profiles/peer/profile.xml" -o="/tmp/filels0pHS" -prf_cn -prf_cid -prf_sq -prf_pa ' 2017-01-27 10:59:30: Removing file /tmp/file76KQUQ 2017-01-27 10:59:30: Successfully removed file: /tmp/file76KQUQ 2017-01-27 10:59:30: pipe exit code: 0 2017-01-27 10:59:30: /bin/su successfully executed 2017-01-27 10:59:30: gpnptool: rc=0 2017-01-27 10:59:30: gpnptool output: 2017-01-27 10:59:30: Removing file /tmp/filels0pHS 2017-01-27 10:59:30: Successfully removed file: /tmp/filels0pHS 2017-01-27 10:59:30: setting profile permissions 2017-01-27 10:59:30: Checking for stale GPnP wallet locks. [node-local=0] 2017-01-27 10:59:30: creating new /opt/local/grid/gpnp/wallets/peer/cwallet.sso.lck 2017-01-27 10:59:30: creating new /opt/local/grid/gpnp/wallets/prdr/cwallet.sso.lck 2017-01-27 10:59:30: creating new /opt/local/grid/gpnp/wallets/pa/cwallet.sso.lck 2017-01-27 10:59:30: GPnP wallet locks cleaned. [node-local=0] 2017-01-27 10:59:30: resfiles are /opt/local/grid/gpnp/wallets/root/ewallet.p12 /opt/local/grid/gpnp/wallets/peer/cwallet.sso /opt/local/grid/gpnp/wallets/prdr/cwallet.sso /opt/local/grid/gpnp/wallets/pa/cwallet.sso /opt/local/grid/gpnp/wallets/peer/cwallet.sso.lck /opt/local/grid/gpnp/wallets/pa/cwallet.sso.lck /opt/local/grid/gpnp/wallets/prdr/cwallet.sso.lck 2017-01-27 10:59:30: GPnP Wallets ownership/permissions successfully set. [node-local=0] 2017-01-27 10:59:30: gpnp setup checked: local valid? 0 cluster-wide valid? 1 2017-01-27 10:59:30: Taking cluster-wide setup as local 2017-01-27 10:59:30: copy "/opt/local/grid/gpnp/profiles/peer/profile.xml" => "/opt/local/grid/gpnp/nodeii/profiles/peer/profile.xml" 2017-01-27 10:59:30: set ownership on "/opt/local/grid/gpnp/nodeii/profiles/peer/profile.xml" => (oracle,oinstall) 2017-01-27 10:59:30: copy "/opt/local/grid/gpnp/wallets/peer/cwallet.sso" => "/opt/local/grid/gpnp/nodeii/wallets/peer/cwallet.sso" 2017-01-27 10:59:30: set ownership on "/opt/local/grid/gpnp/nodeii/wallets/peer/cwallet.sso" => (oracle,oinstall) 2017-01-27 10:59:30: copy "/opt/local/grid/gpnp/wallets/prdr/cwallet.sso" => "/opt/local/grid/gpnp/nodeii/wallets/prdr/cwallet.sso" 2017-01-27 10:59:30: set ownership on "/opt/local/grid/gpnp/nodeii/wallets/prdr/cwallet.sso" => (oracle,oinstall) 2017-01-27 10:59:30: copy "/opt/local/grid/gpnp/profiles/peer/profile_orig.xml" => "/opt/local/grid/gpnp/nodeii/profiles/peer/profile_orig.xml" 2017-01-27 10:59:30: set ownership on "/opt/local/grid/gpnp/nodeii/profiles/peer/profile_orig.xml" => (oracle,oinstall) 2017-01-27 10:59:30: copy "/opt/local/grid/gpnp/wallets/root/ewallet.p12" => "/opt/local/grid/gpnp/nodeii/wallets/root/ewallet.p12" 2017-01-27 10:59:30: set ownership on "/opt/local/grid/gpnp/nodeii/wallets/root/ewallet.p12" => (oracle,oinstall) 2017-01-27 10:59:30: copy "/opt/local/grid/gpnp/wallets/pa/cwallet.sso" => "/opt/local/grid/gpnp/nodeii/wallets/pa/cwallet.sso" 2017-01-27 10:59:30: set ownership on "/opt/local/grid/gpnp/nodeii/wallets/pa/cwallet.sso" => (oracle,oinstall) 2017-01-27 10:59:30: /opt/local/grid/gpnp/wallets/root/b64certificate.txt ? -f failed 2017-01-27 10:59:30: /opt/local/grid/gpnp/wallets/peer/cert.txt ? -f failed 2017-01-27 10:59:30: /opt/local/grid/gpnp/wallets/pa/cert.txt ? -f failed 2017-01-27 10:59:30: Checking for stale GPnP wallet locks. [node-local=1] 2017-01-27 10:59:30: creating new /opt/local/grid/gpnp/nodeii/wallets/peer/cwallet.sso.lck 2017-01-27 10:59:30: creating new /opt/local/grid/gpnp/nodeii/wallets/prdr/cwallet.sso.lck 2017-01-27 10:59:30: creating new /opt/local/grid/gpnp/nodeii/wallets/pa/cwallet.sso.lck 2017-01-27 10:59:30: GPnP wallet locks cleaned. [node-local=1] 2017-01-27 10:59:30: resfiles are /opt/local/grid/gpnp/nodeii/wallets/root/ewallet.p12 /opt/local/grid/gpnp/nodeii/wallets/peer/cwallet.sso /opt/local/grid/gpnp/nodeii/wallets/prdr/cwallet.sso /opt/local/grid/gpnp/nodeii/wallets/pa/cwallet.sso /opt/local/grid/gpnp/nodeii/wallets/peer/cwallet.sso.lck /opt/local/grid/gpnp/nodeii/wallets/pa/cwallet.sso.lck /opt/local/grid/gpnp/nodeii/wallets/prdr/cwallet.sso.lck 2017-01-27 10:59:30: GPnP Wallets ownership/permissions successfully set. [node-local=1] 2017-01-27 10:59:30: gpnp setup: GOTCLUSTERWIDE 2017-01-27 10:59:30: Executing cmd: /opt/local/grid/bin/crsctl query crs releaseversion 2017-01-27 10:59:30: Command output: > Oracle High Availability Services release version on the local node is [12.1.0.2.0] >End Command output 2017-01-27 10:59:30: Version String passed is: [Oracle High Availability Services release version on the local node is [12.1.0.2.0]] 2017-01-27 10:59:30: Version Info returned is : [12.1.0.2.0] 2017-01-27 10:59:30: Got CRS release version: 12.1.0.2.0 2017-01-27 10:59:30: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status" 2017-01-27 10:59:30: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil4.log 2017-01-27 10:59:30: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status 2017-01-27 10:59:30: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status ' 2017-01-27 10:59:30: Removing file /tmp/fileFDTiDP 2017-01-27 10:59:30: Successfully removed file: /tmp/fileFDTiDP 2017-01-27 10:59:30: pipe exit code: 0 2017-01-27 10:59:30: /bin/su successfully executed 2017-01-27 10:59:30: The 'ROOTCRS_STACK' is either in START/FAILED state 2017-01-27 10:59:30: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OLR 2017-01-27 10:59:30: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OLR" 2017-01-27 10:59:30: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil5.log 2017-01-27 10:59:30: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OLR 2017-01-27 10:59:30: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OLR ' 2017-01-27 10:59:31: Removing file /tmp/fileS3PkcQ 2017-01-27 10:59:31: Successfully removed file: /tmp/fileS3PkcQ 2017-01-27 10:59:31: pipe exit code: 0 2017-01-27 10:59:31: /bin/su successfully executed 2017-01-27 10:59:31: checkpoint ROOTCRS_OLR does not exist 2017-01-27 10:59:31: Initializing OLR now.. 2017-01-27 10:59:31: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state START" 2017-01-27 10:59:31: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil6.log 2017-01-27 10:59:31: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state START 2017-01-27 10:59:31: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state START ' 2017-01-27 10:59:32: Removing file /tmp/fileLm7cAS 2017-01-27 10:59:32: Successfully removed file: /tmp/fileLm7cAS 2017-01-27 10:59:32: pipe exit code: 0 2017-01-27 10:59:32: /bin/su successfully executed 2017-01-27 10:59:32: Succeeded in writing the checkpoint:'ROOTCRS_OLR' with status:START 2017-01-27 10:59:32: Install node: nodei 2017-01-27 10:59:32: Current first node: nodei 2017-01-27 10:59:32: OCR locations: /opt/nfsshare/storage/ocr1,/opt/nfsshare/storage/ocr2,/opt/nfsshare/storage/ocr3 2017-01-27 10:59:32: Oracle CRS home = /opt/local/grid 2017-01-27 10:59:32: Oracle cluster name = test-cluster 2017-01-27 10:59:32: OCR locations = /opt/nfsshare/storage/ocr1,/opt/nfsshare/storage/ocr2,/opt/nfsshare/storage/ocr3 2017-01-27 10:59:32: Validating OCR 2017-01-27 10:59:32: Retrieving OCR location used by previous installations 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value () is set for key=ocrconfig_loc 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value () is set for key=ocrmirrorconfig_loc 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value () is set for key=ocrconfig_loc3 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value () is set for key=ocrconfig_loc4 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value () is set for key=ocrconfig_loc5 2017-01-27 10:59:32: Checking if OCR sync file exists 2017-01-27 10:59:32: No need to sync OCR file 2017-01-27 10:59:32: OCR_LOCATION=/opt/nfsshare/storage/ocr1 2017-01-27 10:59:32: OCR_MIRROR_LOCATION=/opt/nfsshare/storage/ocr2 2017-01-27 10:59:32: OCR_MIRROR_LOC3=/opt/nfsshare/storage/ocr3 2017-01-27 10:59:32: OCR_MIRROR_LOC4= 2017-01-27 10:59:32: OCR_MIRROR_LOC5= 2017-01-27 10:59:32: Current OCR location= 2017-01-27 10:59:32: Current OCR mirror location= 2017-01-27 10:59:32: Current OCR mirror loc3= 2017-01-27 10:59:32: Current OCR mirror loc4= 2017-01-27 10:59:32: Current OCR mirror loc5= 2017-01-27 10:59:32: Verifying current OCR settings with user entered values 2017-01-27 10:59:32: Setting OCR locations in /etc/oracle/ocr.loc 2017-01-27 10:59:32: Validating OCR locations in /etc/oracle/ocr.loc 2017-01-27 10:59:32: Checking for existence of /etc/oracle/ocr.loc 2017-01-27 10:59:32: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig 2017-01-27 10:59:32: Setting ocr location /opt/nfsshare/storage/ocr1 2017-01-27 10:59:32: Setting ocr mirror location /opt/nfsshare/storage/ocr2 2017-01-27 10:59:32: Setting ocr location3 /opt/nfsshare/storage/ocr3 2017-01-27 10:59:32: Validating for SI-CSS configuration 2017-01-27 10:59:32: Retrieving OCR main disk location 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value (/opt/nfsshare/storage/ocr1) is set for key=ocrconfig_loc 2017-01-27 10:59:32: Opening file /etc/oracle/ocr.loc 2017-01-27 10:59:32: Value (FALSE) is set for key=local_only 2017-01-27 10:59:32: LOCAL_FLAG = FALSE 2017-01-27 10:59:32: OLR location = /opt/local/grid/cdata/nodeii.olr 2017-01-27 10:59:32: Oracle CRS Home = /opt/local/grid 2017-01-27 10:59:32: Validating /etc/oracle/olr.loc file for OLR location /opt/local/grid/cdata/nodeii.olr 2017-01-27 10:59:32: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.loc to /etc/oracle/olr.loc.orig 2017-01-27 10:59:32: Done setting permissions on file /etc/oracle/olr.loc 2017-01-27 10:59:32: Creating or upgrading Oracle Local Registry (OLR) 2017-01-27 10:59:32: Executing /opt/local/grid/bin/ocrconfig -local -upgrade oracle oinstall 2017-01-27 10:59:32: Executing cmd: /opt/local/grid/bin/ocrconfig -local -upgrade oracle oinstall 2017-01-27 10:59:32: OLR successfully created or upgraded 2017-01-27 10:59:32: /opt/local/grid/bin/clscfg -localadd 2017-01-27 10:59:32: Executing cmd: /opt/local/grid/bin/clscfg -localadd 2017-01-27 10:59:32: Command output: > LOCAL ADD MODE > Creating OCR keys for user 'root', privgrp 'root'.. > Operation successful. >End Command output 2017-01-27 10:59:32: Keys created in the OLR successfully 2017-01-27 10:59:32: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state SUCCESS" 2017-01-27 10:59:32: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil7.log 2017-01-27 10:59:32: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state SUCCESS 2017-01-27 10:59:32: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state SUCCESS ' 2017-01-27 10:59:32: Removing file /tmp/fileOkZKCX 2017-01-27 10:59:33: Successfully removed file: /tmp/fileOkZKCX 2017-01-27 10:59:33: pipe exit code: 0 2017-01-27 10:59:33: /bin/su successfully executed 2017-01-27 10:59:33: Succeeded in writing the checkpoint:'ROOTCRS_OLR' with status:SUCCESS 2017-01-27 10:59:33: Install node: nodei 2017-01-27 10:59:33: Current first node: nodei 2017-01-27 10:59:33: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state SUCCESS" 2017-01-27 10:59:33: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil8.log 2017-01-27 10:59:33: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state SUCCESS 2017-01-27 10:59:33: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OLR -state SUCCESS ' 2017-01-27 10:59:33: Removing file /tmp/file7vFWI4 2017-01-27 10:59:33: Successfully removed file: /tmp/file7vFWI4 2017-01-27 10:59:33: pipe exit code: 0 2017-01-27 10:59:33: /bin/su successfully executed 2017-01-27 10:59:33: Succeeded in writing the checkpoint:'ROOTCRS_OLR' with status:SUCCESS 2017-01-27 10:59:33: Install node: nodei 2017-01-27 10:59:33: Current first node: nodei 2017-01-27 10:59:33: Install node: nodei 2017-01-27 10:59:33: Trying to get the value of key: SYSTEM.rootcrs.checkpoints.firstnode in OCR. 2017-01-27 10:59:33: setting ORAASM_UPGRADE to 1 2017-01-27 10:59:33: Check the existence of key pair with key name: SYSTEM.rootcrs.checkpoints.firstnode in OCR. 2017-01-27 10:59:33: setting ORAASM_UPGRADE to 1 2017-01-27 10:59:33: Invoking "/opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode" 2017-01-27 10:59:33: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil9.log 2017-01-27 10:59:33: Running as user oracle: /opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode 2017-01-27 10:59:33: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode ' 2017-01-27 10:59:34: Removing file /tmp/file1n3cQd 2017-01-27 10:59:34: Successfully removed file: /tmp/file1n3cQd 2017-01-27 10:59:34: pipe exit code: 256 2017-01-27 10:59:34: /bin/su exited with rc=1 2017-01-27 10:59:34: oracle.ops.mgmt.rawdevice.OCRException: PROC-32: Cluster Ready Services on the local node is not running Messaging error [gipcretConnectionRefused] [29] 2017-01-27 10:59:34: Cannot get OCR key with CLUUTIL, try using OCRDUMP. 2017-01-27 10:59:34: Check OCR key using ocrdump 2017-01-27 10:59:34: ocrdump output: [SYSTEM.rootcrs.checkpoints.firstnode] ORATEXT : SUCCESS SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_ALL_ACCESS, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root} 2017-01-27 10:59:34: The key pair with key name: SYSTEM.rootcrs.checkpoints.firstnode exists in OCR. 2017-01-27 10:59:34: Invoking "/opt/local/grid/bin/cluutil -exec -ocrgetval -key checkpoints.firstnode" 2017-01-27 10:59:34: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil10.log 2017-01-27 10:59:34: Running as user oracle: /opt/local/grid/bin/cluutil -exec -ocrgetval -key checkpoints.firstnode 2017-01-27 10:59:34: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -exec -ocrgetval -key checkpoints.firstnode ' 2017-01-27 10:59:34: Removing file /tmp/file0tPgyo 2017-01-27 10:59:34: Successfully removed file: /tmp/file0tPgyo 2017-01-27 10:59:34: pipe exit code: 256 2017-01-27 10:59:34: /bin/su exited with rc=1 2017-01-27 10:59:34: getOcrValue output: 2017-01-27 10:59:34: oracle.ops.mgmt.rawdevice.OCRException: PROC-32: Cluster Ready Services on the local node is not running Messaging error [gipcretConnectionRefused] [29] 2017-01-27 10:59:34: Cannot get OCR key with CLUUTIL, try using OCRDUMP. 2017-01-27 10:59:34: Get OCR key value using ocrdump 2017-01-27 10:59:34: ocrdump output: [SYSTEM.rootcrs.checkpoints.firstnode] ORATEXT : SUCCESS SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_ALL_ACCESS, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root} 2017-01-27 10:59:34: Key is: SYSTEM.rootcrs.checkpoints.firstnode 2017-01-27 10:59:34: Value is: SUCCESS 2017-01-27 10:59:34: Checking a remote host nodei for reachability... 2017-01-27 10:59:34: Resetting cluutil_trc_suff_pp to 0 2017-01-27 10:59:34: Invoking "/opt/local/grid/bin/cluutil -exec -nodealive -node nodei" 2017-01-27 10:59:34: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil0.log 2017-01-27 10:59:34: Running as user oracle: /opt/local/grid/bin/cluutil -exec -nodealive -node nodei 2017-01-27 10:59:34: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -exec -nodealive -node nodei ' 2017-01-27 10:59:35: Removing file /tmp/fileVVp5QA 2017-01-27 10:59:35: Successfully removed file: /tmp/fileVVp5QA 2017-01-27 10:59:35: pipe exit code: 0 2017-01-27 10:59:35: /bin/su successfully executed 2017-01-27 10:59:35: nodei is ALIVE 2017-01-27 10:59:35: Install node: nodei 2017-01-27 10:59:35: Current first node: nodei 2017-01-27 10:59:35: Start to check whether the '-first' and '-force' options are correctly supplied. 2017-01-27 10:59:35: Current Node: nodeii; Current First Node: nodei; Is Installer Node Alive: 1; '-force' Option Supplied: ; Is Upgrade: ; '-first' Option Supplied: ; Is First Node Ckpt Success: 1; Is Installer Node: . 2017-01-27 10:59:35: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_AFDINST 2017-01-27 10:59:35: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_AFDINST" 2017-01-27 10:59:35: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil1.log 2017-01-27 10:59:35: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_AFDINST 2017-01-27 10:59:35: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_AFDINST ' 2017-01-27 10:59:35: Removing file /tmp/filefdeetO 2017-01-27 10:59:35: Successfully removed file: /tmp/filefdeetO 2017-01-27 10:59:35: pipe exit code: 0 2017-01-27 10:59:35: /bin/su successfully executed 2017-01-27 10:59:35: checkpoint ROOTCRS_AFDINST does not exist 2017-01-27 10:59:35: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_AFDINST -state START" 2017-01-27 10:59:35: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil2.log 2017-01-27 10:59:35: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_AFDINST -state START 2017-01-27 10:59:35: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_AFDINST -state START ' 2017-01-27 10:59:36: Removing file /tmp/fileVbwLS3 2017-01-27 10:59:36: Successfully removed file: /tmp/fileVbwLS3 2017-01-27 10:59:36: pipe exit code: 0 2017-01-27 10:59:36: /bin/su successfully executed 2017-01-27 10:59:36: Succeeded in writing the checkpoint:'ROOTCRS_AFDINST' with status:START 2017-01-27 10:59:36: Install node: nodei 2017-01-27 10:59:36: Current first node: nodei 2017-01-27 10:59:36: AFD is not supported on this platform. 2017-01-27 10:59:36: AFD is not supported. 2017-01-27 10:59:36: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_AFDINST -state SUCCESS" 2017-01-27 10:59:36: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil3.log 2017-01-27 10:59:36: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_AFDINST -state SUCCESS 2017-01-27 10:59:36: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_AFDINST -state SUCCESS ' 2017-01-27 10:59:36: Removing file /tmp/fileOTmSfl 2017-01-27 10:59:36: Successfully removed file: /tmp/fileOTmSfl 2017-01-27 10:59:36: pipe exit code: 0 2017-01-27 10:59:36: /bin/su successfully executed 2017-01-27 10:59:36: Succeeded in writing the checkpoint:'ROOTCRS_AFDINST' with status:SUCCESS 2017-01-27 10:59:36: Install node: nodei 2017-01-27 10:59:36: Current first node: nodei 2017-01-27 10:59:36: Getting the node role for nodeii 2017-01-27 10:59:36: Getting the configured node role from the parameter file 2017-01-27 10:59:36: Not found nodeii role in the parameter file 2017-01-27 10:59:36: nodeii role is: hub 2017-01-27 10:59:36: Check if the first node has been successfully configured or upgraded 2017-01-27 10:59:36: Install node: nodei 2017-01-27 10:59:36: Current first node: nodei 2017-01-27 10:59:36: Install node: nodei 2017-01-27 10:59:36: Check the existence of global ckpt 'checkpoints.firstnode' 2017-01-27 10:59:36: setting ORAASM_UPGRADE to 1 2017-01-27 10:59:36: Invoking "/opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode" 2017-01-27 10:59:36: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil4.log 2017-01-27 10:59:36: Running as user oracle: /opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode 2017-01-27 10:59:36: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode ' 2017-01-27 10:59:37: Removing file /tmp/fileKXL2kE 2017-01-27 10:59:37: Successfully removed file: /tmp/fileKXL2kE 2017-01-27 10:59:37: pipe exit code: 256 2017-01-27 10:59:37: /bin/su exited with rc=1 2017-01-27 10:59:37: oracle.ops.mgmt.rawdevice.OCRException: PROC-32: Cluster Ready Services on the local node is not running Messaging error [gipcretConnectionRefused] [29] 2017-01-27 10:59:37: Cannot get OCR key with CLUUTIL, try using OCRDUMP. 2017-01-27 10:59:37: Check OCR key using ocrdump 2017-01-27 10:59:37: ocrdump output: [SYSTEM.rootcrs.checkpoints.firstnode] ORATEXT : SUCCESS SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_ALL_ACCESS, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root} 2017-01-27 10:59:37: The key pair with key name: SYSTEM.rootcrs.checkpoints.firstnode exists in OCR. 2017-01-27 10:59:37: Trying to get the value of key: SYSTEM.rootcrs.checkpoints.firstnode in OCR. 2017-01-27 10:59:37: setting ORAASM_UPGRADE to 1 2017-01-27 10:59:37: Check the existence of key pair with key name: SYSTEM.rootcrs.checkpoints.firstnode in OCR. 2017-01-27 10:59:37: setting ORAASM_UPGRADE to 1 2017-01-27 10:59:37: Invoking "/opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode" 2017-01-27 10:59:37: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil5.log 2017-01-27 10:59:37: Running as user oracle: /opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode 2017-01-27 10:59:37: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -exec -keyexists -key checkpoints.firstnode ' 2017-01-27 10:59:37: Removing file /tmp/fileRMwgBY 2017-01-27 10:59:37: Successfully removed file: /tmp/fileRMwgBY 2017-01-27 10:59:37: pipe exit code: 256 2017-01-27 10:59:37: /bin/su exited with rc=1 2017-01-27 10:59:37: oracle.ops.mgmt.rawdevice.OCRException: PROC-32: Cluster Ready Services on the local node is not running Messaging error [gipcretConnectionRefused] [29] 2017-01-27 10:59:37: Cannot get OCR key with CLUUTIL, try using OCRDUMP. 2017-01-27 10:59:37: Check OCR key using ocrdump 2017-01-27 10:59:37: ocrdump output: [SYSTEM.rootcrs.checkpoints.firstnode] ORATEXT : SUCCESS SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_ALL_ACCESS, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root} 2017-01-27 10:59:37: The key pair with key name: SYSTEM.rootcrs.checkpoints.firstnode exists in OCR. 2017-01-27 10:59:37: Invoking "/opt/local/grid/bin/cluutil -exec -ocrgetval -key checkpoints.firstnode" 2017-01-27 10:59:37: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil6.log 2017-01-27 10:59:37: Running as user oracle: /opt/local/grid/bin/cluutil -exec -ocrgetval -key checkpoints.firstnode 2017-01-27 10:59:37: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -exec -ocrgetval -key checkpoints.firstnode ' 2017-01-27 10:59:37: Removing file /tmp/filehX4uUj 2017-01-27 10:59:37: Successfully removed file: /tmp/filehX4uUj 2017-01-27 10:59:37: pipe exit code: 256 2017-01-27 10:59:37: /bin/su exited with rc=1 2017-01-27 10:59:37: getOcrValue output: 2017-01-27 10:59:37: oracle.ops.mgmt.rawdevice.OCRException: PROC-32: Cluster Ready Services on the local node is not running Messaging error [gipcretConnectionRefused] [29] 2017-01-27 10:59:37: Cannot get OCR key with CLUUTIL, try using OCRDUMP. 2017-01-27 10:59:37: Get OCR key value using ocrdump 2017-01-27 10:59:37: ocrdump output: [SYSTEM.rootcrs.checkpoints.firstnode] ORATEXT : SUCCESS SECURITY : {USER_PERMISSION : PROCR_ALL_ACCESS, GROUP_PERMISSION : PROCR_ALL_ACCESS, OTHER_PERMISSION : PROCR_READ, USER_NAME : root, GROUP_NAME : root} 2017-01-27 10:59:37: Key is: SYSTEM.rootcrs.checkpoints.firstnode 2017-01-27 10:59:37: Value is: SUCCESS 2017-01-27 10:59:37: Global ckpt 'checkpoints.firstnode' state: SUCCESS 2017-01-27 10:59:37: The first node has been successfully configured or upgraded 2017-01-27 10:59:37: Executing /opt/local/grid/bin/crsctl create scr oracle 2017-01-27 10:59:37: Executing cmd: /opt/local/grid/bin/crsctl create scr oracle 2017-01-27 10:59:37: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_GPNPSETUP 2017-01-27 10:59:37: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_GPNPSETUP" 2017-01-27 10:59:37: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil7.log 2017-01-27 10:59:37: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_GPNPSETUP 2017-01-27 10:59:37: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_GPNPSETUP ' 2017-01-27 10:59:38: Removing file /tmp/filesUGEOG 2017-01-27 10:59:38: Successfully removed file: /tmp/filesUGEOG 2017-01-27 10:59:38: pipe exit code: 0 2017-01-27 10:59:38: /bin/su successfully executed 2017-01-27 10:59:38: checkpoint ROOTCRS_GPNPSETUP does not exist 2017-01-27 10:59:38: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_GPNPSETUP -state START" 2017-01-27 10:59:38: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil8.log 2017-01-27 10:59:38: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_GPNPSETUP -state START 2017-01-27 10:59:38: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_GPNPSETUP -state START ' 2017-01-27 10:59:39: Removing file /tmp/fileesF1x5 2017-01-27 10:59:39: Successfully removed file: /tmp/fileesF1x5 2017-01-27 10:59:39: pipe exit code: 0 2017-01-27 10:59:39: /bin/su successfully executed 2017-01-27 10:59:39: Succeeded in writing the checkpoint:'ROOTCRS_GPNPSETUP' with status:START 2017-01-27 10:59:39: Install node: nodei 2017-01-27 10:59:39: Current first node: nodei 2017-01-27 10:59:39: GPnP setup state: new-cluster-wide 2017-01-27 10:59:39: GPnP cluster configuration already performed 2017-01-27 10:59:39: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_GPNPSETUP -state SUCCESS" 2017-01-27 10:59:39: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil9.log 2017-01-27 10:59:39: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_GPNPSETUP -state SUCCESS 2017-01-27 10:59:39: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_GPNPSETUP -state SUCCESS ' 2017-01-27 10:59:39: Removing file /tmp/file5DiEkw 2017-01-27 10:59:39: Successfully removed file: /tmp/file5DiEkw 2017-01-27 10:59:39: pipe exit code: 0 2017-01-27 10:59:39: /bin/su successfully executed 2017-01-27 10:59:39: Succeeded in writing the checkpoint:'ROOTCRS_GPNPSETUP' with status:SUCCESS 2017-01-27 10:59:39: Install node: nodei 2017-01-27 10:59:39: Current first node: nodei 2017-01-27 10:59:39: Pin process list is osysmond.bin,ologgerd,ocssd.bin,cssdmonitor,cssdagent,mdb_pmon_-MGMTDB,kswapd0 2017-01-27 10:59:39: Cluster Health Monitor repository location updated with default 2017-01-27 10:59:39: Cluster Health Monitor pin process list updated with osysmond.bin,ologgerd,ocssd.bin,cssdmonitor,cssdagent,mdb_pmon_-MGMTDB,kswapd0 2017-01-27 10:59:39: Creating CHM/OS config file /opt/local/grid/crf/admin/crfnodeii.ora 2017-01-27 10:59:39: Deleting older CHM/OS repository at 2017-01-27 10:59:39: copy "/tmp/w3uVq1D7n_" => "/opt/local/grid/crf/admin/crfnodeii.ora" 2017-01-27 10:59:39: Check and delete older IPD/OS installation 2017-01-27 10:59:39: INFO: The OS Tool is not installed at /usr/lib/oracrf. 2017-01-27 10:59:39: Registering ohasd 2017-01-27 10:59:39: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OHASD 2017-01-27 10:59:39: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OHASD" 2017-01-27 10:59:39: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil10.log 2017-01-27 10:59:39: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OHASD 2017-01-27 10:59:39: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_OHASD ' 2017-01-27 10:59:40: Removing file /tmp/filej1JecZ 2017-01-27 10:59:40: Successfully removed file: /tmp/filej1JecZ 2017-01-27 10:59:40: pipe exit code: 0 2017-01-27 10:59:40: /bin/su successfully executed 2017-01-27 10:59:40: checkpoint ROOTCRS_OHASD does not exist 2017-01-27 10:59:40: Resetting cluutil_trc_suff_pp to 0 2017-01-27 10:59:40: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OHASD -state START" 2017-01-27 10:59:40: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil0.log 2017-01-27 10:59:40: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OHASD -state START 2017-01-27 10:59:40: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OHASD -state START ' 2017-01-27 10:59:40: Removing file /tmp/fileyu9sLt 2017-01-27 10:59:40: Successfully removed file: /tmp/fileyu9sLt 2017-01-27 10:59:40: pipe exit code: 0 2017-01-27 10:59:40: /bin/su successfully executed 2017-01-27 10:59:40: Succeeded in writing the checkpoint:'ROOTCRS_OHASD' with status:START 2017-01-27 10:59:40: Install node: nodei 2017-01-27 10:59:40: Current first node: nodei 2017-01-27 10:59:40: Executing cmd: /bin/rpm -q sles-release 2017-01-27 10:59:41: Command output: > package sles-release is not installed >End Command output 2017-01-27 10:59:41: init file = /opt/local/grid/crs/init/init.ohasd 2017-01-27 10:59:41: Copying file /opt/local/grid/crs/init/init.ohasd to /etc/init.d directory 2017-01-27 10:59:41: Setting init.ohasd permission in /etc/init.d directory 2017-01-27 10:59:41: init file = /opt/local/grid/crs/init/ohasd 2017-01-27 10:59:41: Copying file /opt/local/grid/crs/init/ohasd to /etc/init.d directory 2017-01-27 10:59:41: Setting ohasd permission in /etc/init.d directory 2017-01-27 10:59:41: Executing cmd: /bin/rpm -q sles-release 2017-01-27 10:59:41: Command output: > package sles-release is not installed >End Command output 2017-01-27 10:59:41: Removing "/etc/rc.d/rc3.d/S96ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc3.d/S96ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc3.d/S96ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc3.d/S96ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: Removing "/etc/rc.d/rc5.d/S96ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc5.d/S96ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc5.d/S96ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc5.d/S96ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: Removing "/etc/rc.d/rc0.d/K15ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc0.d/K15ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc0.d/K15ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc0.d/K15ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: Removing "/etc/rc.d/rc1.d/K15ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc1.d/K15ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc1.d/K15ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc1.d/K15ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: Removing "/etc/rc.d/rc2.d/K15ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc2.d/K15ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc2.d/K15ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc2.d/K15ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: Removing "/etc/rc.d/rc4.d/K15ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc4.d/K15ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc4.d/K15ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc4.d/K15ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: Removing "/etc/rc.d/rc6.d/K15ohasd" 2017-01-27 10:59:41: Removing file /etc/rc.d/rc6.d/K15ohasd 2017-01-27 10:59:41: Successfully removed file: /etc/rc.d/rc6.d/K15ohasd 2017-01-27 10:59:41: Creating a link "/etc/rc.d/rc6.d/K15ohasd" pointing to /etc/init.d/ohasd 2017-01-27 10:59:41: The file ohasd has been successfully linked to the RC directories 2017-01-27 10:59:41: Executing cmd: /bin/rpm -q sles-release 2017-01-27 10:59:41: Command output: > package sles-release is not installed >End Command output 2017-01-27 10:59:41: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OHASD -state SUCCESS" 2017-01-27 10:59:41: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil1.log 2017-01-27 10:59:41: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OHASD -state SUCCESS 2017-01-27 10:59:41: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_OHASD -state SUCCESS ' 2017-01-27 10:59:41: Removing file /tmp/fileajT3G0 2017-01-27 10:59:41: Successfully removed file: /tmp/fileajT3G0 2017-01-27 10:59:41: pipe exit code: 0 2017-01-27 10:59:41: /bin/su successfully executed 2017-01-27 10:59:41: Succeeded in writing the checkpoint:'ROOTCRS_OHASD' with status:SUCCESS 2017-01-27 10:59:41: Install node: nodei 2017-01-27 10:59:41: Current first node: nodei 2017-01-27 10:59:41: ohasd is now registered 2017-01-27 10:59:41: Starting ohasd 2017-01-27 10:59:41: Checking the status of ohasd 2017-01-27 10:59:41: Configured CRS Home: /opt/local/grid 2017-01-27 10:59:41: Executing cmd: /opt/local/grid/bin/crsctl check has 2017-01-27 10:59:41: Checking the status of ohasd 2017-01-27 10:59:46: Executing cmd: /opt/local/grid/bin/crsctl check has 2017-01-27 10:59:46: Checking the status of ohasd 2017-01-27 10:59:51: Executing cmd: /opt/local/grid/bin/crsctl check has 2017-01-27 10:59:51: Checking the status of ohasd 2017-01-27 10:59:56: ohasd is not already running.. will start it now 2017-01-27 10:59:56: Check if the startup mechanism upstart is being used 2017-01-27 10:59:56: Executing cmd: /bin/rpm -qf /sbin/init 2017-01-27 10:59:57: Command output: > systemd-219-19.el7.x86_64 >End Command output 2017-01-27 10:59:57: Not a Linux OS or expected startup method 2017-01-27 10:59:57: Check if the startup mechanism systemd is being used 2017-01-27 10:59:57: Executing cmd: /bin/rpm -qf /sbin/init 2017-01-27 10:59:57: Command output: > systemd-219-19.el7.x86_64 >End Command output 2017-01-27 10:59:57: This is a Linux Systemd environment 2017-01-27 10:59:57: INIT file: oracle-ohasd.service 2017-01-27 10:59:57: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 330 "oracle-ohasd.service" 2017-01-27 10:59:57: Command output: > CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' >End Command output 2017-01-27 10:59:57: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 330 "oracle-ohasd.service" 2017-01-27 10:59:57: Command output: > CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' >End Command output 2017-01-27 10:59:57: CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service' 2017-01-27 10:59:57: itab entries=cssd|evmd|crsd|ohasd 2017-01-27 10:59:57: remove systemd conf for services: [cssd evmd crsd ohasd] 2017-01-27 10:59:57: attempt to deconfigure oracle-cssd.service 2017-01-27 10:59:57: Executing cmd: /usr/bin/systemctl status oracle-cssd.service 2017-01-27 10:59:57: Command output: > ● oracle-cssd.service > Loaded: not-found (Reason: No such file or directory) > Active: inactive (dead) >End Command output 2017-01-27 10:59:57: The unit oracle-cssd.service may not be installed 2017-01-27 10:59:57: isRunning: 0; isEnabled: 0 2017-01-27 10:59:57: remove service file: /etc/systemd/system/oracle-cssd.service 2017-01-27 10:59:57: attempt to deconfigure oracle-evmd.service 2017-01-27 10:59:57: Executing cmd: /usr/bin/systemctl status oracle-evmd.service 2017-01-27 10:59:57: Command output: > ● oracle-evmd.service > Loaded: not-found (Reason: No such file or directory) > Active: inactive (dead) >End Command output 2017-01-27 10:59:57: The unit oracle-evmd.service may not be installed 2017-01-27 10:59:57: isRunning: 0; isEnabled: 0 2017-01-27 10:59:57: remove service file: /etc/systemd/system/oracle-evmd.service 2017-01-27 10:59:57: attempt to deconfigure oracle-crsd.service 2017-01-27 10:59:57: Executing cmd: /usr/bin/systemctl status oracle-crsd.service 2017-01-27 10:59:57: Command output: > ● oracle-crsd.service > Loaded: not-found (Reason: No such file or directory) > Active: inactive (dead) >End Command output 2017-01-27 10:59:57: The unit oracle-crsd.service may not be installed 2017-01-27 10:59:57: isRunning: 0; isEnabled: 0 2017-01-27 10:59:57: remove service file: /etc/systemd/system/oracle-crsd.service 2017-01-27 10:59:57: attempt to deconfigure oracle-ohasd.service 2017-01-27 10:59:57: Executing cmd: /usr/bin/systemctl status oracle-ohasd.service 2017-01-27 10:59:57: Command output: > ● oracle-ohasd.service - Oracle High Availability Services > Loaded: loaded (/etc/systemd/system/oracle-ohasd.service; enabled; vendor preset: disabled) > Active: active (running) since Thu 2017-01-26 11:04:06 EST; 23h ago > Main PID: 2117 (init.ohasd) > CGroup: /system.slice/oracle-ohasd.service > ├─ 2117 /bin/sh /etc/init.d/init.ohasd run >/dev/null 2>&1 └─107218 /bin/sleep 10 > > Jan 26 11:04:06 nodeii.example.net systemd[1]: Started Oracle High Availability Services. > Jan 26 11:04:06 nodeii.example.net systemd[1]: Starting Oracle High Availability Services... > Jan 26 11:04:07 nodeii.example.net logger[2154]: Starting execution of Oracle Clusterware init.ohasd > Jan 26 11:04:07 nodeii.example.net init.ohasd[2117]: /etc/init.d/init.ohasd: line 193: ulimit: %CRS_LIMIT_OPENFILE%: invalid number >End Command output 2017-01-27 10:59:57: isRunning: 1; isEnabled: 1 2017-01-27 10:59:57: Executing cmd: /usr/bin/systemctl stop oracle-ohasd.service 2017-01-27 10:59:57: Executing cmd: /usr/bin/systemctl disable oracle-ohasd.service 2017-01-27 10:59:57: Command output: > Removed symlink /etc/systemd/system/multi-user.target.wants/oracle-ohasd.service. > Removed symlink /etc/systemd/system/graphical.target.wants/oracle-ohasd.service. >End Command output 2017-01-27 10:59:57: remove service file: /etc/systemd/system/oracle-ohasd.service 2017-01-27 10:59:57: Removing file /etc/systemd/system/oracle-ohasd.service 2017-01-27 10:59:57: Successfully removed file: /etc/systemd/system/oracle-ohasd.service 2017-01-27 11:00:02: SYSTEMD: Copying /opt/local/grid/crs/install/oracle-ohasd.service to /etc/systemd/system/oracle-ohasd.service 2017-01-27 11:00:02: Executing cmd: /usr/bin/systemctl daemon-reload 2017-01-27 11:00:03: Executing cmd: /usr/bin/systemctl enable oracle-ohasd.service 2017-01-27 11:00:03: Command output: > Created symlink from /etc/systemd/system/multi-user.target.wants/oracle-ohasd.service to /etc/systemd/system/oracle-ohasd.service. > Created symlink from /etc/systemd/system/graphical.target.wants/oracle-ohasd.service to /etc/systemd/system/oracle-ohasd.service. >End Command output 2017-01-27 11:00:03: Executing cmd: /usr/bin/systemctl start oracle-ohasd.service 2017-01-27 11:00:04: Executing cmd: /opt/local/grid/bin/crsctl start has 2017-01-27 11:00:09: Command output: > CRS-4123: Oracle High Availability Services has been started. >End Command output 2017-01-27 11:00:09: Executing /etc/init.d/ohasd install 2017-01-27 11:00:09: Executing cmd: /etc/init.d/ohasd install 2017-01-27 11:00:09: ohasd is starting 2017-01-27 11:00:09: Started service 'ohasd' 2017-01-27 11:00:09: Checking the status of ohasd 2017-01-27 11:00:09: Configured CRS Home: /opt/local/grid 2017-01-27 11:00:09: Executing cmd: /opt/local/grid/bin/crsctl check has 2017-01-27 11:00:09: ohasd started successfully 2017-01-27 11:00:09: Creating OHASD resources and dependencies 2017-01-27 11:00:09: Configuring HASD 2017-01-27 11:00:09: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_INITRES 2017-01-27 11:00:09: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_INITRES" 2017-01-27 11:00:09: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil2.log 2017-01-27 11:00:09: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_INITRES 2017-01-27 11:00:09: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_INITRES ' 2017-01-27 11:00:10: Removing file /tmp/file6yNI6Y 2017-01-27 11:00:10: Successfully removed file: /tmp/file6yNI6Y 2017-01-27 11:00:10: pipe exit code: 0 2017-01-27 11:00:10: /bin/su successfully executed 2017-01-27 11:00:10: checkpoint ROOTCRS_INITRES does not exist 2017-01-27 11:00:10: The checkpoint 'ROOTCRS_INITRES' does not exist 2017-01-27 11:00:10: Check if OHASD resource types have been registered 2017-01-27 11:00:10: Executing cmd: /opt/local/grid/bin/crsctl stat type -init 2017-01-27 11:00:10: Command output: > TYPE_NAME=application > BASE_TYPE=cluster_resource > > TYPE_NAME=cluster_resource > BASE_TYPE=resource > > TYPE_NAME=generic_application > BASE_TYPE=cluster_resource > > TYPE_NAME=local_resource > BASE_TYPE=resource > > TYPE_NAME=resource > BASE_TYPE= > >End Command output 2017-01-27 11:00:10: Not found any registered resource type 2017-01-27 11:00:10: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_INITRES -state START" 2017-01-27 11:00:10: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil3.log 2017-01-27 11:00:10: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_INITRES -state START 2017-01-27 11:00:10: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_INITRES -state START ' 2017-01-27 11:00:10: Removing file /tmp/filezZzJLZ 2017-01-27 11:00:10: Successfully removed file: /tmp/filezZzJLZ 2017-01-27 11:00:10: pipe exit code: 0 2017-01-27 11:00:10: /bin/su successfully executed 2017-01-27 11:00:10: Succeeded in writing the checkpoint:'ROOTCRS_INITRES' with status:START 2017-01-27 11:00:10: Install node: nodei 2017-01-27 11:00:10: Current first node: nodei 2017-01-27 11:00:10: AFD is not supported on this platform. 2017-01-27 11:00:10: Registering resource type 'ora.ohasdbase.type' 2017-01-27 11:00:10: Executing /opt/local/grid/bin/crsctl add type ora.ohasdbase.type -basetype cluster_resource -file /opt/local/grid/log/nodeii/ohasd/ora.ohasdbase.type -init 2017-01-27 11:00:10: Executing cmd: /opt/local/grid/bin/crsctl add type ora.ohasdbase.type -basetype cluster_resource -file /opt/local/grid/log/nodeii/ohasd/ora.ohasdbase.type -init 2017-01-27 11:00:10: Type 'ora.ohasdbase.type' added successfully 2017-01-27 11:00:10: Registering resource type 'ora.daemon.type' 2017-01-27 11:00:10: Executing /opt/local/grid/bin/crsctl add type ora.daemon.type -basetype ora.ohasdbase.type -file /opt/local/grid/log/nodeii/ohasd/ora.daemon.type -init 2017-01-27 11:00:10: Executing cmd: /opt/local/grid/bin/crsctl add type ora.daemon.type -basetype ora.ohasdbase.type -file /opt/local/grid/log/nodeii/ohasd/ora.daemon.type -init 2017-01-27 11:00:11: Type 'ora.daemon.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.storage.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.storage.type -basetype ora.ohasdbase.type -file /opt/local/grid/log/nodeii/ohasd/ora.storage.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.storage.type -basetype ora.ohasdbase.type -file /opt/local/grid/log/nodeii/ohasd/ora.storage.type -init 2017-01-27 11:00:11: Type 'ora.storage.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.haip.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.haip.type -basetype cluster_resource -file /opt/local/grid/log/nodeii/ohasd/ora.haip.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.haip.type -basetype cluster_resource -file /opt/local/grid/log/nodeii/ohasd/ora.haip.type -init 2017-01-27 11:00:11: Type 'ora.haip.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.evm.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.evm.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.evm.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.evm.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.evm.type -init 2017-01-27 11:00:11: Type 'ora.evm.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.mdns.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.mdns.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.mdns.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.mdns.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.mdns.type -init 2017-01-27 11:00:11: Type 'ora.mdns.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.gpnp.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.gpnp.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.gpnp.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.gpnp.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.gpnp.type -init 2017-01-27 11:00:11: Type 'ora.gpnp.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.gipc.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.gipc.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.gipc.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.gipc.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.gipc.type -init 2017-01-27 11:00:11: Type 'ora.gipc.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.cssd.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.cssd.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.cssd.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.cssd.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.cssd.type -init 2017-01-27 11:00:11: Type 'ora.cssd.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.cssdmonitor.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.cssdmonitor.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.cssdmonitor.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.cssdmonitor.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.cssdmonitor.type -init 2017-01-27 11:00:11: Type 'ora.cssdmonitor.type' added successfully 2017-01-27 11:00:11: Registering resource type 'ora.crs.type' 2017-01-27 11:00:11: Executing /opt/local/grid/bin/crsctl add type ora.crs.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.crs.type -init 2017-01-27 11:00:11: Executing cmd: /opt/local/grid/bin/crsctl add type ora.crs.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.crs.type -init 2017-01-27 11:00:12: Type 'ora.crs.type' added successfully 2017-01-27 11:00:12: Registering resource type 'ora.ctss.type' 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add type ora.ctss.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.ctss.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add type ora.ctss.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.ctss.type -init 2017-01-27 11:00:12: Type 'ora.ctss.type' added successfully 2017-01-27 11:00:12: Registering resource type 'ora.crf.type' 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add type ora.crf.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.crf.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add type ora.crf.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.crf.type -init 2017-01-27 11:00:12: Type 'ora.crf.type' added successfully 2017-01-27 11:00:12: Registering resource type 'ora.asm.type' 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add type ora.asm.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.asm.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add type ora.asm.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.asm.type -init 2017-01-27 11:00:12: Type 'ora.asm.type' added successfully 2017-01-27 11:00:12: Registering resource type 'ora.drivers.acfs.type' 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add type ora.drivers.acfs.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.drivers.acfs.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add type ora.drivers.acfs.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.drivers.acfs.type -init 2017-01-27 11:00:12: Type 'ora.drivers.acfs.type' added successfully 2017-01-27 11:00:12: Registering resource type 'ora.oka.type' 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add type ora.oka.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.oka.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add type ora.oka.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.oka.type -init 2017-01-27 11:00:12: Type 'ora.oka.type' added successfully 2017-01-27 11:00:12: Registering resource type 'ora.diskmon.type' 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add type ora.diskmon.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.diskmon.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add type ora.diskmon.type -basetype ora.daemon.type -file /opt/local/grid/log/nodeii/ohasd/ora.diskmon.type -init 2017-01-27 11:00:12: Type 'ora.diskmon.type' added successfully 2017-01-27 11:00:12: AFD is not supported on this platform. 2017-01-27 11:00:12: AFD is not supported on this platform. 2017-01-27 11:00:12: add 'ora.mdnsd' ... 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add resource ora.mdnsd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.mdns.type -init 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.mdnsd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.mdns.type -init 2017-01-27 11:00:12: Succesfully executed action: add, for resource ora.mdnsd 2017-01-27 11:00:12: add 'ora.gpnpd' ... 2017-01-27 11:00:12: Executing /opt/local/grid/bin/crsctl add resource ora.gpnpd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.gpnp.type -init -f 2017-01-27 11:00:12: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.gpnpd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.gpnp.type -init -f 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.gpnpd 2017-01-27 11:00:13: add 'ora.gipcd' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.gipcd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.gipc.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.gipcd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.gipc.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.gipcd 2017-01-27 11:00:13: add 'ora.diskmon' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.diskmon -attr " USR_ORA_ENV=ORACLE_USER=oracle,START_DEPENDENCIES='weak(concurrent:ora.cssd)pullup:always(ora.cssd)',ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.diskmon.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.diskmon -attr " USR_ORA_ENV=ORACLE_USER=oracle,START_DEPENDENCIES='weak(concurrent:ora.cssd)pullup:always(ora.cssd)',ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.diskmon.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.diskmon 2017-01-27 11:00:13: add 'ora.cssdmonitor' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.cssdmonitor -attr " CSS_USER=oracle,ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.cssdmonitor.type -init -f 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.cssdmonitor -attr " CSS_USER=oracle,ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.cssdmonitor.type -init -f 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.cssdmonitor 2017-01-27 11:00:13: add 'ora.cssd' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.cssd -attr " CSS_USER=oracle,ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x',AUTO_START=always,START_DEPENDENCIES='weak(concurrent:ora.diskmon)hard(ora.cssdmonitor,ora.gpnpd,ora.gipcd)pullup(ora.gpnpd,ora.gipcd)',STOP_DEPENDENCIES='hard(intermediate:ora.gipcd,shutdown:ora.diskmon,intermediate:ora.cssdmonitor)' " -type ora.cssd.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.cssd -attr " CSS_USER=oracle,ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x',AUTO_START=always,START_DEPENDENCIES='weak(concurrent:ora.diskmon)hard(ora.cssdmonitor,ora.gpnpd,ora.gipcd)pullup(ora.gpnpd,ora.gipcd)',STOP_DEPENDENCIES='hard(intermediate:ora.gipcd,shutdown:ora.diskmon,intermediate:ora.cssdmonitor)' " -type ora.cssd.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.cssd 2017-01-27 11:00:13: add 'ora.evmd' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.evmd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.evm.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.evmd -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx' " -type ora.evm.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.evmd 2017-01-27 11:00:13: add 'ora.ctssd' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.ctssd -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.ctss.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.ctssd -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.ctss.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.ctssd 2017-01-27 11:00:13: add 'ora.cluster_interconnect.haip' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.cluster_interconnect.haip -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.haip.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.cluster_interconnect.haip -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.haip.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.cluster_interconnect.haip 2017-01-27 11:00:13: add 'ora.crf' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.crf -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.crf.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.crf -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.crf.type -init 2017-01-27 11:00:13: Succesfully executed action: add, for resource ora.crf 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add category ora.hub.category -init -attr "ACTIVE_CSS_ROLE=hub" 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add category ora.hub.category -init -attr "ACTIVE_CSS_ROLE=hub" 2017-01-27 11:00:13: add 'ora.asm' ... 2017-01-27 11:00:13: Executing /opt/local/grid/bin/crsctl add resource ora.asm -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx',ACTIONS='CRSDASM_START,user:oracle',START_DEPENDENCIES='hard(ora.cssd,ora.cluster_interconnect.haip,ora.ctssd)pullup(ora.cssd,ora.cluster_interconnect.haip,ora.ctssd)weak(ora.drivers.acfs)',STOP_DEPENDENCIES='hard(intermediate:ora.cssd,shutdown:ora.cluster_interconnect.haip)' " -type ora.asm.type -init 2017-01-27 11:00:13: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.asm -attr " ACL='owner:oracle:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:rwx',ACTIONS='CRSDASM_START,user:oracle',START_DEPENDENCIES='hard(ora.cssd,ora.cluster_interconnect.haip,ora.ctssd)pullup(ora.cssd,ora.cluster_interconnect.haip,ora.ctssd)weak(ora.drivers.acfs)',STOP_DEPENDENCIES='hard(intermediate:ora.cssd,shutdown:ora.cluster_interconnect.haip)' " -type ora.asm.type -init 2017-01-27 11:00:14: Succesfully executed action: add, for resource ora.asm 2017-01-27 11:00:14: add 'ora.storage' ... 2017-01-27 11:00:14: Executing /opt/local/grid/bin/crsctl add resource ora.storage -attr " ACL='owner:root:rw-,pgrp:oinstall:r--,other::r--,user:oracle:r-x',ACTIONS='set_usr_cred,user:root,group:oinstall vol_create,user:oracle vol_delete,user:oracle' " -type ora.storage.type -init 2017-01-27 11:00:14: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.storage -attr " ACL='owner:root:rw-,pgrp:oinstall:r--,other::r--,user:oracle:r-x',ACTIONS='set_usr_cred,user:root,group:oinstall vol_create,user:oracle vol_delete,user:oracle' " -type ora.storage.type -init 2017-01-27 11:00:14: Succesfully executed action: add, for resource ora.storage 2017-01-27 11:00:14: add 'ora.crsd' ... 2017-01-27 11:00:14: Executing /opt/local/grid/bin/crsctl add resource ora.crsd -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.crs.type -init 2017-01-27 11:00:14: Executing cmd: /opt/local/grid/bin/crsctl add resource ora.crsd -attr " ACL='owner:root:rw-,pgrp:oinstall:rw-,other::r--,user:oracle:r-x' " -type ora.crs.type -init 2017-01-27 11:00:14: Succesfully executed action: add, for resource ora.crsd 2017-01-27 11:00:14: Executing cmd: /opt/local/grid/bin/okadriverstate supported 2017-01-27 11:00:14: Command output: > OKA-620: OKA is not supported on this operating system version: 'unknown' > OKA-9201: Not Supported >End Command output 2017-01-27 11:00:14: OKA is not supported 2017-01-27 11:00:14: OKA is not supported on this platform. 2017-01-27 11:00:14: Executing cmd: /opt/local/grid/bin/okadriverstate supported 2017-01-27 11:00:14: Command output: > OKA-620: OKA is not supported on this operating system version: 'unknown' > OKA-9201: Not Supported >End Command output 2017-01-27 11:00:14: OKA is not supported 2017-01-27 11:00:14: OKA is not supported on this platform. 2017-01-27 11:00:14: Executing cmd: /opt/local/grid/bin/acfsdriverstate supported 2017-01-27 11:00:15: Command output: > ACFS-9459: ADVM/ACFS is not supported on this OS version: 'unknown' > ACFS-9201: Not Supported >End Command output 2017-01-27 11:00:15: acfs is not supported 2017-01-27 11:00:15: AFD is not supported on this platform. 2017-01-27 11:00:15: No need to set the role for the local node in a regular cluster 2017-01-27 11:00:15: Successfully set the role for the local node 2017-01-27 11:00:15: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_INITRES -state SUCCESS" 2017-01-27 11:00:15: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil4.log 2017-01-27 11:00:15: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_INITRES -state SUCCESS 2017-01-27 11:00:15: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_INITRES -state SUCCESS ' 2017-01-27 11:00:15: Removing file /tmp/filedZ5Leg 2017-01-27 11:00:15: Successfully removed file: /tmp/filedZ5Leg 2017-01-27 11:00:15: pipe exit code: 0 2017-01-27 11:00:15: /bin/su successfully executed 2017-01-27 11:00:15: Succeeded in writing the checkpoint:'ROOTCRS_INITRES' with status:SUCCESS 2017-01-27 11:00:15: Install node: nodei 2017-01-27 11:00:15: Current first node: nodei 2017-01-27 11:00:15: Successfully created OHASD resources for cluster and ASM 2017-01-27 11:00:15: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST 2017-01-27 11:00:15: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST" 2017-01-27 11:00:15: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil5.log 2017-01-27 11:00:15: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST 2017-01-27 11:00:15: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST ' 2017-01-27 11:00:15: Removing file /tmp/filetp80Tx 2017-01-27 11:00:15: Successfully removed file: /tmp/filetp80Tx 2017-01-27 11:00:15: pipe exit code: 0 2017-01-27 11:00:15: /bin/su successfully executed 2017-01-27 11:00:15: checkpoint ROOTCRS_ACFSINST does not exist 2017-01-27 11:00:15: Writing checkpoint for USM driver install 2017-01-27 11:00:15: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_ACFSINST -state START" 2017-01-27 11:00:15: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil6.log 2017-01-27 11:00:15: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_ACFSINST -state START 2017-01-27 11:00:15: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_ACFSINST -state START ' 2017-01-27 11:00:15: Removing file /tmp/filehpWzeQ 2017-01-27 11:00:15: Successfully removed file: /tmp/filehpWzeQ 2017-01-27 11:00:15: pipe exit code: 0 2017-01-27 11:00:15: /bin/su successfully executed 2017-01-27 11:00:15: Succeeded in writing the checkpoint:'ROOTCRS_ACFSINST' with status:START 2017-01-27 11:00:15: Install node: nodei 2017-01-27 11:00:15: Current first node: nodei 2017-01-27 11:00:15: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST -status" 2017-01-27 11:00:15: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil7.log 2017-01-27 11:00:15: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST -status 2017-01-27 11:00:15: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_ACFSINST -status ' 2017-01-27 11:00:16: Removing file /tmp/fileRs8Zi9 2017-01-27 11:00:16: Successfully removed file: /tmp/fileRs8Zi9 2017-01-27 11:00:16: pipe exit code: 0 2017-01-27 11:00:16: /bin/su successfully executed 2017-01-27 11:00:16: The 'ROOTCRS_ACFSINST' is either in START/FAILED state 2017-01-27 11:00:16: Attempt to bounce ohasd 2017-01-27 11:00:16: Executing cmd: /opt/local/grid/bin/crsctl stop crs -f 2017-01-27 11:00:16: Command output: > CRS-4133: Oracle High Availability Services has been stopped. >End Command output 2017-01-27 11:00:16: The return value of stop of CRS: 0 2017-01-27 11:00:16: Executing cmd: /opt/local/grid/bin/crsctl check crs 2017-01-27 11:00:16: Command output: > CRS-4639: Could not contact Oracle High Availability Services >End Command output 2017-01-27 11:00:16: Oracle CRS stack has been shut down 2017-01-27 11:00:16: Executing cmd: /opt/local/grid/bin/crsctl start crs -noautostart 2017-01-27 11:00:31: Command output: > CRS-4123: Oracle High Availability Services has been started. >End Command output 2017-01-27 11:00:31: Return value of start of CRS with '-noautostart': 0 2017-01-27 11:00:31: Executing cmd: /opt/local/grid/bin/crsctl check has 2017-01-27 11:00:31: Command output: > CRS-4638: Oracle High Availability Services is online >End Command output 2017-01-27 11:00:31: Oracle High Availability Services is online 2017-01-27 11:00:31: Executing cmd: /opt/local/grid/bin/acfsdriverstate supported 2017-01-27 11:00:32: Command output: > ACFS-9459: ADVM/ACFS is not supported on this OS version: 'unknown' > ACFS-9201: Not Supported >End Command output 2017-01-27 11:00:32: acfs is not supported 2017-01-27 11:00:32: Skipping ACFS install: It is not supported on this OS/patch level 2017-01-27 11:00:32: ACFS drivers installation completed 2017-01-27 11:00:32: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_ACFSINST -state SUCCESS" 2017-01-27 11:00:32: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil8.log 2017-01-27 11:00:32: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_ACFSINST -state SUCCESS 2017-01-27 11:00:32: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_ACFSINST -state SUCCESS ' 2017-01-27 11:00:32: Removing file /tmp/filejsrpjh 2017-01-27 11:00:32: Successfully removed file: /tmp/filejsrpjh 2017-01-27 11:00:32: pipe exit code: 0 2017-01-27 11:00:32: /bin/su successfully executed 2017-01-27 11:00:32: Succeeded in writing the checkpoint:'ROOTCRS_ACFSINST' with status:SUCCESS 2017-01-27 11:00:32: Install node: nodei 2017-01-27 11:00:32: Current first node: nodei 2017-01-27 11:00:32: Executing cmd: /opt/local/grid/bin/okadriverstate supported 2017-01-27 11:00:32: Command output: > OKA-620: OKA is not supported on this operating system version: 'unknown' > OKA-9201: Not Supported >End Command output 2017-01-27 11:00:32: OKA is not supported 2017-01-27 11:00:32: OKA is not supported on this platform. 2017-01-27 11:00:32: Executing cmd: /opt/local/grid/bin/crsctl stop crs -f 2017-01-27 11:00:33: Command output: > CRS-4133: Oracle High Availability Services has been stopped. >End Command output 2017-01-27 11:00:33: The return value of stop of CRS: 0 2017-01-27 11:00:33: Executing cmd: /opt/local/grid/bin/crsctl check crs 2017-01-27 11:00:33: Command output: > CRS-4639: Could not contact Oracle High Availability Services >End Command output 2017-01-27 11:00:33: Oracle CRS stack has been shut down 2017-01-27 11:00:33: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_BOOTCFG 2017-01-27 11:00:33: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_BOOTCFG" 2017-01-27 11:00:33: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil9.log 2017-01-27 11:00:33: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_BOOTCFG 2017-01-27 11:00:33: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_BOOTCFG ' 2017-01-27 11:00:33: Removing file /tmp/filexJ82Bs 2017-01-27 11:00:33: Successfully removed file: /tmp/filexJ82Bs 2017-01-27 11:00:33: pipe exit code: 0 2017-01-27 11:00:33: /bin/su successfully executed 2017-01-27 11:00:33: checkpoint ROOTCRS_BOOTCFG does not exist 2017-01-27 11:00:33: Checking if initial configuration has been performed 2017-01-27 11:00:33: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_BOOTCFG -state START" 2017-01-27 11:00:33: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil10.log 2017-01-27 11:00:33: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_BOOTCFG -state START 2017-01-27 11:00:33: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_BOOTCFG -state START ' 2017-01-27 11:00:34: Removing file /tmp/fileK00RpF 2017-01-27 11:00:34: Successfully removed file: /tmp/fileK00RpF 2017-01-27 11:00:34: pipe exit code: 0 2017-01-27 11:00:34: /bin/su successfully executed 2017-01-27 11:00:34: Succeeded in writing the checkpoint:'ROOTCRS_BOOTCFG' with status:START 2017-01-27 11:00:34: Install node: nodei 2017-01-27 11:00:34: Current first node: nodei 2017-01-27 11:00:34: Executing cmd: /opt/local/grid/bin/crsctl start crs -noautostart 2017-01-27 11:00:44: Command output: > CRS-4123: Oracle High Availability Services has been started. >End Command output 2017-01-27 11:00:44: Return value of start of CRS with '-noautostart': 0 2017-01-27 11:00:44: Executing cmd: /opt/local/grid/bin/crsctl check has 2017-01-27 11:00:44: Command output: > CRS-4638: Oracle High Availability Services is online >End Command output 2017-01-27 11:00:44: Oracle High Availability Services is online 2017-01-27 11:00:44: Install node: nodei 2017-01-27 11:00:44: Current first node: nodei 2017-01-27 11:00:44: ret=0; localNode=nodeii; firstNode=nodei 2017-01-27 11:00:44: Node nodeii is not the first node to configure, hence do not start CSS in exclusive mode 2017-01-27 11:00:44: ASM_CONFIG value: 2017-01-27 11:00:44: ASM_CONFIG is legacy 2017-01-27 11:00:44: Executing cmd: /opt/local/grid/bin/crsctl stop crs -f 2017-01-27 11:00:44: Command output: > CRS-4133: Oracle High Availability Services has been stopped. >End Command output 2017-01-27 11:00:44: The return value of stop of CRS: 0 2017-01-27 11:00:44: Executing cmd: /opt/local/grid/bin/crsctl check crs 2017-01-27 11:00:44: Command output: > CRS-4639: Could not contact Oracle High Availability Services >End Command output 2017-01-27 11:00:44: Oracle CRS stack has been shut down 2017-01-27 11:00:44: Resetting cluutil_trc_suff_pp to 0 2017-01-27 11:00:44: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_BOOTCFG -state SUCCESS" 2017-01-27 11:00:44: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil0.log 2017-01-27 11:00:44: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_BOOTCFG -state SUCCESS 2017-01-27 11:00:44: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_BOOTCFG -state SUCCESS ' 2017-01-27 11:00:45: Removing file /tmp/fileUOrasq 2017-01-27 11:00:45: Successfully removed file: /tmp/fileUOrasq 2017-01-27 11:00:45: pipe exit code: 0 2017-01-27 11:00:45: /bin/su successfully executed 2017-01-27 11:00:45: Succeeded in writing the checkpoint:'ROOTCRS_BOOTCFG' with status:SUCCESS 2017-01-27 11:00:45: Install node: nodei 2017-01-27 11:00:45: Current first node: nodei 2017-01-27 11:00:45: Startup level is 11 2017-01-27 11:00:45: Attempt to start the whole CRS stack 2017-01-27 11:00:45: Executing cmd: /opt/local/grid/bin/crsctl start crs -wait 2017-01-27 11:02:38: Command output: > CRS-4123: Starting Oracle High Availability Services-managed resources > CRS-2672: Attempting to start 'ora.mdnsd' on 'nodeii' > CRS-2672: Attempting to start 'ora.evmd' on 'nodeii' > CRS-2676: Start of 'ora.evmd' on 'nodeii' succeeded > CRS-2676: Start of 'ora.mdnsd' on 'nodeii' succeeded > CRS-2672: Attempting to start 'ora.gpnpd' on 'nodeii' > CRS-2676: Start of 'ora.gpnpd' on 'nodeii' succeeded > CRS-2672: Attempting to start 'ora.gipcd' on 'nodeii' > CRS-2676: Start of 'ora.gipcd' on 'nodeii' succeeded > CRS-2672: Attempting to start 'ora.cssdmonitor' on 'nodeii' > CRS-2676: Start of 'ora.cssdmonitor' on 'nodeii' succeeded > CRS-2672: Attempting to start 'ora.cssd' on 'nodeii' > CRS-2672: Attempting to start 'ora.diskmon' on 'nodeii' > CRS-2676: Start of 'ora.diskmon' on 'nodeii' succeeded > CRS-2676: Start of 'ora.cssd' on 'nodeii' succeeded > CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'nodeii' > CRS-2672: Attempting to start 'ora.ctssd' on 'nodeii' > CRS-2672: Attempting to start 'ora.storage' on 'nodeii' > CRS-2676: Start of 'ora.storage' on 'nodeii' succeeded > CRS-2883: Resource 'ora.ctssd' failed during Clusterware stack start. > CRS-4406: Oracle High Availability Services synchronous start failed. > CRS-4000: Command Start failed, or completed with errors. >End Command output 2017-01-27 11:02:38: The return value of blocking start of CRS: 1 2017-01-27 11:02:38: Failed to start the Oracle CRS stack 2017-01-27 11:02:38: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 117 2017-01-27 11:02:38: Command output: > CLSRSC-117: Failed to start Oracle Clusterware stack >End Command output 2017-01-27 11:02:38: Executing cmd: /opt/local/grid/bin/clsecho -p has -f clsrsc -m 117 2017-01-27 11:02:38: Command output: > CLSRSC-117: Failed to start Oracle Clusterware stack >End Command output 2017-01-27 11:02:38: CLSRSC-117: Failed to start Oracle Clusterware stack 2017-01-27 11:02:38: ###### Begin DIE Stack Trace ###### 2017-01-27 11:02:38: Package File Line Calling 2017-01-27 11:02:38: --------------- -------------------- ---- ---------- 2017-01-27 11:02:38: 1: main rootcrs.pl 267 crsutils::dietrap 2017-01-27 11:02:38: 2: crsinstall crsinstall.pm 914 main::__ANON__ 2017-01-27 11:02:38: 3: crsinstall crsinstall.pm 842 crsinstall::start_cluster 2017-01-27 11:02:38: 4: crsinstall crsinstall.pm 359 crsinstall::prepare_to_start_clusterware 2017-01-27 11:02:38: 5: crsinstall crsinstall.pm 288 crsinstall::CRSInstall 2017-01-27 11:02:38: 6: main rootcrs.pl 410 crsinstall::new 2017-01-27 11:02:38: ####### End DIE Stack Trace ####### 2017-01-27 11:02:38: ROOTCRS_STACK checkpoint has failed 2017-01-27 11:02:38: ckpt: -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK 2017-01-27 11:02:38: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK" 2017-01-27 11:02:38: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil1.log 2017-01-27 11:02:38: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK 2017-01-27 11:02:38: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK ' 2017-01-27 11:02:39: Removing file /tmp/filehBhY11 2017-01-27 11:02:39: Successfully removed file: /tmp/filehBhY11 2017-01-27 11:02:39: pipe exit code: 0 2017-01-27 11:02:39: /bin/su successfully executed 2017-01-27 11:02:39: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status" 2017-01-27 11:02:39: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil2.log 2017-01-27 11:02:39: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status 2017-01-27 11:02:39: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -chkckpt -name ROOTCRS_STACK -status ' 2017-01-27 11:02:39: Removing file /tmp/fileXkeNHF 2017-01-27 11:02:39: Successfully removed file: /tmp/fileXkeNHF 2017-01-27 11:02:39: pipe exit code: 0 2017-01-27 11:02:39: /bin/su successfully executed 2017-01-27 11:02:39: The 'ROOTCRS_STACK' status is START 2017-01-27 11:02:39: ROOTCRS_STACK state is START 2017-01-27 11:02:39: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state FAIL" 2017-01-27 11:02:39: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil3.log 2017-01-27 11:02:39: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state FAIL 2017-01-27 11:02:39: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state FAIL ' 2017-01-27 11:02:40: Removing file /tmp/fileWYY66j 2017-01-27 11:02:40: Successfully removed file: /tmp/fileWYY66j 2017-01-27 11:02:40: pipe exit code: 0 2017-01-27 11:02:40: /bin/su successfully executed 2017-01-27 11:02:40: Succeeded in writing the checkpoint:'ROOTCRS_STACK' with status:FAIL 2017-01-27 11:02:40: Install node: nodei 2017-01-27 11:02:40: Current first node: nodei 2017-01-27 11:02:40: Invoking "/opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state FAIL" 2017-01-27 11:02:40: trace file=/opt/local/oracle/crsdata/nodeii/crsconfig/cluutil4.log 2017-01-27 11:02:40: Running as user oracle: /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state FAIL 2017-01-27 11:02:40: s_run_as_user2: Running /bin/su oracle -c ' echo CLSRSC_START; /opt/local/grid/bin/cluutil -ckpt -oraclebase /opt/local/oracle -writeckpt -name ROOTCRS_STACK -state FAIL ' 2017-01-27 11:02:40: Removing file /tmp/filex3P4kZ 2017-01-27 11:02:40: Successfully removed file: /tmp/filex3P4kZ 2017-01-27 11:02:40: pipe exit code: 0 2017-01-27 11:02:40: /bin/su successfully executed 2017-01-27 11:02:40: Succeeded in writing the checkpoint:'ROOTCRS_STACK' with status:FAIL 2017-01-27 11:02:40: Install node: nodei 2017-01-27 11:02:40: Current first node: nodei