Home » Server Options » RAC & Failsafe » Failure at final check of Oracle CRS stack 10 (RHEL-ES-4, Oracle 10g Clusterware)
Failure at final check of Oracle CRS stack 10 [message #503478] Sat, 16 April 2011 04:08 Go to next message
pradies
Messages: 250
Registered: May 2008
Senior Member
Hi,

I am trying to install Oracle 10g RAC clusterware on RHEL-ES-4 using vmware. everything works properly till the time root.sh on second node.
I am getting the below error.

===========================================
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
Failure at final check of Oracle CRS stack.
10
=============================================

After googling this topic, I found I have to check this first below

==========================================================
This particular case is caused by the OS init system does not working.

" Failure at final check of Oracle CRS stack.
10"
means CRS daemon did not startup during 600 seconds period.

In the root.sh script, it adds CRS related entry in /etc/inittab, run "init q" and expect 3 CRS related daemon processes to start, eg:

init.cssd
init.crsd
init.evmd

With init system problem, none of these daemon processes are spawned, this causes CRS process startup failure as they rely on the CRS daemon processes to start first.

This can be verified by adding a simple entry in /etc/inittab:
test:2:once:/usr/bin/echo "HELLO TEST" > /tmp/test.log

run "init q" as root user. If the init is working, then there should be a file /tmp/test.log generated.
===========================================================

According to above I am not able to generate this file.

Can someone let me know where is the problem and what will be the solution for this.




Regards

Pradeep.

Re: Failure at final check of Oracle CRS stack 10 [message #503490 is a reply to message #503478] Sat, 16 April 2011 07:42 Go to previous messageGo to next message
knight
Messages: 111
Registered: January 2009
Senior Member
any clues in o.s/crs logs?
check for the permissions on raw devices
Re: Failure at final check of Oracle CRS stack 10 [message #503517 is a reply to message #503490] Sun, 17 April 2011 03:25 Go to previous messageGo to next message
babuknb
Messages: 1734
Registered: December 2005
Location: NJ
Senior Member

also CRS version please
Re: Failure at final check of Oracle CRS stack 10 [message #503545 is a reply to message #503517] Sun, 17 April 2011 23:08 Go to previous messageGo to next message
pradies
Messages: 250
Registered: May 2008
Senior Member
Hi,

My Raw devices having below permission. some Doc says that ocr file should have oracle:oinstall ownership and some says that it should be root:oinstall. I m confuse which is right. Permission for OCR Disk is 640.

=================================================
[root@rac2 ~]# ls -ll /dev/raw/
total 0
crw-r----- 1 oracle oinstall 162, 1 Apr 18 08:44 raw1
crw-r----- 1 oracle oinstall 162, 2 Apr 18 08:44 raw2
crw-rw---- 1 oracle dba 162, 3 Apr 18 08:44 raw3
crw-rw---- 1 oracle dba 162, 4 Apr 18 08:44 raw4
crw-rw---- 1 oracle dba 162, 5 Apr 18 08:44 raw5
[root@rac2 ~]# cat /etc/rc.local
#!/bin/sh
#
# This script will be executed *after* all the other init scripts.
# You can put your own initialization stuff in here if you don't
# want to do the full Sys V style init stuff.

touch /var/lock/subsys/local
#OCR Devices
chown oracle:oinstall /dev/raw/raw1
chown oracle:oinstall /dev/raw/raw2
chmod 640 /dev/raw/raw1
chmod 640 /dev/raw/raw2

#Voting Disk Devices
chown oracle:dba /dev/raw/raw3
chown oracle:dba /dev/raw/raw4
chown oracle:dba /dev/raw/raw5

chmod 660 /dev/raw/raw3
chmod 660 /dev/raw/raw4
chmod 660 /dev/raw/raw5

[root@rac2 ~]# cat /etc/sysconfig/rawdevices
# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
# raw device bindings
# format: <rawdev> <major> <minor>
# <rawdev> <blockdev>
# example: /dev/raw/raw1 /dev/sda1
# /dev/raw/raw2 8 5
#OCR Devices
/dev/raw/raw1 /dev/sdb1
/dev/raw/raw2 /dev/sdb2

#Voting Disk Devices
/dev/raw/raw3 /dev/sdc1
/dev/raw/raw4 /dev/sdc2
/dev/raw/raw5 /dev/sdc3

#ASM Disk Devices

[root@rac2 ~]#
========================================================
Alertrac2.log is as follows
========================================================
[root@rac2 rac2]# cat alertrac2.log
2011-04-16 13:35:21.221
[client(8781)]CRS-1006:The OCR location /dev/raw/raw2 is inaccessible. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/client/ocrconfig_8781.log.
2011-04-16 13:35:21.463
[client(8781)]CRS-1001:The OCR was formatted using version 2.
2011-04-16 13:35:49.554
[client(8839)]CRS-1801:Cluster crs configured with nodes rac1 rac2 .
2011-04-16 13:38:05.511
[cssd(9464)]CRS-1605:CSSD voting file is online: /dev/raw/raw4. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 13:38:05.523
[cssd(9464)]CRS-1605:CSSD voting file is online: /dev/raw/raw3. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 13:38:05.528
[cssd(9464)]CRS-1605:CSSD voting file is online: /dev/raw/raw5. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 13:40:40.647
[cssd(10412)]CRS-1605:CSSD voting file is online: /dev/raw/raw3. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 13:40:40.648
[cssd(10412)]CRS-1605:CSSD voting file is online: /dev/raw/raw4. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 13:40:40.648
[cssd(10412)]CRS-1605:CSSD voting file is online: /dev/raw/raw5. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 14:19:23.831
[cssd(19436)]CRS-1605:CSSD voting file is online: /dev/raw/raw3. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 14:19:23.863
[cssd(19436)]CRS-1605:CSSD voting file is online: /dev/raw/raw5. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-16 14:19:23.929
[cssd(19436)]CRS-1605:CSSD voting file is online: /dev/raw/raw4. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-18 08:45:38.691
[cssd(8115)]CRS-1605:CSSD voting file is online: /dev/raw/raw3. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-18 08:45:38.731
[cssd(8115)]CRS-1605:CSSD voting file is online: /dev/raw/raw4. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-18 08:45:38.731
[cssd(8115)]CRS-1605:CSSD voting file is online: /dev/raw/raw5. Details in /u01/crs/oracle/product/10.2.0/crs/log/rac2/cssd/ocssd.log.
2011-04-18 08:45:42.035
[cssd(8115)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac2 .
2011-04-18 08:45:48.089
[cssd(8115)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac1 rac2 .
2011-04-18 08:45:49.671
[evmd(8021)]CRS-1401:EVMD started on node rac2.
2011-04-18 08:45:50.173
[crsd(6788)]CRS-1012:The OCR service started on node rac2.
2011-04-18 08:45:58.145
[crsd(6788)]CRS-1201:CRSD started on node rac2.
[root@rac2 rac2]#
===========================================================

Kindly suggest what else is required and what is the solution for this.


Regards

Pradeep
Re: Failure at final check of Oracle CRS stack 10 [message #503547 is a reply to message #503545] Sun, 17 April 2011 23:51 Go to previous messageGo to next message
pradies
Messages: 250
Registered: May 2008
Senior Member
Hi,

Oracle CRS Version is 10.2.0.



Pradeep
Re: Failure at final check of Oracle CRS stack 10 [message #503550 is a reply to message #503547] Mon, 18 April 2011 00:38 Go to previous messageGo to next message
babuknb
Messages: 1734
Registered: December 2005
Location: NJ
Senior Member

>>Oracle CRS Version is 10.2.0.

Do I need to consider 10.2.0.2 or 10.2.0.3 or 10.2.0.4 ? Don't you know your four digit version?
Re: Failure at final check of Oracle CRS stack 10 [message #503570 is a reply to message #503550] Mon, 18 April 2011 02:16 Go to previous messageGo to next message
pradies
Messages: 250
Registered: May 2008
Senior Member
Hi,

It is 10g Release 2 (10.2) for Linux
Re: Failure at final check of Oracle CRS stack 10 [message #507459 is a reply to message #503570] Sun, 15 May 2011 21:11 Go to previous messageGo to next message
mkounalis
Messages: 147
Registered: October 2009
Location: Dallas, TX
Senior Member
I am pretty sure that OCR is root:oinstall. Also - you are running on VMWARE? I thought support for VMWARE on RAC was only from 11gr2 and on - 10g I don't believe is supported . . . . did that change?
Re: Failure at final check of Oracle CRS stack 10 [message #507508 is a reply to message #507459] Mon, 16 May 2011 07:26 Go to previous message
pradies
Messages: 250
Registered: May 2008
Senior Member
Hi,

Thanks for your support. but I have completed my installation without any error with the same oracle version with same OS release.

Regards

Pradeep
Previous Topic: Oracle 11gR2 - RAC to RAC replication via SAN
Next Topic: ASM and 11G R2 and Voting Disks
Goto Forum:
  


Current Time: Tue Oct 19 23:01:39 CDT 2021