AIX reboot with CRS ???

From: <erikw_nl_at_yahoo.com>
Date: 31 May 2006 00:05:13 -0700
Message-ID: <1149059113.891473.130900@h76g2000cwa.googlegroups.com>

Hi,

We have an Oracle RAC cluster on AIX 5.3 ML3, with Oracle RAC 10GR (10.2.0).

Due to a misconfiguration of the stack_hard parameter in /etc/securitylimits, crsd could not respawn and generated core dumps. The errorlog of the AIX system looks as follows:

B6267342   0530113306 P H hdisk20        DISK OPERATION ERROR
A6DF45AA   0530113206 I O RMCdaemon      The daemon is started.
2BFA76F6   0530112806 T S SYSPROC        SYSTEM SHUTDOWN BY USER
9DBCFDEE   0530113106 T O errdemon       ERROR LOGGING TURNED ON
A63BEB70   0530112306 P S SYSPROC        SOFTWARE PROGRAM ABNORMALLY
TERMINATED
A63BEB70   0529155106 P S SYSPROC        SOFTWARE PROGRAM ABNORMALLY
TERMINATED
A63BEB70   0529154306 P S SYSPROC        SOFTWARE PROGRAM ABNORMALLY
TERMINATED
A63BEB70   0529150006 P S SYSPROC        SOFTWARE PROGRAM ABNORMALLY

TERMINATED The reboot at 0530112806 can not be explained, since nobody was logged in at that time (output of last command proves this). We also do not think somebody issued the reboot with remote command execution. So we think the reboot is initiated by a program.

Does anybody have a clue what could have happened here ?, can crsd initiate a reboot ?. We know that cssd generates a system dump when it gets unhappy for some reason, but reboots we did not have before. The Oracle DBA claims not to have seen anything in the logging of crsd.

All input is very much appreciated. Thanks in advance.

Erik Received on Wed May 31 2006 - 02:05:13 CDT