Re: CPU hogged with endless "FLUSH SLAVE FAILED, AWR ENQUEUE TIMEOUT" messages in alert log

From: Martin Berger <martin.a.berger_at_gmail.com>
Date: Thu, 29 Nov 2012 10:49:33 +0100
Message-ID: <CALH8A93TTFAwsL3f0q9M-zTGxkhqdwXa-imP8UzF7Xu9E-jDXQ_at_mail.gmail.com>



Hi Thomas,
Did you sort out if "FLUSH SLAVE FAILED" and "100% CPU" are in any cause-effect relation or do they just correlate at the same time?

Do you have some records how the 100% CPU where split up in user, system, nice, idle, waiting .... ?
How many CPUs do you have on this node? I'd say it's hard for one process to saturate more than 1 CPU (but I might be wrong in case man processes spinning for a resource)

Regarding the increasing of SGA, are you using huge pages for SGA? How many processes do you have configured, and how many are actually in use?

Martin

On Mon, Nov 26, 2012 at 8:56 AM, Thomas Kellerer <thomas.kellerer_at_mgm-tp.com
> wrote:

> Hello,
>
> an Oracle 10.2.0.5.0 2-node RAC system (Linux) went haywire last week. The
> CPUs of both nodes went to 100% and the message
>
> KEWRAFC: FLUSH SLAVE FAILED, AWR ENQUEUE TIMEOUT
>
> was written to the alert log about every minute.
>
> On Metalink we found two documents describing this problem (Bug 6851176
> and Documet ID 555124.1), but none of the suggested actions did make a
> difference.
> Apart from the CPU the system is idle. I/O is normal and no swapping is
> going on.
>
> One major change that we did on this system was to increase the SGA from
> 2GB to 12GB (because recently other Oracle instances were moved from the
> system to a different system and thus we could use the memory). Both nodes
> have 16GB of physical memory.
>
> The client has opened a ticket with Oracle support but given version
> number we don't expect a reaction soon.
>
> We also tried deleting the saved AWR snapshots and increase the snapshot
> time from 1 hour to 4 hour to reduce the amount of information that is
> written to the AWR tables. Nothing showed a difference.
>
> Can anybody think of other possible workarounds or even a solution to this?
>
> Thanks in advance.
>
> Thomas Kellerer
> --
> http://www.freelists.org/webpage/oracle-l
>
>

--
http://www.freelists.org/webpage/oracle-l
Received on Thu Nov 29 2012 - 10:49:33 CET

Original text of this message