Received: (qmail 1523 invoked from network); 9 Sep 2012 15:52:36 -0500
Received: from freelists-180.iquest.net (HELO turing.freelists.org) (206.53.239.180)
  by static-ip-85-25-126-90.inaddr.ip-pool.com with SMTP; 9 Sep 2012 15:52:33 -0500
Received: from localhost (localhost [127.0.0.1])
 by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 3DDD5EE8701;
 Sun,  9 Sep 2012 16:52:27 -0400 (EDT)
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=freelists.org;
 s=turing; t=1347223947; bh=qV9cwU9EG+g03DKHDe7ZtHABPg7JXvoPRSSoonlC
 GBo=; h=MIME-Version:In-Reply-To:References:From:Date:Message-ID:
	 Subject:To:Cc:Content-type:Content-Transfer-Encoding:Sender:
	 Reply-To:List-help:List-unsubscribe:List-Id:List-subscribe:
	 List-owner:List-post:List-archive; b=Byqt8lz1sJtPjg/4N0oeL7k2riza4
 T4eIauHivsdKBW8G3xHcIXh+SNatuyCt68tEe44fYYIW2h3f82kI2xJIUlbTu/27mrG
 BKtLv1ox9jLeHGAmnt4VhiS+VZ3c1XGQHnp9uDrm2mucfWp986vJZvuzEak6Z0UMQC9
 lcCp+vBg=
X-Virus-Scanned: Debian amavisd-new at localhost.localdomain
Received: from turing.freelists.org ([127.0.0.1])
 by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id otjQOl+aU8EZ; Sun,  9 Sep 2012 16:52:26 -0400 (EDT)
Received: from turing.freelists.org (localhost [127.0.0.1])
 by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 92281EE8489;
 Sun,  9 Sep 2012 16:51:43 -0400 (EDT)
Received: with ECARTIS (v1.0.0; list oracle-l); Sun, 09 Sep 2012 16:51:01 -0400 (EDT)
Received: from localhost (localhost [127.0.0.1])
 by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 9412AEE6FC8
 for <oracle-l@freelists.org>; Sun,  9 Sep 2012 16:51:01 -0400 (EDT)
Authentication-Results: turing.freelists.org; dkim=pass (2048-bit key) header.i=@gmail.com
Received: from turing.freelists.org ([127.0.0.1])
 by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id H0EvHe2v7h7H for <oracle-l@freelists.org>;
 Sun,  9 Sep 2012 16:51:01 -0400 (EDT)
Received: from mail-iy0-f179.google.com (mail-iy0-f179.google.com [209.85.210.179])
 by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 4853DEE6FC5
 for <oracle-l@freelists.org>; Sun,  9 Sep 2012 16:51:01 -0400 (EDT)
Received: by iage36 with SMTP id e36so1015540iag.10
        for <oracle-l@freelists.org>; Sun, 09 Sep 2012 13:51:01 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :cc:content-type;
        bh=lnw9h/3QnJiDYKASp5iT3hpdI28KbIOzvJzqwSE3kWA=;
        b=yIoZHvtn5b7IoXojV18do1nEKCTtlJSRrWpND/7VGCbRDkIvSioMKcs1AncDHWxHvj
         uOVgFX6IkxGm4JWK958brsHUlxuKD6s0MmyuyidnLrIfdxsgsdwuJokHtNt3+NHZaxAB
         35gCDChtzERMYrsaMug5GYGG+2M2Mtl6l9MTJ73/ABNLkkGKN/5766aztR80zkOnqQ5P
         Kl8db7mmhb5ZoDgkUIOt4DpmwYlZEz3AUtnDbW3IRHd8L2riNMNS4Sh2SUlluJTbJ90p
         rbUKoSd6L5sAjOIEl52Gti0X/AFoUgBD7dKyFvv/lyDfYPTXn2Ijb0oc4kem+kLMID9q
         qmPg==
Received: by 10.50.219.161 with SMTP id pp1mr8469498igc.19.1347223861120; Sun,
 09 Sep 2012 13:51:01 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.43.58.135 with HTTP; Sun, 9 Sep 2012 13:50:40 -0700 (PDT)
In-Reply-To: <CAFsgGrx5eiXqG-nC6D_6F5Y0-cAeF+mx4oBeEaB5qXzc+ppCKQ@mail.gmail.com>
References: <CAFsgGrx1CBidGx+KFBPYvhvyqmVGif7vEA8o7sQ3-4kvaPtDYg@mail.gmail.com>
 <CADsdiQjA-Lggrj4LxSYkmyvAo49ii35O+wpwQHMpKQgXBmbK9w@mail.gmail.com> <CAFsgGrx5eiXqG-nC6D_6F5Y0-cAeF+mx4oBeEaB5qXzc+ppCKQ@mail.gmail.com>
From: Martin Berger <martin.a.berger@gmail.com>
Date: Sun, 9 Sep 2012 22:50:40 +0200
Message-ID: <CALH8A90TRc1Q6zVByRyrV6Nz6+MVMUfo5zL0wre9p4apPUKgNA@mail.gmail.com>
Subject: Re: Performance tuning of a system
To: s.cislaghi@gmail.com
Cc: kyle Hailey <kylelf@gmail.com>, Oracle L <oracle-l@freelists.org>
Content-type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-archive-position: 44717
X-ecartis-version: Ecartis v1.0.0
Sender: oracle-l-bounce@freelists.org
Errors-to: oracle-l-bounce@freelists.org
X-original-sender: martin.a.berger@gmail.com
Precedence: normal
Reply-To: martin.a.berger@gmail.com
List-help: <mailto:ecartis@freelists.org?Subject=help>
List-unsubscribe: <oracle-l-request@freelists.org?Subject=unsubscribe>
List-software: Ecartis version 1.0.0
List-Id: oracle-l <oracle-l.freelists.org>
X-List-ID: oracle-l <oracle-l.freelists.org>
List-subscribe: <oracle-l-request@freelists.org?Subject=subscribe>
List-owner: <mailto:steve.adams@ixora.com.au>
List-post: <mailto:oracle-l@freelists.org>
List-archive: <http://www.freelists.org/archives/oracle-l>
X-list: oracle-l

Ste,

do you have any chance to pin down a 'transaction' for sure?
Something like dbms_application_info is setting?

My problem:
* curently we do not know which part of your 'transactions' is slow.
* it's rare and can not be reproduced at will
* a target of 5 sec, and even a 'bad' query of 30 sec is hard to find
in dba_hist_active_session_history - you would need to sample
v$active_session_history manually immediately after the issue raises.

Doug Burns wrote about ASH and AWR sampling can be manipulated:
http://oracledoug.com/serendipity/index.php?/archives/1395-ASH-and-the-psychology-of-Hidden-Parameters.html
But I'd not like to go that way in production without good reason and support.

That's why I come back to identify the bad 'transactions'. If you can
pin those down, it should still give enough samples over some days so
they can be used in statistical methods?

Do you have a tracking table where all 'transactions' - and their
timing is tracked by the application?
If you have, you can create a trigger there and do your own 'flush
v$active_sesion_history into persistent table'

hth,
 Martin


On Sun, Sep 9, 2012 at 6:16 PM, Stefano Cislaghi <s.cislaghi@gmail.com> wrote:
> Hi Kyle,
>
> your queries are very interesting and I will check them ASAP. Anyway I
> gained some more information about the problem.
> The constraint is to have all transactions performed in less than 5
> seconds. Transaction is not a single statement but, from the
> application point of view,
>
> - few selects into the db
> - elaborate data (by appserver)
> - run 2 or 3 store proc
>
> So we know that almost 99% are under 2 sec but sometimes others are
> above 5sec, 20/30sec. DB is not directly incriminated but it's been
> asked to provide, if any, any information for debugging. IMHO I think
> it is quite hard because the 'long' transactions happen everyday in
> totally different time windows; I do not have enough data, even with
> AWR, ecc to say what was happening for instance yesterday at 16:44:56
> sec where a transaction took 33sec instead 2. From the application we
> know that during the long transaction no abnormal load was done on db,
> I mean no abnormal number of transaction in the same second. Disk
> speed? maybe, but how to get the disk queue or any other interesting
> info from the DB?
--
http://www.freelists.org/webpage/oracle-l


