From oracle-l-bounce@freelists.org Mon Aug 8 07:53:51 2005 Return-Path: Received: from air891.startdedicated.com (root@localhost) by orafaq.com (8.12.10/8.12.10) with ESMTP id j78Croav022418 for ; Mon, 8 Aug 2005 07:53:50 -0500 X-ClientAddr: 206.53.239.180 Received: from turing.freelists.org (freelists-180.iquest.net [206.53.239.180]) by air891.startdedicated.com (8.12.10/8.12.10) with ESMTP id j78CrmIP022403 for ; Mon, 8 Aug 2005 07:53:48 -0500 Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 9CA3B1DD36B; Mon, 8 Aug 2005 07:53:45 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 15410-04; Mon, 8 Aug 2005 07:53:45 -0500 (EST) Received: from turing (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 140471DD353; Mon, 8 Aug 2005 07:53:45 -0500 (EST) X-MimeOLE: Produced By Microsoft Exchange V6.5.7226.0 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by Ecartis Subject: RE: OCFS2 Date: Mon, 8 Aug 2005 14:51:19 +0200 Message-ID: <445F36B0271AE1419CEE0B9589044B433747E3@TYGRRA01-XCS00.telkom.co.za> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: OCFS2 Thread-Index: AcWcFVPNPNhldHSqSVma3X8UOS5APwAAOLqn From: "Billy Verreynne (JW)" To: "Oracle Discussion List" X-OriginalArrivalTime: 08 Aug 2005 12:51:19.0612 (UTC) FILETIME=[DF661FC0:01C59C17] X-archive-position: 23534 X-ecartis-version: Ecartis v1.0.0 Sender: oracle-l-bounce@freelists.org Errors-To: oracle-l-bounce@freelists.org X-original-sender: VerreyB@telkom.co.za Precedence: normal Reply-To: VerreyB@telkom.co.za X-list: oracle-l X-Virus-Scanned: by amavisd-new-20030616-p9 (Debian) at avenirtech.net X-mailscan-MailScanner-Information: Please contact the ISP for more information X-mailscan-MailScanner: Found to be clean X-MailScanner-From: oracle-l-bounce@freelists.org X-Spam-Level: X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on air891.startdedicated.com X-Spam-Status: No, hits=-4.9 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=2.63 Raj wrote: > Just curious. What version of PowerPath were you using? PowerPath > 4.3.2 with RHEL 3.0 U4 and OCFS 1.0.14 or ASM has been fairly stable. Powerpath Version 4.3.2 (build 11) on 2.4.21-27.ELsmp kernels. EMC stated to us that they do not certify ASMlib with Powerpath. We were not the 1st customer to run into this brick wall. Pity they did not tell us that up-front when I installed and configured the cluster. Anyway, symptoms are actual I/O errors and the RAC instances reading corrupted data blocks. No actual corruption on the SAN side. Non destructive solution was to disable ASMlib and reconfigure the ASMlib devices as raw devices and change the ASM instances' discovery string. No changes were required on the RAC instances side and database was still intact after the change. Note that Oracle also says that this config works (note:309815.1). But I can confirm (with 2 TARs filed) it does not with the specific versions of Linux, Powerpath and ASMlib we have. In case you're wondering, reason for the older kernel version is the Interconnect hardware we're using. Configured as a 10Gbit ethernet backbone (can go up to 30Gbit). Very nice, very fast, and pretty cheap. Also allows memory and other resources to be shared among cluster nodes. However, Infiniband was bought out by Cisco and now we're waiting for Cisco to provide the TopSwitch/Infiniband kernel drivers for the latest Linux kernels. -- Billy ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ This e-mail and its contents are subject to the Telkom SA Limited e-mail legal notice available at http://www.telkom.co.za/TelkomEMailLegalNotice.PDF ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -- http://www.freelists.org/webpage/oracle-l