Return-Path: Delivered-To: 2-oracle-l@orafaq.com Received: (qmail 11566 invoked from network); 10 Dec 2007 17:19:20 -0600 Received: from freelists-180.iquest.net (HELO turing.freelists.org) (206.53.239.180) by 69.64.49.119 with SMTP; 10 Dec 2007 17:19:16 -0600 Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 680157D6988; Mon, 10 Dec 2007 18:19:15 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 06544-01-22; Mon, 10 Dec 2007 18:19:15 -0500 (EST) Received: from turing (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id F27CF7D6A07; Mon, 10 Dec 2007 18:19:13 -0500 (EST) Received: with ECARTIS (v1.0.0; list oracle-l); Mon, 10 Dec 2007 18:17:03 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with ESMTP id 8B4157D606F for ; Mon, 10 Dec 2007 18:17:03 -0500 (EST) Received: from turing.freelists.org ([127.0.0.1]) by localhost (turing.freelists.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 04573-01-22 for ; Mon, 10 Dec 2007 18:17:03 -0500 (EST) Received: from web35404.mail.mud.yahoo.com (web35404.mail.mud.yahoo.com [66.163.179.113]) by turing.freelists.org (Avenir Technologies Mail Multiplex) with SMTP id 003B07D5B7B for ; Mon, 10 Dec 2007 18:16:59 -0500 (EST) Received: (qmail 64190 invoked by uid 60001); 10 Dec 2007 23:16:59 -0000 X-YMail-OSG: f23AOtoVM1kia_J_3FavYZxsGSRIbtDstW79modkNfMXwQ3ukulmr_pdBbUZNfz1fJcyx0jP8sI0CPtV._izwu_N_IXJeXdtTgqrbi8RlClsGgbkUx3e297TiJSJTA-- Received: from [64.53.237.191] by web35404.mail.mud.yahoo.com via HTTP; Mon, 10 Dec 2007 15:16:59 PST Date: Mon, 10 Dec 2007 15:16:59 -0800 (PST) From: Dan Norris Subject: Re: NFS on a 10g RAC cluster To: "Crisler, Jon" , krish.hariharan@quasardb.com Cc: Oracle-L Freelists MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-362518654-1197328619=:63817" Message-ID: <107328.63817.qm@web35404.mail.mud.yahoo.com> X-archive-position: 3830 X-ecartis-version: Ecartis v1.0.0 Sender: oracle-l-bounce@freelists.org Errors-to: oracle-l-bounce@freelists.org X-original-sender: dannorris@dannorris.com Precedence: normal Reply-to: dannorris@dannorris.com List-help: List-unsubscribe: List-software: Ecartis version 1.0.0 List-Id: oracle-l X-List-ID: oracle-l List-subscribe: List-owner: List-post: List-archive: X-list: oracle-l X-Virus-Scanned: Debian amavisd-new at localhost.localdomain --0-362518654-1197328619=:63817 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Hi Jon,=0A=0AI misinterpreted the question and took an opportunity to get o= n my soapbox--sorry about that. =0A=0AYes, I believe that you should be abl= e to set up NFS Server as a resource (or group of resources) under manageme= nt of Oracle Clusterware. Pretty much any process that you can start, stop,= and check is eligible for Clusterware management. If you want to see some = examples, check out these links:=0A=0Ahttp://www.oracle.com/technology/prod= ucts/database/clusterware/pdf/TWP-Oracle-Clusterware-3rd-party.pdf=0Ahttp:/= /www.oracle.com/technology/products/database/clusterware/pdf/SI_DB_Failover= _11g.pdf (as an example--good scripts here)=0Ahttp://www.oracle.com/technol= ogy/sample_code/products/rac/zip/sifo_action_scripts.zip=0Ahttp://www.oracl= e.com/technology/sample_code/products/rac/zip/crs_asagent.zip=0A=0AIn gener= al, you'd want to have some VIP address that clients of the NFS service use= to access the NFS mounts. I'm not an NFS expert, but I expect there are so= me NFS server daemons that you may need to restart (possibly to bind to the= new IP) and you'll certainly want to run some exportfs commands or equival= ent. You might also need to fail over some of the underlying storage if you= 're not using a CFS. This is essentially rebuilding what has already been d= one in a commercial offering by Polyserve (now HP) with their Enterprise Fi= le Services Clustered Gateway (EFS-CG) product (though they use customized = NFS server code--not stock Linux NFS server code so I'm told). I've never u= sed it personally--just read about it, so this isn't an endorsement, just a= wareness: http://h18006.www1.hp.com/products/storageworks/efs/index.html=0A= =0ADan=0A=0A----- Original Message ----=0AFrom: "Crisler, Jon" =0ATo: Dan Norris ; krish.hariharan@quasa= rdb.com=0ACc: Oracle-L Freelists =0ASent: Monday, D= ecember 10, 2007 4:03:29 PM=0ASubject: RE: NFS on a 10g RAC cluster=0A=0A= =0A=0A=0A=0A =0A =0A=0A=0A=0A=0A=0A=0A=0A=0A=0AI think I may have stated the prob= lem a=0Abit ambiguously =96 the intent was not to store database files on N= FS, but rather=0Ato host NFS on the same platform, and let CRS manage and f= ailover the NFS=0Adaemons. CRS can be extended to manage non-Oracle applic= ations. The database=0Ais already built and running via ASM storage to a S= AN.=0A =0A=0A =0A =0A=0A=0A=0A=0A=0A=0A=0A=0A=0A=0AFrom: Dan Norris=0A[mai= lto:dannorris@dannorris.com] =0A=0ASent: Monday, December 10, 2007=0A5:00 P= M=0A=0ATo: krish.hariharan@quasardb.com;=0ACrisler, Jon=0A=0ACc: Oracle-L F= reelists=0A=0ASubject: Re: NFS on a 10g RAC=0Acluster=0A =0A=0A=0A=0A=0A = =0A =0A=0A=0A=0A=0A=0AI'm not a fan of putting Oracle DBs=0Aon NFS. Further= more, as this list shows: http://www.oracle.com/technology/products/databas= e/clustering/certify/tech_generic_unix_new.html,=0Aonly a relatively small = handful of specialized NFS appliances/software are=0Asupported for RAC. Tha= t is, you can't take the typical UNIX NFS server=0Aimplementation and use i= t to run RAC in a supported way. If you don't care=0Aabout support and just= want to build a sandbox, it may work fine--I've used=0AOpenFiler for sandb= oxes and it worked well for my functional (not load)=0Atesting.=0A=0A=0A=0A= Dan=0A =0A=0A=0A=0A----- Original Message=0A----=0A=0AFrom: "krish.harihara= n@quasardb.com"=0A=0A=0ATo: Jon.Crisler@usi.c= om=0A=0ACc: Oracle-L Freelists =0A=0ASent: Monday, = December 10, 2007 1:37:46 PM=0A=0ASubject: Re: NFS on a 10g RAC cluster=0A= =0A=0A=0AJon,=0A=0A=0A=0AFrom discussions with a Unix architect, I understo= od that read-write nfs=0A=0Ahas some holes that our security teams did not = like. We however use read=0A=0Aonly nfs routinely in many environments. The= issues were:=0A=0A1. Security did not like us using nfs, especially read-w= rite=0A=0A2. In our Solaris environments, in some older OS releases, stale = nfs=0A=0Amounts were problematic.=0A=0A=0A=0AA question though: Is there a = reason why you wouldn't have the nfs mounts=0A=0Aon all nodes of the RAC an= d perhaps control access to that mount point=0A=0Athrough, say the services= framework as opposed to failing the mount point=0A=0Ato different nodes?= =0A=0A=0A=0A-Krish=0A=0A=0A=0A--=0A=0Ahttp://www.freelists.org/webpage/orac= le-l=0A=0A=0A=0A=0A =0A=0A=0A=0A=0A =0A =0A=0A=0A=0A=0A=0A=0A=0A=0A=0A=0A= =0A=0A=0A --0-362518654-1197328619=:63817 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable
Hi Jon,

I misinterpreted the question and took an opportunity to ge= t on my soapbox--sorry about that.

Yes, I believe that you should b= e able to set up NFS Server as a resource (or group of resources) under man= agement of Oracle Clusterware. Pretty much any process that you can start, = stop, and check is eligible for Clusterware management. If you want to see = some examples, check out these links:

http://www.oracle.com/technology/product= s/database/clusterware/pdf/TWP-Oracle-Clusterware-3rd-party.pdf<= br>http://www.oracle.com/technology/products/database= /clusterware/pdf/SI_DB_Failover_11g.pdf (as an example--good scripts he= re)
http://www.ora= cle.com/technology/sample_code/products/rac/zip/sifo_action_scripts.zip=
http://www.oracle.com/tec= hnology/sample_code/products/rac/zip/crs_asagent.zip

In general, you'd want to have some VIP address that clients of the NFS s= ervice use to access the NFS mounts. I'm not an NFS expert, but I expect th= ere are some NFS server daemons that you may need to restart (possibly to b= ind to the new IP) and you'll certainly want to run some exportfs commands = or equivalent. You might also need to fail over some of the underlying storag= e if you're not using a CFS. This is essentially rebuilding what has alread= y been done in a commercial offering by Polyserve (now HP) with their Enter= prise File Services Clustered Gateway (EFS-CG) product (though they use cus= tomized NFS server code--not stock Linux NFS server code so I'm told). I've= never used it personally--just read about it, so this isn't an endorsement= , just awareness: http://h18006.www1.hp.com/products/stor= ageworks/efs/index.html

Dan

----- Original= Message ----
From: "Crisler, Jon" <Jon.Crisler@usi.com>
To: Da= n Norris <dannorris@dannorris.com>; krish.hariharan@quasardb.com
C= c: Oracle-L Freelists <oracle-l@freelists.org>
Sent: Monday, December 10, 2007 4:03:29 PM
Subject: RE: NFS on a 10g RAC cluster
<= br>=0A=0A=0A=0A =0A =0A=0A=0A=0A=0A=0A
=0A=0A

I thin= k I may have stated the problem a=0Abit ambiguously =96 the intent was not = to store database files on NFS, but rather=0Ato host NFS on the same platfo= rm, and let CRS manage and failover the NFS=0Adaemons.  CRS can be ext= ended to manage non-Oracle applications.  The database=0Ais already bu= ilt and running via ASM storage to a SAN.

=0A=0A

 

=0A=0A
=0A=0A
=0A=0A
=0A=0A
=0A=0A

<= font face=3D"Tahoma" size=3D"2">From: Dan Norri= s=0A[mailto:dannorris@dannorris.com]
=0ASent: Monday, December 10, 2007=0A5:00 PM
=0ATo: krish.hariharan@quasardb.com;= =0ACrisler, Jon
=0ACc: = Oracle-L Freelists
=0ASubject: Re: NFS on a 10g RAC=0Acluster

=0A=0A
=0A=0A=

 

=0A=0A
=0A=0A
=0A= =0A

I'm not = a fan of putting Oracle DBs=0Aon NFS. Furthermore, as this list shows: http://www= .oracle.com/technology/products/database/clustering/certify/tech_generic_un= ix_new.html,=0Aonly a relatively small handful of specialized NFS appli= ances/software are=0Asupported for RAC. That is, you can't take the typical= UNIX NFS server=0Aimplementation and use it to run RAC in a supported way.= If you don't care=0Aabout support and just want to build a sandbox, it may= work fine--I've used=0AOpenFiler for sandboxes and it worked well for my f= unctional (not load)=0Atesting.
=0A
=0ADan

=0A=0A=0A=0A

----- Orig= inal Message=0A----
=0AFrom: "krish.hariharan@quasardb.com"=0A<krish.= hariharan@quasardb.com>
=0ATo: Jon.Crisler@usi.com
=0ACc: Oracle-L= Freelists <oracle-l@freelists.org>
=0ASent: Monday, December 10, = 2007 1:37:46 PM
=0ASubject: Re: NFS on a 10g RAC cluster
=0A
=0AJo= n,
=0A
=0AFrom discussions with a Unix architect, I understood that r= ead-write nfs
=0Ahas some holes that our security teams did not like. We= however use read
=0Aonly nfs routinely in many environments. The issues= were:
=0A1. Security did not like us using nfs, especially read-write=0A2. In our Solaris environments, in some older OS releases, stale nfs=0Amounts were problematic.
=0A
=0AA question though: Is there a re= ason why you wouldn't have the nfs mounts
=0Aon all nodes of the RAC and= perhaps control access to that mount point
=0Athrough, say the services= framework as opposed to failing the mount point
=0Ato different nodes?<= br>=0A
=0A-Krish
=0A
=0A--
=0Ahttp://www.freelist= s.org/webpage/oracle-l
=0A
=0A

=0A=0A
=0A= =0A

 

=0A=0A
= =0A=0A
=0A=0A
=0A=0A

--0-362518654-1197328619=:63817-- -- http://www.freelists.org/webpage/oracle-l