Re: Oracle Support and Standby

From: RajeevGM <rprabha01_at_gmail.com>
Date: Mon, 11 Apr 2016 16:54:56 -0400
Message-Id: <E21A631E-8BB5-44C1-B17B-C5F8639A1DFC_at_gmail.com>



What is the o.s ver / platform and the rdbms version ?
> On Apr 11, 2016, at 4:51 PM, Sherrie Kubis <Sherrie.Kubis_at_swfwmd.state.fl.us> wrote:
> 
> Absolutely to the letter.  
> 
> Oracle Support has answered me and I'm working with a good analyst, who is having me rebuild the standby control file.  So far, it's not working.  I'm getting the sinking feeling that I'm going to have to rebuild.  
> 
> I hope that the analyst can also help me understand what happened and why, although we might not be able to reconstruct it.  Two thoughts the person working on this were that flashback to the same GRP was done twice, and then an RMAN full wasn't done in between the flashbacks.  I don't understand that line of thinking or if it has merit.    A crosscheck on the standby was also done, this note doesn't indicate that. 
> 
> At the bottom of this note there are instructions about rebuilding the standby control file with ASM and OMF.  It was going fine up until the 'switch database to copy' ... I'm now getting the error: 
> RMAN-06571: datafile 1 does not have recoverable copy
> 
> I'm not getting a good feeling that I'll be able to salvage the standby.
> 
> *********************************************************
> Sherrie Kubis
> Sr. Oracle DBA 
> Information Technology Bureau
> Southwest Florida Water Management District
> 2379 Broad Street
> Brooksville, FL 34604-6899
> 352.796.7211 x4033
> sherrie.kubis_at_swfwmd.state.fl.us
> 
> Please take a moment to answer a few questions and let us how we're doing.
> 
> IMPORTANT NOTICE
> E-mails made or received in conjunction with the official business of the District are public records.  All e-mails sent to and from this address are automatically archived.  For more information regarding the State of Florida public records laws, please visit www.myflorida.com.
> 
> 
> -----Original Message-----
> From: RajeevGM [mailto:rprabha01_at_gmail.com] 
> Sent: Monday, April 11, 2016 4:43 PM
> To: Sherrie Kubis <Sherrie.Kubis_at_swfwmd.state.fl.us>
> Cc: oracle-l_at_freelists.org
> Subject: Re: Oracle Support and Standby
> 
> Were the steps mentioned in
> Doc ID - 728374.1 followed ?
> 

>> On Apr 11, 2016, at 2:58 PM, Sherrie Kubis <Sherrie.Kubis_at_swfwmd.state.fl.us> wrote:
>>
>> Yes, thank you for listening to my rant!
>>
>> I have a primary and a non-active standby; we only use the standby for disaster recovery.
>>
>> This weekend there was an application upgrade. It didn't go well but we had set a guaranteed restore point. We flashed back the primary and then also the standby:
>>
>> Primary:
>> stop log apply
>> shut down database
>> startup database In mount
>> flashback to GRP
>> shutdown
>> select resetlogs_change# from v$database: and note the number
>>
>> Standby:
>> flashback standby database to scn <primary scn -2); stop database
>> start in mount (since it's a physical standby non-active)
>>
>> At this point I'm going to say that someone else was driving the ship
>> and it all went by fast. Then they went on vacation :(
>>
>> This first flashback worked, we restarted Data Guard and were good to go.
>>
>> The redid the application, had more problems so needed to flashback again.
>>
>> We flashed back to the same GRP. Got the same information for the SCN and did the same scenario.
>> At first we got the same message about the database being 'diverged',
>> now we are getting
>>
>> Warning: the given resetlogs_id 908669300 is not on the valid incarnation path.
>>
>> There were some things done with incarnations that weren't recorded, a bad thing I know. I think she was thinking that "this will fix it and we're good" but now, a few days later not so good to not know this.
>>
>> On the primary:
>> RMAN> list incarnation of database;
>>
>>
>> List of Database Incarnations
>> DB Key Inc Key DB Name DB ID STATUS Reset SCN Reset Time
>> ------- ------- -------- ---------------- --- ---------- ----------
>> 1 2 COLLABP 951429914 PARENT 1 13-NOV-2014 13:39:38
>> 1 811470 COLLABP 951429914 ORPHAN 77425738806 08-APR-2016 21:22:50
>> 1 813678 COLLABP 951429914 ORPHAN 77425738806 08-APR-2016 23:22:00
>> 1 816123 COLLABP 951429914 ORPHAN 77425738806 09-APR-2016 00:08:20
>> 1 818353 COLLABP 951429914 CURRENT 77425738806 09-APR-2016 00:22:46
>>
>> Standby:
>> RMAN> list incarnation of database;
>>
>> List of Database Incarnations
>> DB Key Inc Key DB Name DB ID STATUS Reset SCN Reset Time
>> ------- ------- -------- ---------------- --- ---------- ----------
>> 1 2 COLLABP 951429914 PARENT 1 13-NOV-2014 13:39:38
>> 1 811470 COLLABP 951429914 ORPHAN 77425738806 08-APR-2016 21:22:50
>> 1 813678 COLLABP 951429914 ORPHAN 77425738806 08-APR-2016 23:22:00
>> 1 816123 COLLABP 951429914 ORPHAN 77425738806 09-APR-2016 00:08:20
>> 1 818353 COLLABP 951429914 CURRENT 77425738806 09-APR-2016 00:22:46
>>
>> *********************************************************
>> Sherrie Kubis
>> Sr. Oracle DBA
>> Information Technology Bureau
>> Southwest Florida Water Management District
>> 2379 Broad Street
>> Brooksville, FL 34604-6899
>> 352.796.7211 x4033
>> sherrie.kubis_at_swfwmd.state.fl.us
>>
>> Please take a moment to answer a few questions and let us how we're doing.
>>
>> IMPORTANT NOTICE
>> E-mails made or received in conjunction with the official business of the District are public records. All e-mails sent to and from this address are automatically archived. For more information regarding the State of Florida public records laws, please visit www.myflorida.com.
>>
>>
>> -----Original Message-----
>> From: RajeevGM [mailto:rprabha01_at_gmail.com]
>> Sent: Monday, April 11, 2016 1:49 PM
>> To: Sherrie Kubis <Sherrie.Kubis_at_swfwmd.state.fl.us>
>> Cc: oracle-l_at_freelists.org
>> Subject: Re: Oracle Support
>>
>> Sherrie,
>>
>> My experience, for any non-Sev1 SRs, the turn around time varies..
>>
>> Anyway, could you please describe the issue/ errors visible on the standby db ?
>>
>> Rajeev
>>
>>> On Apr 11, 2016, at 1:29 PM, Sherrie Kubis <Sherrie.Kubis_at_swfwmd.state.fl.us> wrote:
>>> 
>>> Anyone else have this kind of experience with Oracle Support? 
>>> 
>>> I opened a ticket for a hosed standby on Saturday.  I understand that because it's not a down system it can't be a Sev 1, and now I know that only a Sev 1 system gets weekend attention.  
>>> 
>>> Now it is Monday afternoon.  I called support to ask what the status is, and the music was so loud I couldn't hear the person.  I asked if she would hang up and call me back.  Instead, she updated the ticket that an analyst needed to call me.  
>>> 
>>> Then I called back again (no music this time) and was told support engineers are only working Sev 1 tickets right now, they have a backlog.  But somebody would call me back.  When I asked when, she said "well, everyone is on their meal break, so it will be another 45 minutes before I can ask that".  What?  I know they have to eat, but really, everyone goes at the same time?  I say that to myself as I'm eating my salad while sitting at my desk hoping for help.
>>> 
>>> Because of budget cuts my management has asked me to think about third-party support and dropping maintenance, as most of our Districts are moving to another platform because of state budgets.  I was horrified at first, thinking "how can I support Oracle databases without true Oracle support?!"  Now I think I know.  
>>> 
>>> 
>>> 
>>> *********************************************************
>>> Sherrie Kubis
>>> Sr. Oracle DBA
>>> Information Technology Bureau
>>> Southwest Florida Water Management District
>>> 2379 Broad Street
>>> Brooksville, FL 34604-6899
>>> 352.796.7211 x4033
>>> sherrie.kubis_at_swfwmd.state.fl.us
>>> 
>>> 
>>> IMPORTANT NOTICE
>>> E-mails made or received in conjunction with the official business of the District are public records.  All e-mails sent to and from this address are automatically archived.  For more information regarding the State of Florida public records laws, please visit www.myflorida.com.
>>> 
>>> 
>>> --
>>> http://www.freelists.org/webpage/oracle-l
>>> 
>>> 
--
http://www.freelists.org/webpage/oracle-l
Received on Mon Apr 11 2016 - 22:54:56 CEST

Original text of this message