RE: srvctl remove asm generates PRKS-1033 and CRS-0214

Greetings,  

I would like to chime in and echo Charles' frustration with all the diagnostics and ask if anyone has a reasonable approach to understanding them. I too find them very complex and cryptic and on several occasions have tried to understand them, really to no avail. Based on my experience and from what I have seen expressed here it appears that not many Oracle analysts are readily fluent with the multitude of logs and traces which can be generated. Google helps but only to a very limited degree.  

Does there exist somewhere, either on MetaLink, technet or someone's web site a guide to understanding diagnostics in a RAC environment? Or am I just dreaming?  

Thanks.  

Bill Wagman
Univ. of California at Davis
IET Campus Data Center
wjwagman_at_ucdavis.edu
(530) 754-6208  

From: oracle-l-bounce_at_freelists.org
[mailto:oracle-l-bounce_at_freelists.org] On Behalf Of Charles Schultz Sent: Wednesday, July 25, 2007 5:55 AM
To: Alex Gorbachev
Cc: freelists
Subject: Re: srvctl remove asm generates PRKS-1033 and CRS-0214

Alex,

Thanks for the "hints"; I look at these as diagnostic hints, not subject to the same limitation of guessing as say, problem resolution. *grin*

To that end, I am finding that I am easily overwhelmed by all the diagnostics. What am I looking for? It seems to me that my Oracle Support Analyst should setup an OWC and step through these diagnostics with me, pointing out what I need to look for so we can both find the problem together, and from there discover (not guess) a resolution.

When I use srvctl remove asm, what modules of CRS touched? Or rather, what modules do I need to turn tracing on to get the whole picture? I can see how the CRSOCR module would be relevant, but what about the CRSRES? Any more?

I have used SRVM_TRACE, but again, not knowing what I am looking for, I did not discover much. Looks like crs_unregister returns an error, but I am not sure why. Yet.

I will keep hitchhiking along this road. Thanks for all the feedback, from all of you.

On 7/24/07, Alex Gorbachev <ag_at_oracloid.com> wrote:

        Charles,         

        When you look for the logs - you should look for the logs in Oracle

        Home (where srvctl is running from) and in CRS home (since OCR updates

        are done by crsd). Just in case it was missed.         

        Btw, you want to make sure that you run srvctl from Oracle Home and

        not CRS Home and, perhaps, even from ASM Oracle Home if you installed

        it separately. I guess all this can be marked as done already anyway.         

        I think I might have few more guesses that would qualify for hints ;-)

        unless there would be no way to debug it so I try to give some hints

        how to debug it.         

        There is tracing facility that is interfaced by crsctl. I would try to

	look at tracing CRSOCR and CRSRES modules:
	$ORA_CRS_HOME/bin/crsctl log crs CRSOCR:255,CRSRES:255 
	I'm not sure about trace levels you need. Default should be 0 if
I
	recall correctly.
	If you don't find anything useful - try other modules (use
crsctl
	lsmodules crs).
	
	Even before doing that you might want to enable tracing/debug in

	srvctl that you call from oracle home - it's a shell script and
there
	are couple variables that you might want to research -
ORA_CRSDEBUG
	and SRVM_TRACE
	
	If you find anything interesting - let us know. 
	
	Cheers,
	Alex
	
	On 7/24/07, Charles Schultz <sacrophyte_at_gmail.com> wrote:


	> I posed this question over at the oracle ASM forum as well.

	>

	> We are trying to wipe out ASM. We have been trying to follow a

couple 


	> metalink notes, and threads both here and in oracle-l, not to

mention


	> reading some books (K Gopal and Julian Dyke). Google is not

giving us much


	> help, either.

	>

	> We had a couple RAC databases, but those have already been

removed, and the 


	> shared ASM disks have been wiped clean (with dd). We have not

touched the


	> OCR or voting disks directly at all, only via srvctl and the

crs commands. I


	> have removed as many dependencies as I can think of (entry in

oratab, 


	> running processes, ?dump directories).

	>

	> Oracle EE 10.2.0.3 running on RHEL4. Below are a series of

commands we have


	> used. I attempted to find the "CRS daemon log file", but it is

not updated 


	> with any relevant information. The ocssd log file has some

interesting


	> stuff, but nothing that leads me to a solution.

	>

	>

	> <urbdb1> /u01/app/oracle: srvctl remove asm -n urbdb1

	> PRKS-1033 : Failed to remove configuration for ASM instance

"+ASM1" on node


	> "urbdb1" from cluster registry,

	>

	> [PRKS-1023 : Failed to remove CRS resource for ASM instance

"+ASM1" on node 


	> "urbdb1",

	> [CRS-0214: Could not unregister resource

'ora.urbdb1.ASM1.asm'.]]


	> [PRKS-1023 : Failed to remove CRS resource for ASM instance

"+ASM1" on node


	> "urbdb1", 

	>

	> [CRS-0214: Could not unregister resource

'ora.urbdb1.ASM1.asm'.]]


	> <urbdb1> /u01/app/oracle: crs_unregister ora.urbdb1.ASM1.asm

	> CRS-0214: Could not unregister resource 'ora.urbdb1.ASM1.asm

'.


	>

	> <urbdb1> /u01/app/oracle: oerr crs 214

	> 214, 0, "Could not unregister resource '%s'."

	> // *Cause: There was an internal error while unregistering the

resource.


	> // *Action: Check the CRS daemon log file.

	>

	> <urbdb1> /u01/app/oracle: find . -type f -mmin -1 -exec ls

-alt {} \;


	> -rw-r----- 1 oracle oinstall 183445 Jul 24 09:29

	> ./product/crs/cv/log/cvutrace.log.0 

	> -rw-r--r-- 1 oracle oinstall 7072151 Jul 24 09:29

	> ./product/crs/log/urbdb1/cssd/ocssd.log

	>

	> -rw-r--r-- 1 oracle oinstall 186 Jul 24 09:29

	> ./product/crs/log/urbdb1/client/css4348.log

	> -rw-r--r-- 1 oracle oinstall 809409 Jul 24 09:29

	> ./product/asm/network/log/listener.log

	> -rw-r----- 1 oracle oinstall 9292901 Jul 24 09:29

	> ./product/agent10g/network/log/sqlnet.log

	>

	> 

	> As always, I am hoping the answer to this trickiness is easy

and staring me


	> in the face. =)

	>

	> --

	> Charles Schultz

	
	
	--
	Alex Gorbachev, Oracle DBA Brewer, The Pythian Group 
	http://www.pythian.com/blogs/author/alex http://www.oracloid.com
	BAAG party - www.BattleAgainstAnyGuess.com
	

-- 
Charles Schultz 

--
http://www.freelists.org/webpage/oracle-l