RE: Manually creating OEM Incident?

From: Herring, David <"Herring,>
Date: Fri, 6 Sep 2019 21:53:13 +0000
Message-ID: <DM6PR02MB5564E61DCC1A1AFA008595AFD4BA0_at_DM6PR02MB5564.namprd02.prod.outlook.com>





Courtney,

I definitely appreciate all the info.

Incident creation off existing Event - Yup, I thought of this but what I was looking for is something a little less manual and not involved steps down through a GUI. Plus I need an Event first.

Event publish via "emcli" - I guess this could be used as part of a 2-step process in that I generate an Event using this method, then go into the GUI and create an Incident off it as a test. I could use it as an emergency where I wanted to get a ticket generated off certain data or a situation and have the ticket creation process handled programmatically after I create the Incident off the Event I create.

The simulation of an Incident off existing rules has always been a nice feature but, as you pointed out, nothing gets created. In one of the situations I mentioned, we should have had a critical alert raised on DBDATA being above 95% full, which would have eventually sent a ticket off to our out-sourced system DBA team. Once I found that we had a hole in our Incident Rules I wanted to force a re-evaluation, then thought about forcing an Incident to be created, then just manually created a ticket in CASD due to the emergency.

Regards,

Dave

[cid:image001.png_at_01D05044.5C2AEE60]

Dave Herring
DBA
103 JFK Parkway
Short Hills, New Jersey 07078
Mobile 630.441.4404

dnb.com<http://www.dnb.com/>

[cid:image002.png_at_01D05044.5C2AEE60]<http://www.facebook.com/DunBradstreet>[cid:image003.png_at_01D05044.5C2AEE60]<http://twitter.com/dnbus>[cid:image004.png_at_01D05044.5C2AEE60]<http://www.linkedin.com/company/dun-&-bradstreet>[cid:image005.png@01D05044.5C2AEE60]<http://www.youtube.com/user/DunandBrad>

From: oracle-l-bounce_at_freelists.org <oracle-l-bounce_at_freelists.org> On Behalf Of Courtney Llamas Sent: Friday, September 6, 2019 3:46 PM To: dmarc-noreply_at_freelists.org
Cc: oracle-l_at_freelists.org
Subject: Re: Manually creating OEM Incident?

CAUTION: This email originated from outside of D&B. Please do not click links or open attachments unless you recognize the sender and know the content is safe.

There is a way to manually create an incident based on an alert. But I’m not sure that would have triggered any notification or actions… will have to test that. https://docs.oracle.com/en/enterprise-manager/cloud-control/enterprise-manager-cloud-control/13.3.1/emadm/using-incident-management.html#GUID-F8CA7018-DEBB-4CBD-8F57-4E9A77E1729C<https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.oracle.com%2Fen%2Fenterprise-manager%2Fcloud-control%2Fenterprise-manager-cloud-control%2F13.3.1%2Femadm%2Fusing-incident-management.html%23GUID-F8CA7018-DEBB-4CBD-8F57-4E9A77E1729C&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207211897&sdata=XUnVn8L2IZrhuYTQQ3A2dP2g%2BZbOpYyA%2BYxxoi3UO9E%3D&reserved=0>

Creating an Incident Manually
If an event of interest occurs that is not covered by any rule and you want to convert that event to an incident, perform the following:

  1. Using an available view, find the event of interest.
  2. Select the event in the table.
  3. From the More... drop-down menu, choose Create Incident...
  4. Enter the incident details and click OK.
  5. Should you decide to work on the incident, set yourself as owner of the incident and update status to Work in Progress.

You can also create an event manually with EMCLI - meant for user reported, but this still wouldn’t trigger notifications/ticket creation unless that event type/target type is included in the rules... https://docs.oracle.com/en/enterprise-manager/cloud-control/enterprise-manager-cloud-control/13.3.1/emadm/using-incident-management.html#GUID-98AA06D1-C274-47C0-BB1B-B8EA18B08DB7<https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.oracle.com%2Fen%2Fenterprise-manager%2Fcloud-control%2Fenterprise-manager-cloud-control%2F13.3.1%2Femadm%2Fusing-incident-management.html%23GUID-98AA06D1-C274-47C0-BB1B-B8EA18B08DB7&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207221899&sdata=BmdZUFuBfnjHktzx0T6sJ20M%2B50ftgRN80lX9DyPN3M%3D&reserved=0>

Really, you should have a rule that creates an incident and triggers notification of some sort for any critical alert (at least). The OOB ruleset has an example of this: [cid:image006.png_at_01D564D1.C12BE700]

I also recommend using the Events without Incidents out of box View in Incident Manager, to track anything falling thru the cracks.

For testing, we do have a way to simulate alerts, but I don’t think that will actually create the ticket in CASD, it was meant as a way to test w/o actually triggering the actions but just to verify them. The best way to test is to actually change a threshold - I like archive dest personally, or table space. https://docs.oracle.com/en/enterprise-manager/cloud-control/enterprise-manager-cloud-control/13.3.1/emadm/using-incident-management.html#GUID-D28D8C54-46B9-4A54-8FD6-996965275522<https://nam03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.oracle.com%2Fen%2Fenterprise-manager%2Fcloud-control%2Fenterprise-manager-cloud-control%2F13.3.1%2Femadm%2Fusing-incident-management.html%23GUID-D28D8C54-46B9-4A54-8FD6-996965275522&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207221899&sdata=x4QI0PDp3L%2BjffpAzSDVfs5kIDl2UvIsFnpavdBq9VI%3D&reserved=0>

Hope this helps! I’ll try to play around w/ the create event when I get some time after OOW! ;)

On Sep 6, 2019, at 12:51 PM, Herring, David <dmarc-noreply_at_freelists.org<mailto:dmarc-noreply_at_freelists.org>> wrote:

Sure. Recently I found a non-clustered env had reached 98% full on DBDATA but we didn't get an alert. Turns out our Incident Rule for space alerts was set only for ASM Cluster vs. ASM Instance. It got overlooked because we only have a handful of non-clustered envs. I updated our ASM Instance Incident Rule to include space metrics but I would have loved at that point to quickly create an Incident concerning space to force that Incident Rule to trigger an alert and consequently a ticket being raised on CA Service Desk (CASD).

Another example is with testing a bridge we have from CASD to a 3rd party company's ticketing system. I'd love to issue a command to have an Incident created to test the whole process at any time. I know the CASD Connector has the ability to run a test but that's a "getTicket" whereas I'd like the whole process tested. Currently I have a little script to push a mountpoint above the warning threshold, then drop the temp files. A real hack that is kind of risky.

Regards,

Dave

<image001.png>

Dave Herring
DBA
103 JFK Parkway
Short Hills, New Jersey 07078
Mobile 630.441.4404

dnb.com<https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.dnb.com%2F&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207231893&sdata=vyEI7DU91jJ%2FUZHvk3vOvp8qiA6PrwHHEucfR705x%2Bw%3D&reserved=0>

<image002.png><https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.facebook.com%2FDunBradstreet&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207231893&sdata=dfnbDQSY0yrp3k7O%2FN04frNdIACoQ2FMu3vVCQO80iA%3D&reserved=0><image003.png><https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftwitter.com%2Fdnbus&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207241884&sdata=i3hgCg5M6pLOGA%2FyHwC%2Bupv3jkvh%2BymutaIw9ALFpUU%3D&reserved=0><image004.png><https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fdun-%26-bradstreet&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207241884&sdata=1hiGouJITaPnxmBtb044Rm5AA1BcqqvBnYa5506kiDg%3D&reserved=0><image005.png><https://nam03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.youtube.com%2Fuser%2FDunandBrad&data=02%7C01%7Cherringd%40dnb.com%7C8a3f2bdd422648ffdc9e08d7330b5d34%7C19e2b708bf12437597198dec42771b3e%7C0%7C0%7C637033996207241884&sdata=qOMZPOVKUghkqu9QcN%2BcMYISUnMpQUlsOQ26dKwbf5g%3D&reserved=0>

From: oracle-l-bounce_at_freelists.org<mailto:oracle-l-bounce_at_freelists.org> <oracle-l-bounce_at_freelists.org<mailto:oracle-l-bounce_at_freelists.org>> On Behalf Of Courtney Llamas Sent: Friday, September 6, 2019 11:52 AM To: dmarc-noreply_at_freelists.org<mailto:dmarc-noreply_at_freelists.org> Cc: oracle-l_at_freelists.org<mailto:oracle-l_at_freelists.org> Subject: Re: Manually creating OEM Incident?

CAUTION: This email originated from outside of D&B. Please do not click links or open attachments unless you recognize the sender and know the content is safe.

hmm… can you give me a little background on what you’re trying to do?

On Sep 6, 2019, at 11:49 AM, Herring, David <dmarc-noreply_at_freelists.org<mailto:dmarc-noreply_at_freelists.org>> wrote:

Folks, does anyone know if there's a way to manually / programmatically create an OEM Incident outside of the console? I was hoping that "emcli" would have something like that. It has " delete_incident_record" and "clear_problem" but nothing for creating / raising an Incident.

This is for OEM 12.1.0.4 / 5.

Thx.

Dave













--
http://www.freelists.org/webpage/oracle-l


Received on Fri Sep 06 2019 - 23:53:13 CEST

Original text of this message