New to PagerDuty so apologies if this is obvious.
Setup: New Relic monitoring a system process on two EC2 instances, if it stops on either of them an alert is sent to PagerDuty. If both stop two alerts are sent. It’s the same New Relic condition monitoring both instances.
What I want to happen:
- If the process on Server-A or Server-B goes down (not both) a P2 incident is raised.
- If then the process on the second server goes down (so now both down) the same incident is raised to a P1.
- If the process on both servers goes down at the same a P1 incident is raised.
Problem is right now PagerDuty will open two separate incidents. Is there a clever way for it to check for an open one and if it matches a criteria, say host name, it just updates the existing one instead of creating a second one?
I can see if we were using an API for reporting we could use the dedup_key
but I don’t think this applies to alerts from New Relic.