A new user was added to one of our accounts. The API test was configured to be too specific so creating the user modified the output of the API test, triggering a critical alert.

We have reconfigured the alert to be broader whilst still completing the necessary test. Also we have changed our procedures to consider this system part of production environment which means it will come under our normal rules of not making changes outside of regular business hours.