I actually use a small button on my board to silence my “alarm” and then it automatically re-arms when it goes out of the alarm state for a given amount of time. That would be one option. You could also just have it re-arm when it leaves the alarm state.