Is it an emergency if my system just stops working?

Often, yes, and you do not have to be certain before you call. A home left without heat in the cold, or without cooling in a heat wave, is a real reason to call, and more so with young children, older adults, or anyone in fragile health at home. If you are not sure, call and talk it through. There is no cost to asking.