An indication of infection - quite possibly the start of an abscess - needs checking out because it can become very painful and untreated the infection can spread to your blood.
Oh, you should get to a dentist right away; I don't think it would be over-reacting to consider it urgent. You may have an abscess, which could become a serious problem left untreated.
