A normal rib break is usually but not always accompanied by bruising on the chest. The chest wall however has no changes in shape except for swelling or bruising. Pressing on the outside of the chest...
You should go to the doctors and get them x-rayed. It might mean that you broke a rib, or if not you might have damaged it. It is better safe then sorry. If you didn't do something to your actual rib...