An exclamation point is used at the end of an exclamatory sentence.
Example:
You shouldn't do that!
An apostrophe is used to show possession, create a contraction, or to show an omission.
Example:
Garfield's tail is orange and white.
I can't stay angry at Garfield.
John is friends with Jennifer O'Riley.