When you blow up a balloon, you're putting stress on the rubber. When you puncture the balloon, there's only a small space where the air can escape. The air wants to get out fast, so it forces a tear in the balloon, causing a "pop" noise.
when blowing a balloon, the balloon will pop after the maximum pressure allowed by the composition of the balloon e.g. (rubber, plastic and alluminum)is exceeded.