When a penguin is a chick, it has gray down feathers. As it gets older and more mature, the down is replaced by the smooth, water-proof, back and white feathers you are used to seeing.
The chicks are covered in fluffy down for the first few weeks of life, they begin to lose this covering as their feathers begin to come in.
Added: They basically look like big grey puffballs with...