There are a number of different kinds of small white worms. Do you find them in blankets, and other fabric? If so, they are moth larvae. If you find them in rotting meat they are fly larvae.
No one named it the White House, but it happened after the burn marks were covered by white paint after the British burned it in 1812. To paint a house in the 1800's was very expensive and a whole...