Answer:
There is a field of study called "metamathematics" that attempts to address just that question.
If this is a serious question, you might want to begin by going to the library and exploring the three volume set Principia Mathematica by Whitehead and Russell.