James Madison was a graduate of the College of New Jersey, which later changed its name to Princeton university. During the time he attended that school, both Classical Latin and ancient Greek were languages required of all educated men, so he certainly studied both. French was the language of diplomacy in those days, so he may well have understood that language.