Websters says it is bachelor's, but i suppose it depends on the mechanics of style and the discipline you are working in that makes a difference for these picky little things. This is what I'm going...
It depends on how you are using is, whether in a sentence or a degree type etc. For example, on the diploma itself it is written as Bachelor of Arts, or Bachelor of Science. In a sentence it could be...