Is it Bachelor's degree or Bachelors degree?

It depends on the context of which you are using the word. "I have a bachelor's degree," or "I have a bachelor of arts degree."

I'd have to say it's bachelor's degree

Websters says it is bachelor's, but i suppose it depends on the mechanics of style and the discipline you are working in that makes a difference for these picky little things. This is what I'm going...

It depends on how you are using is, whether in a sentence or a degree type etc. For example, on the diploma itself it is written as Bachelor of Arts, or Bachelor of Science. In a sentence it could be...

the answer to this question is bachelor