The answer is that he did not likewhat he was doing very much so he didn't respond to it very well. He worked out of fear to Prospero because of what he knows he can do.
prospero does not like caliban very much and sets caliban hard work to do just because caliban raped miranda. who's side do you tke? caliban's...or Prospero's?
Caliban and Prospero hate each other because Caliban tried to sexually assault Miranda. Caliban has been taught how to speak and Caliban insulted his learned gift by just using it to insult Prospero...