"Deaf" is not a derogatory term, it merely describes the condition of being unable to hear. Since some people have a reduced ability to hear but do still have some hearing, the term "hearing impaired" would be more accurate for those people.
However, the term "dumb" when used to describe people who cannot speak, is insulting (since it also means stupid). So deaf is OK, but deaf and dumb is not.