It is hard to find just one word that can replace "misbehave". If you are talking about a machine, you could use "malfunction".
When talking about people, synonyms have more than one word, e.g.
act up
play up
make trouble
behave badly
be bad
be naughty
be rude
be mean
not nice