Putah.
You could say "Pare de molestarme", or maybe "Déjame en paz" (leave me in peace - leave me alone).
The answer for how you say annoying in spanish is ENFADOSOS.
"molesto", "embarazoso", "fastidioso" and "cargante"
"You are annoying" in Spanish is "Eres enojoso". It is pronounced "AIR-ace en-oh-HO-so". Please see the Related link below for confirmation of the translation.
To say=decir. To speak=hablar.