If you are referring to hermaphrodites, not all of them even have penises. Hermaphrodites do not even usually show obvious signs. There are many that go their entire life and never even know that...
No not in all cases some Small adults have been known to have no penis at all if you are a small adults and experiencing these problems i suggest you see your GP and ask for some advice