He wouldn't technically be a man then would he? Can an individual appear male and have female genitals also? Yes. That is probably more common than the reverse. Most are under developed and probably not fertile in either sense.
The are many variables that come into play in order to determine this. It depends on whether he's a platonic friend or a lover. A male friend will rarely tell another male friend that "he's your...