I am a heterosexual male in my forties- I've never wanted to be a woman but I have been cross dressing since I was about 4 or 5 years old. At that age I had no conception of gender or sexuality...
It's not only possible, it is how most transvestites find themselves: having issues as 3 and 4 years old, way before any real ideas of sex, sex roles and orientation start. A few transvestites find...