Well, it sounds like he is trying to set some boundaries...that you do not get to control or supervise what he does when he is not with you. However, instead of taking offense, ask questions about what he means. Use I-messages to say that you would be uncomfortable with his spending time with another woman, alone or otherwise.