As with other bears, a female would be a sow, a male is a boar, and a baby is a cub. But the male and female terms are less used than just the terms "male bear" and "female bear."
Well... If it is a family then no. but if they hate each other then maybe they will just be careful when your hunting animals because some pandas are fighting and they might see you.. So they get too...