You could try cleaning yourself carefully, rinsing with a lot of fresh water, then using an astringent such as Witch Hazel. It may be an allergy. If it continues, you should speak to a doctor about it.
It might be poison ivy as well, but don't scratch in public.:)