Assuming the horse is close to the edge of a road or path, or near a perimeter such as a rockface or stand of trees, it would be at best foolish and at worst incredibly dangerous to attempt to pass...
Go guitly and slowly round it on the outside
Ask it for authorisation and overtake it on the inside!
If you want to over take a horse rider you overtake on the inside.