A good way is to pressure wash the bricks. This will remove the moss and clean the bricks at the same time. It's good that you pressure wash your fences and outdoor walls regularly.
first place your tongue on the sap.
then carefully lick it off without missing any spots.
after this you can either spit it out or swallow it.
i tend to save it in a cup as my famous secret recipe
If it won't come off with a pressure washer or paint stripper, you may need to have it sand blasted. Be careful sandblasting soft brick because it will eat it up.