It depends on the sand itself, if it contains silt ( mud), or it contains sulfates , both will crack the mortar , usually in Iraq its one part of cement to 2.25 parts of sand in middle and south of...
If the mortar which has dried upon the brick is a Portland Cement mortar there is no sure fire way to remove it. As a professional mason I tell my customers that we can reduce the degree of mortar...