Weep holes are supposed to leak every time you run water through the hydrant. If it leaks constantly, you don't have a problem with a leaky weephole, you have a leaking hydrant. This can be fixed by replacing the rubber stopper at the end of the rod.