Running water causes erosion of soil and rocks. This is done by the friction between the constant movement of the water and the still rock or soil. Rock erodes much slower but will eventually wear...
It slowly washes away little particles of rock. Over time, even though the water washes away tiny amounts of rock, the rock gets smaller and smaller until the water has washed away the whole rock.