un bolt old one from exhaust pipe then unbolt it from the engine. Take it off and whne putting a new one on it is a good idea to change gasket and manifold bolts.
EDIT: I have a '94 Jeep Cherokee with the same Inline 6 4.0L engine as is in yours. With mine, I had to remove the intake manifold, you will probably have to do the same.