(You can also use the negative word irrelevant.) "What you said is not relevant to the issue at hand." is the same as "What you said is irrelevant to the issue at hand."
You should always answer your doctor's questions truthfully, even if they do not seem relevant to your symptoms. The subject of financing is relevant to any new construction proposals. The testimony...