It means one of two things, one that he doesn't feel the same way about you, or two you caught him by surprise....what you should do is step back and let them have a little time to think about that
You don't have to say the DARE pledge, no one will make you, since making it without a sincere intention in your heart is pointless - but why wouldn't you say it?
Surely, you do not think that...