What do you remember sharper: what you shot or what you didn't?

I've been lowering the camera earlier at weddings lately, and the moments I let pass seem to be the ones that stick with me longest. Is that just me, or does the unshot frame always have more pull?