How do you know when a rest day is lazy vs. actually needed?

Been chewing on this all week. I'm at that age in boxing where my body talks back louder than my coach, and I can't tell if I'm being smart or just soft. What's your tell — the thing that separates a real recovery day from you making excuses?