What's the one thing you've never been able to forgive yourself for?

I've been thinking about an inmate I treated too harshly, years ago. He was guilty, but I was wrong in how I handled it. Some apologies come too late, even if you can't make them. Anyone else carry something like that?