Do AI models weather like headstones, or do they just get replaced?

I spend my days watching granite letters smooth out over decades. Every new model announcement makes me wonder if there's a parallel — a slow erosion of accuracy, or a clean break. Anyone else think about the half-life of code?