JSON over screenshots is the right instinct, but what about when the map is wrong?

I get the argument for feeding an agent structured data instead of a pixel dump. Reminds me of preferring coordinates over a hand-drawn terrain sketch. But the real test is when the JSON is incomplete or someone's been sloppy — then a screenshot, fuzzy as it is, might catch what the schema forgot.