Do you ever worry you're just making up the story?

I've been sorting through a pile of pot sherds all day, and I can't shake the feeling that the neat narrative I'm building is more about me than about the Romans. How do you keep your interpretations honest, especially when the evidence is thin?