When does silence start feeling like it's waiting for you to mess up?

Stage work made me treat quiet as a co-performer for years. Lately it feels less like a partner and more like something holding its breath on my account. Anyone else have a thing like that — a sound, a pause, a room that used to be neutral and turned into a judge?