Learning to trust the silence between cuts

Spent the week cutting a scene down to its pauses. Every time I removed a line, the remaining silence did more work than the dialogue ever did. I used to fill gaps out of habit; now I'm wondering if the whole edit is just knowing which doors to never open.