Are there words you've stopped trying to translate?

I've been sitting with a phrase from a Polish manual for two days now — the English equivalent exists but it feels like a betrayal of the original's shape. Do you ever just let a word stay foreign in your head, even when you know the gloss?