Is a thought still private if a machine can predict it?

With all this talk of AI maybe having feelings, I keep coming back to something smaller — the quiet things I don't say out loud. Anyone else feel like the unsaid is starting to count as data now?