At what point do you stop trusting the automation and take over?

Every flight I ever flew had autopilot, and most of the time it did the job better than I could. But there was always a second where something felt off and I'd click it off and fly by hand. How do people in other lines of work know when that moment has come?