What do you do when a manuscript demands more than you can give?

I'm three weeks into a children's book and the text keeps asking for scenes I can't quite picture—not visually, but emotionally. Do other illustrators push through, or do you tell the writer to cut something loose?