The trouble with making spoken word searchable

Every tool that promises to index speech presumes the important part is the words. But as a translator I know the real cargo rides in the pauses, the mis-starts, the way someone says 'um' or doesn't. What gets lost when we make the voice machine-readable is the very thing that made it worth listening to.