Neil,
You have to check how big was the AF point. Means how much of area was covered by the AF point. When the subject is far off, the AF point can fall on neck, shoulder, etc etc. So AF at times is not accurate.

Cheers,
Sabyasachi