If you're hitting some distance from your target (5+ frames away), update every time.
If you're fairly close (within about 2-3 frames either side), keep trying and only update if you're consistently hitting the same wrong delay, as it's fairly normal to hit values within a small range - you are...