The exact opposite happens to me. Within reach, I am more interested. Out of reach, I lose interest.
It's different if we have been in bed together, and she's suddenly out of reach. Last time this happened, I panicked and lost control. Hopefully, I've learned my lesson.