Several things to check:
1- Who is your Internet service provider and what is your Internet plan (256Kbps, 1Mbps, etc..) ?
2- Do you have anything that could be using your Internet connection running in the background (such as Adobe, Chrome/Firefox, anti-virus updater...) ?
3- Are there other people using your connection at the same time (legally: people in your home - illegally: someone who stole your Wi-Fi password) ?
4- What you are talking about "moving back to a prior position" is called "rubber band effect" and is usually caused by an unstable ping (open a command prompt and type in this command: ping -t
www.google.com). Do you get multiple "Request timed out" replies ?