When you get out if you hang around, your physical body will pull you back in- if you find yourself floating around your room get out of there (through the wall, to another room) fast before it happens.
Yeah I've noticed myself that your physical body is like a magnet to your Astral body. It does seem the further away you are, the less likely you'll go right back in.