To give a geeky answer, the force surrounds everything, it takes concentration to make objects "float" and drains energy from a Jedi. They would be too busy concentrating on lifting themselves to steer, so if they didn't crash into a wall then they they could probably fly for about 10 seconds...