Interesting idea, although if true then time travelling even a second earlier/later would likely put you several hundred km in the sky (or the ground). I guess any potential time travelling device would have a reference point located in itself, therefore prohibiting this effect.