Why is it usually assumed that time-travelers would be from the future? Wouldn't it be more likely from a physics standpoint for a time-traveler to be from the past?