It is easy to time-travel, the physicist says—we do it every day. Travelling backward is the problem.