That's just how time travel looks like to the untrained eye. The reason why there aren't more travelers is that your average physicist refuses to be eaten by a giraffe in the name of science.

I will fucking kill you and anyone else who gets in the way of me and my tunes.

Sometimes the good guy rips out innocent people's throats. That's just something the world need to live with if it wants the good guy to keep saving the day.