it happens to me on the first map, time doesn't _seem_ to be a factor.
they get slow, then they'll go back to normal after a few mins, then later they'll go slow again.