You need to go into the graph editor and change the tangents on the curve to linear tangents, that way the animation will be all the same speed.