As been mentioned, they seem to be soft/blurry. That may be because of the lens, 45mm at 4.5, I presume that's shooting wide open at that length for that lens? If so, stopping down 2 stops, possibly to f8 could possibly have a sharper image, which means you'll need to bump up the ISO 2 stops to maintain 1/640.
Also, freezing action is good in some instances, but also having motion blur adds to the feel of a race and speed.
For instance:
This one looks like he's standing still - 1/1250, ISO 100, f4, 100mm
Zoom-Zoom - 1/20, ISO 100, f16, 70mm
If you shoot that course again, I say reposition yourself further up the course as they enter the turn, this will put you closer to the line which will get their facial expressions.