In my experience it seems that it is the amount of pressure, not the acceleration of the ball that causes the most pain.
For example if you have a pin and press hard on the flat side of it, it does not hurt. However if you press even very gently on the sharp side, you will experience pain (DON'T TRY THIS AT HOME, my science teacher did when I was 8 to demostrate pressure).
The same applies here with the cricket ball. It depends where you get hit. Last year I got hit in the mouth by a cricket ball, and it hurt a great deal. This is because Pressure = Force/Surface Area, and the ball hit me on my teeth, which have a small surface area, therefore lots of pressure felt on the teeth, and hence lots of pain. Acceleration also has a big part in the pain felt as using Newton's 2nd Law, Force = Mass * Acceleration, therefore the greater the acceleration, the greater the force.
But why do I say the surface area of where you get hit is more important than acceleration? Well if I can draw your attention to my father, he got hit by a cricket ball at a recent ODI at Lords (http://www.youtube.com/watch?v=m5j8_IkDWGw). Now in this instance he got hit on the face, and it didn't actually hurt him that much, as the ball impacted him over a greater surface area.
For the 10 or so years I have played cricket, it seems that people do not get hurt when hit on the forehead, but rather when they are hit on the cheek, chin ot mouth, places with less surface area.
Just one last thing I'd thought I'd mention. Horzontal velocity stays constant, so horizontally there is no acceleration. If at 5m above the ground you drop a bullet and fire a bullet from a gun at 100m/s at the same time, they both hit the ground at the same time.
Luckily nowadays I normally catch the ball. I urge people to try the same!