The fuzz slows down the ball in flight, keeps it from bouncing too high, and lets the racket get a better "grip" on it. A perfectly smooth ball would travel so fast and bounce so high that the game would be unplayable. Also, with a smooth ball, it would be much more difficult for the player to control the direction of the shots.