A good VoIP network has very low jitter.  If you get too much jitter, then packets will be received and transferred at different speeds and audio quality will suffer.  If your packets do no arrive or arrive too late, then that audio chunk will be missing or blurred.

The best way to improve your jitter is to check with your ISP.