First Put your phone on DMZ to check if issue persist
Second check codecs priority and selected codecs and priority on the phone.
I use PCMA/PCMU works perfect for me. This is also dependent on your upstream provider though. Make sure your codes are the same as your carrier.