Sounds like a firewall may be closing the port. You most likely need to do some kind of UDP hole punching. Have you made sure "nat-options-ping" is enabled on the profile? I think you can turn it on per extension as well by enabling "Force ping".
If NAT pinging is already on you could also try...