Try disabling Call Waiting, but then you may only get one call to your extension at a time.
On the phone:
Settings -> Call Features -> Disable Call Waiting = Yes
Also:
# Disable Call Waiting. 0 - No, 1 - Yes. Default is 0
# Number: 0, 1
# Mandatory
P91 = 0 <--- Change this to 1