My partner is asking me to stop talking to my ex

My boyfriend gets upset because I'm still in contact with my ex, just as friends. He says it makes him uncomfortable, but I think he's being controlling. Do I have to cut off all communication, or am I within my rights to keep the friendship?