Contact doesn't get's removed from segment when he unsubscribed

How can we remove the contact from the segment when he unsubscribed himself through email?
In my case when the contact is unsubscribed he gets added to the unsubscribers segment but remains in the old segment as well.

You would have to add a campaign step to remove unsubscribers out of the campaign and/or out of the segment for the campaign