When you try to remove prospects which were already targeted in a campaign, you will receive the following error message:
The quickest option is to change the prospect's status to unsubscribe, which will stop further outreach to him/her from your campaign.