Deleting a contact does not remove them from marketing campaigns

I would consider this a bug, personally. If a contact is deleted, I would expect them to be deleted from marketing campaigns as well.

Fortunately, it looks like you can restore a contact, clear their campaigns, and then delete the contact again.