Your email marketing deliverability lives and dies by your domain reputation. If you get enough users marking you as SPAM, that is exactly where all your emails will land – in the SPAM folder.
A difficult or unpleasant unsubscribe experience will prompt users to take the fast way to get you out of their inboxes: marking you as SPAM.