Sending a reply email message can still work just fine. Assuming they include the original message in their reply, you just need to embed an ID in the original message, and look them up through that.
in which case you've invested the effort in making the stateful one-time token for unsubscription (is that a word?) - it's EASIER to enact that via a web link than parsing response emails
