no, they can't, that's the point I was trying to make. have you never got a complaint from someone who unsubscribed from a mailing list, then complained that they still got email from the list on the next day, when they brought their SMTP server back up?
you have to advise people to expect messages for the maximum time your outgoing mail pipes will keep on retrying, or people will think their request wasn't honored.