@vruz All those things affect millions of other people, an abstract statistic that we cannot fully viscerally understand, but stepping down affects yourself.
In particular, stepping down from his potential position means stopping being a politician, which he has been from before he was the youngest senator until he was the oldest president. There's no way to mentally distance yourself from that decision.