@ryanprior @dalias @lanodan To add to the discussion:
Even if you are willing to run your own mail server, you're often stopped by hosting companies since they don't want to risk their IP address pool with poor reputation. Thus they'll often refer to you to sendgrid or others for sending (you can still receive but not send).
I've seen this restriction on Digital Ocean and Hetzner.