Yeah, having enough money that your investments throw off significant income is pretty great. So is winning the birth lottery and having a trust fund you can live off of or winning an actual lottery.
But that's a different thing than having to buy lower quality items that cost more in the long run.
If you look at the actual thing, the price of homes purchases by poor people or the cost of rent paid, it's generally lower and not higher.