I agree with this given the current situation where a person can just go get the procedure in some other state.
Though if it were a total ban, and even illegal to go out of your area to get one, then even the wealthy wouldnt be able to get an abortion. But thats not the case, so what we have right now what you are saying is certainly true, and a bit issue IMO.