That's the thing is fedi admins believe they are like discord mods and can kick people off the whole fedi who they don't like. You can't. It's designed to prevent you from doing that. This isn't your private server. No matter where you connect to the network from, there will be gab people on it, and there is nothing you can do about it.