He probably can't kick you out, there's protections and shit depending on where you live. If he's a dick, then even more reason to dick him as much as you can.

I get you though, I've been pretty fucking close to calling it quits. It does turn back around though, even if it's brief. It's better than nothing.