If I change #Matrix server softwares while using the same hostname, how badly am I likely to screw everything up?

I started off with Conduit and I'm regretting it. I'm not so invested in the setup that I need to keep my chat history, I just don't want some inter-domain encryption key shenanigans to happen if suddenly socially.drinkingatmy.computer is now a different homeserver. A web search didn't return anything useful.

Kikuri for your time.