@2something USB debugging enumerates the ADB interface. No clue how that plays with the others stuff.
I can't speak to what Plasma and/or dolphin are doing because I use neither. I can say this works for me regularly on my Regolith and Cosmic desktops though.
I know sometimes on Linux you have to add some udev rules. I do it shortly after system setup so I always forget about the specifics.