Realised that my headphones were sounding really muddy and somehow got it into my head that maybe my amp just couldn't drive them properly. Turns out I was just using the wrong gain setting and missing out on like 60% of the output power by not using the balanced port.
Successfully staved off urge to buy more expensive audio equipment.