Scouring the internet I found out some enterprising folks back in the 00's were replacing the HDD with a CompactFlash card and a PCMCIA adapter. Those cards are still alive today, so... could that work?
The answer was yes! Took out the HDD, put in the CF+adapter, and after some hacking around I got it to work!