Embed Notice

@kaia @p my previous setup was a slim laptop with a 3090 eGPU, and it worked well. I didn't benchmark it, but my feeling is that loading the model into RAM took a bit longer via Thunderbolt, but once that was done, token generation performance was pretty much the same as with PCIe.

So, adding it via an eGPU enclosure may be viable. I'm sure there's lots of reports on /r/eGPU or on eGPU.io