@arcana @sun @genmaicha
with an average Nvidia (!) 30xx/40xx gaming GPU, you can already run some things. Stable Diffusion, Text Generation etc with smaller models. however, the restriction is always VRAM. my 4090 can run a lot, but in retrospect two or four cheaper cards would have been better VRAM-wise.

if you just want to experiment, maybe hourly cloud offer that rent enterprises grade Tesla GPUs and similar are best. it's quite cheap.