Embed Notice

@simon
LoRA is clearly a great tool but, to use an open source analogy, it feels like applying a kernel patch downstream: it gets the job done but at some point, if it is generic enough, it needs to be upstreamed. And that part is not possible with LoRA. To integrate the modification in the model, a full retraining is inevitable.