@dalias @rysiek @craigmaloney AIUI the Firefox models AREN'T based on "LLMs" in the colloquial sense.
Many of the models *do* use the Transformer architecture, but the size of the model weights¹ is several orders of magnitude away from the state-of-the-arse junk currently separating gullible VCs from their investorbux.
Language-pair translation is a legitimately good approach and Mozilla et al. should be applauded for making it available locally.
¹see `models/prod` in https://github.com/mozilla/firefox-translations-models