@obrhoff ah ok. Have too look deeper into it. I played around with MLX a few months back and it was fairly easy to get models running on macOS/iOS.
Cool that more of these kind of projects are coming up.
Here is an app that makes use of MLX to run local models on iOS in case you are interested. ✌️