Embed Notice

@Angle@anticapitalist.party correct, they (supposedly) make tools to be used by other tools, which is how we're doing it. the company i contract with is the "elsewhere" you mention, although that is currently only because it's the cheapest way to get a specific vector product our tools need (embeddings -- base level stuff that is hard to run at-scale in somebody else's cloud cheaply). i'd be better off using claude ($) or a local MoE model like you mention.

as for devstral, despite my best efforts i can't find the time to get stuff going on GPUs here at the house. i'm a fan of Mixtral, but i can only run stuff on CPUs at home so i don't use it for work where it's genuinely faster for me to code the dang script myself than it is to wait on some 8 year old AMDs i got kicking around.