@thomasfuchs True. I was *mostly* referring to how so much of the training was done through exploitative labor practices in the global South.
(FWIW I also think there’s a lot hidden under the “only trained on licensed works” label. Common Pile includes CC-BY[-SA] works, which LLM-generated text violates.)
The thing about betting on Trump to protect you — quite apart from his lifelong willingness to throw anyone under the bus to save himself — is that he won’t be around in 5 years, much less the rest of your life.
Remember, kids: when it happens, there are going to be thousands of fascists trying to disavow their complicity and be accepted back into normal society.
(South American friends please note, you do not have to let them in this time.)
@anildash@xgranade “Open weights” can mean many things, so pointing that out hardly qualifies as “condescending pedantry”; it’s directly addressing a key point.
Common Pile includes texts that are licensed CC BY and CC BY-SA, so if you’re not attributing (and sharing-alike when required) the fragments of text you extrude, then you’re not complying with the licenses OR consent.
(You may be doing those things, in which case, good; your defensiveness suggests otherwise.)
@anildash@xgranade Unless you mean to imply that your *own* model weights are open, using “open weights” means you are not, in fact, using only your own words.
@whitequark It’d be wild if Rome and the US ended up collapsing for the same damned reason, ~2000 years apart. (Lead generally, I mean, not leaded solder specifically.)
@thomasfuchs It *might* get some of the unengaged folks to realize that yes, politics do affect you, whether you want it or not.
More likely IMO is the oligarchs seeing line go down sharply and throw their weight to get it fixed. Air travel is a big deal financially but pales in comparison to air freight—and ~50% moves on passenger flights. And crippling air freight brings the entire economy to a screeching halt.
And we are far less resilient to a logistics shock than we were in 2001.
@GeePawHill It is also a cognitive hazard for people who read or hear it.
It strengthens the brain’s tendency to interpret text *shaped like* intentional thought *as* intentional thought, thereby weakening its ability to distinguish them.
And multiple studies have shown it happens even if you are aware of the effect.
Practice cognitive hygiene, or at a minimum don’t spread the contagion.
@interfluidity@ryanlcooper “the authors miss a chance to see how the inefficiency and administrative burdens they loathe in construction actually plague the welfare state too, something liberals are very much to blame for but also have no desire to fix.”
Yes!!!
Arguably even more significant impact than for building. (Though there the deadweight accrues mostly to developers and landowners, and so is harder to dislodge.)
@interfluidity I think it’s still underappreciated the degree to which billionaires are rejecting the entirety of the social contract. The problem for them becomes, at some point, that that social contract includes the bits about the people not dragging them from their homes and guillotining them in the public square.
Which is, of course, why controlling the media is existential for them.
Historically, that bet has not paid off in the long run. Ask the Romanovs and Ceaușescus, for example.
@interfluidity@rajivsethi All good points, and I’d largely agree. And to be clear I’m mostly reacting to the information environment where people can firmly believe (for example) that TFG did not say something that he explicitly did, repeatedly, on tape.
I think ultimately it has to come with a recognition that the “marketplace” is like a real one: easily overwhelmed and manipulated by monopolistic actors with wildly disproportionate access to resources. 1/
@interfluidity@rajivsethi And to the extent that’s *new* it’s the combination of a whole new magnitude of inequality and the absurdly low marginal costs of dumping and distributing idea “product” on the digital market. 2/2
@interfluidity @rajivsethi I think—at least right now—it underplays the current harms of misinformation. To the extent we have data, it’s not just a paranoid fringe anymore that holds fundamentally wrong understandings; it appears that a large cohort of Trumpist electoral support really is based on objectively false beliefs.