9/ Pagliery:
Michael Cohen is back on the stand. He's in a dark (blue? gray?) suit and a sky blue tie.
He keeps a vague, blank expression. He eyeballs each individual juror as they file in, and he nods at one of them.
As they sit down, he takes a deep breath and sighs.
We begin.
Yeah, it’s just a proof of concept. And because I’m down this rabbit hole, I should elaborate that the real bottleneck for this stuff is what’s called the context limit: how much text it can comprehend at a given moment, all at once. People in these AI companies are still sperging about training data quantity, but we’ve legitimately hit diminishing returns on that. We absolutely have not with context limit.
Right now GPT-14 is at 128K tokens and Claude2.1 is at 200K tokens. What’s stopping these LLMs from being an automated GM, or an effective lawyer, is that you can’t make requests like: “Taking on board these five megabytes of TTRPG rules text plus everything on their official forums that amount to the totality of this gameline, plus everything that took place in your game and all of your past rulings in it, what happens next?”
Or requests like: “Taking on board every applicable law in the City of Denver, including Federal, State, and Local laws, is it illegal to do X?”
What’s stopping those kinds of requests is that you can’t fit all that information into 200K tokens. I say megabytes of text instead of the gigabytes the PDFs consume, because the text form of these documents is much smaller. To put it into perspective, the PDF of the Mage: the Awakening 2e rulebook is 37MB, the text file I extract from it is 1.5MB, and the number of tokens it uses up is about 350K.
But in time, we’re going to have humongous context windows, for multiple reasons. One, the implementations themselves will be made to use less VRAM per token. Two, more VRAM will become available. In our lifetimes, we might see some ridonculous shit like context limits that can fit literally all of Wikipedia directly into them.
As an aside, if you want to read some of the copes OpenAI offers for limited context window, read about embeddings.
https://www.tiktok.com/t/ZPRvC3MJf/
This is a Tiktok video (6:18) made by a professional copywriter (user @howtowritecopy on Tiktok) showing all of us how journalists can use specific language to make us empathize or not empathize with victims of violence. She takes two headlines from the past few months and compares them.
Even if you know propaganda is happening and you know some of the tricks they use to manipulate the masses, you are still susceptible. The people producing these media pieces have been trained by experts in how to make you look away and stop paying attention when it suits them.
As consumers of news media, it is absolutely essential that we all learn these techniques to allow us to critically analyze the information we are given in order to know what they want us to think. This way, we can resist their chosen narratives and understand more accurately what is really going on.
This is so, so so important. If you can, please take a few minutes out of your day to learn things that our institutions don't want us to know. I hope you find it as informative as I did!
@timnitGebru
"When people show us who they are, we should believe them"
I believe Israel is showing us who Israel really is since 1948 … funny thing is: we do not want to believe what they keep showing us openly, so we ignore it!
Palestinians are telling us how Israel is oppressing them since 1948 … we ignore them.
As we have ignored Black SouthAfricans until the 1970s and said BDS will "only" hurt the Black poor.
Now we claim BDS to be "antisemitic" — because BDS is very effective!
Daily Inspiration: "If you see a conspiracy behind every tree maybe you need to get out of the forest!" - Futurist Jim Carroll
All of us have lost someone to the maelstrom of the madness, the confusion of the crazy, the innards of the insanity. We've seen otherwise rational people fall prey to delusions, subscribe to conspiracies, and fuel their paranoia through the warm path of the social media misinformation swamp.
I've long been watching all of this with the unease common to most rational, logical, and sane people.
I dare not wade into the debate, knowing that all too quickly, those who have been sucked down into the conspiracy wormhole will rise up in righteous madness.
I know I've lost a few friends along the way, and I always ponder the issue of how otherwise intelligent people can fall into a world of the absolutely irrational. I don't bother trying to debate with them; it seems that they have devoted much time to empower themselves with information from within the conspiracy swap, eager to do nothing more with their lives than to fight within a debate.
I have better things to do with my time.
I just feel sad for them.
As a futurist, I've long had to pay attention to the issue though. After all, while it's easy to predict the future, it's not easy to predict the implications of madness-driven volatility.
All that people can do when passing on traditions is say what they are, explain why they exist, and hope others don't misuse them.
As far as I can tell from the people I follow, they are normally used appropriately.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.