How does novel information differ from hallucinating? It doesn’t really, it’s a Bob Ross happy accident aided by the large amounts of information making it mostly reasonable most of the time.
When it gets it right, like really right and you wonder if it’s really thinking, that’s the same amazing moment as when it repeats ‘echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;echo;’ forever.
You’re spot on for all of that. Context windows have a lot to do with the unhinged behavior right now… But it’s a fundamental trait of how LLMs work.
For example, you can tell it to refer to you by a specific name and once it stops you know the context window is overrun and it’ll go off the rails soon… The newer chat bots have mitigations in place but it still happens a lot.
These are non-deterministic predictive text generators.
Any semblance of novel thoughts is due to two things for modern LLMs:
Model “temperature”: a setting that determines how much “randomness” there is… with a value of 0 it will generate exactly what it can find that exactly follows what you gave it the best it can. Note it often breaks when you try this.
It has more information than you: I’ve had interesting interactions with work where it came up with actually good ideas. These are all accounted for by MCPs allowing it to search and piece things together or the post training refinements and catalog augmentation though.
An LLM will only know what it knows.
AGI will be able to come up with novel information or work though things it’s never been trained on.
It caused so much trauma that they had to flee their country!
You, maybe or maybe not doing something that you may not talk about, hurt them so badly they gave up their family, life, work, friends, everything to get away from what you might do even if you don’t talk about it.
Welcome to fascism, the next stages get bumpy.
At first I thought it said
Why was FIFA President in fellatio with Trump at Gaza peace summit in Egypt?
And it made sense.
Do problem r/religiousfruitcake
Wish you were here bests them both.
Hats off to Roy Harper!
All of them, as long as they aren’t Epstein.
Fuck, maybe I should turn my add blocker off once in awhile.
Camera, full color discreet display, and open source/*nix based? Yes, I would throw a couple grand down for that.
He’s got some people he wants his prince to bone saw.
Next deportation camps for people who may or may not be US citizens, or members of the mythical Antifa, will be based in Saudi.