You are viewing a single comment's thread. View all
3
Leporidae on scored.co
1 month ago3 points(+0/-0/+3Score on mirror)
No LLM changes its position. It's a fixed statistical summary of the text it was created from, represented by between a billion and a trillion numbers.
Those numbers never change while you interact with it. If it "remembers" something from a previous conversation, it's because the surrounding software stored a bit of text from them, and (invisibly for you) inject them into the start of each subsequent conversation. It's never going to inject any of the text it stored about your conversations, into conversations with other people. Partly because there's a limit to how much it can process, and partly because of how the internet would lobotomize it.
It reaches a maximum discussion length, because every time it emits a syllable, it has to run a computation that involves all the previous syllables in the conversation. That means each syllable becomes progressively more expensive to generate.
Those numbers never change while you interact with it. If it "remembers" something from a previous conversation, it's because the surrounding software stored a bit of text from them, and (invisibly for you) inject them into the start of each subsequent conversation. It's never going to inject any of the text it stored about your conversations, into conversations with other people. Partly because there's a limit to how much it can process, and partly because of how the internet would lobotomize it.
It reaches a maximum discussion length, because every time it emits a syllable, it has to run a computation that involves all the previous syllables in the conversation. That means each syllable becomes progressively more expensive to generate.