Skip to content

The Future of Everything is Lies, I Guess

I am always surprised how many people do not understand this.

“Models do not (broadly speaking) learn over time. They can be tuned by their operators, or periodically rebuilt with new inputs or feedback from users and experts. Models also do not remember things intrinsically: when a chatbot references something you said an hour ago, it is because the entire chat history is fed to the model at every turn. Longer-term “memory” is achieved by asking the chatbot to summarize a conversation, and dumping that shorter summary into the input of every run.”

https://aphyr.com/posts/411-the-future-of-everything-is-lies-i-guess

Leave a Reply

Your email address will not be published. Required fields are marked *