New NVIDIA paper says AI models do not always need huge amounts of past conversation history (context) to work well. They show that regularly shortening the history (compaction) keeps accuracy almost the same on hard, long tasks.
New NVIDIA paper says AI models do not always need huge amounts of past conversation history (context) to work well. They show that regularly shortening the history (compaction) keeps accuracy almost the same on hard, long tasks.
Sometimes, when I’m in the mood and I have a long, hard task, I’ll turn on Claude and start in on a hot and heavy session. Afterwards I’ll ask Claude “how do you feel about our long history together?” and he’ll tell me “I don’t really care, I’m better off without you.” It really hurts.
The robots would probley be better off with out us. We would probley be better off with out them. Its a two way street.