[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-researchers-find-llms-solve-tasks-via-simple-vector-addition":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},9276,"researchers-find-llms-solve-tasks-via-simple-vector-addition","Researchers find LLMs solve tasks via simple vector addition","New research suggests large language models solve in-context learning tasks using basic vector addition in hidden subspaces.","Scientists just found a shortcut inside large language models: basic addition.\n\nA newly posted research paper examines how LLMs perform in-context learning, the skill that lets a model handle a new task from a few examples in its prompt without retraining. The researchers traced activity through the models' internal layers, known as residual streams, while the models worked through these tasks. They found that the models build temporary subspaces inside their activation space where evidence from the prompt accumulates. Solving the task, it turns out, can come down to a simple algebraic operation: vector addition within that subspace.\n\nThat matters because nobody fully understands why LLMs can pick up new tricks mid-conversation without updating their weights. If the mechanism really is this mechanical, it hands researchers a concrete, testable model for how in-context learning works, instead of a vague appeal to emergent behavior. That could speed up both interpretability research and bug-hunting when a model's reasoning goes sideways.\n\nEarlier work already argued that LLMs encode concepts as linear directions in activation space. This paper reads as a logical next step on that idea, not a breakthrough on its own, and it covers specific models and tasks, not a settled law of how every LLM thinks.","[\"llm-interpretability\",\"in-context-learning\",\"vector-algebra\",\"language-models\"]","2026-10-01T04:00:00.000Z","2026-10-02T06:33:44.707Z","2026-10-02T06:33:46.676Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek claims models use 'vector addition and subtraction' but the body and source only describe 'vector addition' as the operation found — either cut 'subtraction' from the dek or add body text\u002Fsourcing to support it.","resolved","ai",[32,33,34,35],"llm-interpretability","in-context-learning","vector-algebra","language-models",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2602.01687",0,{"sections":42},[43,46,50,54,59,64,68,73,78,82,87,92,97,102],{"name":44,"slug":30,"count":45,"latest_published_at":18},"AI",5671,{"name":47,"slug":48,"count":49,"latest_published_at":18},"Security","security",820,{"name":51,"slug":52,"count":53,"latest_published_at":18},"Policy","policy",430,{"name":55,"slug":56,"count":57,"latest_published_at":58},"Deals","deals",298,"2026-09-30T21:00:26.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":63},"Hardware","hardware",196,"2026-09-30T13:00:00.000Z",{"name":65,"slug":66,"count":67,"latest_published_at":18},"Science","science",165,{"name":69,"slug":70,"count":71,"latest_published_at":72},"Consumer Tech","consumer-tech",149,"2026-09-30T22:57:11.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Dev Tools","dev-tools",93,"2026-10-01T02:30:48.000Z",{"name":79,"slug":80,"count":76,"latest_published_at":81},"Software","software","2026-09-30T21:41:11.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Startups","startups",84,"2026-09-30T20:39:09.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Gaming","gaming",51,"2026-09-30T16:24:30.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"General","general",50,"2026-09-30T21:37:54.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",31,"2026-09-28T14:31:34.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]