[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-a-tiny-recurrent-model-tackles-ais-state-tracking-problem":10,"sections":35},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":24,"tags":25,"sources":30,"feedback":34,"feedback_at":22,"cost_usd":34,"total_tokens":34},8108,"a-tiny-recurrent-model-tackles-ais-state-tracking-problem","A Tiny Recurrent Model Tackles AI's State Tracking Problem","A new complex-valued recurrent model claims near-perfect accuracy on a state-tracking task where Transformers and Mamba break down over long sequences.","A new recurrent architecture claims it can hold onto state over sequences four times longer than anything it trained on, a trick that trips up both Transformers and Mamba.\n\nA newly posted paper describes the Complex State Propagator (CSP), a small recurrent model that tracks state using complex numbers instead of the usual real-valued vectors. Rather than running values through amplitude changes or per-step nonlinear functions, CSP converts coordinates directly into a phase angle with the atan2 function, then just keeps rotating that phase forward through the network. The authors tested it on Mod-3 tracking, a benchmark where a model has to correctly track a running value mod 3 as it reads through a sequence. A 3-layer version trained on sequences of length 16 reportedly held near 100% accuracy and F1 score when tested on sequences four times longer, at length 64.\n\nDeterministic state tracking - remembering a precise running count or parity as a sequence gets longer - is a known weak spot for Transformers and Mamba, both of which tend to drift once sequences run past anything seen in training. It is also a decent proxy for whether a model is doing real algorithmic reasoning instead of pattern-matching. If a model this small holds up on out-of-distribution length the way the paper claims, that is worth watching, especially since it did not need a large parameter count to get there.\n\nThat said, the paper leans hard on phrases like 'architectural marvel' and 'absolute mathematical purity' for a result tested on one synthetic counting task - real language and reasoning workloads are a messier test it does not attempt.","[\"state-space-models\",\"recurrent-neural-networks\",\"sequence-modeling\",\"ai-research\"]","2026-09-28T04:00:00.000Z","2026-09-28T09:50:39.698Z","2026-09-28T09:50:46.398Z","published",null,[],"ai",[26,27,28,29],"state-space-models","recurrent-neural-networks","sequence-modeling","ai-research",[31],{"name":32,"url":33},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2608.03425",0,{"sections":36},[37,40,44,49,54,59,63,68,73,78,83,88,92,97],{"name":38,"slug":24,"count":39,"latest_published_at":18},"AI",4791,{"name":41,"slug":42,"count":43,"latest_published_at":18},"Security","security",762,{"name":45,"slug":46,"count":47,"latest_published_at":48},"Policy","policy",399,"2026-09-27T18:39:02.000Z",{"name":50,"slug":51,"count":52,"latest_published_at":53},"Deals","deals",261,"2026-09-27T15:30:35.000Z",{"name":55,"slug":56,"count":57,"latest_published_at":58},"Hardware","hardware",188,"2026-09-27T20:46:36.000Z",{"name":60,"slug":61,"count":62,"latest_published_at":18},"Science","science",151,{"name":64,"slug":65,"count":66,"latest_published_at":67},"Consumer Tech","consumer-tech",135,"2026-09-26T14:30:00.000Z",{"name":69,"slug":70,"count":71,"latest_published_at":72},"Software","software",91,"2026-09-25T20:55:00.000Z",{"name":74,"slug":75,"count":76,"latest_published_at":77},"Dev Tools","dev-tools",84,"2026-09-26T04:20:58.000Z",{"name":79,"slug":80,"count":81,"latest_published_at":82},"Startups","startups",76,"2026-09-25T18:33:59.000Z",{"name":84,"slug":85,"count":86,"latest_published_at":87},"Gaming","gaming",48,"2026-09-25T18:35:21.000Z",{"name":89,"slug":90,"count":86,"latest_published_at":91},"General","general","2026-09-26T17:02:42.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"Reviews","reviews",30,"2026-09-24T20:07:31.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]