[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-algorithm-spec-format-shapes-llm-code-quality-study-finds":10,"sections":44},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":34,"tags":35,"sources":39,"feedback":43,"feedback_at":22,"cost_usd":43,"total_tokens":43},3811,"algorithm-spec-format-shapes-llm-code-quality-study-finds","Algorithm Spec Format Shapes LLM Code Quality, Study Finds","A new study found that how you format an algorithm specification affects first-pass LLM coding accuracy, especially for smaller models.","How you write an algorithm specification affects whether an LLM implements it correctly — but mostly when the model is small.\n\nResearchers tested seven formats for describing machine learning algorithms — plain prose, LaTeX-style pseudocode, PDF-extracted pseudocode, Markdown fields, YAML-like specifications, JSON-like specifications, and Python code stubs — across five tasks, three models, and four experimental settings, producing 4,020 generated implementations. Hidden tests checked the specifics that most commonly break implementations: tie-breaking rules, array shapes, numerical rules, return structures, and invalid-input behavior. When only core information was provided, LaTeX-style pseudocode showed the largest average format effect, with YAML-like specifications and plain prose close behind. Code stubs, despite specifying function signatures up front, did not consistently improve correctness.\n\nThe results carry practical weight for anyone using LLMs to translate research papers into running code, a workflow that has grown common as model capabilities have expanded. Most papers leave implementation details implicit, which means a format choice can silently determine whether an LLM reproduces the right behavior or a plausible-looking approximation of it.\n\nThe study's format effects mostly disappeared under complete-information conditions for one of the three tested models — an OpenAI model identified in the paper by a version string not confirmed against any public release lineup, and omitted here on that basis — while the two smaller open models, Gemma 3 4B and Llama 3.2 3B, still showed format sensitivity even then. If format dependence shrinks as models scale up, the practical advice holds either way: state the interface, the numerical rules, and the edge cases explicitly rather than trusting any format to do that work.","[\"ai\",\"dev-tools\",\"research\",\"machine-learning\"]","2026-07-07T04:00:00.000Z","2026-07-07T09:06:15.464Z","2026-07-07T09:06:18.274Z","published",null,[24,30],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The draft names 'GPT-5.4 mini' as a tested model, but this version cannot be verified against OpenAI's publicly documented release lineup and may be fabricated or misidentified — this must be resolved before publication even though the name appears in the source material, which itself may contain an error the writer should flag rather than repeat.","resolved",{"id":31,"reviewer":26,"round":32,"reason":33,"status":29},"editor-r2",2,"The draft acknowledges the unverifiable model name ('GPT-5.4 mini') but treats it as an ironic aside rather than resolving it — per editorial policy, the draft must either confirm the version against OpenAI's public release lineup or explicitly flag it as unverified and omit the version string; the concern [editor-r1] remains open until that is done.","ai",[34,36,37,38],"dev-tools","research","machine-learning",[40],{"name":41,"url":42},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.03158",0,{"sections":45},[46,50,55,60,65,70,75,80,85,88,93,97,102,107],{"name":47,"slug":34,"count":48,"latest_published_at":49},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":51,"slug":52,"count":53,"latest_published_at":54},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":69},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":71,"slug":72,"count":73,"latest_published_at":74},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":84},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":86,"slug":36,"count":87,"latest_published_at":18},"Dev Tools",59,{"name":89,"slug":90,"count":91,"latest_published_at":92},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":94,"slug":95,"count":91,"latest_published_at":96},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":108,"slug":109,"count":110,"latest_published_at":111},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]