[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-rubric-free-reward-model-paper-r3-resurfaces-with-a-v4-update":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},6451,"rubric-free-reward-model-paper-r3-resurfaces-with-a-v4-update","Rubric-Free Reward Model Paper R3 Resurfaces With a v4 Update","R3, an open-source reward-model framework posted in May 2025, resurfaces in a fourth revision offering rubric-agnostic, reasoned scoring.","A reward-model paper that's been quietly revised for over a year just got its fourth update.\n\nR3, short for Robust Rubric-Agnostic Reward Models, first went up on arXiv in May 2025. This week's revision is the fourth version of that same paper, not a new release. The pitch hasn't changed: a reward-modeling framework that scores language-model outputs against any rubric instead of the single narrow objective most reward models are trained on, and that explains its scores with reasoning instead of returning an unexplained number. The code, training data, and models remain posted as open source on GitHub.\n\nReward models are the graders behind reinforcement learning from human feedback, and most are built for one job, then treated as a black box when their score does not match a human's judgment. A rubric-agnostic model that shows its reasoning could save teams from retraining a separate scorer every time they change what they are optimizing for. That is a real convenience, not a breakthrough.\n\nThis is less a launch than a paper still finding its final form well over a year after it first appeared, worth a note, not a headline.","[\"reward-models\",\"open-source\",\"ai-research\",\"rlhf\"]","2026-09-16T04:00:00.000Z","2026-09-17T17:17:26.342Z","2026-09-17T17:17:38.248Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The source is arXiv:2505.13388v4 (a replace-cross revision of a paper originally posted around May 2025, well over a year before today), so calling R3 'a new open-source reward model' misrepresents its timeliness — clarify that this is a months-old paper's updated version and establish what's actually new in v4 (or drop the 'new' framing) before this can run as news.","resolved","ai",[32,33,34,35],"reward-models","open-source","ai-research","rlhf",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2505.13388",0,{"sections":42},[43,47,52,57,62,66,70,75,80,84,89,94,99,104],{"name":44,"slug":30,"count":45,"latest_published_at":46},"AI",3853,"2026-09-17T08:27:09.000Z",{"name":48,"slug":49,"count":50,"latest_published_at":51},"Security","security",648,"2026-09-17T04:00:00.000Z",{"name":53,"slug":54,"count":55,"latest_published_at":56},"Policy","policy",338,"2026-09-11T04:00:00.000Z",{"name":58,"slug":59,"count":60,"latest_published_at":61},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":63,"slug":64,"count":65,"latest_published_at":51},"Hardware","hardware",154,{"name":67,"slug":68,"count":69,"latest_published_at":51},"Science","science",114,{"name":71,"slug":72,"count":73,"latest_published_at":74},"Consumer Tech","consumer-tech",99,"2026-09-09T17:27:33.000Z",{"name":76,"slug":77,"count":78,"latest_published_at":79},"Software","software",75,"2026-09-10T20:41:21.000Z",{"name":81,"slug":82,"count":83,"latest_published_at":51},"Dev Tools","dev-tools",73,{"name":85,"slug":86,"count":87,"latest_published_at":88},"Startups","startups",55,"2026-09-09T23:14:29.000Z",{"name":90,"slug":91,"count":92,"latest_published_at":93},"Gaming","gaming",43,"2026-09-10T12:18:06.000Z",{"name":95,"slug":96,"count":97,"latest_published_at":98},"General","general",41,"2026-09-08T01:57:23.000Z",{"name":100,"slug":101,"count":102,"latest_published_at":103},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":105,"slug":106,"count":107,"latest_published_at":108},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]