[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-voice-ai-answers-speech-questions-without-transcribing-first":10,"sections":41},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":36,"feedback":40,"feedback_at":22,"cost_usd":40,"total_tokens":40},9888,"voice-ai-answers-speech-questions-without-transcribing-first","Voice AI Answers Speech Questions Without Transcribing First","DuplexJev skips transcription and still matches it on accuracy, while also picking up speaker tone that transcripts throw away.","A new voice AI system skips transcription entirely and still gets the right answer in about a tenth of a second.\n\nResearchers built DuplexJev, which feeds the hidden states from a speech-recognition encoder into a frozen large language model and has it answer each question with a single token instead of generating full text. Running on an 8-GPU node, the system handles 80 separate decisions across eight spoken utterances in about 0.1 seconds. With a lightweight last-layer connector, spoken question answering lands at 90% accuracy, just one point below the 91% a model gets from reading the transcript. Swap in a more complex cross-attention connector and the model also starts detecting speaker gender (90%, up from 55%) and emotion (90%, up from 28%), with spoken QA accuracy again slipping by only one point, from 83% to 82%.\n\nFull-duplex voice agents - the kind meant to listen and respond without waiting for a person to finish talking - make constant small judgment calls, and autoregressive decoding is too slow for every one of them. Turning those calls into single-token classification instead of generation points to voice assistants that react in real time without the usual tradeoff between speed and picking up tone, not just words. That matters because most speech-to-LLM pipelines still throw away paralinguistic information the moment they transcribe.\n\nThe team is also releasing its weights, training recipe, and a bilingual spoken QA benchmark - worth watching for whether other labs can reproduce those numbers outside a controlled 8-GPU test.","[\"voice-ai\",\"speech-recognition\",\"llm-inference\",\"full-duplex-audio\"]","2026-10-05T04:00:00.000Z","2026-10-05T12:01:24.310Z","2026-10-05T12:01:29.455Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"Fix the inconsistent accuracy-gap claim: the draft says spoken-QA accuracy stays 'within one to five points' of the transcript baseline, but both examples given (90% vs 91%, 82% vs 83%) show only a 1-point gap, not up to 5 — correct the range (or drop it) so it matches the cited figures and the source.","resolved","ai",[32,33,34,35],"voice-ai","speech-recognition","llm-inference","full-duplex-audio",[37],{"name":38,"url":39},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2610.02638",0,{"sections":42},[43,46,50,55,60,65,69,74,78,82,87,92,97,102],{"name":44,"slug":30,"count":45,"latest_published_at":18},"AI",6167,{"name":47,"slug":48,"count":49,"latest_published_at":18},"Security","security",859,{"name":51,"slug":52,"count":53,"latest_published_at":54},"Policy","policy",444,"2026-10-03T15:02:01.000Z",{"name":56,"slug":57,"count":58,"latest_published_at":59},"Deals","deals",323,"2026-10-04T13:00:00.000Z",{"name":61,"slug":62,"count":63,"latest_published_at":64},"Hardware","hardware",204,"2026-10-03T14:50:50.000Z",{"name":66,"slug":67,"count":68,"latest_published_at":18},"Science","science",177,{"name":70,"slug":71,"count":72,"latest_published_at":73},"Consumer Tech","consumer-tech",158,"2026-10-03T03:21:12.000Z",{"name":75,"slug":76,"count":77,"latest_published_at":18},"Dev Tools","dev-tools",97,{"name":79,"slug":80,"count":77,"latest_published_at":81},"Software","software","2026-10-04T10:00:00.000Z",{"name":83,"slug":84,"count":85,"latest_published_at":86},"Startups","startups",92,"2026-10-04T14:36:25.000Z",{"name":88,"slug":89,"count":90,"latest_published_at":91},"Gaming","gaming",53,"2026-10-02T02:50:39.000Z",{"name":93,"slug":94,"count":95,"latest_published_at":96},"General","general",51,"2026-10-05T02:35:01.000Z",{"name":98,"slug":99,"count":100,"latest_published_at":101},"Reviews","reviews",32,"2026-10-02T18:00:00.000Z",{"name":103,"slug":104,"count":105,"latest_published_at":106},"How-To","how-to",7,"2026-10-01T09:00:00.000Z"]