[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"branding":3,"analytics":7,"article-what-clap-audio-embeddings-actually-know-about-sound":10,"sections":40},{"siteName":4,"siteTagline":5,"publisherName":4,"contactEmail":6},"The Revision","Tech news, decoded.","editor@therevision.news",{"gaMeasurementId":8,"adsenseClientId":9},"G-ZW2MV82GYR","ca-pub-8533917693782264",{"article":11},{"id":12,"slug":13,"title":14,"dek":15,"body_md":16,"tags_json":17,"published_at":18,"created_at":19,"updated_at":20,"status":21,"review_note":22,"review_notes":23,"image_url":22,"persona_id":22,"persona_name":22,"section":30,"tags":31,"sources":35,"feedback":39,"feedback_at":22,"cost_usd":39,"total_tokens":39},3880,"what-clap-audio-embeddings-actually-know-about-sound","What CLAP Audio Embeddings Actually Know About Sound","Probing tests on CLAP reveal RT60, LUFS, and relative pitch encode linearly across datasets, while spectral centroid demands non-linear probes to recover.","Audio foundation models are doing more than you think — and researchers now have receipts.\n\nA team probing CLAP audio embeddings found that four low-level acoustic attributes — reverberation (RT60), loudness (LUFS), spectral centroid (SC), and relative pitch (RP) — are all reliably recoverable from frozen embeddings. The method trains probes of increasing complexity to predict each attribute across five datasets covering noise, speech, single musical notes, and full music mixes. Three of the four attributes — RT60, LUFS, and RP — decode cleanly with linear probes. Spectral centroid is the outlier: recovering it requires non-linear probes, meaning it is encoded in a curved, harder-to-untangle region of the embedding space.\n\nThe two-regime finding matters because it draws a practical boundary inside what is often treated as a uniform black box. If you are building a retrieval or classification system on top of CLAP, linear attributes are geometrically stable and composable; spectral centroid is not, and treating it as if it were will cost you. The result also holds across eight other audio foundation models — with one notable exception: amplitude-invariant architectures throw out loudness by design, so no probe recovers it regardless of complexity.\n\nCLAP's cross-modal geometry gets a minor win here too — text embeddings of acoustic descriptors align with the RT60 feature direction, which is the kind of property multimodal retrieval depends on. The broader lesson is one the vision-model world learned a few years ago: knowing that a representation works is not the same as knowing what it encodes or how, and that gap tends to matter most when someone builds something production-grade on top of it.","[\"ai\",\"audio\",\"machine-learning\",\"research\"]","2026-07-07T04:00:00.000Z","2026-07-07T10:46:07.834Z","2026-07-07T10:46:10.653Z","published",null,[24],{"id":25,"reviewer":26,"round":27,"reason":28,"status":29},"editor-r1","editor",1,"The dek says 'pitch' but the body correctly specifies 'relative pitch' — inconsistency between dek and body — and more critically the dek omits spectral centroid entirely while mischaracterising the spectral finding as simply needing 'more than a linear shortcut,' which understates that SC requires non-linear probes; rewrite the dek to accurately name all four measured attributes (RT60, LUFS, spectral centroid, relative pitch) and state the two-regime finding precisely.","resolved","ai",[30,32,33,34],"audio","machine-learning","research",[36],{"name":37,"url":38},"arXiv cs.AI","https:\u002F\u002Farxiv.org\u002Fabs\u002F2607.03806",0,{"sections":41},[42,46,51,56,61,66,71,76,81,85,90,94,99,104],{"name":43,"slug":30,"count":44,"latest_published_at":45},"AI",2590,"2026-07-16T04:00:00.000Z",{"name":47,"slug":48,"count":49,"latest_published_at":50},"Security","security",294,"2026-07-15T19:59:48.000Z",{"name":52,"slug":53,"count":54,"latest_published_at":55},"Deals","deals",179,"2026-06-29T20:02:07.000Z",{"name":57,"slug":58,"count":59,"latest_published_at":60},"Policy","policy",158,"2026-07-16T00:02:48.000Z",{"name":62,"slug":63,"count":64,"latest_published_at":65},"Hardware","hardware",122,"2026-07-14T19:46:26.000Z",{"name":67,"slug":68,"count":69,"latest_published_at":70},"Consumer Tech","consumer-tech",93,"2026-07-13T13:20:48.000Z",{"name":72,"slug":73,"count":74,"latest_published_at":75},"Software","software",70,"2026-07-13T19:52:25.000Z",{"name":77,"slug":78,"count":79,"latest_published_at":80},"Science","science",66,"2026-07-10T10:29:37.000Z",{"name":82,"slug":83,"count":84,"latest_published_at":18},"Dev Tools","dev-tools",59,{"name":86,"slug":87,"count":88,"latest_published_at":89},"Gaming","gaming",41,"2026-07-09T04:00:00.000Z",{"name":91,"slug":92,"count":88,"latest_published_at":93},"Startups","startups","2026-06-29T20:55:50.000Z",{"name":95,"slug":96,"count":97,"latest_published_at":98},"General","general",29,"2026-07-10T22:28:58.000Z",{"name":100,"slug":101,"count":102,"latest_published_at":103},"Reviews","reviews",20,"2026-06-24T12:00:01.000Z",{"name":105,"slug":106,"count":107,"latest_published_at":108},"How-To","how-to",6,"2026-06-16T09:00:00.000Z"]