Modulate Earns #1 Spot on Hugging Face’s Transcription Benchmark
The milesto e u de sco es how Modulate’s u ique voice- ative a chitectu e ca outpe fo m a lot la ge playe s ac oss the met ics that matte most to e te p ises: accu acy, pace, a d price. The a ki g demo st ates that specialised AI fashions pu pose-built fo co ve satio al audio ca compete on the highest ranges with out elyi g o i c easi gly la ge a d expe sive fou datio fashions.
“T a sc iptio has turn into fou datio al to voice AI, however the eco omics have ot stored up with how these methods a e really bei g deployed,” stated Mike Pappas, CEO a d co-fou de of Modulate. “Develope s a d e te p ises ought to ot have to decide on betwee accu acy, pace, a d affo dability. Modulate delive s all th ee, whereas ope i g the doo to a a lot deepe u de sta di g of what’s happe i g i stay co ve satio s.”
The Huggi g Face Ope ASR Leade boa d p ovides a t a spa e t, ep oducible compa iso of leadi g ope -sou ce a d comme cial t a sc iptio fashions ac oss sta da dized datasets spa i g a number of domai s, acce ts, a d eco di g co ditio s. Fashions a e evaluated usi g Wo d E o Price, o WER, the sta da d met ic fo t a sc iptio accu acy that measu es the pe ce tage of wo ds a mannequin will get w o g, with a lowe WER i dicati g highe accu acy. Modulate a ked #1 out of 88 fashions, demo st ati g Modulate’s capacity to delive state-of-the-a t t a sc iptio accu acy on the best p ice poi t out there.
As t a sc iptio turns into c itical i f ast uctu e fo voice age ts, co tact ce te s, f aud detectio , custome expe ie ce, a d co ve satio al AI wo kflows, e te p ises a d develope s a e i c easi gly dema di g solutio s that ca pe fo m at scale. Modulate meets that eed, delive i g high-pe fo ma ce t a sc iptio whereas se vi g as a e t y poi t i to Modulate’s b oade Velma platfo m fo voice- ative co ve satio u de sta di g.
Fo develope s evaluati g t a sc iptio fashions, i depe de t validatio o be chma okay pe fo ma ce provides co fide ce that fashions will pe fo m as anticipated i eal-wo ld co ditio s. I la ge-scale e vi o me ts, eve small diffe e ces i t a sc iptio accu acy a d p ice ca t a slate i to mea i gful diffe e ces i eliability, custome expe ie ce, a d ope ati g price.
Modulate t ai s its fashions o mo e tha 500 millio hou s of oisy, eal-wo ld audio, givi g it a st o g fou datio fo e vi o me ts whe e speech is ot clea , sc ipted, o studio-quality. The mannequin t a sc ibes faste tha eal time, which is esse tial fo stay t a sc iptio , st eami g applicatio s, a d othe voice wo kflows whe e late cy di ectly impacts use expe ie ce.
U like co ve tio al t a sc iptio instruments that focus p ima ily o co ve ti g speech to textual content, T a sc iptio is pa t of Modulate’s b oade voice i tellige ce platfo m, constructed to u de sta d eal-wo ld audio sig als that t a sc ipts alo e ca ot captu e. Modulate’s E semble Liste i g Mannequin, o ELM, a chitectu e combi es doze s of audio- ative fashions desig ed to u de sta d voice, e abli g Modulate to delive extremely accu ate, p oductio – eady audio i tellige ce at a f actio of the price of la ge , mo e ge e alized fashions o LLM-fi st app oaches.
I additio to high-accu acy t a sc iptio , Modulate’s t a sc iptio fashions suppo t adva ced voice i tellige ce capabilities i cludi g emotio detectio de ived f om audio sig als athe tha t a sc ipt textual content, dia izatio , acce t ide tificatio , deepfake detectio , a d suppo t fo 57+ la guages a d dialects.
These capabilities a e particularly impo ta t as voice AI strikes f om co t olled demos i to stay, high-stakes e vi o me ts. I co tact ce te s, AI age ts, f aud p eve tio wo kflows, a d e te p ise voice applicatio s, what matte s is ot o ly what was stated, however the way it was stated, who stated it, whethe the voice ca be t usted, a d what co textual content is eme gi g i the co ve satio .
“T a sc iptio is a impo ta t sta ti g poi t, however it’s ot the e d state,” stated Pappas. “The eal oppo tu ity is co ve satio u de sta di g. Voice ca ies sig als like emotio , u ge cy, hesitatio , acce t, ide tity, a d authe ticity that eve appea i a t a sc ipt. Velma is constructed to assist e te p ises captu e these sig als a d tu them i to actio in a position i tellige ce.”
Most voice pipeli es nonetheless begi by flatte i g audio i to textual content, the passi g that textual content i to a LLM o othe dow st eam system. Whereas that app oach has turn into sta da d, it disca ds a lot of the mea i g co tai ed i the o igi al audio, i cludi g to e, i te t, speake dy amics, i te uptio s, sa casm, emotio , a d othe co ve satio al sig als that ca cha ge how a co ve satio needs to be u de stood.
Velma combi es Modulate’s i mud y-leadi g t a sc iptio fashions with these additio al acoustic sig als, e abli g a iche u de sta di g of co ve satio s which powe s co te t mode atio , f aud p eve tio , custome expe ie ce, a d t ust a d security use circumstances. Modulate’s app oach is g ou ded i eal-wo ld audio, i cludi g oisy, high-scale, emotio ally advanced voice e vi o me ts whe e accu acy, late cy, price, a d explai capacity a e esse tial to p oductio deployme t.
Modulate’s t a sc iptio offe i gs a e out there at p ices betwee $0.025 a d $0.06 pe hou , compa ed with $0.22-0.39 pe hou fo Eleve Labs Sc ibe v2, $0.21-0.45 pe hou fo AssemblyAI U ive sal 3 P o, a d $0.31-0.55 pe hou fo Deepg am Nova-3, maki g Modulate 7x to 10x much less expe sive tha seve al othe leadi g t a sc iptio API p ovide s, whereas delive i g the very best accu acy o Huggi g Face’s ASR be chma okay.
Huggi g Face’s Ope ASR Leade boa d evaluates fashions ac oss seve datasets, i cludi g AMI, Ea i gs-22, GigaSpeech, Lib iSpeech Clea , Lib iSpeech Othe , SPGI Speech, a d VoxPopuli-AA-Clea ed. AMI, which co sists of oisy eal-wo ld meeti g audio, is extensively ega ded as o e of probably the most troublesome datasets, because it eflects the ki d of messy, multi-speake e vi o me ts whe e e te p ise t a sc iptio fashions should really pe fo m.
These t a sc iptio fashions, in addition to othe u ique fashions fo emotio u de sta di g, behavio a alysis, a d a lot mo e, a e all out there at present th ough Modulate’s API. To lea mo e, go to https://www.modulate.ai/.
Modulate is a voice i tellige ce compa y buildi g AI fashions a d APIs desig ed to u de sta d eal-wo ld co ve satio al audio at scale. Its tech ology combi es speech ecog itio , acoustic a alysis, a d co ve satio al co textual content to delive eliable, explai in a position, a d cost-effective voice i tellige ce fo develope s a d e te p ises.
Fo mo e i fo matio o to get sta ted, go to modulate.ai.
Okay isti Ca de sG ithaus Age cy(e)
###

