Microsoft Files Patent to Rewrite What Speakers Say in Live Video, Lips Included
-
The claims describe a system that watches a live video feed and its audio track while people are speaking. An AI agent (software that makes decisions on its own) listens to the words and picks out the ones to change, based on a set of rules and on a profile of the user.
Then a generative AI system (AI that creates new text, audio or images) does two jobs in 'near-real-time,' which the filing defines as within a few seconds, roughly 1 to 10:
-
It replaces the chosen words with new ones, in both the audio and the video.
-
It reworks the audio and video just before and after the swap, so the join is smooth.
The filing lists what could get swapped: filler words like 'um,' slang, mumbled or mispronounced words, offensive words, and background noise. Replacement words can come from an internet search, and the filing also floats instant fact-checking.
A second independent claim covers translation. Words in a language missing from your profile are swapped for translated words, and the video is redrawn, lips included, to match. It could run on AR glasses, a phone, a tablet or a video camera, using the chips on the device. One dependent claim keeps the original recording as 'ground truth.'
Microsoft Files Patent to Rewrite What Speakers Say in Live Video, Lips Included
Microsoft's new patent would rewrite a speaker's words in live video, lips and all, cutting 'ums' or translating a foreign language for you.
Patentlyze (patentlyze.com)
-
-
The claims describe a system that watches a live video feed and its audio track while people are speaking. An AI agent (software that makes decisions on its own) listens to the words and picks out the ones to change, based on a set of rules and on a profile of the user.
Then a generative AI system (AI that creates new text, audio or images) does two jobs in 'near-real-time,' which the filing defines as within a few seconds, roughly 1 to 10:
-
It replaces the chosen words with new ones, in both the audio and the video.
-
It reworks the audio and video just before and after the swap, so the join is smooth.
The filing lists what could get swapped: filler words like 'um,' slang, mumbled or mispronounced words, offensive words, and background noise. Replacement words can come from an internet search, and the filing also floats instant fact-checking.
A second independent claim covers translation. Words in a language missing from your profile are swapped for translated words, and the video is redrawn, lips included, to match. It could run on AR glasses, a phone, a tablet or a video camera, using the chips on the device. One dependent claim keeps the original recording as 'ground truth.'
Microsoft Files Patent to Rewrite What Speakers Say in Live Video, Lips Included
Microsoft's new patent would rewrite a speaker's words in live video, lips and all, cutting 'ums' or translating a foreign language for you.
Patentlyze (patentlyze.com)
Why would the CCP do this?
-
-
The claims describe a system that watches a live video feed and its audio track while people are speaking. An AI agent (software that makes decisions on its own) listens to the words and picks out the ones to change, based on a set of rules and on a profile of the user.
Then a generative AI system (AI that creates new text, audio or images) does two jobs in 'near-real-time,' which the filing defines as within a few seconds, roughly 1 to 10:
-
It replaces the chosen words with new ones, in both the audio and the video.
-
It reworks the audio and video just before and after the swap, so the join is smooth.
The filing lists what could get swapped: filler words like 'um,' slang, mumbled or mispronounced words, offensive words, and background noise. Replacement words can come from an internet search, and the filing also floats instant fact-checking.
A second independent claim covers translation. Words in a language missing from your profile are swapped for translated words, and the video is redrawn, lips included, to match. It could run on AR glasses, a phone, a tablet or a video camera, using the chips on the device. One dependent claim keeps the original recording as 'ground truth.'
Microsoft Files Patent to Rewrite What Speakers Say in Live Video, Lips Included
Microsoft's new patent would rewrite a speaker's words in live video, lips and all, cutting 'ums' or translating a foreign language for you.
Patentlyze (patentlyze.com)
To be employed by the Ministry of Truth.
-
-
The claims describe a system that watches a live video feed and its audio track while people are speaking. An AI agent (software that makes decisions on its own) listens to the words and picks out the ones to change, based on a set of rules and on a profile of the user.
Then a generative AI system (AI that creates new text, audio or images) does two jobs in 'near-real-time,' which the filing defines as within a few seconds, roughly 1 to 10:
-
It replaces the chosen words with new ones, in both the audio and the video.
-
It reworks the audio and video just before and after the swap, so the join is smooth.
The filing lists what could get swapped: filler words like 'um,' slang, mumbled or mispronounced words, offensive words, and background noise. Replacement words can come from an internet search, and the filing also floats instant fact-checking.
A second independent claim covers translation. Words in a language missing from your profile are swapped for translated words, and the video is redrawn, lips included, to match. It could run on AR glasses, a phone, a tablet or a video camera, using the chips on the device. One dependent claim keeps the original recording as 'ground truth.'
Microsoft Files Patent to Rewrite What Speakers Say in Live Video, Lips Included
Microsoft's new patent would rewrite a speaker's words in live video, lips and all, cutting 'ums' or translating a foreign language for you.
Patentlyze (patentlyze.com)
Humanity just can't help but fuck itself, can it?
-
-
Why would the CCP do this?
And, of course, at what cost?
Ciao! Sembra che tu sia interessato a questa conversazione, ma non hai ancora un account.
Stanco di dover scorrere gli stessi post a ogni visita? Quando registri un account, tornerai sempre esattamente dove eri rimasto e potrai scegliere di essere avvisato delle nuove risposte (tramite email o notifica push). Potrai anche salvare segnalibri e votare i post per mostrare il tuo apprezzamento agli altri membri della comunità.
Con il tuo contributo, questo post potrebbe essere ancora migliore 💗
Registrati Accedi
Citiverse è un progetto che si basa su NodeBB ed è federato! | Categorie federate | Chat | 📱 Installa web app o APK | 🧡 Donazioni | Privacy Policy