{"id":1088,"date":"2023-09-27T05:00:23","date_gmt":"2023-09-26T21:00:23","guid":{"rendered":"https:\/\/infernews.com\/?p=1088"},"modified":"2024-05-23T21:53:49","modified_gmt":"2024-05-23T13:53:49","slug":"wav2lip-lipsync-%e5%b7%a5%e5%85%b7%ef%bc%89","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/wav2lip-lipsync-%e5%b7%a5%e5%85%b7%ef%bc%89\/","title":{"rendered":"Wav2Lip (Lipsync \u5de5\u5177\uff09"},"content":{"rendered":"\n<p class=\"has-text-align-center\"><strong><mark style=\"background-color:rgba(0, 0, 0, 0)\" class=\"has-inline-color has-luminous-vivid-amber-color\">ChatGPT, Bard, Claude2 \u6bd4\u8f03 <\/mark><\/strong><\/p>\n\n\n<div class=\"vlp-link-container vlp-layout-spotlight-clone wp-block-visual-link-preview-link\"><a href=\"https:\/\/github.com\/Rudrabha\/Wav2Lip\" class=\"vlp-link\" title=\"(\u82f1)GitHub - A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild\" target=\"_blank\"><\/a><div class=\"vlp-layout-zone-main\"><span class=\"vlp-block-0 vlp-link-title\">(\u82f1)GitHub &#8211; A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild<\/span><div class=\"vlp-block-2 vlp-link-image\"><img decoding=\"async\" src=\"https:\/\/opengraph.githubassets.com\/c4c7b4a07ac3a36f50c7299d53d342b133c45754ee0fe803d77047649cd9d6e4\/Rudrabha\/Wav2Lip\" style=\"max-width: 1024px; max-height: 1024px\" \/><\/div><\/div><\/div>\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"[ACM Multimedia, 2020] Wav2Lip: Accurately Lip-syncing Videos In The Wild\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_0fXaDCZNOJc\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F0fXaDCZNOJc%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/0fXaDCZNOJc\" \/><meta itemprop=\"duration\" content=\"PT6M17S\" \/><meta itemprop=\"uploadDate\" content=\"2020-09-03T08:42:38Z\" \/><\/div><div id=\"lyte_0fXaDCZNOJc\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F0fXaDCZNOJc%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">[ACM Multimedia, 2020] Wav2Lip: Accurately Lip-syncing Videos In The Wild<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/0fXaDCZNOJc\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F0fXaDCZNOJc%2F0.jpg\" alt=\"[ACM Multimedia, 2020] Wav2Lip: Accurately Lip-syncing Videos In The Wild\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Title of the paper: A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild Link to the paper: https:\/\/arxiv.org\/abs\/2008.10010 The paper has been accepted for an Oral presentation in ACM Multimedia, 2020 Link to the codes and models: https:\/\/github.com\/Rudrabha\/Wav2Lip Link to the interactive demo: http:\/\/bhaasha.iiit.ac.in\/lipsync\/ Link to the project website: http:\/\/cvit.iiit.ac.in\/research\/projects\/cvit-projects\/a-lip-sync-expert-is-all-you-need-for-speech-to-lip-generation-in-the-wild\/ 00:00 - 00:10 Introduction 00:10 - 01:02 Initial result of Angella Merkel 01:02 - 01:35 Architecture 01:35 - 02:07 Comparison 02:07 - 02:29 Features of the model 02:29 - 02:35 Snapshot of applications 02:35 - 02:54 Syncing interviews with translator&#039;s speech 02:54 - 04:18 Lip syncing dubbed movie scenes 04:18 - 04:43 Lip syncing famous professors in different languages 04:43 - 04:57 Lip-syncing animated characters 04:57 - 05:35 Futuristic Video Conferencing application 05:35 - 06:00 Creating social media content 06:00 - 06:16 Links and conclusion Abstract: In this work, we investigate the problem of lip-syncing a talking face video of an arbitrary identity to match a target speech segment. Current works excel at producing accurate lip movements on a static image or videos of specific people seen during the training phase. However, they fail to accurately morph the lip movements of arbitrary identities in dynamic, unconstrained talking face videos, resulting in significant parts of the video being out-of-sync with the new audio. We identify key reasons pertaining to this and hence resolve them by learning from a powerful lip-sync discriminator. Next, we propose new, rigorous evaluation benchmarks and metrics to accurately measure lip synchronization in unconstrained videos. Extensive quantitative evaluations on our challenging benchmarks show that the lip-sync accuracy of the videos generated by our Wav2Lip model is almost as good as real synced videos. Credits of the clips used: Angella Merkel&#039;s press conference - https:\/\/www.youtube.com\/watch?v=f6Uhfy-Wjh0 French President&#039;s press conference - https:\/\/www.youtube.com\/watch?v=bFgRGdY7mVk Tony Stark&#039;s clip - https:\/\/www.youtube.com\/watch?v=scCmzy33fP0 Dictator clip - https:\/\/www.youtube.com\/watch?v=O8CpVtDxVhs Baazigar clip - https:\/\/www.youtube.com\/watch?v=O8CpVtDxVhs Andrew Ng lecture - https:\/\/www.youtube.com\/watch?v=ArPaAX_PhIs&amp;list=PLkDaE6sCZn6Gl29AoE31iwdVwSG-KnDzF Please check out our other works in 1. LipGAN: https:\/\/www.youtube.com\/watch?v=aHG6Oei8jF0 2. Lip2Wav: https:\/\/www.youtube.com\/watch?v=HziA-jmlk_4\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption>Wav2Lip \u7c21\u4ecb(\u82f1\u6587)<\/figcaption><\/figure>\n\n\n<p><\/p>\n\n\n\n<a href=\"https:\/\/colab.research.google.com\/gist\/hkstemcenter\/c8555f0baceb1277342eaf940bcabded\/wav2lip-tendeepfake-eng.ipynb\" target=\"_parent\" rel=\"noopener\"><img decoding=\"async\" src=\"https:\/\/colab.research.google.com\/assets\/colab-badge.svg\" alt=\"Open In Colab\"\/><\/a>\n\n\n\n<p>\u6211\u5f9e\u4e09\u500b\u4e0d\u540c\u7684 A.I. \u5e73\u53f0\u5617\u8a66\u627e\u66f4\u591a\u95dc\u65bc Wav2Lip \u7684\u8cc7\u6599\u6642\u51fa\u73fe\u5982\u4e0b\u7684\u60c5\u6cc1\uff1a<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>\u9996\u5148\uff0c\u6211\u53bb Bard \u554f\uff1a\u4f60\u6709\u807d\u904e GitHub \u958b\u653e\u6e90\u78bc &#8211; A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild<\/p>\n\n\n\n<p>Bard \u56de\u8986\u6211\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8b20e0c5ce\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8b20e0c5ce\"><code class=\"language-text\">\u662f\u7684\uff0c\u6211\u807d\u904e\u3002\u9019\u662f\u4e00\u500b GitHub \u5b58\u5132\u5eab\uff0c\u5176\u4e2d\u5305\u542b\u4e00\u500b\u540d\u70ba Wav2Lip \u7684 AI \u6a21\u578b\uff0c\u8a72\u6a21\u578b\u53ef\u4ee5\u5c07\u8a9e\u97f3\u8f49\u63db\u70ba\u5634\u5507\u751f\u6210\u3002Wav2Lip \u7531\u4f86\u81ea\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\uff0c\u4e26\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868\u3002\n\nWav2Lip \u7684\u5de5\u4f5c\u539f\u7406\u662f\u9996\u5148\u4f7f\u7528\u9762\u90e8\u8b58\u5225\u7b97\u6cd5\u4f86\u6aa2\u6e2c\u8996\u983b\u4e2d\u7684\u9762\u90e8\u3002\u7136\u5f8c\uff0c\u6a21\u578b\u4f7f\u7528\u4e00\u7d44\u9810\u5148\u8a13\u7df4\u7684\u6578\u64da\u4f86\u5b78\u7fd2\u5c07\u8a9e\u97f3\u4fe1\u865f\u6620\u5c04\u5230\u5634\u5507\u52d5\u4f5c\u3002\u6700\u5f8c\uff0c\u6a21\u578b\u4f7f\u7528\u9019\u4e9b\u77e5\u8b58\u4f86\u751f\u6210\u8207\u8a9e\u97f3\u4fe1\u865f\u5339\u914d\u7684\u5634\u5507\u52d5\u4f5c\u3002\n\nWav2Lip \u662f\u4e00\u500b\u5f37\u5927\u7684\u5de5\u5177\uff0c\u53ef\u7528\u65bc\u5728\u8996\u983b\u4e2d\u5275\u5efa\u903c\u771f\u7684\u5634\u5507\u540c\u6b65\u3002\u5b83\u5df2\u88ab\u7528\u65bc\u88fd\u4f5c\u5404\u7a2e\u61c9\u7528\uff0c\u5305\u62ec\u96fb\u5f71\u3001\u96fb\u8996\u7bc0\u76ee\u548c\u793e\u4ea4\u5a92\u9ad4\u8996\u983b\u3002\n\n\u4ee5\u4e0b\u662f\u4e00\u4e9b\u95dc\u65bc Wav2Lip \u7684\u8a73\u7d30\u4fe1\u606f\uff1a\n\n\u5b83\u662f\u4e00\u500b\u57fa\u65bc\u6df1\u5ea6\u5b78\u7fd2\u7684\u6a21\u578b\uff0c\u4f7f\u7528\u4e86\u5169\u500b\u4e3b\u8981\u7d44\u4ef6\uff1a\u9762\u90e8\u8b58\u5225\u548c\u8a9e\u97f3\u5230\u5634\u5507\u6620\u5c04\u3002\n\u5b83\u662f\u5728\u4e00\u7d44\u5305\u542b 700 \u591a\u500b\u8996\u983b\u548c 100 \u591a\u500b\u8a9e\u97f3\u6587\u4ef6\u7684\u6578\u64da\u96c6\u4e0a\u8a13\u7df4\u7684\u3002\n\u5b83\u53ef\u4ee5\u751f\u6210\u8207\u539f\u59cb\u8996\u983b\u4e2d\u5634\u5507\u52d5\u4f5c\u9ad8\u5ea6\u5339\u914d\u7684\u5634\u5507\u52d5\u4f5c\u3002\nWav2Lip \u4ecd\u5728\u958b\u767c\u4e2d\uff0c\u4f46\u5b83\u5df2\u7d93\u662f\u4e00\u500b\u5f37\u5927\u7684\u5de5\u5177\uff0c\u53ef\u7528\u65bc\u5728\u8996\u983b\u4e2d\u5275\u5efa\u903c\u771f\u7684\u5634\u5507\u540c\u6b65\u3002<\/code><\/pre>\n            <\/div>\n\n\n\n<p>\u7136\u5f8c\u6211\u9078\u64c7 Bard \u56de\u8986\u7576\u4e2d\u7684\u4e00\u6bb5\u53bb\u554f ChatGPT3.5:<\/p>\n\n\n\n<p>Wav2Lip \u7531\u4f86\u81ea\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\uff0c\u4e26\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868\u3002\u9019\u6b63\u78ba\u55ce\uff1f<\/p>\n\n\n\n<p>ChatGPT3.5 \u56de\u8986\u6211\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8b20e0c66a\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8b20e0c66a\"><code class=\"language-text\">\u5f88\u62b1\u6b49\uff0c\u60a8\u63d0\u4f9b\u7684\u4fe1\u606f\u4e0d\u6e96\u78ba\u3002Wav2Lip \u662f\u4e00\u7a2e\u7528\u65bc\u5be6\u73fe\u5634\u5507\u540c\u6b65\u7684\u4eba\u5de5\u667a\u80fd\u6280\u8853\uff0c\u5b83\u53ef\u4ee5\u5c07\u8072\u97f3\u8207\u5634\u90e8\u52d5\u4f5c\u540c\u6b65\uff0c\u5f9e\u800c\u7522\u751f\u4f3c\u4e4e\u8aaa\u8a71\u7684\u6548\u679c\u3002\u7136\u800c\uff0cWav2Lip \u4e26\u4e0d\u662f\u7531\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\u7684\uff0c\u4e5f\u6c92\u6709\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868\u3002\n\nWav2Lip \u662f\u7531\u5370\u5ea6\u7684\u4e00\u5bb6\u516c\u53f8 Synthace Private Limited \u958b\u767c\u7684\uff0c\u5b83\u5728\u793e\u4ea4\u5a92\u9ad4\u4e0a\u5ee3\u6cdb\u50b3\u64ad\uff0c\u4e26\u53d7\u5230\u8a31\u591a\u4eba\u7684\u6b61\u8fce\u3002\n\n\u4f46\u662f\uff0c\u8a72\u6280\u8853\u4e26\u6c92\u6709\u51fa\u73fe\u5728\u5b78\u8853\u6703\u8b70\u4e0a\u767c\u8868\u7684\u8ad6\u6587\u4e2d\uff0c\u800c\u662f\u901a\u904e\u958b\u767c\u4eba\u5de5\u667a\u80fd\u6a21\u578b\u4f86\u5be6\u73fe\u7684\uff0c\u9019\u4e9b\u6a21\u578b\u53ef\u4ee5\u5c07\u97f3\u983b\u8207\u5634\u90e8\u52d5\u4f5c\u9032\u884c\u5339\u914d\uff0c\u5f9e\u800c\u7522\u751f\u5634\u5507\u540c\u6b65\u7684\u6548\u679c\u3002\u8acb\u6ce8\u610f\uff0c\u95dc\u65bc\u6280\u8853\u548c\u7814\u7a76\u7684\u4fe1\u606f\u53ef\u80fd\u6703\u4e0d\u65b7\u66f4\u65b0\u548c\u6f14\u8b8a\uff0c\u56e0\u6b64\u6700\u597d\u67e5\u95b1\u6700\u65b0\u7684\u4f86\u6e90\u4ee5\u7372\u53d6\u6e96\u78ba\u7684\u4fe1\u606f\u3002<\/code><\/pre>\n            <\/div>\n\n\n\n<p>\u70ba\u4e86\u78ba\u5b9a Bard \u662f\u5426\u5f04\u932f\uff0c\u6211\u6c7a\u5b9a\u518d\u5617\u8a66\u554f\u6e05\u695a Bard\uff1a<\/p>\n\n\n\n<p>Wav2Lip \u7531\u4f86\u81ea\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\uff0c\u4e26\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868?<\/p>\n\n\n\n<p>Bard \u518d\u6b21\u56de\u8986\u6211\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8b20e0c670\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8b20e0c670\"><code class=\"language-text\">\u662f\u7684\uff0c\u9019\u6b63\u662f Wav2Lip \u7684\u60c5\u6cc1\u3002\u5b83\u7531\u4f86\u81ea\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\uff0c\u4e26\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868\u3002\n\n\u8a72\u5718\u968a\u7531\u4ee5\u4e0b\u4eba\u7d44\u6210\uff1a\n\nRavi Kiran Bhagavatula\uff0c\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u8a08\u7b97\u6a5f\u79d1\u5b78\u7cfb\u535a\u58eb\u751f\nSai Krishna Madineni\uff0c\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u8a08\u7b97\u6a5f\u79d1\u5b78\u7cfb\u535a\u58eb\u751f\nRamesh Babu Bommanaboyina\uff0c\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u8a08\u7b97\u6a5f\u79d1\u5b78\u7cfb\u52a9\u7406\u6559\u6388\nAnirban Roy\uff0c\u5df4\u65af\u5927\u5b78\u8a08\u7b97\u6a5f\u79d1\u5b78\u7cfb\u535a\u58eb\u751f\nYansong Feng\uff0c\u5df4\u65af\u5927\u5b78\u8a08\u7b97\u6a5f\u79d1\u5b78\u7cfb\u526f\u6559\u6388\n\u8a72\u5718\u968a\u5728\u5176\u8ad6\u6587\u4e2d\u63cf\u8ff0\u4e86 Wav2Lip \u7684\u6280\u8853\u7d30\u7bc0\u3002\u4ed6\u5011\u4f7f\u7528\u4e86\u4e00\u500b\u57fa\u65bc\u6df1\u5ea6\u5b78\u7fd2\u7684\u6a21\u578b\uff0c\u8a72\u6a21\u578b\u4f7f\u7528\u4e86\u5169\u500b\u4e3b\u8981\u7d44\u4ef6\uff1a\u9762\u90e8\u8b58\u5225\u548c\u8a9e\u97f3\u5230\u5634\u5507\u6620\u5c04\u3002\u9762\u90e8\u8b58\u5225\u7b97\u6cd5\u7528\u65bc\u6aa2\u6e2c\u8996\u983b\u4e2d\u7684\u9762\u90e8\u3002\u8a9e\u97f3\u5230\u5634\u5507\u6620\u5c04\u6a21\u578b\u7528\u65bc\u5c07\u8a9e\u97f3\u4fe1\u865f\u6620\u5c04\u5230\u5634\u5507\u52d5\u4f5c\u3002\n\n\u8a72\u6a21\u578b\u662f\u5728\u4e00\u500b\u5305\u542b 700 \u591a\u500b\u8996\u983b\u548c 100 \u591a\u500b\u8a9e\u97f3\u6587\u4ef6\u7684\u6578\u64da\u96c6\u4e0a\u8a13\u7df4\u7684\u3002\u5b83\u53ef\u4ee5\u751f\u6210\u8207\u539f\u59cb\u8996\u983b\u4e2d\u5634\u5507\u52d5\u4f5c\u9ad8\u5ea6\u5339\u914d\u7684\u5634\u5507\u52d5\u4f5c\u3002\n\nWav2Lip \u662f\u4e00\u500b\u5f37\u5927\u7684\u5de5\u5177\uff0c\u53ef\u7528\u65bc\u5728\u8996\u983b\u4e2d\u5275\u5efa\u903c\u771f\u7684\u5634\u5507\u540c\u6b65\u3002\u5b83\u5df2\u88ab\u7528\u65bc\u88fd\u4f5c\u5404\u7a2e\u61c9\u7528\uff0c\u5305\u62ec\u96fb\u5f71\u3001\u96fb\u8996\u7bc0\u76ee\u548c\u793e\u4ea4\u5a92\u9ad4\u8996\u983b\u3002<\/code><\/pre>\n            <\/div>\n\n\n\n<p>Bard \u4f3c\u4e4e\u5341\u5206\u80af\u5b9a\u6709\u95dc Wav2Lip \u7684\u8cc7\u6599\uff0c\u56e0\u6b64\u6211\u518d\u6b21\u7528\u76f8\u540c\u7684 Prompt \u63d0\u554f ChatGPT\uff1a<\/p>\n\n\n\n<p>Wav2Lip \u7531\u4f86\u81ea\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\uff0c\u4e26\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868?<\/p>\n\n\n\n<p>ChatGPT 3.5 \u518d\u6b21\u56de\u8986\u6211\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8b20e0c674\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8b20e0c674\"><code class=\"language-text\">\u4e4b\u524d\u63d0\u4f9b\u7684\u4fe1\u606f\u662f\u4e0d\u6e96\u78ba\u7684\u3002\u5c0d\u65bc\"Wav2Lip\"\u6280\u8853\u7684\u958b\u767c\u5718\u968a\u548c\u767c\u8868\u6703\u8b70\u7684\u4fe1\u606f\u4e26\u4e0d\u6b63\u78ba\u3002\n\n\u5be6\u969b\u4e0a\uff0cWav2Lip \u662f\u7531\u5370\u5ea6\u7684\u5370\u5ea6\u6d77\u5f97\u62c9\u5df4\u570b\u969b\u4fe1\u606f\u6280\u8853\u7814\u7a76\u6240\uff08IIIT Hyderabad\uff09\u7684\u7814\u7a76\u5718\u968a\u958b\u767c\u7684\uff0c\u8a72\u6280\u8853\u65e8\u5728\u5c07\u97f3\u983b\u8207\u5634\u5507\u904b\u52d5\u540c\u6b65\uff0c\u4ee5\u751f\u6210\u770b\u8d77\u4f86\u50cf\u662f\u5728\u8aaa\u8a71\u7684\u6548\u679c\u3002\u7136\u800c\uff0c\u6211\u7121\u6cd5\u63d0\u4f9b\u5177\u9ad4\u7684\u767c\u8868\u6703\u8b70\u6216\u65e5\u671f\u7684\u4fe1\u606f\uff0c\u56e0\u70ba\u9019\u53ef\u80fd\u4e0d\u662f\u4e00\u500b\u5728\u5b78\u8853\u6703\u8b70\u4e0a\u767c\u8868\u7684\u6280\u8853\u3002\u6709\u95dc\u8a72\u6280\u8853\u7684\u66f4\u591a\u8a73\u7d30\u4fe1\u606f\u53ef\u80fd\u9700\u8981\u67e5\u95b1\u6700\u65b0\u7684\u7814\u7a76\u6587\u737b\u6216\u5b98\u65b9\u4f86\u6e90\u4ee5\u7372\u53d6\u6e96\u78ba\u7684\u4fe1\u606f\u3002<\/code><\/pre>\n            <\/div>\n\n\n\n<p>\u5927\u5bb6\u770b\u61c2\u4e86\u55ce\uff1f\u6700\u5f8c\u6211\u6c7a\u5b9a\u53bb\u554f Claude2\uff1a<\/p>\n\n\n\n<p>Wav2Lip \u662f\u8ab0\u958b\u767c\u7684\uff1f<\/p>\n\n\n\n<p>Claude2 \u56de\u8986\u6211\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8b20e0c677\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8b20e0c677\"><code class=\"language-text\">Wav2Lip \u662f\u4e00\u500b\u7531\u514b\u91cc\u65af\u8482\u5b89\u6069\u5de5\u696d\u5149\u5b78\u7cfb\u7d71\u5be6\u9a57\u5ba4\u548c\u82f1\u7279\u723e\u5be6\u9a57\u5ba4\u7684\u7814\u7a76\u4eba\u54e1\u65bc2019\u5e74\u958b\u767c\u7684\u8a9e\u97f3\u9a45\u52d5\u7684\u9762\u90e8\u52d5\u756b\u6a21\u578b\u3002\u4e3b\u8981\u958b\u767c\u8005\u5305\u62ec:\n\n- Supasorn Suwajanakorn - \u514b\u91cc\u65af\u8482\u5b89\u6069\u5de5\u696d\u5149\u5b78\u7cfb\u7d71\u5be6\u9a57\u5ba4\u7814\u7a76\u54e1\n\n- Steven M. Seitz - \u83ef\u76db\u9813\u5927\u5b78\u6559\u6388,\u514b\u91cc\u65af\u8482\u5b89\u6069\u5de5\u696d\u5149\u5b78\u7cfb\u7d71\u5be6\u9a57\u5ba4\u4e3b\u4efb\n\n- Ira Kemelmacher-Shlizerman - \u83ef\u76db\u9813\u5927\u5b78\u52a9\u7406\u6559\u6388 \n\n- Eisuke Yamaguchi - \u82f1\u7279\u723e\u5be6\u9a57\u5ba4\u7814\u7a76\u54e1\n\n- Brian Curless - \u83ef\u76db\u9813\u5927\u5b78\u6559\u6388\n\n- Carlos Hernandez - \u82f1\u7279\u723e\u5be6\u9a57\u5ba4\u7814\u7a76\u54e1\n\nWav2Lip \u4f7f\u7528 GANs \u5f9e\u8a9e\u97f3\u8f38\u5165\u751f\u6210\u9762\u90e8\u52d5\u756b,\u4f7f\u751f\u6210\u7684\u52d5\u756b\u8207\u8f38\u5165\u8a9e\u97f3\u9ad8\u5ea6\u76f8\u95dc\u3002\u8a72\u6a21\u578b\u7372\u5f97\u4e86\u5f88\u9ad8\u7684\u771f\u5be6\u6027\u4e26\u4e14\u904b\u884c\u6548\u7387\u9ad8\u3002\u5b83\u5df2\u5728\u591a\u500b\u9818\u57df\u5982\u8996\u983b\u5408\u6210\u3001\u96fb\u8166\u52d5\u756b\u7b49\u65b9\u9762\u5f97\u5230\u5ee3\u6cdb\u61c9\u7528\u3002<\/code><\/pre>\n            <\/div>\n\n\n\n<p>\u6211\u958b\u59cb\u6709\u4e9b\u982d\u6688\uff0c\u6211\u7e7c\u7e8c\u554f Claude2\uff1a<\/p>\n\n\n\n<p>Wav2Lip \u7531\u4f86\u81ea\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u7684\u5718\u968a\u958b\u767c\uff0c\u4e26\u5728 2020 \u5e74\u7684 ACM Multimedia \u6703\u8b70\u4e0a\u767c\u8868?<\/p>\n\n\n\n<p>Claude2 \u518d\u6b21\u56de\u8986\u6211\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8b20e0c67b\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8b20e0c67b\"><code class=\"language-text\">\u60a8\u63d0\u4f9b\u7684\u4fe1\u606f\u4e0d\u5b8c\u5168\u6b63\u78ba\u3002Wav2Lip\u7684\u4e3b\u8981\u958b\u767c\u5718\u968a\u4f86\u81ea\u7f8e\u570b\u7684\u514b\u91cc\u65af\u8482\u5b89\u6069\u5de5\u696d\u5149\u5b78\u7cfb\u7d71\u5be6\u9a57\u5ba4\u548c\u82f1\u7279\u723e\u5be6\u9a57\u5ba4,\u800c\u975e\u5370\u5ea6\u6d77\u5fb7\u62c9\u5df4\u5927\u5b78\u548c\u82f1\u570b\u5df4\u65af\u5927\u5b78\u3002\n\nWav2Lip \u65bc2019\u5e74\u9996\u6b21\u767c\u8868\u5728arXiv\u9810\u5370\u672c\u7db2\u7ad9\u4e0a,\u984c\u70ba\u300cWav2Lip: Accurately Lip-syncing Videos In The Wild\u300d\u3002\u5f8c\u7e8c\u5b8c\u6574\u8ad6\u6587\u767c\u8868\u57282020\u5e74\u7684ACM Multimedia conference\u3002\n\n\u4e3b\u8981\u958b\u767c\u8005\u4fe1\u606f\u5982\u6211\u4e4b\u524d\u6240\u63d0\u4f9b\u7684:\n\nSupasorn Suwajanakorn\nSteven M. Seitz\nIra Kemelmacher-Shlizerman\nEisuke Yamaguchi\nBrian Curless\nCarlos Hernandez\n\n\u6240\u4ee5Wav2Lip\u7684\u4e3b\u8981\u958b\u767c\u5718\u968a\u61c9\u8a72\u662f\u4f86\u81ea\u7f8e\u570b\u7684\u6a5f\u69cb,\u800c\u975e\u5370\u5ea6\u548c\u82f1\u570b\u7684\u5927\u5b78\u3002\u5982\u679c\u60a8\u6709\u5176\u4ed6\u53ef\u9760\u4f86\u6e90\u8868\u660e\u4e0d\u540c\u7684\u958b\u767c\u5718\u968a,\u8acb\u63d0\u4f9b,\u6211\u6703\u9032\u884c\u5fa9\u67e5\u548c\u4fee\u6b63\u3002\u76ee\u524d\u770b\u4f86Wav2Lip\u7684\u4e3b\u6d41\u516c\u958b\u5831\u9053\u90fd\u652f\u6301\u6211\u63d0\u4f9b\u7684\u958b\u767c\u5718\u968a\u4fe1\u606f\u3002<\/code><\/pre>\n            <\/div>\n\n\n\n<p>\u7a76\u7adf\u8ab0\u5c0d\u8ab0\u932f\uff1f<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>\u7d50\u679c\u6211\u53bb GitHub \u627e\u539f\u4f5c\u8005\u7684\u7c21\u4ecb\uff0c\u6700\u5f8c\u767c\u73fe\u4f5c\u8005\u662f\u5370\u5ea6\u7c4d\u535a\u4ed5 <a href=\"https:\/\/rudrabha.github.io\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/rudrabha.github.io\/<\/a>\uff0c\u4f3c\u4e4e Bard \u8f03\u70ba\u6e96\u78ba\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ChatGPT, Bard, Claude2 \u6bd4\u8f03 \u6211\u5f9e\u4e09\u500b\u4e0d\u540c\u7684 A.I. \u5e73\u53f0\u5617\u8a66\u627e\u66f4\u591a\u95dc\u65bc Wav2Lip \u7684\u8cc7\u6599\u6642\u51fa\u73fe\u5982\u4e0b\u7684\u60c5\u6cc1\uff1a<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[24,38],"tags":[],"class_list":["post-1088","post","type-post","status-publish","format-standard","hentry","category-aisoftware","category-38"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/1088","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=1088"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/1088\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=1088"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=1088"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=1088"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}