{"id":3756,"date":"2024-12-08T22:52:27","date_gmt":"2024-12-08T14:52:27","guid":{"rendered":"https:\/\/infernews.com\/?p=3756"},"modified":"2025-03-17T01:26:09","modified_gmt":"2025-03-16T17:26:09","slug":"float-%e6%9c%80%e5%bc%b7-lipsync-%e5%b7%a5%e5%85%b7","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/float-%e6%9c%80%e5%bc%b7-lipsync-%e5%b7%a5%e5%85%b7\/","title":{"rendered":"FLOAT – \u6700\u5f37 LipSync \u5de5\u5177"},"content":{"rendered":"\n

FLOAT \u662f\u500b\u97f3\u8a0a\u9a45\u52d5\u4eba\u50cf\u5f71\u7247\u6a21\u578b\u3002\u6a21\u578b\u63d0\u4f9b\u80fd\u5920\u751f\u6210\u66f4\u81ea\u7136\u3001\u66f4\u5177\u8868\u73fe\u529b\u7684\u9762\u90e8\u52d5\u756b\uff0c\u53cd\u6620\u51fa\u8aaa\u8a71\u8005\u7684\u60c5\u611f\u72c0\u614b\u3002<\/p>\n\n\n

<\/a>
FLOAT<\/span>
<\/div><\/div><\/div>\n\n\n

\u95dc\u9375\u8a5e\u5f59\u8868<\/h3>\n\n\n\n
    \n
  • \u64f4\u6563\u6a21\u578b (Diffusion models):<\/strong> \u4e00\u7a2e\u751f\u6210\u6a21\u578b\uff0c\u901a\u904e\u9010\u6f38\u5411\u6578\u64da\u6dfb\u52a0\u566a\u8072\uff0c\u7136\u5f8c\u5b78\u7fd2\u9006\u8f49\u8a72\u904e\u7a0b\u4f86\u751f\u6210\u65b0\u6578\u64da\u3002<\/li>\n\n\n\n
  • \u6d41\u5339\u914d (Flow matching):<\/strong> \u4e00\u7a2e\u751f\u6210\u6a21\u578b\u8a13\u7df4\u6280\u8853\uff0c\u5176\u76ee\u6a19\u662f\u5b78\u7fd2\u5c07\u7c21\u55ae\u5206\u4f48\u8f49\u63db\u70ba\u76ee\u6a19\u6578\u64da\u5206\u4f48\u7684\u8b8a\u63db\u3002<\/li>\n\n\n\n
  • \u904b\u52d5\u6f5b\u5728\u7a7a\u9593 (Motion latent space):<\/strong> \u4e00\u500b\u8868\u793a\u4eba\u50cf\u904b\u52d5\u7684\u4f4e\u7dad\u7a7a\u9593\uff0c\u5f9e\u8f38\u5165\u7684\u4eba\u50cf\u5716\u50cf\u4e2d\u5b78\u7fd2\u5f97\u5230\u3002<\/li>\n\n\n\n
  • \u97f3\u983b\u9a45\u52d5\u8aaa\u8a71\u4eba\u50cf\u751f\u6210 (Audio-driven talking portrait generation):<\/strong> \u4f7f\u7528\u97f3\u983b\u4fe1\u865f\u4f5c\u70ba\u8f38\u5165\uff0c\u751f\u6210\u8207\u97f3\u983b\u540c\u6b65\u7684\u8aaa\u8a71\u4eba\u50cf\u8996\u983b\u7684\u4efb\u52d9\u3002<\/li>\n\n\n\n
  • \u60c5\u611f\u589e\u5f37 (Emotion enhancement):<\/strong> \u6839\u64da\u8f38\u5165\u7684\u8a9e\u97f3\u60c5\u611f\u6a19\u7c64\uff0c\u589e\u5f37\u751f\u6210\u7684\u4eba\u50cf\u52d5\u756b\u7684\u60c5\u611f\u8868\u73fe\u529b\u3002<\/li>\n\n\n\n
  • \u5e40\u7d1a AdaLN (Frame-wise AdaLN):<\/strong> \u4e00\u7a2e\u81ea\u9069\u61c9\u5c64\u6b78\u4e00\u5316\u6280\u8853\uff0c\u5728\u6bcf\u500b\u6642\u9593\u6b65\u9577\u6839\u64da\u689d\u4ef6\u4fe1\u606f\u8abf\u6574\u7279\u5fb5\u7d71\u8a08\u91cf\uff0c\u7528\u65bc\u589e\u5f37\u751f\u6210\u904b\u52d5\u7684\u591a\u6a23\u6027\u3002<\/li>\n\n\n\n
  • \u51fd\u6578\u8a55\u4f30\u6b21\u6578 (NFEs):<\/strong> \u8a55\u4f30\u751f\u6210\u6a21\u578b\u6240\u9700\u7684\u6642\u9593\u6b65\u9577\u6216\u8fed\u4ee3\u6b21\u6578\uff0c\u7528\u65bc\u8861\u91cf\u6a21\u578b\u7684\u6548\u7387\u3002<\/li>\n\n\n\n
  • 3DMM \u982d\u90e8\u59ff\u614b\u53c3\u6578 (3DMM head pose parameters):<\/strong> \u4e00\u7a2e\u57fa\u65bc 3D Morphable Model \u7684\u4eba\u81c9\u59ff\u614b\u8868\u793a\uff0c\u53ef\u4ee5\u63a7\u5236\u751f\u6210\u4eba\u50cf\u7684\u982d\u90e8\u65b9\u5411\u3002<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"

    FLOAT \u662f\u500b\u97f3\u8a0a\u9a45\u52d5\u4eba\u50cf\u5f71\u7247\u6a21\u578b\u3002\u6a21\u578b\u63d0\u4f9b\u80fd\u5920\u751f\u6210\u66f4\u81ea\u7136\u3001\u66f4\u5177\u8868\u73fe\u529b\u7684\u9762\u90e8\u52d5\u756b\uff0c\u53cd\u6620\u51fa\u8aaa\u8a71\u8005\u7684\u60c5\u611f\u72c0\u614b\u3002 \u95dc\u9375\u8a5e\u5f59\u8868<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[76,128],"tags":[],"class_list":["post-3756","post","type-post","status-publish","format-standard","hentry","category-76","category-128"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/3756","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=3756"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/3756\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=3756"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=3756"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=3756"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}