{"id":12044,"date":"2026-09-10T02:07:58","date_gmt":"2026-09-09T18:07:58","guid":{"rendered":"https:\/\/infernews.com\/blog\/mask-forcing-improving-autoregressive-video-diffusio\/"},"modified":"2026-09-10T03:58:01","modified_gmt":"2026-09-09T19:58:01","slug":"mask-forcing-improving-autoregressive-video-diffusio","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/mask-forcing-improving-autoregressive-video-diffusio\/","title":{"rendered":"Mask Forcing\uff1a\u96d9\u91cd\u906e\u7f69\u5e6b\u5f71\u7247\u64f4\u6563\u6a21\u578b"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/09\/pasted-b50ffce046d2.jpg\" alt=\"Mask Forcing pipeline\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u7528 DMD\uff08Distribution Matching Distillation\uff09\u628a\u96d9\u5411\u5f71\u7247\u64f4\u6563\u6a21\u578b\u84b8\u993e\u6210\u81ea\u56de\u6b78\uff08AR\uff09\u5b78\u751f\u6a21\u578b\u6642\uff0c\u5f71\u7247\u5f80\u5f80\u51fa\u73fe\u904e\u5ea6\u98fd\u548c\u540c\u904e\u5ea6\u5e73\u6ed1\u5605\u60c5\u6cc1\uff0c\u80cc\u5f8c\u6210\u56e0\u4fc2 reverse-KL \u76ee\u6a19\u5605 mode-seeking \u50be\u5411\uff0c\u4ee4\u5b78\u751f\u5206\u4f48\u5bb9\u6613\u584c\u7e2e\u5230\u6559\u5e2b\u6a21\u578b\u5605\u5c11\u6578\u6a21\u5f0f\u4e4b\u4e0a\u3002Mask Forcing \u5605\u5207\u5165\u9ede\u6b63\u6b63\u4fc2\u5462\u500b\u77db\u76fe\uff1a\u4f62\u55ba AR \u84b8\u993e\u5605 self-rollout \u904e\u7a0b\u4e2d\uff0c\u6cbf\u7a7a\u9593\u540c\u6642\u9593\u8ef8\u96a8\u6a5f\u906e\u7f69\u3001\u6ce8\u5165\u8f03\u4e7e\u6de8\u5605 token\uff0c\u85c9\u6b64\u64fe\u52d5 rollout \u8ecc\u8de1\uff0c\u4ee4\u5b78\u751f\u6709\u6a5f\u6703\u63a2\u7d22\u6559\u5e2b\u5206\u4f48\u5605\u66f4\u591a\u5340\u57df\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5462\u500b\u505a\u6cd5\u540c\u6642\u5e36\u4f86\u5169\u500b\u597d\u8655\uff1a\u64fe\u52d5\u4ee4 DMD \u5605\u5b78\u7fd2\u8a0a\u865f\u5514\u518d\u5c40\u9650\u65bc\u5b78\u751f\u5df2\u7d93\u8986\u84cb\u5605\u6a21\u5f0f\uff1b\u800c\u8f03\u4e7e\u6de8\u5605 token \u4ea6\u53ef\u4ee5\u4f5c\u70ba\u5f15\u5c0e\uff0c\u5354\u52a9\u540c\u4e00 chunk \u5165\u9762\u8f03\u5608\u96dc\u5605 token \u53bb\u566a\uff0c\u7b49\u4e2d\u9593\u904e\u6e21\u66f4\u7a69\u5b9a\uff0c\u5f9e\u800c\u6e1b\u5c11\u932f\u8aa4\u55ba\u5f8c\u7e8c denoising step \u540c chunk \u4e4b\u9593\u7d2f\u7a4d\u3002\u6574\u500b\u65b9\u6cd5\u5514\u9700\u8981\u771f\u5be6\u5f71\u7247\u76e3\u7763\u3001\u5514\u9700\u8981\u984d\u5916\u5f8c\u8a13\u7df4\u968e\u6bb5\uff0c\u4ea6\u5514\u6703\u589e\u52a0\u63a8\u8ad6\u6210\u672c\uff0c\u7d14\u7cb9\u6539\u52d5\u8a13\u7df4\u671f\u5605 rollout\u3002<\/p>\n\n\n<div\n    \tclass=\"align wp-block-vpb-video\"    id='vpbpVideoPlayer-1'\n    data-attributes='{&quot;source&quot;:&quot;https:\\\/\\\/alicezrzhao.github.io\\\/mask_forcing\\\/videos\\\/Self_Forcing\\\/In%20spring%20on%20a%20hillside%20above%20a%20bright%20lake,%20a%20woman%20in%20a%20light%20yellow%20dress%20and%20straw%20hat%20dominates.mp4&quot;,&quot;repeat&quot;:true,&quot;autoplay&quot;:true,&quot;muted&quot;:true,&quot;align&quot;:&quot;&quot;,&quot;poster&quot;:&quot;&quot;,&quot;controls&quot;:{&quot;play-large&quot;:true,&quot;restart&quot;:false,&quot;rewind&quot;:true,&quot;play&quot;:true,&quot;fast-forward&quot;:true,&quot;progress&quot;:true,&quot;current-time&quot;:true,&quot;duration&quot;:false,&quot;mute&quot;:true,&quot;volume&quot;:true,&quot;pip&quot;:false,&quot;airplay&quot;:false,&quot;captions&quot;:false,&quot;settings&quot;:true,&quot;download&quot;:false,&quot;fullscreen&quot;:true},&quot;captions&quot;:[],&quot;ratio&quot;:&quot;16:9&quot;,&quot;accentColor&quot;:&quot;&quot;,&quot;lazyLoad&quot;:false,&quot;width&quot;:&quot;100%&quot;,&quot;radius&quot;:&quot;0px&quot;,&quot;resetOnEnd&quot;:false,&quot;autoHideControl&quot;:true,&quot;isSetup&quot;:false}'\n><\/div>\n\n\n<p class=\"wp-block-paragraph\">Mask Forcing \u5c6c\u65bc\u4e00\u7a2e\u84b8\u993e\u589e\u5f37\u7b56\u7565\uff0c\u4e3b\u8981\u670d\u52d9\u65bc\u60f3\u628a AR \u5f71\u7247\u751f\u6210\u505a\u5feb\u3001\u4f46\u53c8\u60f3\u907f\u958b DMD \u8996\u89ba\u8cea\u7d20\u4e0b\u964d\u5605\u5718\u968a\uff0c\u4f8b\u5982\u505a\u5be6\u6642\u6216\u8fd1\u5be6\u6642\u5f71\u7247\u751f\u6210\u5605\u7814\u7a76\u540c\u7522\u54c1\u7dda\u3002\u4f62\u540c\u4e00\u822c\u505a\u6cd5\u5605\u53d6\u6368\u6e05\u6670\uff1a\u653e\u68c4\u6a21\u5f0f\u96c6\u4e2d\u6240\u5e36\u4f86\u5605\u77ed\u671f\u7a69\u5b9a\uff0c\u63db\u53d6\u5206\u4f48\u591a\u6a23\u6027\u540c\u4e2d\u9593\u6b65\u9810\u6e2c\u5605\u53ef\u9760\u6027\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u91dd\u5c0d AR \u5f71\u7247\u64f4\u6563\u84b8\u993e\u4e2d DMD \u5605 mode-seeking \u554f\u984c\uff0c\u7528\u96d9\u91cd\u96dc\u8a0a\u906e\u7f69\u64fe\u52d5 rollout<\/li>\n\n\n\n<li>\u4e0d\u9700\u771f\u5be6\u5f71\u7247\u76e3\u7763\u6216\u984d\u5916\u5f8c\u8a13\u7df4\u968e\u6bb5\uff0c\u5514\u6539\u52d5\u63a8\u8ad6\u6d41\u7a0b<\/li>\n\n\n\n<li>\u4ee4\u5b78\u751f\u5206\u4f48\u8986\u84cb\u66f4\u591a\u6559\u5e2b\u6a21\u5f0f\uff0c\u4e26\u4ee5\u8f03\u4e7e\u6de8 token \u5f15\u5c0e\u8f03\u5608\u96dc token \u53bb\u566a<\/li>\n\n\n\n<li>\u9069\u7528\u65bc\u8ffd\u6c42\u5be6\u6642\u5f71\u7247\u751f\u6210\u3001\u53c8\u60f3\u63d0\u5347\u8996\u89ba\u8cea\u7d20\u5605\u7814\u7a76\u540c\u7522\u54c1\u5834\u666f<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/alicezrzhao.github.io\/mask_forcing\/\" rel=\"noopener noreferrer\"><strong>\u9805\u76ee\u4e3b\u9801<\/strong><\/a> \u00b7 <a href=\"https:\/\/github.com\/delaprada\/Mask-Forcing\" rel=\"noopener noreferrer\"><strong>GitHub<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Mask Forcing \u91dd\u5c0d\u81ea\u56de\u6b78\u5f71\u7247\u64f4\u6563\u84b8\u993e\u4e2d\u5605\u6a21\u5f0f\u584c\u7e2e\u554f\u984c\uff0c\u5229\u7528\u96d9\u91cd\u96dc\u8a0a\u906e\u7f69\u5605 rollout \u7b56\u7565\uff0c\u4ee4\u5b78\u751f\u6a21\u578b\u5206\u4f48\u8986\u84cb\u66f4\u591a\u6559\u5e2b\u6a21\u5f0f\uff0c\u540c\u6642\u5514\u4f7f\u984d\u5916\u5f71\u7247\u8cc7\u6599\u6216\u5f8c\u8a13\u7df4\u3002<\/p>\n","protected":false},"author":8,"featured_media":12043,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wpai_generated_summary":"","footnotes":""},"categories":[133,164,165,31,162,157,76,127],"tags":[],"class_list":["post-12044","post","type-post","status-publish","format-standard","hentry","category-133","category-164","category-165","category-video","category-ai-productions","category-157","category-76","category-127"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12044","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=12044"}],"version-history":[{"count":1,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12044\/revisions"}],"predecessor-version":[{"id":12046,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12044\/revisions\/12046"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/12043"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=12044"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=12044"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=12044"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}