{"id":4314,"date":"2025-01-19T18:35:52","date_gmt":"2025-01-19T10:35:52","guid":{"rendered":"https:\/\/infernews.com\/?p=4314"},"modified":"2025-03-17T01:18:11","modified_gmt":"2025-03-16T17:18:11","slug":"manganinja-%e5%84%aa%e8%b3%aa%e7%b7%9a%e7%a8%bf%e5%9c%96%e5%83%8f%e4%b8%8a%e8%89%b2","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/manganinja-%e5%84%aa%e8%b3%aa%e7%b7%9a%e7%a8%bf%e5%9c%96%e5%83%8f%e4%b8%8a%e8%89%b2\/","title":{"rendered":"MangaNinja \u512a\u8cea\u7dda\u7a3f\u5716\u50cf\u4e0a\u8272"},"content":{"rendered":"\n<p><em><a href=\"https:\/\/johanan528.github.io\/MangaNinjia\/\" target=\"_blank\" rel=\"noreferrer noopener\">MangaNinja<\/a><\/em> \u7684\u4e3b\u8981\u8a2d\u8a08\u76ee\u6a19\u662f\u57fa\u65bc\u5354\u52a9\u7dda\u7a3f\u5716\u50cf\u4e0a\u8272\u3002\u5b83\u63a1\u7528\u4e86\u5e7e\u500b\u95dc\u9375\u6280\u8853\uff1a<strong>\u5340\u584a\u96a8\u6a5f\u7f6e\u63db\u6a21\u7d44<\/strong>(patch shuffling module)\uff0c<strong>\u9ede\u9a45\u52d5\u63a7\u5236\u65b9\u6848<\/strong>(point-driven control scheme)\u3002\u5be6\u9a57\u7d50\u679c\u986f\u793a\uff0c<em>MangaNinja<\/em> \u5728\u8272\u5f69\u6e96\u78ba\u5ea6\u548c\u751f\u6210\u5716\u50cf\u8cea\u91cf\u65b9\u9762\u660e\u986f\u512a\u65bc\u5176\u4ed6\u73fe\u6709\u7684\u975e\u751f\u6210\u5f0f\u8457\u8272\u65b9\u6cd5\uff08\u5982 BasicPBC\uff09\u3001\u4e00\u81f4\u6027\u751f\u6210\u65b9\u6cd5\uff08\u5982 IP-Adapter\uff09\u4ee5\u53ca AnyDoor\u3002\u7e3d\u7d50\u4f86\u8aaa\uff0c<em>MangaNinja<\/em> \u900f\u904e\u5340\u584a\u96a8\u6a5f\u7f6e\u63db\u6a21\u7d44\u548c\u9ede\u9a45\u52d5\u63a7\u5236\u65b9\u6848\u5be6\u73fe\u7cbe\u78ba\u7684\u7dda\u7a3f\u8457\u8272\u3002\u5b83\u4e0d\u50c5\u53ef\u4ee5\u8655\u7406\u55ae\u4e00\u53c3\u8003\u5716\u50cf\uff0c\u9084\u53ef\u4ee5\u5229\u7528\u591a\u500b\u53c3\u8003\u5716\u50cf\u9032\u884c\u8457\u8272\uff0c\u4e26\u4e14\u53ef\u4ee5\u8655\u7406\u53c3\u8003\u5716\u50cf\u8207\u7dda\u7a3f\u4e4b\u9593\u5b58\u5728\u5dee\u7570\u7684\u60c5\u6cc1\u3002\u6b64\u5916\uff0c<em>MangaNinja<\/em> \u7684\u4e92\u52d5\u5f0f\u63a7\u5236\u529f\u80fd\uff0c\u5141\u8a31\u4f7f\u7528\u8005\u66f4\u7cbe\u78ba\u5730\u63a7\u5236\u8457\u8272\u7d50\u679c\u3002<\/p>\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"MangaNinja: Line Art Colorization with Precise Reference Following\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_Hg24TUEzcMg\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2FHg24TUEzcMg%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/Hg24TUEzcMg\" \/><meta itemprop=\"duration\" content=\"PT2M17S\" \/><meta itemprop=\"uploadDate\" content=\"2025-01-15T02:46:37Z\" \/><\/div><div id=\"lyte_Hg24TUEzcMg\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2FHg24TUEzcMg%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">MangaNinja: Line Art Colorization with Precise Reference Following<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/Hg24TUEzcMg\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2FHg24TUEzcMg%2F0.jpg\" alt=\"MangaNinja: Line Art Colorization with Precise Reference Following\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Project Page: https:\/\/johanan528.github.io\/MangaNinjia\/ Code: https:\/\/github.com\/ali-vilab\/MangaNinjia This is the demo video for our paper: &quot;MangaNinja: Line Art Colorization with Precise Reference Following&quot; Authors: Zhiheng Liu*, Ka Leong Cheng*, Xi Chen, Jie Xiao, Hao Ouyang, Kai Zhu, Yu Liu, Yujun Shen, Qifeng Chen, Ping Luo\u2020 Abstract: Derived from diffusion models, MangaNinja specializes in the task of reference-guided line art colorization. We incorporate two thoughtful designs to ensure precise character detail transcription, including a patch shuffling module to facilitate correspondence learning between the reference color image and the target line art, and a point-driven control scheme to enable fine-grained color matching. Experiments on a self-collected benchmark demonstrate the superiority of our model over current solutions in terms of precise colorization. We further showcase the potential of the proposed interactive point control in handling challenging cases (e.g., extreme poses and shadows), cross-character colorization, multi-reference harmonization, etc., beyond the reach of existing algorithms.\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n\n\n<p><a href=\"https:\/\/huggingface.co\/Johanan0528\/MangaNinjia\/tree\/main\" target=\"_blank\" rel=\"noreferrer noopener\">HuggingFace \u6a21\u578b\u4e0b\u8f09<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>MangaNinja \u7684\u4e3b\u8981\u8a2d\u8a08\u76ee\u6a19\u662f\u57fa\u65bc\u5354\u52a9\u7dda\u7a3f\u5716\u50cf\u4e0a\u8272\u3002\u5b83\u63a1\u7528\u4e86\u5e7e\u500b\u95dc\u9375\u6280\u8853\uff1a\u5340\u584a\u96a8\u6a5f\u7f6e\u63db\u6a21\u7d44(patch shuffling module)\uff0c\u9ede\u9a45\u52d5\u63a7\u5236\u65b9\u6848(point-driven control scheme)\u3002\u5be6\u9a57\u7d50\u679c\u986f\u793a\uff0cMangaNinja \u5728\u8272\u5f69\u6e96\u78ba\u5ea6\u548c\u751f\u6210\u5716\u50cf\u8cea\u91cf\u65b9\u9762\u660e\u986f\u512a\u65bc\u5176\u4ed6\u73fe\u6709\u7684\u975e\u751f\u6210\u5f0f\u8457\u8272\u65b9\u6cd5\uff08\u5982 BasicPBC\uff09\u3001\u4e00\u81f4\u6027\u751f\u6210\u65b9\u6cd5\uff08\u5982 IP-Adapter\uff09\u4ee5\u53ca AnyDoor\u3002\u7e3d\u7d50\u4f86\u8aaa\uff0cMangaNinja \u900f\u904e\u5340\u584a\u96a8\u6a5f\u7f6e\u63db\u6a21\u7d44\u548c\u9ede\u9a45\u52d5\u63a7\u5236\u65b9\u6848\u5be6\u73fe\u7cbe\u78ba\u7684\u7dda\u7a3f\u8457\u8272\u3002\u5b83\u4e0d\u50c5\u53ef\u4ee5\u8655\u7406\u55ae\u4e00\u53c3\u8003\u5716\u50cf\uff0c\u9084\u53ef\u4ee5\u5229\u7528\u591a\u500b\u53c3\u8003\u5716\u50cf\u9032\u884c\u8457\u8272\uff0c\u4e26\u4e14\u53ef\u4ee5\u8655\u7406\u53c3\u8003\u5716\u50cf\u8207\u7dda\u7a3f\u4e4b\u9593\u5b58\u5728\u5dee\u7570\u7684\u60c5\u6cc1\u3002\u6b64\u5916\uff0cMangaNinja \u7684\u4e92\u52d5\u5f0f\u63a7\u5236\u529f\u80fd\uff0c\u5141\u8a31\u4f7f\u7528\u8005\u66f4\u7cbe\u78ba\u5730\u63a7\u5236\u8457\u8272\u7d50\u679c\u3002 HuggingFace \u6a21\u578b\u4e0b\u8f09<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[38,120,76,133],"tags":[],"class_list":["post-4314","post","type-post","status-publish","format-standard","hentry","category-38","category-120","category-76","category-133"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/4314","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=4314"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/4314\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=4314"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=4314"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=4314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}