{"id":924,"date":"2023-09-14T01:42:50","date_gmt":"2023-09-13T17:42:50","guid":{"rendered":"https:\/\/infernews.com\/?p=924"},"modified":"2023-09-14T19:34:17","modified_gmt":"2023-09-14T11:34:17","slug":"learn-to-make-lora","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/learn-to-make-lora\/","title":{"rendered":"SDXL LoRA \u57f9\u8a13\u6307\u5357(\u82f1\u6587)"},"content":{"rendered":"<div class=\"vlp-link-container vlp-layout-spotlight-clone wp-block-visual-link-preview-link\"><a href=\"https:\/\/www.canva.com\/design\/DAFcn1l_ulE\/view\" class=\"vlp-link\" title=\"LEARN TO MAKE LoRA\" target=\"_blank\"><\/a><div class=\"vlp-layout-zone-main\"><span class=\"vlp-block-0 vlp-link-title\">LEARN TO MAKE LoRA<\/span><div class=\"vlp-block-1 vlp-link-summary\">\u9019\u662f\u4e00\u500b\u5f88\u68d2\u7684\u7c21\u5831\uff0c\u5167\u5bb9\u4ecb\u7d39\u4e86 SDXL LoRA \u7684\u6307\u5357\u548c\u8a13\u7df4\u8981\u6c42\u3002<\/div><div class=\"vlp-block-2 vlp-link-image\"><img decoding=\"async\" src=\"https:\/\/www.canva.com\/design\/DAFcn1l_ulE\/screen\" style=\"max-width: 1024px; max-height: 1024px\" \/><\/div><\/div><\/div>\n\n\n<p>\u9019\u4efd\u7c21\u5831\u63d0\u4f9b\u5b78\u7fd2\u5982\u4f55\u88fd\u4f5cLoRA \u6a21\u578b\u7684\u5bf6\u8cb4\u8cc7\u8a0a\u3002\u5728\u9019\u4efd\u7c21\u5831\u4e2d\uff0c\u4f60\u5c07\u627e\u5230\u4ee5\u4e0b\u6307\u5c0e\u65b9\u91dd\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5c07\u6700\u5927\u89e3\u6790\u5ea6\u8a2d\u5b9a\u70ba\u81f3\u5c11 1024&#215;1024\uff0c\u9019\u662fSDXL\u7684\u6a19\u6e96\u89e3\u6790\u5ea6\u3002<\/li>\n\n\n\n<li>\u4f7f\u7528\u81f3\u5c11 12GB \u5167\u5b58\u7684 GPU \u9032\u884c LoRA \u6a21\u578b\u7684\u8a13\u7df4\u3002<\/li>\n\n\n\n<li>\u6211\u5011\u5f37\u70c8\u5efa\u8b70\u5728 SDXL LoRA \u8a13\u7df4\u904e\u7a0b\u4e2d\u4f7f\u7528 <code>--train_unet_only<\/code> \u9078\u9805\uff0c\u4ee5\u907f\u514d\u56e0SDXL\u4e2d\u7684\u96d9\u6587\u672c\u7de8\u78bc\u5668\u800c\u9020\u6210\u7121\u6cd5\u9810\u6599\u7684\u8a13\u7df4\u7d50\u679c\u3002<\/li>\n\n\n\n<li>PyTorch 2 \u6bd4 PyTorch 1 \u4f7f\u7528\u7684 GPU \u5167\u5b58\u8f03\u5c11\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u6b64\u5916\uff0c\u7c21\u5831\u9084\u63d0\u4f9b\u4e86\u4e00\u500b\u4f7f\u7528 Adafactor \u512a\u5316\u5668\u7684\u793a\u4f8b\u914d\u7f6e\uff0c\u8a72\u512a\u5316\u5668\u5177\u6709\u56fa\u5b9a\u7684\u5b78\u7fd2\u7387\uff0c\u4e26\u4f7f\u7528\u4e86\u5e38\u6578\u52a0\u6eab\u7b56\u7565\u3002\u4ee5\u4e0b\u662f\u793a\u4f8b\u914d\u7f6e\u7684\u4ee3\u78bc\u7247\u6bb5\uff1a<\/p>\n\n\n\n<div class=\"codecopy-container\">\n                <div class=\"codecopy-header\">\n                    \n                    <button class=\"codecopy-btn\" data-target=\"codecopy-69f8c14d1e0b7\" title=\"Copy code to clipboard\">\n                <svg width=\"16\" height=\"16\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\">\n                    <path d=\"M16 1H4C2.9 1 2 1.9 2 3V17H4V3H16V1ZM19 5H8C6.9 5 6 5.9 6 7V21C6 22.1 6.9 23 8 23H19C20.1 23 21 22.1 21 21V7C21 5.9 20.1 5 19 5ZM19 21H8V7H19V21Z\" fill=\"currentColor\"\/>\n                <\/svg>\n                <span class=\"codecopy-text\">Copy<\/span>\n            <\/button>\n                <\/div>\n                <pre class=\"line-numbers\" id=\"codecopy-69f8c14d1e0b7\"><code class=\"language-text\">optimizer_type = \"adafactor\"\noptimizer_args = &#91; \"scale_parameter=False\", \"relative_step=False\", \"warmup_init=False\" ]\nlr_scheduler = \"constant_with_warmup\"\nlr_warmup_steps = 100\nlearning_rate = 4e-7 # \u9019\u662fSDXL\u7684\u6a19\u6e96\u5b78\u7fd2\u7387\n<\/code><\/pre>\n            <\/div>\n\n\n\n<p>\u8acb\u9ede\u64ca<a href=\"https:\/\/www.canva.com\/design\/DAFcn1l_ulE\/view\">\u9019\u88e1<\/a>\u67e5\u770b\u5b8c\u6574\u7684\u7c21\u5831\u5167\u5bb9\u3002\u5e0c\u671b\u9019\u4efd\u7c21\u5831\u80fd\u5920\u5e6b\u52a9\u4f60\u66f4\u597d\u5730\u4e86\u89e3\u5982\u4f55\u88fd\u4f5cLoRA\u6a21\u578b\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u9019\u4efd\u7c21\u5831\u63d0\u4f9b\u5b78\u7fd2\u5982\u4f55\u88fd\u4f5cLoRA \u6a21\u578b\u7684\u5bf6\u8cb4\u8cc7\u8a0a\u3002\u5728\u9019\u4efd\u7c21\u5831\u4e2d\uff0c\u4f60\u5c07\u627e\u5230\u4ee5\u4e0b\u6307\u5c0e\u65b9\u91dd\uff1a \u6b64\u5916\uff0c\u7c21\u5831\u9084\u63d0\u4f9b\u4e86\u4e00\u500b\u4f7f\u7528 Adafactor \u512a\u5316\u5668\u7684\u793a\u4f8b\u914d\u7f6e\uff0c\u8a72\u512a\u5316\u5668\u5177\u6709\u56fa\u5b9a\u7684\u5b78\u7fd2\u7387\uff0c\u4e26\u4f7f\u7528\u4e86\u5e38\u6578\u52a0\u6eab\u7b56\u7565\u3002\u4ee5\u4e0b\u662f\u793a\u4f8b\u914d\u7f6e\u7684\u4ee3\u78bc\u7247\u6bb5\uff1a \u8acb\u9ede\u64ca\u9019\u88e1\u67e5\u770b\u5b8c\u6574\u7684\u7c21\u5831\u5167\u5bb9\u3002\u5e0c\u671b\u9019\u4efd\u7c21\u5831\u80fd\u5920\u5e6b\u52a9\u4f60\u66f4\u597d\u5730\u4e86\u89e3\u5982\u4f55\u88fd\u4f5cLoRA\u6a21\u578b\u3002<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[27],"tags":[],"class_list":["post-924","post","type-post","status-publish","format-standard","hentry","category-paper"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/924","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=924"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/924\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=924"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=924"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=924"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}