{"id":4945,"date":"2025-03-14T01:07:23","date_gmt":"2025-03-13T17:07:23","guid":{"rendered":"https:\/\/infernews.com\/?page_id=4945"},"modified":"2025-04-26T00:11:19","modified_gmt":"2025-04-25T16:11:19","slug":"model-%e7%89%b9%e5%be%b5","status":"publish","type":"page","link":"https:\/\/infernews.com\/blog\/model-%e7%89%b9%e5%be%b5\/","title":{"rendered":"Model \u6a94\u6848\u683c\u5f0f\u8aaa\u660e"},"content":{"rendered":"\n<p>Quality rank (highest to lowest): fp16 &gt; bf16 &gt; fp8_scaled &gt; fp8_e4m3fn<\/p>\n\n\n\n<p>\u5728 Hugging Face \u7684 <a href=\"https:\/\/huggingface.co\/city96\/HiDream-I1-Fast-gguf\/tree\/main\">HiDream-I1-Fast-gguf \u6a21\u578b\u5132\u5b58\u5eab<\/a> \u4e2d\uff0c\u4e0d\u540c\u7684\u6a94\u6848\u5f8c\u7db4\uff08\u5982 _K\u3001_K_M\u3001_K_S\u3001F16\u3001BF16\uff09\u4ee3\u8868\u6a21\u578b\u6b0a\u91cd\u5132\u5b58\u7684\u4e0d\u540c\u7cbe\u5ea6\u683c\u5f0f\u3002\u4ee5\u4e0b\u662f\u9019\u4e9b\u683c\u5f0f\u7684\u8aaa\u660e\u53ca\u5176\u5dee\u7570\uff0c\u7528\u7e41\u9ad4\u4e2d\u6587\u5448\u73fe\uff1a<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u6a94\u6848\u683c\u5f0f\u8aaa\u660e<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>F16<\/strong><br>\u4ee3\u8868 <strong>16\u4f4d\u6d6e\u9ede\u6578\uff08FP16\uff09<\/strong>\uff0c\u9019\u662f\u4e00\u7a2e\u534a\u7cbe\u5ea6\u6d6e\u9ede\u683c\u5f0f\u3002\u76f8\u8f03\u65bc\u5b8c\u6574\u7684 32 \u4f4d\u6d6e\u9ede\u6578\uff08FP32\uff09\uff0cF16 \u4f7f\u7528\u66f4\u5c11\u7684\u4f4d\u5143\u4f86\u8868\u793a\u6a21\u578b\u6b0a\u91cd\uff0c\u80fd\u6709\u6548\u6e1b\u5c11\u8a18\u61b6\u9ad4\u4f7f\u7528\u4e26\u52a0\u5feb\u8a08\u7b97\u901f\u5ea6\uff0c\u4f46\u53ef\u80fd\u6703\u7a0d\u5fae\u964d\u4f4e\u6a21\u578b\u7684\u6e96\u78ba\u6027\u3002\u9069\u5408\u9700\u8981\u9ad8\u6548\u80fd\u4f46\u5c0d\u7cbe\u5ea6\u8981\u6c42\u4e0d\u6975\u9ad8\u7684\u5834\u666f\u3002<\/li>\n\n\n\n<li><strong>BF16<\/strong><br>\u4ee3\u8868 <strong>bfloat16<\/strong>\uff0c\u4e5f\u662f\u4e00\u7a2e 16 \u4f4d\u6d6e\u9ede\u6578\u683c\u5f0f\uff0c\u8207 F16 \u985e\u4f3c\uff0c\u4f46\u4f4d\u5143\u5206\u914d\u4e0d\u540c\u3002BF16 \u4fdd\u7559\u4e86\u8207 FP32 \u76f8\u540c\u7684\u6307\u6578\u7bc4\u570d\uff088 \u4f4d\uff09\uff0c\u4f46\u6e1b\u5c11\u4e86\u5c3e\u6578\u4f4d\u6578\uff087 \u4f4d\uff09\uff0c\u56e0\u6b64\u5728\u4fdd\u6301\u8f03\u5927\u52d5\u614b\u7bc4\u570d\u7684\u540c\u6642\u964d\u4f4e\u8a18\u61b6\u9ad4\u9700\u6c42\u3002\u9019\u7a2e\u683c\u5f0f\u5e38\u61c9\u7528\u65bc\u6df1\u5ea6\u5b78\u7fd2\uff0c\u56e0\u5176\u5728\u67d0\u4e9b\u786c\u9ad4\uff08\u5982\u652f\u63f4 BF16 \u7684 GPU\uff09\u4e0a\u80fd\u63d0\u4f9b\u66f4\u5feb\u7684\u8a08\u7b97\u6548\u80fd\u3002<\/li>\n\n\n\n<li><strong>Q2_K<\/strong><br>\u4ee3\u8868 <strong>2\u4f4d\u5143\u91cf\u5316\u7684\u7248\u672c\uff0c\u4f7f\u7528 K-quant \u65b9\u6cd5<\/strong>\u3002\u91cf\u5316\u662f\u4e00\u7a2e\u6280\u8853\uff0c\u5c07\u6a21\u578b\u6b0a\u91cd\u5f9e\u9ad8\u7cbe\u5ea6\uff08\u5982 32 \u4f4d\u6216 16 \u4f4d\uff09\u58d3\u7e2e\u5230\u4f4e\u4f4d\u5143\uff08\u5982 2 \u4f4d\u5143\uff09\uff0c\u4ee5\u5927\u5e45\u6e1b\u5c11\u6a94\u6848\u5927\u5c0f\u548c\u8a18\u61b6\u9ad4\u9700\u6c42\u3002Q2_K \u8868\u793a\u4f7f\u7528 2 \u4f4d\u5143\u4f86\u8868\u793a\u6b0a\u91cd\uff0c\u4e26\u63a1\u7528 K-quant\uff08\u4e00\u7a2e\u7279\u5b9a\u7684\u91cf\u5316\u6280\u8853\uff0c\u53ef\u80fd\u6d89\u53ca k-means \u6216\u5176\u4ed6\u65b9\u6cd5\uff09\u9032\u884c\u8655\u7406\u3002\u9019\u7a2e\u6975\u4f4e\u4f4d\u5143\u7cbe\u5ea6\u7684\u7248\u672c\u6a94\u6848\u6700\u5c0f\uff0c\u4f46\u6e96\u78ba\u6027\u640d\u5931\u53ef\u80fd\u8f03\u660e\u986f\u3002<\/li>\n\n\n\n<li><strong>Q3_K_M<\/strong><br>\u4ee3\u8868 <strong>3\u4f4d\u5143\u91cf\u5316\u7684\u7248\u672c\uff0c\u4f7f\u7528 K-quant \u7684\u4e2d\u7b49\u8b8a\u9ad4\uff08M\uff09<\/strong>\u3002\u9019\u662f 3 \u4f4d\u5143\u91cf\u5316\u7684\u6a21\u578b\uff0c\u63a1\u7528 K-quant \u65b9\u6cd5\uff0c\u4e26\u4ee5\u300c\u4e2d\u7b49\u300d\uff08Medium\uff09\u8b8a\u9ad4\u5be6\u73fe\u3002\u5728 3 \u4f4d\u5143\u91cf\u5316\u4e2d\uff0cM \u8b8a\u9ad4\u901a\u5e38\u6bd4\u5c0f\u578b\u8b8a\u9ad4\uff08S\uff09\u4fdd\u7559\u66f4\u591a\u7cbe\u5ea6\uff0c\u56e0\u6b64\u5728\u6a21\u578b\u5927\u5c0f\u548c\u6e96\u78ba\u6027\u4e4b\u9593\u63d0\u4f9b\u66f4\u597d\u7684\u5e73\u8861\u3002<\/li>\n\n\n\n<li><strong>Q3_K_S<\/strong><br>\u4ee3\u8868 <strong>3\u4f4d\u5143\u91cf\u5316\u7684\u7248\u672c\uff0c\u4f7f\u7528 K-quant \u7684\u5c0f\u578b\u8b8a\u9ad4\uff08S\uff09<\/strong>\u3002\u540c\u6a23\u662f 3 \u4f4d\u5143\u91cf\u5316\uff0c\u4f46\u63a1\u7528\u300c\u5c0f\u578b\u300d\uff08Small\uff09\u8b8a\u9ad4\u3002\u76f8\u8f03\u65bc Q3_K_M\uff0cQ3_K_S \u9032\u4e00\u6b65\u58d3\u7e2e\u6a21\u578b\u5927\u5c0f\uff0c\u4f46\u7531\u65bc\u4f7f\u7528\u4e86\u66f4\u5c11\u7684\u7cbe\u5ea6\u8cc7\u6e90\uff0c\u6e96\u78ba\u6027\u53ef\u80fd\u7565\u4f4e\u65bc M \u8b8a\u9ad4\u3002<\/li>\n\n\n\n<li><strong>Q4_0<\/strong><br>\u4ee3\u8868 <strong>4\u4f4d\u5143\u91cf\u5316\u7684\u7248\u672c\uff0c\u4f7f\u7528\u539f\u59cb\u91cf\u5316\u65b9\u6cd5<\/strong>\u3002\u9019\u662f 4 \u4f4d\u5143\u91cf\u5316\u7684\u6a21\u578b\uff0c\u672a\u4f7f\u7528 K-quant\uff0c\u800c\u662f\u63a1\u7528 GGUF \u683c\u5f0f\u4e2d\u7684\u539f\u59cb\u91cf\u5316\u65b9\u6cd5\uff08\u4f8b\u5982 Q4_0\uff09\u3002\u8207 2 \u4f4d\u5143\u6216 3 \u4f4d\u5143\u7248\u672c\u76f8\u6bd4\uff0c4 \u4f4d\u5143\u63d0\u4f9b\u66f4\u9ad8\u7684\u7cbe\u5ea6\uff0c\u56e0\u6b64\u6e96\u78ba\u6027\u53ef\u80fd\u66f4\u597d\uff0c\u4f46\u6a94\u6848\u5927\u5c0f\u4e5f\u76f8\u5c0d\u8f03\u5927\u3002<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">\u4e3b\u8981\u5dee\u7570\u7e3d\u7d50<\/h3>\n\n\n\n<p>\u9019\u4e9b\u6a94\u6848\u683c\u5f0f\u7684\u6838\u5fc3\u5dee\u7570\u5728\u65bc<strong>\u4f4d\u5143\u7cbe\u5ea6<\/strong>\u548c<strong>\u91cf\u5316\u65b9\u6cd5<\/strong>\uff0c\u5f71\u97ff\u6a21\u578b\u7684<strong>\u6a94\u6848\u5927\u5c0f<\/strong>\u3001<strong>\u8a08\u7b97\u6548\u7387<\/strong>\u548c<strong>\u6e96\u78ba\u6027<\/strong>\uff1a<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u4f4d\u5143\u7cbe\u5ea6<\/strong><\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>F16 \u548c BF16<\/strong>\uff1a\u90fd\u662f 16 \u4f4d\u6d6e\u9ede\u6578\u683c\u5f0f\uff0c\u7cbe\u5ea6\u8f03\u9ad8\uff0c\u6a94\u6848\u8f03\u5927\uff08\u4f8b\u5982 F16 \u53ef\u80fd\u9054\u5230 34.2 GB\uff09\uff0c\u9069\u5408\u9700\u8981\u9ad8\u54c1\u8cea\u8f38\u51fa\u7684\u5834\u666f\u3002<\/li>\n\n\n\n<li><strong>Q4_0<\/strong>\uff1a4 \u4f4d\u5143\u91cf\u5316\uff0c\u7cbe\u5ea6\u4f4e\u65bc F16\/BF16\uff0c\u4f46\u9ad8\u65bc Q2\/Q3\uff0c\u6a94\u6848\u5927\u5c0f\u9069\u4e2d\u3002<\/li>\n\n\n\n<li><strong>Q3_K_M \u548c Q3_K_S<\/strong>\uff1a3 \u4f4d\u5143\u91cf\u5316\uff0c\u7cbe\u5ea6\u9032\u4e00\u6b65\u964d\u4f4e\uff0c\u6a94\u6848\u66f4\u5c0f\u3002<\/li>\n\n\n\n<li><strong>Q2_K<\/strong>\uff1a2 \u4f4d\u5143\u91cf\u5316\uff0c\u7cbe\u5ea6\u6700\u4f4e\uff0c\u6a94\u6848\u6700\u5c0f\uff08\u4f8b\u5982\u53ef\u80fd\u50c5 6.56 GB\uff09\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u91cf\u5316\u65b9\u6cd5<\/strong><\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>_K<\/strong>\uff1a\u8868\u793a\u4f7f\u7528 K-quant \u65b9\u6cd5\uff0c\u9019\u662f\u4e00\u7a2e\u9032\u968e\u91cf\u5316\u6280\u8853\uff0c\u53ef\u80fd\u901a\u904e\u5206\u7d44\u6216\u805a\u985e\u4fdd\u7559\u66f4\u591a\u8cc7\u8a0a\uff0c\u63d0\u5347\u4f4e\u4f4d\u5143\u7cbe\u5ea6\u7684\u8868\u73fe\u3002<\/li>\n\n\n\n<li><strong>_K_M \u548c _K_S<\/strong>\uff1a\u5728\u76f8\u540c\u4f4d\u5143\u6578\uff08\u5982 3 \u4f4d\u5143\uff09\u4e0b\uff0cM\uff08\u4e2d\u7b49\uff09\u548c S\uff08\u5c0f\u578b\uff09\u8b8a\u9ad4\u4ee3\u8868\u4e0d\u540c\u7684\u6b0a\u91cd\u5206\u914d\u7b56\u7565\u3002M \u8b8a\u9ad4\u901a\u5e38\u6bd4 S \u8b8a\u9ad4\u4fdd\u7559\u66f4\u591a\u7cbe\u5ea6\uff0c\u56e0\u6b64\u6e96\u78ba\u6027\u66f4\u9ad8\uff0c\u4f46\u6a94\u6848\u7a0d\u5927\u3002<\/li>\n\n\n\n<li><strong>_0<\/strong>\uff1a\u5982 Q4_0\uff0c\u4f7f\u7528\u539f\u59cb\u91cf\u5316\u65b9\u6cd5\uff0c\u672a\u63a1\u7528 K-quant\uff0c\u53ef\u80fd\u662f\u8f03\u65e9\u6216\u8f03\u7c21\u55ae\u7684\u91cf\u5316\u65b9\u5f0f\u3002<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>F16 \u8207 BF16 \u7684\u5dee\u7570<\/strong><\/li>\n<\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>F16\uff08FP16\uff09\u4f7f\u7528 5 \u4f4d\u6307\u6578\u548c 10 \u4f4d\u5c3e\u6578\uff0c\u9069\u5408\u901a\u7528\u8a08\u7b97\u3002<\/li>\n\n\n\n<li>BF16 \u4f7f\u7528 8 \u4f4d\u6307\u6578\u548c 7 \u4f4d\u5c3e\u6578\uff0c\u52d5\u614b\u7bc4\u570d\u66f4\u5927\uff0c\u4f46\u5728\u7cbe\u7d30\u7cbe\u5ea6\u4e0a\u7a0d\u5f31\u3002BF16 \u5728\u67d0\u4e9b\u786c\u9ad4\uff08\u5982\u652f\u63f4 bfloat16 \u7684\u8655\u7406\u5668\uff09\u4e0a\u53ef\u80fd\u6709\u901f\u5ea6\u512a\u52e2\u3002<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">\u5982\u4f55\u9078\u64c7\uff1f<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u9ad8\u54c1\u8cea\u9700\u6c42<\/strong>\uff1a\u9078\u64c7 <strong>F16<\/strong> \u6216 <strong>BF16<\/strong>\uff0c\u9069\u5408\u6709\u8db3\u5920\u8a18\u61b6\u9ad4\u548c\u7b97\u529b\u7684\u8a2d\u5099\uff0cBF16 \u5728\u7279\u5b9a\u786c\u9ad4\u4e0a\u53ef\u80fd\u66f4\u9ad8\u6548\u3002<\/li>\n\n\n\n<li><strong>\u8a18\u61b6\u9ad4\u6709\u9650<\/strong>\uff1a\u9078\u64c7\u91cf\u5316\u7248\u672c\uff0c\u5982 <strong>Q2_K<\/strong>\uff08\u6700\u5c0f\uff09\u3001<strong>Q3_K_S<\/strong>\uff08\u7a0d\u5927\u4f46\u4ecd\u9ad8\u6548\uff09\u6216 <strong>Q4_0<\/strong>\uff08\u5e73\u8861\u9078\u64c7\uff09\u3002<\/li>\n\n\n\n<li><strong>\u5e73\u8861\u9700\u6c42<\/strong>\uff1a<strong>Q3_K_M<\/strong> \u5728\u6e96\u78ba\u6027\u548c\u5927\u5c0f\u9593\u63d0\u4f9b\u6298\u8877\uff0c\u9069\u5408\u591a\u6578\u5834\u666f\u3002<\/li>\n<\/ul>\n\n\n\n<p>\u7e3d\u4e4b\uff0c\u9019\u4e9b\u6a94\u6848\u8b93\u4f7f\u7528\u8005\u80fd\u6839\u64da\u786c\u9ad4\u689d\u4ef6\u548c\u61c9\u7528\u9700\u6c42\u9748\u6d3b\u9078\u64c7\uff0c\u5f9e\u9ad8\u7cbe\u5ea6\u7684 F16\/BF16 \u5230\u6975\u81f4\u58d3\u7e2e\u7684 Q2_K\uff0c\u6eff\u8db3\u4e0d\u540c\u4f7f\u7528\u60c5\u5883\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Quality rank (highest to lowest): fp16 &gt; bf16 &gt; fp8_scaled &gt; fp8_e4m3fn \u5728 Hugging Face \u7684 HiDream-I1-Fast-gguf \u6a21\u578b\u5132\u5b58\u5eab \u4e2d\uff0c\u4e0d\u540c\u7684\u6a94\u6848\u5f8c\u7db4\uff08\u5982 _K\u3001_K_M\u3001_K_S\u3001F16\u3001BF16\uff09\u4ee3\u8868\u6a21\u578b\u6b0a\u91cd\u5132\u5b58\u7684\u4e0d\u540c\u7cbe\u5ea6\u683c\u5f0f\u3002\u4ee5\u4e0b\u662f\u9019\u4e9b\u683c\u5f0f\u7684\u8aaa\u660e\u53ca\u5176\u5dee\u7570\uff0c\u7528\u7e41\u9ad4\u4e2d\u6587\u5448\u73fe\uff1a \u6a94\u6848\u683c\u5f0f\u8aaa\u660e \u4e3b\u8981\u5dee\u7570\u7e3d\u7d50 \u9019\u4e9b\u6a94\u6848\u683c\u5f0f\u7684\u6838\u5fc3\u5dee\u7570\u5728\u65bc\u4f4d\u5143\u7cbe\u5ea6\u548c\u91cf\u5316\u65b9\u6cd5\uff0c\u5f71\u97ff\u6a21\u578b\u7684\u6a94\u6848\u5927\u5c0f\u3001\u8a08\u7b97\u6548\u7387\u548c\u6e96\u78ba\u6027\uff1a \u5982\u4f55\u9078\u64c7\uff1f \u7e3d\u4e4b\uff0c\u9019\u4e9b\u6a94\u6848\u8b93\u4f7f\u7528\u8005\u80fd\u6839\u64da\u786c\u9ad4\u689d\u4ef6\u548c\u61c9\u7528\u9700\u6c42\u9748\u6d3b\u9078\u64c7\uff0c\u5f9e\u9ad8\u7cbe\u5ea6\u7684 F16\/BF16 \u5230\u6975\u81f4\u58d3\u7e2e\u7684 Q2_K\uff0c\u6eff\u8db3\u4e0d\u540c\u4f7f\u7528\u60c5\u5883\u3002<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"class_list":["post-4945","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/pages\/4945","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=4945"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/pages\/4945\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=4945"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}