{"id":9731,"date":"2026-06-28T16:31:35","date_gmt":"2026-06-28T08:31:35","guid":{"rendered":"https:\/\/infernews.com\/blog\/qwythos-9b-gguf\/"},"modified":"2026-06-28T16:32:48","modified_gmt":"2026-06-28T08:32:48","slug":"qwythos-9b-gguf","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/qwythos-9b-gguf\/","title":{"rendered":"Qwythos-9B GGUF \u6280\u8853\u62c6\u89e3"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/06\/qwythos.jpg\" alt=\"Og image\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u9019\u500b\u6a21\u578b\u4e4b\u6240\u4ee5\u503c\u5f97\u6ce8\u610f\uff0c\u4e3b\u8981\u662f\u56e0\u70ba\u5b83\u628a \u63a8\u7406\u80fd\u529b\u3001\u8d85\u9577\u4e0a\u4e0b\u6587\u3001\u4ee5\u53ca\u672c\u5730\u90e8\u7f72\u53cb\u597d\u6027 \u7d50\u5408\u5728\u4e00\u500b 9B \u7d1a\u5225\u7684\u6a21\u578b\u88e1\u3002\u5b83\u662f\u57fa\u65bc Qwen3.5-9B \u7684\u5168\u53c3\u6578\u63a8\u7406\u6a21\u578b\uff0c\u4e26\u7528 5 \u5104\u591a\u689d Claude Mythos \/ Claude Fable traces \u505a\u5f8c\u8a13\u7df4\uff0c\u9084\u652f\u63f4 1M context\u3001vision \u548c function calling \u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Hugging Face  <strong>empero-ai\/Qwythos-9B-Claude-Mythos-5-1M<\/strong> \u7684 GGUF \u91cf\u5316\u7248\u672c\u5c6c\u65bc quantized \u5f62\u5f0f\uff0c\u800c\u975e\u539f\u59cb\u8a13\u7df4\u6b0a\u91cd\u3002\u5b83\u7684\u4e3b\u8981\u7528\u9014\u662f\u5728 <strong>llama.cpp\u3001Ollama\u3001LM Studio<\/strong> \u7b49 GGUF \u57f7\u884c\u74b0\u5883\u4e2d\u90e8\u7f72\u4e00\u500b\u652f\u63f4\u63a8\u7406\u3001\u8996\u89ba\u8f38\u5165\u3001function calling \u8207\u9577\u4e0a\u4e0b\u6587\u7684 9B \u6a21\u578b\uff1b\u5176\u8868\u73fe\u8d85\u8d8a base Qwen3.5-9B\uff0c\u4f46\u9019\u4e00\u5c64\u95dc\u4fc2\u5c6c\u65bc\u4e0a\u6e38\u6a21\u578b\u8aaa\u660e\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Qwythos-9B \u662f full-parameter reasoning model\uff0c\u7d93\u904e\u8d85\u904e 5 \u5104 tokens \u7684 Claude Mythos \/ Claude Fable traces \u5f8c\u8a13\u7df4\uff0c\u4e26\u4f7f\u7528 Empero AI \u5167\u90e8 <code>rethink<\/code> \u5de5\u5177\u751f\u6210 chain-of-thought\u3002\u80fd\u529b\u4e0a\u652f\u63f4 <strong>1,048,576 tokens\uff081M context\uff09<\/strong>\uff0c\u900f\u904e YaRN rope-scaling \u9810\u8a2d\u958b\u555f\uff1b\u540c\u6642\u6a19\u793a\u70ba <strong>image-text-to-text<\/strong>\u3001multimodal\u3001vision\u3001agentic\uff0c\u8868\u793a\u5b83\u4e0d\u53ea\u662f\u6587\u5b57\u804a\u5929\u6a21\u578b\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">v2 \u5df2\u8981\u6c42\u91cd\u65b0\u4e0b\u8f09\uff0c\u539f\u56e0\u5305\u62ec tokenizer metadata \u5c0d Qwen3.5 GGUF runtimes \u7684\u4fee\u6b63\u3001chat template \u66f4\u65b0\uff0c\u4ee5\u53ca\u65b0\u589e <code>-MTP-<\/code> \u7248\u672c\u3002\u5df2\u5217\u51fa\u7684\u4e00\u822c\u7248\u672c\u5305\u62ec\uff1a<code>Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf<\/code>\uff085.24 GiB\uff0c\u5b98\u65b9\u5efa\u8b70\u9810\u8a2d\uff09\u3001<code>Q5_K_M<\/code>\uff086.02 GiB\uff09\u3001<code>Q6_K<\/code>\uff086.85 GiB\uff09\u3001<code>Q8_0<\/code>\uff088.87 GiB\uff09\u8207 <code>BF16<\/code>\uff0816.69 GiB\uff09\uff1b\u9801\u9762\u4ea6\u63d0\u5230 vision projector smoke-tested\uff0c\u4f46\u622a\u53d6\u5167\u5bb9\u672a\u898b mmproj \u6a94\u540d\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Q4_K_M<\/strong> \u662f\u6700\u9069\u5408\u8d77\u6b65\u7684\u91cf\u5316\u7d1a\u5225\uff0c\u5bb9\u91cf\u8f03\u4f4e\uff0c\u800c\u4e14\u9801\u9762\u76f4\u63a5\u6a19\u6210 recommended default<\/li>\n<li><strong>Q5_K_M \/ Q6_K<\/strong> \u8f03\u9069\u5408\u60f3\u63d0\u9ad8\u54c1\u8cea\u3001\u53c8\u60f3\u63a7\u5236\u8a18\u61b6\u9ad4\u4f54\u7528\u7684\u90e8\u7f72<\/li>\n<li><strong>Q8_0<\/strong> \u63a5\u8fd1 near-lossless\uff0c\u8f03\u9069\u5408\u91cd\u8996\u8f38\u51fa\u7a69\u5b9a\u5ea6\u7684\u60c5\u5883<\/li>\n<li><code>-MTP-<\/code> \u6a94\u6848\u662f\u70ba <strong>llama.cpp MTP draft speculation<\/strong> \u6e96\u5099\uff0c\u4e00\u822c\u76f8\u5bb9\u6027\u5247\u4ee5\u666e\u901a\u6a94\u540d\u7248\u672c\u8f03\u7a69\u9663<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u8207\u4e00\u822c\u53ea\u505a\u6307\u4ee4\u5fae\u8abf\u7684\u540c\u985e\u6a21\u578b\u76f8\u6bd4\uff0c\u9019\u500b\u9805\u76ee\u5f37\u8abf\u4e09\u9ede\uff1a\u4e00\u662f 1M context \u5df2\u9810\u8a2d\u53ef\u7528\uff0c\u4e8c\u662f native function calling \u4f9d\u7167 Qwen3.5 spec\uff0c\u4e09\u662f v2 \u9023 chat template \u90fd\u91dd\u5c0d tool calling \u8207 OpenCode-style agent loops \u4fee\u6b63\u3002\u9650\u5236\u4ea6\u5f88\u6e05\u695a\uff1a\u5b8c\u6574\u8a13\u7df4\u7d30\u7bc0\u8207\u8a55\u6e2c\u6578\u5b57\u9700\u8981\u56de\u5230 base model card \u67e5\u770b\uff0c\u800c\u9019\u500b\u9801\u9762\u4e3b\u8981\u662f\u91cf\u5316\u5206\u767c\u9801\uff1b\u4f7f\u7528\u6642\u4ea6\u8981\u7559\u610f\u820a\u7248 GGUF \u6a94\u540d\u5df2\u88ab\u66ff\u63db\uff0c\u5426\u5247 chat template \u8207 runtime \u76f8\u5bb9\u6027\u53ef\u80fd\u53d7\u5f71\u97ff\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/huggingface.co\/empero-ai\/Qwythos-9B-Claude-Mythos-5-1M-GGUF\" rel=\"noopener noreferrer\" target=\"_blank\"><strong>\u9805\u76ee\u4e3b\u9801<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u9019\u662f Qwythos-9B-Claude-Mythos-5-1M \u7684 GGUF \u91cf\u5316\u7248\uff0c\u4e3b\u6253 1M context\u3001\u63a8\u7406\u8207\u5de5\u5177\u8abf\u7528\u3002\u9801\u9762\u4ea6\u4ea4\u4ee3 v2 \u6a94\u6848\u66f4\u65b0\u8207 MTP \u7528\u6cd5\u3002<\/p>\n","protected":false},"author":8,"featured_media":9730,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ai_generated_summary":"","footnotes":""},"categories":[133,116,191,30,185,119,76],"tags":[],"class_list":["post-9731","post","type-post","status-publish","format-standard","hentry","category-133","category-agentic","category-anthropic","category-image","category-qwen","category-119","category-76"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9731","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=9731"}],"version-history":[{"count":1,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9731\/revisions"}],"predecessor-version":[{"id":9733,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9731\/revisions\/9733"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/9730"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=9731"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=9731"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=9731"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}