{"id":9940,"date":"2026-07-07T21:06:16","date_gmt":"2026-07-07T13:06:16","guid":{"rendered":"https:\/\/infernews.com\/blog\/hy3-295b-moe\/"},"modified":"2026-07-07T22:11:19","modified_gmt":"2026-07-07T14:11:19","slug":"hy3-295b-moe","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/hy3-295b-moe\/","title":{"rendered":"\u9a30\u8a0a Hy3 295B \u53c3\u6578 MoE \u958b\u6e90\u65b0\u6a21\u578b"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/07\/pasted-fb196db6e6bb.jpg\" alt=\"Og image\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Hy3 \u662f\u7531\u9a30\u8a0a\u6df7\u5143\uff08Tencent Hy\uff09\u5718\u968a\u958b\u767c\u7684\u5927\u578b\u8a9e\u8a00\u6a21\u578b\uff0c\u5c6c\u65bc Mixture-of-Experts\uff08MoE\uff09\u6df7\u5408\u5c08\u5bb6\u67b6\u69cb\uff0c\u7e3d\u53c3\u6578\u91cf\u9054 295B\uff0c\u6bcf\u6b21\u63a8\u7406\u50c5\u555f\u7528 21B \u6d3b\u8e8d\u53c3\u6578\uff0c\u4e26\u984d\u5916\u914d\u5099 3.8B \u5605 Multi-Token Prediction\uff08MTP\uff09\u5c64\u53c3\u6578\u3002\u6b64\u6a21\u578b\u57fa\u65bc Hy3 Preview \u9032\u884c\u5f8c\u8a13\u7df4\u64f4\u5c55\uff0c\u5f9e 50 \u591a\u500b\u7522\u54c1\u5718\u968a\u6536\u96c6\u610f\u898b\u5f8c\uff0c\u4ee5\u66f4\u9ad8\u54c1\u8cea\u6578\u64da\u53ca\u66f4\u5927\u898f\u6a21\u5f37\u5316\u5b78\u7fd2\uff08RL\uff09\u5b8c\u6210\u512a\u5316\u3002\u9801\u9762\u672a\u660e\u78ba\u6a19\u793a Hy3 \u4fc2\u57fa\u65bc\u908a\u500b\u5916\u90e8\u57fa\u790e\u6a21\u578b\uff08base model\uff09\u9032\u884c\u5fae\u8abf\uff0c\u4f46\u6a21\u578b\u63a1\u7528\u539f\u751f MoE \u8a2d\u8a08\uff0c\u6574\u9ad4\u67b6\u69cb\u4e26\u975e\u7531\u5176\u4ed6\u65e2\u6709\u6a21\u578b\u884d\u751f\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Hy3 \u5171\u6709 80 \u5c64\u975e MTP \u4e3b\u9ad4\u5c64\u52a0 1 \u5c64 MTP \u5c64\uff0c\u63a1\u7528 GQA \u6ce8\u610f\u529b\u6a5f\u5236\uff0864 \u500b\u67e5\u8a62\u982d\u30018 \u500b KV \u982d\uff0chead dim 128\uff09\uff0c\u96b1\u85cf\u7dad\u5ea6\u70ba 4096\uff0c\u4e2d\u9593\u5c64\u7dad\u5ea6 13312\uff0c\u4e0a\u4e0b\u6587\u9577\u5ea6\u652f\u63f4 256K token\uff0c\u8a5e\u8868\u5927\u5c0f\u70ba 120832\u3002MoE \u90e8\u5206\u914d\u7f6e 192 \u500b\u5c08\u5bb6\uff0c\u6bcf\u6b21\u63a8\u7406\u555f\u7528 top-8 \u5c08\u5bb6\uff0c\u76ee\u524d\u50c5\u63d0\u4f9b BF16 \u7cbe\u5ea6\u7248\u672c\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Hy3 \u5b98\u65b9\u63a8\u85a6\u4f7f\u7528 vLLM \u53ca SGLang \u5169\u7a2e\u9ad8\u6548\u63a8\u8ad6\u6846\u67b6\uff0c\u9801\u9762\u4ea6\u63d0\u4f9b\u91dd\u5c0d\u5169\u8005\u5605\u90e8\u7f72\u6307\u5357\u53ca finetuning \u6d41\u7a0b\u3002\u7531\u65bc\u6a21\u578b\u9ad4\u7a4d\u9f90\u5927\uff0c\u5373\u4f7f\u53ea\u6709 21B \u6d3b\u8e8d\u53c3\u6578\uff0c\u5b8c\u6574 BF16 \u6b0a\u91cd\u5c0d\u6d88\u8cbb\u7d1a GPU \u800c\u8a00\u4ecd\u7136\u6975\u5177\u6311\u6230\u6027\uff0c\u9700\u8981\u591a\u5f35\u9ad8\u968e\u52a0\u901f\u5668\u624d\u80fd\u627f\u8f09\u3002<\/p>\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"Tencent Hy3 (Fully Tested) + Fully Free API: BEATS GLM-5.2?\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_4niRFwN1DtI\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F4niRFwN1DtI%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/4niRFwN1DtI\" \/><meta itemprop=\"duration\" content=\"PT7M11S\" \/><meta itemprop=\"uploadDate\" content=\"2026-07-07T09:15:00Z\" \/><\/div><div id=\"lyte_4niRFwN1DtI\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F4niRFwN1DtI%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">Tencent Hy3 (Fully Tested) + Fully Free API: BEATS GLM-5.2?<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/4niRFwN1DtI\" rel=\"nofollow noopener\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F4niRFwN1DtI%2F0.jpg\" alt=\"Tencent Hy3 (Fully Tested) + Fully Free API: BEATS GLM-5.2?\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"In this video, I&#039;ll be telling you about Tencent&#039;s new Hy3 model, the full release of their Hunyuan 3 model, including its open-source Apache 2.0 license, 295B MoE architecture, 256K context window, free OpenRouter endpoint, and how it performs on my KingBench 3 benchmark. -- Key Takeaways: \ud83d\ude80 Tencent has released Hy3, the full version of Hunyuan 3, under the Apache 2.0 open-source license. \ud83e\udde0 Hy3 is a 295B Mixture-of-Experts model with only 21B active parameters per token. \u26a1 The model uses a Multi-Token Prediction head and speculative decoding for faster inference. \ud83d\udcda It supports a massive 256K context window with controllable reasoning effort. \ud83d\udd17 Hy3 is currently available through a completely free OpenRouter endpoint with 262K context. \ud83e\uddea In my KingBench 3 testing, Hy3 scored 16 out of 70, or about 22.86%. \ud83d\udcbb Hy3 struggled with complex coding, 3D generation, math, and agentic tasks compared to top models. \u2705 While it is not a strong main coding model, it is useful for free high-volume tasks like summarization, extraction, and document processing.\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n\n\n<p class=\"wp-block-paragraph\">\u503c\u5f97\u7559\u610f\u5605\u4fc2\uff0cHy3 \u914d\u5099 MTP \u5c64\u53c3\u6578\uff0c\u53ef\u914d\u5408 speculative decoding \u7b49\u52a0\u901f\u6280\u8853\u63d0\u5347 token \u751f\u6210\u6548\u7387\uff0c\u5462\u985e\u9032\u968e\u529f\u80fd\u9069\u5408\u8ffd\u6c42\u4f4e\u5ef6\u9072\u5605\u61c9\u7528\u5834\u666f\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6a21\u578b\u985e\u578b<\/strong>\uff1a295B \u53c3\u6578 MoE \u8a9e\u8a00\u6a21\u578b\uff0c\u6bcf\u6b21\u555f\u7528 21B \u53c3\u6578<\/li>\n\n\n\n<li><strong>\u4e0a\u4e0b\u6587\u9577\u5ea6<\/strong>\uff1a256K token\uff0c\u8a5e\u8868 120832<\/li>\n\n\n\n<li><strong>\u7cbe\u5ea6\u652f\u63f4<\/strong>\uff1a\u76ee\u524d\u50c5\u63d0\u4f9b BF16 \u7248\u672c\uff0c\u672a\u898b GGUF \u6216 AWQ \u7b49\u91cf\u5316\u6a94\u6848<\/li>\n\n\n\n<li><strong>\u90e8\u7f72\u6846\u67b6<\/strong>\uff1a\u5b98\u65b9\u63a8\u85a6 vLLM \u8207 SGLang<\/li>\n\n\n\n<li><strong>\u6838\u5fc3\u5f37\u9805<\/strong>\uff1aAgent \u80fd\u529b\u3001\u63a8\u7406\u8868\u73fe\uff0c\u4ee5\u53ca MTP speculative decoding \u52a0\u901f\u6f5b\u529b<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/huggingface.co\/tencent\/Hy3\/blob\/main\/README_CN.md\" rel=\"noopener noreferrer\" target=\"_blank\"><strong>\u9805\u76ee\u4e3b\u9801<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u9a30\u8a0a\u6df7\u5143\u5718\u968a\u63a8\u51fa 295B \u53c3\u6578 MoE \u8a9e\u8a00\u6a21\u578b Hy3\uff0c\u652f\u63f4 256K \u4e0a\u4e0b\u6587\uff0c\u4e3b\u6253 Agent \u80fd\u529b\u8207\u9ad8\u6548\u63a8\u7406\u3002<\/p>\n","protected":false},"author":8,"featured_media":9939,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ai_generated_summary":"","footnotes":""},"categories":[133,76,172],"tags":[],"class_list":["post-9940","post","type-post","status-publish","format-standard","hentry","category-133","category-76","category-172"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9940","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=9940"}],"version-history":[{"count":1,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9940\/revisions"}],"predecessor-version":[{"id":9952,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9940\/revisions\/9952"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/9939"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=9940"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=9940"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=9940"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}