{"id":12202,"date":"2026-09-13T14:35:43","date_gmt":"2026-09-13T06:35:43","guid":{"rendered":"https:\/\/infernews.com\/blog\/minicpm5-sota-on-device-llms-small-yet-powerful\/"},"modified":"2026-09-13T14:35:43","modified_gmt":"2026-09-13T06:35:43","slug":"minicpm5-sota-on-device-llms-small-yet-powerful","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/minicpm5-sota-on-device-llms-small-yet-powerful\/","title":{"rendered":"MiniCPM5-2B\uff1a\u5c0f\u6a21\u578b\u6311\u6230\u9577\u6587\u672c\u8207\u672c\u6a5f Agent"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/09\/minicpm_logo.jpg\" alt=\"minicpm logo\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">2B \u7d1a\u958b\u6e90\u6a21\u578b\u4e00\u5411\u88ab\u8996\u70ba\u300c\u5783\u573e\u300d\uff0c\u4f46 OpenBMB \u63a8\u51fa MiniCPM5-2B \u60f3\u76f4\u63a5\u6253\u7834\u5462\u500b\u5370\u8c61\u3002\u4f62\u4fc2\u4e00\u500b\u5bc6\u96c6 2B Transformer\uff0c\u5c08\u70ba\u672c\u6a5f\u90e8\u7f72\u3001\u8cc7\u6e90\u53d7\u9650\u5834\u666f\u540c Agent \u5de5\u4f5c\u6d41\u800c\u8a2d\uff0c\u4e26\u975e\u8ffd\u6c42\u8dd1\u5206\uff0c\u800c\u4fc2\u5e0c\u671b\u7528\u7d30\u6a21\u578b\u625b\u8d77\u7de8\u78bc\u3001\u5de5\u5177\u8abf\u7528\u540c\u9577\u6587\u672c\u63a8\u7406\u5605\u5be6\u969b\u4efb\u52d9\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u4f62\u6700\u5927\u5605\u8ce3\u9ede\u4fc2\u6df7\u5408\u6ce8\u610f\u529b\u67b6\u69cb\uff1a25% InfLLM-V2 \u914d 75% Lightning Attention\uff0c\u524d\u8005\u8655\u7406\u5c40\u90e8\u7d30\u7bc0\uff0c\u5f8c\u8005\u8ca0\u8cac\u5ee3\u57df\u4e0a\u4e0b\u6587\uff0c\u907f\u958b\u5168\u6ce8\u610f\u529b\u55ba\u9577\u5e8f\u5217\u5605\u8a18\u61b6\u9ad4\u8ca0\u64d4\u3002\u53e6\u4e00\u95dc\u9375\u4fc2 Transformer-to-Hybrid Continue Training\uff0c\u76f4\u63a5\u55ba\u9810\u8a13\u7df4\u6b0a\u91cd\u4e0a\u505a\u67b6\u69cb\u8f49\u63db\uff0c\u7701\u53bb\u51b7\u555f\u52d5\u8a13\u7df4\u6210\u672c\uff0c\u6574\u9ad4\u8a13\u7df4\u9810\u7b97\u5927\u7d04\u53ea\u9700\u5f9e\u982d\u7df4\u4e00\u500b\u540c\u7d1a\u6a21\u578b\u5605 25%\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u55ba\u9577\u6587\u672c\u4f62\u55ba 256K token \u5e8f\u5217\u9577\u5ea6\u4e0b\u63a8\u8ad6\u901f\u5ea6\u9054 Qwen3-8B \u5605 3.5 \u500d\uff08A6000D \u5be6\u6e2c\uff09\uff0c1M token \u4ecd\u53ef\u904b\u884c\uff0c\u800c Qwen3-8B \u55ba 1M \u5df2\u7d93 OOM\u3002\u77ed\u6587\u672c\u65b9\u9762\uff0c\u4f62\u5605\u77e5\u8b58\u3001\u6578\u5b78\u3001\u7de8\u78bc\u80fd\u529b\u8cbc\u8fd1 Qwen3-8B\uff0c\u4f46\u9577\u6587\u672c\u57fa\u6e96\u6e2c\u8a66\u53cd\u800c\u66f4\u9ad8\uff0c\u53ef\u4ee5\u7406\u89e3\u70ba\u300c\u7d30\u6a21\u578b\u5514\u518d\u9700\u8981\u55ba\u9577\u77ed\u5834\u666f\u4e4b\u9593\u4e8c\u64c7\u4e00\u300d\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5c0d\u60f3\u55ba\u672c\u6a5f\u8dd1 Agent\u3001\u6216\u9700\u8981\u8655\u7406\u8d85\u9577\u6587\u4ef6\u5605\u958b\u767c\u8005\u540c\u5718\u968a\uff0c\u5462\u500b\u6a21\u578b\u63d0\u4f9b\u5497\u4e00\u500b\u5177\u9ad4\u9078\u9805\u3002OpenBMB \u540c\u6642\u958b\u6e90\u5497 UltraX \u9810\u8a13\u7df4\u6578\u64da\u96c6\u3001UltraData-Code\u3001UltraData-SFT-Agent-2609\uff0850 \u842c\u689d Agent \u6a23\u672c\uff09\u540c UltraData-RL-2609\uff0c\u65b9\u4fbf\u4e0b\u6e38\u5fae\u8abf\u3002Hugging Face \u6709\u7dda\u4e0a Demo \u53ef\u5373\u6642\u8a66\uff0cGitHub \u4e0a\u4ea6\u6709\u90e8\u7f72\u8207\u5fae\u8abf\u8173\u672c\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u6df7\u5408\u6ce8\u610f\u529b<\/strong>\uff1a25% InfLLM-V2 + 75% Lightning Attention\uff0c\u517c\u9867\u5c40\u90e8\u540c\u5ee3\u57df\u4e0a\u4e0b\u6587<\/li>\n<li><strong>\u67b6\u69cb\u5ef6\u7e8c\u8a13\u7df4<\/strong>\uff1aTransformer \u6b0a\u91cd\u76f4\u63a5\u8f49\u70ba\u6df7\u5408\u67b6\u69cb\uff0c\u8a13\u7df4\u6210\u672c\u50c5\u7d04 25%<\/li>\n<li><strong>\u9577\u6587\u672c\u8868\u73fe<\/strong>\uff1a256K \u63a8\u8ad6\u901f\u5ea6\u70ba Qwen3-8B \u5605 3.5 \u500d\uff0c1M token \u4ecd\u53ef\u904b\u884c<\/li>\n<li><strong>\u77ed\u6587\u672c\u4fdd\u6301\u7af6\u722d\u529b<\/strong>\uff1a\u77e5\u8b58\u3001\u6578\u5b78\u3001\u7de8\u78bc\u63a5\u8fd1 Qwen3-8B \u6c34\u5e73<\/li>\n<li><strong>\u914d\u5957\u958b\u6e90\u6578\u64da<\/strong>\uff1aUltraData \u7cfb\u5217\u6db5\u84cb\u9810\u8a13\u7df4\u3001Agent SFT\u3001RL \u6a23\u672c<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/github.com\/OpenBMB\/MiniCPM\" rel=\"noopener noreferrer\"><strong>GitHub<\/strong><\/a> \u00b7 <a href=\"https:\/\/huggingface.co\/openbmb\/MiniCPM5-2B\" rel=\"noopener noreferrer\"><strong>\u6a21\u578b<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>MiniCPM5-2B \u5b9a\u4f4d\u672c\u6a5f\u52a9\u7406\u8207 Agent \u5de5\u4f5c\u6d41\uff0c\u6191\u6df7\u5408\u6ce8\u610f\u529b\u6a5f\u5236\u5728 256K \u4e0a\u4e0b\u6587\u901f\u5ea6\u9054\u540c\u985e\u6a21\u578b\u7684 3.5 \u500d\uff0c1M \u9577\u5ea6\u4ea6\u5514\u6703 OOM\u3002<\/p>\n","protected":false},"author":8,"featured_media":12201,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wpai_generated_summary":"","footnotes":""},"categories":[133,116,76,127,38,199],"tags":[],"class_list":["post-12202","post","type-post","status-publish","format-standard","hentry","category-133","category-agentic","category-76","category-127","category-38","category-dataset-"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12202","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=12202"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12202\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/12201"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=12202"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=12202"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=12202"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}