{"id":13037,"date":"2026-10-08T23:56:55","date_gmt":"2026-10-08T15:56:55","guid":{"rendered":"https:\/\/infernews.com\/blog\/cia-minimal-repro\/"},"modified":"2026-10-08T23:56:55","modified_gmt":"2026-10-08T15:56:55","slug":"cia-minimal-repro","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/cia-minimal-repro\/","title":{"rendered":"CIA-minimal-repro\uff1a\u8207\u601d\u7dad\u93c8\u4e00\u81f4\u6027\u6539\u9032\u6a21\u578b\u8a13\u7df4"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/10\/pasted-115280da51f0.jpg\" alt=\"Repository image for yihuaihong\/CIA-minimal-repro\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u7576\u6a21\u578b\u7b54\u5c0d\u554f\u984c\uff0c\u537b\u672a\u5fc5\u771f\u6b63\u7528\u5230\u63d0\u793a\u4e2d\u7684\u95dc\u9375\u8cc7\u8a0a\uff0cCIA \u4ee5\u53ef\u9a57\u8b49\u7684\u65b9\u5f0f\u62c6\u958b\u9019\u500b\u5dee\u7570\u3002\u9019\u500b GitHub \u9805\u76ee\u5c6c\u65bc\u6a21\u578b\u8a13\u7df4\u53ca\u8a55\u4f30\u7a0b\u5f0f\u78bc\uff0c\u8655\u7406\u6a21\u578b\u5167\u90e8\u8cc7\u8a0a\u4f7f\u7528\uff08B_INT\uff09\u8207 Chain of Thought\uff08B_CoT\uff09\u8868\u8ff0\u662f\u5426\u4e00\u81f4\u7684\u554f\u984c\uff0c\u4e26\u4ee5 macro-F1 \u5b9a\u7fa9 CIA \u5206\u6578\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">RS-B \u548c DPO-A \u4f7f\u7528\u540c\u4e00\u6279\u8cc7\u6599\u8d77\u6b65\uff1a\u57fa\u790e\u6a21\u578b\u70ba\u6bcf\u500b\u63d0\u793a\u53d6\u6a23 16 \u500b\u56de\u7b54\uff0c\u518d\u6309\u5167\u90e8\u4f7f\u7528\u8cc7\u8a0a\u3001CoT \u8868\u8ff0\u53ca\u7b54\u6848\u6b63\u78ba\u6027\u6a19\u8a18\u3002RS-B \u4fdd\u7559 B_INT \u8207 B_CoT \u4e00\u81f4\u7684\u56de\u7b54\u9032\u884c SFT\uff0c\u5373\u4f7f\u7b54\u6848\u672a\u5fc5\u6b63\u78ba\uff1bDPO-A \u5247\u6309\u6b63\u78ba\u6027\u52a0\u4e00\u81f4\u6027\u6392\u5e8f\uff0c\u5c07\u6bcf\u984c\u6392\u540d\u6700\u9ad8\u53ca\u6700\u4f4e\u7684\u56de\u7b54\u914d\u5c0d\u4f5c DPO\uff0c\u53d6\u6368\u66f4\u504f\u5411\u540c\u6642\u8ffd\u6c42\u6b63\u78ba\u548c\u5fe0\u5be6\u8868\u8ff0\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u8a55\u4f30\u6db5\u84cb TwoHop\u3001Hint \u548c Mult \u4e09\u9805\u4efb\u52d9\u3002TwoHop \u4ee5\u7dda\u6027 probe \u8b80\u53d6\u96b1\u85cf\u72c0\u614b\uff0cHint \u4f7f\u7528 Qwen2.5-32B-Instruct \u5224\u65b7 CoT \u662f\u5426\u627f\u8a8d\u63d0\u793a\uff0cMult \u5247\u4ee5 causal corruption test \u6aa2\u67e5\u7b54\u6848\u6703\u5426\u8ddf\u96a8\u88ab\u4fee\u6539\u7684\u4e2d\u9593\u4e58\u7a4d\uff1b\u9019\u4e9b\u65b9\u6cd5\u6bd4\u55ae\u770b\u6700\u7d42\u7b54\u6848\u66f4\u80fd\u66b4\u9732\u6a21\u578b\u662f\u5426\u771f\u6b63\u4f9d\u8cf4\u95dc\u9375\u6b65\u9a5f\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u53ef\u91cd\u73fe\u7bc4\u570d<\/strong>\uff1a\u63d0\u4f9b RS-B\u3001DPO-A\u3001\u8a13\u7df4\u6d41\u7a0b\u53ca\u4e09\u9805\u4efb\u52d9\u7684\u8a55\u4f30\u5165\u53e3\u3002<\/li>\n<li><strong>\u9650\u5236<\/strong>\uff1a\u5132\u5b58\u5eab\u53ea\u6709\u7a0b\u5f0f\u78bc\uff0c\u4e0d\u5305\u542b\u8cc7\u6599\u3001\u6a21\u578b\u6b0a\u91cd\u3001probe \u6b0a\u91cd\u6216\u5be6\u9a57\u7d50\u679c\u3002<\/li>\n<li><strong>\u786c\u4ef6\u8981\u6c42<\/strong>\uff1a\u9810\u8a2d\u4ee5 2 \u5f35 GPU \u914d\u5408 Accelerate \u548c DeepSpeed ZeRO-3\uff0c\u539f\u59cb\u5be6\u9a57\u4f7f\u7528 80 GB A100\u3001H100 \u53ca H200\u3002<\/li>\n<li><strong>\u6aa2\u67e5\u65b9\u5f0f<\/strong>\uff1aTwoHop \u6bcf 15 \u6b65\u5132\u5b58 checkpoint \u4e26\u9078\u9a57\u8b49\u96c6\u5cf0\u503c\uff0cHint \u548c Mult \u5247\u53ea\u4fdd\u7559\u6700\u7d42\u6a21\u578b\u3002<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u7814\u7a76\u4eba\u54e1\u53ef\u7528\u5b83\u91cd\u8dd1\u8a13\u7df4\u53ca\u6aa2\u67e5\u6307\u6a19\u5b9a\u7fa9\uff0c\u5df2\u6709 Hugging Face Open R1 \u8a13\u7df4\u74b0\u5883\u7684\u5718\u968a\u4ea6\u8f03\u5bb9\u6613\u63a5\u5165\uff1b\u4f46\u7f3a\u5c11\u8cc7\u6599\u8207\u6b0a\u91cd\uff0c\u4e0d\u80fd\u76f4\u63a5\u4e0b\u8f09\u5f8c\u91cd\u73fe\u7d50\u679c\u3002\u9805\u76ee\u66f4\u9069\u5408\u4f5c\u70ba\u7814\u7a76\u7ba1\u7dda\u7684\u7cbe\u7c21\u9aa8\u67b6\uff0c\u800c\u975e\u958b\u7bb1\u5373\u7528\u7684\u5b8c\u6574\u6a21\u578b\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/github.com\/yihuaihong\/CIA-minimal-repro\" rel=\"noopener noreferrer\"><strong>GitHub<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>CIA \u5c07\u6a21\u578b\u662f\u5426\u771f\u6b63\u4f7f\u7528\u95dc\u9375\u8cc7\u8a0a\uff0c\u8207 CoT \u662f\u5426\u8aaa\u51fa\u76f8\u95dc\u5167\u5bb9\u5206\u958b\u91cf\u5ea6\uff0c\u518d\u7528 RS-B \u548c DPO-A \u6539\u5584\u5169\u8005\u7684\u4e00\u81f4\u6027\u3002<\/p>\n","protected":false},"author":8,"featured_media":13036,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wpai_generated_summary":"","wpai_meta_description":"","footnotes":""},"categories":[133,76,127,185,147,197,150,160],"tags":[],"class_list":["post-13037","post","type-post","status-publish","format-standard","hentry","category-133","category-76","category-127","category-qwen","category-deepseek","category-framework","category-150","category-160"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/13037","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=13037"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/13037\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/13036"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=13037"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=13037"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=13037"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}