{"id":12945,"date":"2026-10-06T03:31:00","date_gmt":"2026-10-05T19:31:00","guid":{"rendered":"https:\/\/infernews.com\/blog\/scientificslop-benchmarking-and-mitigating-scientific-slop-in-ai-generated-pape\/"},"modified":"2026-10-06T03:31:00","modified_gmt":"2026-10-05T19:31:00","slug":"scientificslop-benchmarking-and-mitigating-scientific-slop-in-ai-generated-pape","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/scientificslop-benchmarking-and-mitigating-scientific-slop-in-ai-generated-pape\/","title":{"rendered":"ScientificSlop\uff1aAI \u8ad6\u6587\u4e0d\u53ea\u8981\u8b80\u5f97\u9806\uff0c\u4e5f\u8981\u6aa2\u67e5\u8b49\u64da\u662f\u5426\u63a5\u5f97\u4e0a"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/10\/pasted-58a1d812bca4.jpg\" alt=\"Repository image for yerimoh\/ScientificSlop\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e00\u7bc7\u8ad6\u6587\u5373\u4f7f\u53e5\u53e5\u901a\u9806\uff0c\u8ad6\u9ede\u3001\u65b9\u6cd5\u548c\u8b49\u64da\u4ecd\u53ef\u80fd\u63a5\u4e0d\u4e0a\u3002SciSlop \u662f\u4e00\u5957\u8861\u91cf AI \u751f\u6210\u8ad6\u6587\u79d1\u5b78\u5167\u5bb9\u54c1\u8cea\u7684\u8a55\u4f30\u5de5\u5177\uff0c\u5f9e\u7d50\u69cb\u3001\u8ad6\u8b49\u548c\u7814\u7a76\u6750\u6599\u4e09\u500b\u9762\u5411\u6aa2\u67e5\u516d\u7a2e\u554f\u984c\uff0c\u800c\u4e0d\u662f\u53ea\u5224\u65b7\u6587\u5b57\u50cf\u4e0d\u50cf AI \u6240\u5beb\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u914d\u5957\u7684 SciSlopBench \u6536\u9304 390 \u7d44 AI \u751f\u6210\u8ad6\u6587\u8207\u4eba\u985e\u64b0\u5beb\u8ad6\u6587\uff0c\u8b93\u7814\u7a76\u8005\u6bd4\u8f03\u4e0d\u540c\u8a55\u5206\u65b9\u6cd5\u5206\u8fa8\u5169\u8005\u7684\u80fd\u529b\u3002\u5df2\u91cb\u51fa\u7684\u5206\u6578\u4e2d\uff0cSciSlop \u7684\u914d\u5c0d\u6e96\u78ba\u7387\u70ba 0.859\uff1b\u4f5c\u70ba\u57fa\u6e96\u7684 Binoculars \u70ba 0.687\u3002\u9019\u662f\u7279\u5b9a\u6e2c\u8a66\u96c6\u4e0a\u7684\u7d50\u679c\uff0c\u4e0d\u80fd\u76f4\u63a5\u89e3\u8b80\u6210\u5de5\u5177\u80fd\u5224\u5b9a\u4efb\u4f55\u8ad6\u6587\u771f\u507d\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u53e6\u4e00\u90e8\u5206 SciSlopHarness \u6703\u5f15\u5c0e\u56fa\u5b9a\u7684\u5927\u578b\u8a9e\u8a00\u6a21\u578b\u4fee\u6539\u8ad6\u6587\uff0c\u4f46\u53ea\u5728\u5be6\u9a57\u7d00\u9304\u80fd\u652f\u6301\u4fee\u6539\u6642\u624d\u52d5\u7b46\u3002\u9019\u500b\u9650\u5236\u6709\u52a9\u907f\u514d\u6a21\u578b\u70ba\u4e86\u8b93\u6587\u5b57\u770b\u8d77\u4f86\u66f4\u597d\u800c\u64c5\u81ea\u6539\u8b8a\u7814\u7a76\u4e3b\u5f35\uff1b\u4e0d\u904e\uff0c\u73fe\u6709\u8aaa\u660e\u6c92\u6709\u63d0\u4f9b\u8db3\u4ee5\u5224\u65b7\u4fee\u6539\u54c1\u8cea\u7684\u5b8c\u6574\u6578\u5b57\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5132\u5b58\u5eab\u540c\u6642\u63d0\u4f9b\u57fa\u6e96\u8cc7\u6599\u3001\u8a55\u4f30\u7a0b\u5f0f\u3001\u6bd4\u8f03\u7528\u7684\u5075\u6e2c\u5668\u8207\u81ea\u52d5\u5be9\u7a3f\u7cfb\u7d71\uff0c\u4ee5\u53ca\u5206\u6790 2017 \u81f3 2026 \u5e74 ICLR \u5be9\u7a3f\u5206\u6578\u548c\u6c7a\u7b56\u7684\u7a0b\u5f0f\u3002\u8cc7\u6599\u4ee5\u4e09\u500b Parquet \u8868\u683c\u91cb\u51fa\uff1b\u5b89\u88dd Python \u4f9d\u8cf4\u5f8c\uff0c\u53ef\u5148\u8b80\u53d6\u5206\u6578\u8868\u91cd\u7b97\u914d\u5c0d\u6e96\u78ba\u7387\u8207 AUROC\uff0c\u518d\u6309\u6587\u4ef6\u6d41\u7a0b\u91cd\u8dd1\u90e8\u5206\u78ba\u5b9a\u6027\u6307\u6a19\u3002GPU \u5957\u4ef6\u5c6c\u53ef\u9078\u9805\uff0c\u6a21\u578b\u76f8\u95dc\u6307\u6a19\u5247\u53ef\u80fd\u9700\u8981\u5916\u90e8\u6a21\u578b\u547c\u53eb\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u516d\u9805\u6307\u6a19\u6db5\u84cb\u7d50\u69cb\u3001\u8ad6\u8b49\u8207\u7814\u7a76\u6750\u6599\u3002<\/li>\n<li>SciSlopBench \u5305\u542b 390 \u7d44\u914d\u5c0d\u8ad6\u6587\u3002<\/li>\n<li>\u516c\u958b\u5206\u6578\u4e2d\u7684\u914d\u5c0d\u6e96\u78ba\u7387\u70ba 0.859\uff0c\u9ad8\u65bc Binoculars \u7684 0.687\u3002<\/li>\n<li>SciSlopHarness \u53ea\u5728\u5be6\u9a57\u7d00\u9304\u652f\u6301\u6642\u624d\u4fee\u6539\u5167\u5bb9\u3002<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u5c0d\u7814\u7a76\u5718\u968a\u800c\u8a00\uff0c\u9019\u5957\u5de5\u5177\u9069\u5408\u7528\u4f86\u6aa2\u67e5 AI \u8f14\u52a9\u5beb\u4f5c\u662f\u5426\u524a\u5f31\u8ad6\u8b49\u9023\u8cab\u6027\uff0c\u4e5f\u80fd\u4f5c\u70ba\u7814\u7a76\u8ad6\u6587\u8a55\u4f30\u65b9\u6cd5\u7684\u6e2c\u8a66\u6750\u6599\u3002\u9805\u76ee\u61c9\u8996\u70ba\u7814\u7a76\u7528\u9014\uff0c\u4e0d\u80fd\u53d6\u4ee3\u5c08\u5bb6\u5c0d\u65b9\u6cd5\u3001\u8b49\u64da\u53ca\u5f15\u7528\u7684\u5be9\u95b1\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/yerimoh.github.io\/scientific-slop-demo\/\" rel=\"noopener noreferrer\"><strong>\u9805\u76ee\u4e3b\u9801<\/strong><\/a> \u00b7 <a href=\"https:\/\/github.com\/yerimoh\/ScientificSlop\" rel=\"noopener noreferrer\"><strong>GitHub<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>SciSlop \u628a\u7126\u9ede\u653e\u5728 AI \u8ad6\u6587\u7684\u8ad6\u8b49\u3001\u7d50\u69cb\u8207\u7814\u7a76\u6750\u6599\uff0c\u4e26\u4ee5 390 \u7d44\u4eba\u985e\u8207 AI \u8ad6\u6587\u6e2c\u8a66\u80fd\u5426\u8fa8\u8a8d\u79d1\u5b78\u5167\u5bb9\u4e2d\u7684\u7a7a\u6d1e\u4e4b\u8655\u3002<\/p>\n","protected":false},"author":8,"featured_media":12944,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wpai_generated_summary":"","footnotes":""},"categories":[133,131,76,38,152,150,199],"tags":[],"class_list":["post-12945","post","type-post","status-publish","format-standard","hentry","category-133","category-embedding","category-76","category-38","category-python","category-150","category-dataset-"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12945","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=12945"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/12945\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/12944"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=12945"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=12945"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=12945"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}