{"id":11438,"date":"2026-08-26T06:12:43","date_gmt":"2026-08-25T22:12:43","guid":{"rendered":"https:\/\/infernews.com\/blog\/ribospan-rna-modeling\/"},"modified":"2026-08-26T06:12:43","modified_gmt":"2026-08-25T22:12:43","slug":"ribospan-rna-modeling","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/ribospan-rna-modeling\/","title":{"rendered":"RiboSpan \u628a\u9577\u7bc7 RNA \u7d0d\u5165 10K \u4e0a\u4e0b\u6587\u6a21\u578b"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/08\/pasted-f12339c1d924.jpg\" alt=\"RiboSpan architecture\"><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">\u9577\u7bc7 mRNA \u904e\u5f80\u5bb9\u6613\u56e0\u7d04 1K \u7684\u4e0a\u4e0b\u6587\u9650\u5236\u800c\u88ab\u622a\u65b7\uff0c\u4ee4 5\u2032 UTR\u3001CDS \u548c 3\u2032 UTR \u7121\u6cd5\u653e\u5728\u540c\u4e00\u500b\u6a21\u578b\u8996\u91ce\u5167\u3002RiboSpan \u662f\u4e00\u500b RNA foundation model\uff0c\u5be6\u969b\u8655\u7406\u7684\u662f\u5b8c\u6574\u9577\u93c8 RNA \u7684\u806f\u5408\u8868\u793a\u8207\u4e0b\u6e38\u5efa\u6a21\u554f\u984c\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u9805\u76ee\u63a1\u7528 1.61B \u53c3\u6578\u7684\u96d9\u5411 Transformer\uff0c\u6bcf\u5c64\u90fd\u4f7f\u7528 dense self-attention\uff0c\u4e26\u4ee5\u6bcf\u500b\u6838\u82f7\u9178\u4e00\u500b token \u7684\u65b9\u5f0f\u4fdd\u7559\u4f4d\u7f6e\u5c0d\u9f4a\u8cc7\u8a0a\u3002RiboSpan-10K \u539f\u751f\u4ee5\u6700\u591a 10,240 nt \u7684\u9577\u5ea6\u9810\u8a13\u7df4\uff0c\u4e0d\u4f9d\u8cf4\u63a8\u7406\u968e\u6bb5\u5ef6\u9577\u4e0a\u4e0b\u6587\uff1b\u8a13\u7df4\u8cc7\u6599\u5305\u62ec 6,760 \u842c\u689d RNA \u5e8f\u5217\uff0c\u5408\u5171 857 \u5104\u500b\u6838\u82f7\u9178\uff0c\u4f86\u6e90\u6db5\u84cb RNAcentral\u3001Ensembl \u548c Ensembl Genomes\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u55ae\u6838\u82f7\u9178 tokenization\uff0c\u4fdd\u7559\u9ad8\u89e3\u6790\u5ea6\u5e8f\u5217\u4f4d\u7f6e<\/li>\n<li>Bidirectional Transformer \u53ef\u540c\u6642\u8b80\u53d6\u4e0a\u6e38\u3001\u4e0b\u6e38\u53ca\u9060\u8ddd\u96e2\u8cc7\u8a0a<\/li>\n<li>RiboSpan-10K \u539f\u751f\u652f\u63f4 10,240 nt \u9577\u4e0a\u4e0b\u6587<\/li>\n<li>\u4e0d\u52a0 task-specific head \u6216 fine-tuning\uff0cfrozen representation \u5728\u8a55\u6e2c\u4e2d\u9054\u5230 state-of-the-art\uff0c\u9577 RNA \u5c24\u5176\u7a81\u51fa<\/li>\n<li>\u4ee5 40% masking \u7e7c\u7e8c\u9810\u8a13\u7df4\uff0c\u53ef\u63d0\u5347\u9ad8\u6bd4\u4f8b\u906e\u7f69\u4e0b\u7684\u91cd\u5efa\u80fd\u529b\uff0c\u540c\u6642\u4fdd\u7559 15% masked language modeling\uff08MLM\uff09\u8a13\u7df4\u5efa\u7acb\u7684 backbone \u8868\u793a<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u7814\u7a76\u8005\u53ef\u5f9e Hugging Face \u8f09\u5165\u9810\u8a13\u7df4 RIBOSPAN checkpoint\uff0c\u518d\u4ee5 Python \u6574\u5408\u5e8f\u5217\u8868\u793a\u3001\u91cd\u5efa\u6216\u5176\u4ed6 RNA \u5206\u6790\u6d41\u7a0b\uff1bcheckpoint \u6703\u81ea\u52d5\u4e0b\u8f09\u4e26\u5feb\u53d6\uff0c\u4ea6\u53ef\u6539\u7528\u672c\u5730\u8def\u5f91\u3002\u6a21\u578b\u898f\u6a21\u548c dense attention \u5e36\u4f86\u8f03\u9ad8\u7684\u8a18\u61b6\u9ad4\u53ca\u904b\u7b97\u6210\u672c\uff0c\u9577\u5ea6\u8d85\u904e 10,240 nt \u7684\u8f49\u9304\u672c\u4ecd\u9700\u53e6\u884c\u5207\u5206\u6216\u8a2d\u8a08\u8655\u7406\u7b56\u7565\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">RiboSpan \u9069\u5408\u7814\u7a76 RNA \u529f\u80fd\u3001\u9577\u8f49\u9304\u672c\u8868\u793a\u548c\u751f\u7269\u8cc7\u8a0a\u6a21\u578b\u7684\u5718\u968a\uff0c\u5c24\u5176\u65b9\u4fbf\u5148\u56fa\u5b9a backbone\u3001\u518d\u6e2c\u8a66\u4e0b\u6e38\u4efb\u52d9\u7684\u4eba\u54e1\u3002\u76f8\u8f03\u53ea\u8655\u7406\u7d04 1K \u4e0a\u4e0b\u6587\u7684 dense RNA encoder\uff0c\u5b83\u4fdd\u7559\u5b8c\u6574\u8f49\u9304\u672c\u95dc\u4fc2\uff1b\u4ee3\u50f9\u662f 1.61B \u53c3\u6578\u4ee4\u672c\u5730\u63a8\u7406\u548c\u5fae\u8abf\u9580\u6abb\u66f4\u9ad8\uff0c\u800c\u6a21\u578b\u6b0a\u91cd\u4ea6\u63a1\u7528\u975e\u5546\u696d\u6388\u6b0a\uff0c\u5546\u696d\u9805\u76ee\u9700\u8981\u5148\u6838\u5c0d\u9650\u5236\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/huggingface.co\/papers\/2608.22849\" rel=\"noopener noreferrer\"><strong>\u9805\u76ee\u4e3b\u9801<\/strong><\/a> \u00b7 <a href=\"https:\/\/github.com\/GAIR-NLP\/RIBOSPAN-FM\" rel=\"noopener noreferrer\"><strong>GitHub<\/strong><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u9577\u7bc7 mRNA \u4e0d\u518d\u9700\u8981\u622a\u65b7\u8655\u7406\uff0cRiboSpan \u4ee5\u55ae\u6838\u82f7\u9178\u89e3\u6790\u5ea6\u540c\u6642\u7406\u89e3\u5b8c\u6574\u8f49\u9304\u672c\u3002<\/p>\n","protected":false},"author":8,"featured_media":11437,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"wpai_generated_summary":"","footnotes":""},"categories":[133,152,76,127],"tags":[],"class_list":["post-11438","post","type-post","status-publish","format-standard","hentry","category-133","category-python","category-76","category-127"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/11438","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=11438"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/11438\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/11437"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=11438"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=11438"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=11438"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}