{"id":9695,"date":"2026-06-26T21:55:21","date_gmt":"2026-06-26T13:55:21","guid":{"rendered":"https:\/\/infernews.com\/blog\/code-generation-under-multimodal\/"},"modified":"2026-06-26T21:56:08","modified_gmt":"2026-06-26T13:56:08","slug":"code-generation-under-multimodal","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/code-generation-under-multimodal\/","title":{"rendered":"\u591a\u6a21\u614b\u7a0b\u5f0f\u78bc\u751f\u6210\u8ad6\u6587\u6574\u7406\uff1a\u8996\u89ba\u8f38\u5165\u5982\u4f55\u6539\u8b8a\u5beb\u7a0b\u5f0f"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/06\/image-473af003.jpg\" alt=\"mllm code logo\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Awesome-Multimodal-LLM-for-Code \u662f\u4e00\u4efd<strong>\u8ad6\u6587\u6574\u7406\u578b\u8cc7\u6e90\u5eab\uff08paper list \/ survey collection\uff09<\/strong>\uff0c\u5c08\u9580\u8490\u96c6\u300c\u591a\u6a21\u614b\u5927\u578b\u8a9e\u8a00\u6a21\u578b\uff08Multimodal LLM, MLLM\uff09\u7528\u65bc\u7a0b\u5f0f\u78bc\u751f\u6210\u300d\u76f8\u95dc\u7684\u7814\u7a76\u8ad6\u6587\u3001\u57fa\u6e96\u6e2c\u8a66\u8207\u8a55\u4f30\u65b9\u6cd5\uff0c\u6838\u5fc3\u4efb\u52d9\u662f\u628a\u300c\u8996\u89ba\u8f38\u5165\u300d\u8207\u300c\u7a0b\u5f0f\u78bc\u8f38\u51fa\u300d\u4e32\u63a5\u8d77\u4f86\uff0c\u4f8b\u5982\u628a UI \u622a\u5716\u3001\u5716\u8868\u3001SVG \u5411\u91cf\u5716\u3001CAD \u8349\u5716\u8f49\u6210\u53ef\u57f7\u884c\u7684\u7a0b\u5f0f\u78bc\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u50b3\u7d71\u7684 text-to-code \u7814\u7a76\u4e3b\u8981\u8655\u7406\u7d14\u6587\u5b57\u63cf\u8ff0\u751f\u6210\u7a0b\u5f0f\u78bc\uff0c\u4f46\u5f88\u591a\u771f\u5be6\u4efb\u52d9\u7684\u610f\u5716\u662f\u900f\u904e\u5716\u7247\u3001\u5f71\u7247\u6216\u4e92\u52d5\u756b\u9762\u4f86\u8868\u9054\u7684\uff0c\u7d14\u6587\u5b57\u7bc4\u5f0f\u7121\u6cd5\u8655\u7406\u7248\u9762\u914d\u7f6e\u3001\u8996\u89ba\u8a9e\u610f\u8207\u4e92\u52d5\u884c\u70ba\u7b49\u7d04\u675f\u3002\u9019\u500b\u8cc7\u6e90\u5eab\u628a\u7814\u7a76\u5207\u6210\u6e05\u695a\u7684\u5b50\u984c\uff0c\u5305\u62ec Web\/Mobile UI \u7a0b\u5f0f\u78bc\u751f\u6210\u3001\u79d1\u5b78\u5716\u8868\u7a0b\u5f0f\u78bc\u751f\u6210\u3001\u8996\u89ba\u8c50\u5bcc\u7684\u7a0b\u5f0f\u8a2d\u8a08\u984c\u3001SVG \u751f\u6210\u3001\u7c21\u5831\u751f\u6210\u3001UML\u3001CAD\u3001\u6d77\u5831\u30013D \u9ede\u96f2\u3001\u904a\u6232\u7a0b\u5f0f\u78bc\uff0c\u4ee5\u53ca\u7a0b\u5f0f\u4fee\u5fa9\u7b49\uff0c\u65b9\u4fbf\u7814\u7a76\u8005\u6309\u5834\u666f\u67e5\u627e\u5c0d\u61c9\u8ad6\u6587\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u8207\u4e00\u822c Awesome \u5217\u8868\u76f8\u6bd4\uff0c\u9019\u4efd\u8cc7\u6e90\u7684\u5dee\u7570\u5728\u65bc<strong>\u805a\u7126\u65bc\u300c\u8996\u89ba\u8b49\u64da\u5982\u4f55\u5f71\u97ff\u7a0b\u5f0f\u6b63\u78ba\u6027\u300d<\/strong>\uff0c\u4e26\u6536\u9304\u4e86 Design2Code\u3001ChartMimic\u3001Chart2Code\u3001StarVector\u3001PPTAgent\u3001ScienceAgentBench \u7b49\u5177\u4ee3\u8868\u6027\u7684\u57fa\u6e96\u6e2c\u8a66\u8207\u6a21\u578b\u3002\u5f9e\u652f\u63f4\u8cc7\u6599\u53ef\u4ee5\u770b\u5230\uff0c\u9644\u5e36\u7684 survey \u8ad6\u6587\u9032\u4e00\u6b65\u628a\u9818\u57df\u5206\u6210 GUI\u3001\u79d1\u5b78\u8996\u89ba\u5316\u3001\u7d50\u69cb\u5316\u5716\u5f62\u8207\u524d\u6cbf\u4efb\u52d9\u56db\u5927\u985e\uff0c\u4e26\u6307\u51fa\u8996\u89ba\u76f8\u4f3c\u5ea6\u4e0d\u8db3\u4ee5\u8a55\u4f30\u6b63\u78ba\u6027\uff0c\u9084\u9700\u8981\u8a9e\u610f\u3001\u4e92\u52d5\u8207\u9818\u57df\u7d04\u675f\u7684\u8b49\u64da\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5c0d<strong>\u524d\u7aef\u5de5\u7a0b\u5e2b\u3001\u8cc7\u6599\u8996\u89ba\u5316\u7814\u7a76\u8005\u3001AI \u7a0b\u5f0f\u78bc\u52a9\u624b\u958b\u767c\u8005\uff0c\u4ee5\u53ca\u505a benchmark \u8a2d\u8a08\u7684\u4eba<\/strong>\u7279\u5225\u6709\u7528\uff0c\u80fd\u5feb\u901f\u638c\u63e1 MLLM \u5728\u7a0b\u5f0f\u78bc\u4efb\u52d9\u4e0a\u7684\u6700\u65b0\u9032\u5c55\u8207\u8a55\u6e2c\u65b9\u6cd5\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u91cd\u9ede\u6458\u8981\uff1a<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5c6c\u65bc\u8ad6\u6587\u6574\u7406\u8cc7\u6e90\u5eab\uff0c\u805a\u7126\u591a\u6a21\u614b\u7a0b\u5f0f\u78bc\u751f\u6210<\/li>\n\n\n\n<li>\u6db5\u84cb UI\u3001\u5716\u8868\u3001SVG\u3001CAD\u3001\u7c21\u5831\u30013D \u7b49\u5341\u591a\u500b\u5b50\u984c<\/li>\n\n\n\n<li>\u6536\u9304 Design2Code\u3001ChartMimic\u3001ScienceAgentBench \u7b49\u57fa\u6e96<\/li>\n\n\n\n<li>\u5f37\u8abf\u8996\u89ba\u76f8\u4f3c\u5ea6\u4e0d\u8db3\u4ee5\u8a55\u4f30\u7a0b\u5f0f\u6b63\u78ba\u6027<\/li>\n\n\n\n<li>\u539f\u59cb\u8cc7\u6599\u672a\u63d0\u4f9b\u5b89\u88dd\u6216\u90e8\u7f72\u65b9\u5f0f\uff0c\u50c5\u4f9b\u8ad6\u6587\u7d22\u5f15\u8207\u95b1\u8b80<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>GitHub\uff1a<\/strong> <a href=\"https:\/\/github.com\/xjywhu\/Awesome-Multimodal-LLM-for-Code\" rel=\"noopener noreferrer\">https:\/\/github.com\/xjywhu\/Awesome-Multimodal-LLM-for-Code<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u4e00\u4efd\u805a\u7126\u65bc\u300c\u770b\u5716\u5beb\u7a0b\u5f0f\u300d\u7684\u8ad6\u6587\u6e05\u55ae\uff0c\u6db5\u84cb UI\u3001\u5716\u8868\u3001SVG\u3001CAD \u7b49\u591a\u6a21\u614b\u7a0b\u5f0f\u78bc\u751f\u6210\u7684\u7814\u7a76\u8207\u57fa\u6e96\u3002<\/p>\n","protected":false},"author":8,"featured_media":9694,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ai_generated_summary":"","footnotes":""},"categories":[133,163,169,164,146,189,198],"tags":[],"class_list":["post-9695","post","type-post","status-publish","format-standard","hentry","category-133","category-163","category-169","category-164","category-146","category-189","category-198"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9695","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=9695"}],"version-history":[{"count":1,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9695\/revisions"}],"predecessor-version":[{"id":9697,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/9695\/revisions\/9697"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/9694"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=9695"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=9695"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=9695"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}