{"id":8925,"date":"2026-06-07T21:21:07","date_gmt":"2026-06-07T13:21:07","guid":{"rendered":"https:\/\/infernews.com\/blog\/nvidia-omnidreams-is-a-world-model-that-generates-photorealistic-video-for-auton\/"},"modified":"2026-06-07T21:23:24","modified_gmt":"2026-06-07T13:23:24","slug":"nvidia-omnidreams","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/nvidia-omnidreams\/","title":{"rendered":"OmniDreams\uff1aNVidia \u9ede\u6a23\u91cd\u5851\u81ea\u99d5\u6a21\u64ec"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2026\/06\/pasted-385ce849e4b0.jpg\" alt=\"Repository image for nv-tlabs\/omni-dreams\"\/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">NVIDIA OmniDreams \u662f\u4e00\u500b\u7528\u65bc\u81ea\u52d5\u99d5\u99db\u6a21\u64ec\u7684 world model\uff0c\u91cd\u9ede\u4e0d\u5728\u91cd\u64ad\u5df2\u9304\u597d\u7684\u8def\u9762\u7247\u6bb5\uff0c\u800c\u662f\u5728\u7cfb\u7d71\u63d0\u4f9b\u689d\u4ef6\u5f8c\uff0c\u6301\u7e8c\u751f\u6210\u591a\u93e1\u982d\u3001\u8fd1\u4e4e\u5beb\u5be6\u7684\u5f71\u7247\u756b\u9762\u3002\u5b83\u5403\u9032\u4e00\u5f35\u771f\u5be6 RGB \u8d77\u59cb\u5f71\u50cf\u3001\u6587\u5b57\u63d0\u793a\uff0c\u4ee5\u53ca\u6bcf\u5e40\u7684 coarse HD map image \u548c trajectory poses\uff0c\u518d\u4ee5\u5206\u6bb5\u65b9\u5f0f\u63a8\u9032\u5f8c\u7e8c\u756b\u9762\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u9019\u500b\u9805\u76ee\u60f3\u8655\u7406\u7684\u6838\u5fc3\u554f\u984c\uff0c\u662f\u50b3\u7d71\u795e\u7d93\u6a21\u64ec\u5668\u96d6\u7136\u53ef\u4ee5\u5f88\u50cf\u771f\uff0c\u4f46\u901a\u5e38\u53d7\u9650\u65bc\u539f\u672c\u62cd\u5230\u7684\u8cc7\u6599\uff0c\u9047\u5230\u5c11\u898b\u5929\u6c23\u3001\u7a81\u767c\u4ea4\u901a\u884c\u70ba\u6216\u672a\u898b\u904e\u7684\u5834\u666f\u6642\uff0c\u5f48\u6027\u4e0d\u8db3\u3002OmniDreams \u8d70\u7684\u662f\u81ea\u56de\u6b78\u751f\u6210\u8def\u7dda\uff0c\u6703\u6839\u64da\u904e\u5f80\u756b\u9762\u3001\u6a21\u64ec\u5668\u72c0\u614b\u8207\u5373\u6642\u99d5\u99db\u52d5\u4f5c\uff0c\u7e7c\u7e8c\u751f\u6210\u4e0b\u4e00\u6bb5\u611f\u6e2c\u756b\u9762\uff0c\u8f03\u63a5\u8fd1 closed-loop simulation \u7684\u9700\u8981\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5f9e\u516c\u958b\u8cc7\u6599\u770b\uff0c\u5b83\u7684\u5275\u65b0\u9ede\u5728\u65bc\u628a Cosmos diffusion model \u7684\u8996\u89ba\u5148\u9a57\uff0c\u5ef6\u4f38\u6210\u53ef\u5373\u6642\u53cd\u61c9\u52d5\u4f5c\u7684\u751f\u6210\u5f0f world model\uff0c\u4e26\u4e14\u652f\u63f4 multi-camera photorealistic video\u3002\u8ad6\u6587\u4ea6\u63d0\u5230\u5b83\u66fe\u5728 21k \u5c0f\u6642\u99d5\u99db\u5834\u666f\u4e0a\u505a mid-training \u8207 post-training\uff0c\u76ee\u6a19\u662f\u8986\u84cb\u66f4\u591a\u50b3\u7d71\u6a21\u64ec\u5668\u96e3\u4ee5\u523b\u756b\u7684\u60c5\u5883\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u4f7f\u7528\u9019\u500b\u9805\u76ee\u6642\uff0c\u8f03\u9069\u5408\u628a\u5b83\u8996\u70ba\u7814\u7a76\u8207\u5f8c\u8a13\u7df4\u6a23\u672c\u767c\u4f48\u9ede\uff1b\u4e92\u52d5\u5f0f\u63a8\u8ad6\u8207 live driving demo \u5247\u653e\u5728\u914d\u5957\u9805\u76ee FlashDreams\u3002\u5009\u5eab\u4ea6\u63d0\u4f9b post-training \u6a23\u672c\uff0c\u570d\u7e5e Cosmos2 SV-HDMap world model \u5fae\u8abf\uff0c\u4e26\u63d0\u5230 student-init\u3001bidirectional teacher \u8207 self-forcing distillation \u7b49\u8a13\u7df4\u8def\u7dda\uff0c\u4f46\u786c\u4ef6\u9580\u6abb\u4e0d\u4f4e\uff0c\u5b98\u65b9\u5217\u660e\u6700\u4f4e\u70ba\u55ae\u500b 8-GPU Ampere\/Hopper \u7bc0\u9ede\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u53ef\u5f9e\u55ae\u5f35\u771f\u5be6\u756b\u9762\u958b\u59cb\uff0c\u751f\u6210\u9023\u7e8c\u591a\u93e1\u982d\u5f71\u7247<\/li>\n\n\n\n<li>\u8f38\u5165\u689d\u4ef6\u6e05\u6670\uff0c\u5305\u62ec\u6587\u5b57\u63d0\u793a\u3001HD map \u8207 trajectory poses<\/li>\n\n\n\n<li>\u91cd\u9ede\u5834\u666f\u662f closed-loop autonomous vehicle simulation<\/li>\n\n\n\n<li>\u76f8\u95dc\u6a21\u578b\u8207\u7cfb\u7d71\u5305\u62ec Cosmos diffusion model\u3001Cosmos2 SV-HDMap\u3001FlashDreams\u3001Alpamayo 1\u3001AlpaSim\u3001WAM<\/li>\n\n\n\n<li>\u8ad6\u6587\u521d\u6b65\u7d50\u679c\u6307\u51fa\uff0c\u5f9e OmniDreams \u5f8c\u8a13\u7df4\u51fa\u7684 WAM \u5728 Physical AI Autonomous Vehicles NuRec \u4e0a\u8868\u73fe\u4e0d\u4fd7\uff0c\u4e14\u7e3d\u53c3\u6578\u91cf\u5c11\u65bc VLA-based Alpamayo 1.5 \u7684\u4e94\u5206\u4e4b\u4e00<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u6574\u9ad4\u4f86\u770b\uff0cOmniDreams \u4e0d\u662f\u4e00\u822c\u958b\u7bb1\u5373\u7528\u7684\u6d88\u8cbb\u7d1a\u5de5\u5177\uff0c\u800c\u662f\u9762\u5411\u81ea\u52d5\u99d5\u99db\u7814\u7a76\u3001\u6a21\u64ec\u5e73\u53f0\u8207\u751f\u6210\u5f0f world model \u958b\u767c\u6d41\u7a0b\u7684\u95dc\u9375\u9805\u76ee\u3002\u5c0d\u7814\u7a76\u5718\u968a\u3001\u6a21\u64ec\u7cfb\u7d71\u5de5\u7a0b\u5e2b\uff0c\u6216\u8005\u60f3\u8ffd\u8e64 NVIDIA \u5728 Physical AI \u8207 AV simulation \u65b9\u5411\u7684\u4eba\u4f86\u8aaa\uff0c\u9019\u500b\u9805\u76ee\u5f88\u6709\u53c3\u8003\u50f9\u503c\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>GitHub\uff1a<\/strong> <a href=\"https:\/\/github.com\/nv-tlabs\/omni-dreams\" rel=\"noopener noreferrer\">https:\/\/github.com\/nv-tlabs\/omni-dreams<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u9805\u76ee\uff1a<\/strong> <a href=\"https:\/\/research.nvidia.com\/labs\/sil\/projects\/omnidreams-blog\/\" rel=\"noopener noreferrer\">https:\/\/research.nvidia.com\/labs\/sil\/projects\/omnidreams-blog\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>OmniDreams\u628a\u55ae\u5f35\u756b\u9762\u3001\u6587\u5b57\u63d0\u793a\u8207\u5730\u5716\u8ecc\u8de1\u7d50\u5408\uff0c\u5be6\u6642\u751f\u6210\u591a\u93e1\u982d\u64ec\u771f\u5f71\u7247\u3002\u9019\u985e world model\uff0c\u6b63\u6539\u8b8a\u81ea\u52d5\u99d5\u99db\u6a21\u64ec\u7684\u53ef\u64f4\u5c55\u6027\u3002<\/p>\n","protected":false},"author":8,"featured_media":8924,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ai_generated_summary":"","footnotes":""},"categories":[133,179,186],"tags":[],"class_list":["post-8925","post","type-post","status-publish","format-standard","hentry","category-133","category-nvidia","category-186"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/8925","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=8925"}],"version-history":[{"count":2,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/8925\/revisions"}],"predecessor-version":[{"id":8928,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/8925\/revisions\/8928"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media\/8924"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=8925"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=8925"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=8925"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}