{"id":4122,"date":"2024-12-28T18:39:33","date_gmt":"2024-12-28T10:39:33","guid":{"rendered":"https:\/\/infernews.com\/?p=4122"},"modified":"2024-12-29T17:34:39","modified_gmt":"2024-12-29T09:34:39","slug":"meta-%e6%8e%a8%e5%87%ba%e3%80%8c%e5%a4%a7%e5%9e%8b%e6%a6%82%e5%bf%b5%e6%a8%a1%e5%9e%8b%e3%80%8dlcm","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/meta-%e6%8e%a8%e5%87%ba%e3%80%8c%e5%a4%a7%e5%9e%8b%e6%a6%82%e5%bf%b5%e6%a8%a1%e5%9e%8b%e3%80%8dlcm\/","title":{"rendered":"Meta \u63a8\u51fa\u300c\u5927\u578b\u6982\u5ff5\u6a21\u578b\u300d(LCM)"},"content":{"rendered":"\n<p>\u7a81\u7834\u50b3\u7d71\u4ee5\u55ae\u8a5e\u70ba\u55ae\u4f4d\u7684 LLM\uff0cLCM(Large Concept Model)&nbsp;\u76f4\u63a5\u8655\u7406\u53e5\u5b50\u7d1a\u5225\u7684\u8a9e\u7fa9\u8868\u793a\uff0c\u5373\u300c\u6982\u5ff5\u300d\u3002\u7814\u7a76\u4eba\u54e1\u5229\u7528 SONAR \u5d4c\u5165\u7a7a\u9593\uff0c\u8a13\u7df4 LCM \u9032\u884c\u53e5\u5b50\u9810\u6e2c\uff0c\u4e26\u63a2\u7d22\u4e86\u591a\u7a2e\u6a21\u578b\u67b6\u69cb\u548c\u8a13\u7df4\u65b9\u6cd5\uff0c\u6700\u7d42\u5728 1.6B \u548c 7B \u53c3\u6578\u898f\u6a21\u7684\u6a21\u578b\u4e0a\u53d6\u5f97\u4e86\u512a\u7570\u7684\u591a\u8a9e\u8a00\u96f6\u6a23\u672c\u6cdb\u5316\u80fd\u529b\uff0c\u5c24\u5176\u5728\u6458\u8981\u548c\u6458\u8981\u64f4\u5c55\u4efb\u52d9\u4e0a\u8868\u73fe\u7a81\u51fa\u3002 \u8a72\u7814\u7a76\u6210\u679c\u53ca\u7a0b\u5f0f\u78bc\u7686\u5df2\u516c\u958b\u91cb\u51fa\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/ai.meta.com\/research\/publications\/large-concept-models-language-modeling-in-a-sentence-representation-space\/\" target=\"_blank\" rel=\" noreferrer noopener\"><img data-dominant-color=\"f7f8f8\" data-has-transparency=\"false\" style=\"--dominant-color: #f7f8f8;\" loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"418\" src=\"\/blog\/wp-content\/uploads\/2024\/12\/image-5-1024x418.png\" alt=\"\" class=\"wp-image-4123 not-transparent\" srcset=\"https:\/\/infernews.com\/blog\/wp-content\/uploads\/2024\/12\/image-5-1024x418.png 1024w, https:\/\/infernews.com\/blog\/wp-content\/uploads\/2024\/12\/image-5-300x123.png 300w, https:\/\/infernews.com\/blog\/wp-content\/uploads\/2024\/12\/image-5-768x314.png 768w, https:\/\/infernews.com\/blog\/wp-content\/uploads\/2024\/12\/image-5-1536x627.png 1536w, https:\/\/infernews.com\/blog\/wp-content\/uploads\/2024\/12\/image-5-640x261.png 640w, https:\/\/infernews.com\/blog\/wp-content\/uploads\/2024\/12\/image-5.png 1626w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>Jepa (Joint Embedding Predictive Architecture) \u662f\u4e00\u7a2e\u5728\u5d4c\u5165\u7a7a\u9593\u4e2d\u9810\u6e2c\u4e0b\u4e00\u500b\u89c0\u5bdf\u8868\u793a\u7684\u65b9\u6cd5\uff0cV-JEPA (Video-JEPA) \u662f Jepa \u7684\u4e00\u7a2e\u4f38\u5ef6\uff0c\u52a0\u5165\u5f71\u50cf\u4f5c\u70ba\u4e00\u7a2e\u81ea\u6211\u76e3\u7763\u7684\u65b9\u5f0f\u4f86\u5b78\u7fd2\u5f71\u7247\u7684\u8868\u793a\u3002<\/p>\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"Experts are STUNNED! Meta&amp;#039;s NEW LLM Architecture is a GAME-CHANGER!\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_1Z1vKdrmpj4\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F1Z1vKdrmpj4%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/1Z1vKdrmpj4\" \/><meta itemprop=\"duration\" content=\"PT8M20S\" \/><meta itemprop=\"uploadDate\" content=\"2024-12-28T09:50:53Z\" \/><\/div><div id=\"lyte_1Z1vKdrmpj4\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F1Z1vKdrmpj4%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">Experts are STUNNED! Meta&#039;s NEW LLM Architecture is a GAME-CHANGER!<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/1Z1vKdrmpj4\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F1Z1vKdrmpj4%2F0.jpg\" alt=\"Experts are STUNNED! Meta&amp;#039;s NEW LLM Architecture is a GAME-CHANGER!\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Meta Just Introduced a NEW Type Of LLM Thats Even BETTER (LCMS Explained!) Join my AI Academy - https:\/\/www.skool.com\/postagiprepardness \ud83d\udc24 Follow Me on Twitter https:\/\/twitter.com\/TheAiGrid \ud83c\udf10 Checkout My website - https:\/\/theaigrid.com\/ Links From Todays Video: https:\/\/ai.meta.com\/research\/publications\/large-concept-models-language-modeling-in-a-sentence-representation-space\/ Welcome to my channel where i bring you the latest breakthroughs in AI. From deep learning to robotics, i cover it all. My videos offer valuable insights and perspectives that will expand your knowledge and understanding of this rapidly evolving field. Be sure to subscribe and stay updated on my latest videos. Was there anything i missed? (For Business Enquiries) contact@theaigrid.com Music Used LEMMiNO - Cipher https:\/\/www.youtube.com\/watch?v=b0q5PR1xpA0 CC BY-SA 4.0 LEMMiNO - Encounters https:\/\/www.youtube.com\/watch?v=xdwWCl_5x2s #LLM #Largelanguagemodel #chatgpt #AI #ArtificialIntelligence #MachineLearning #DeepLearning #NeuralNetworks #Robotics #DataScience\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n\n\n<p>\u5be6\u6230\uff1a<\/p>\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"Experimenting With LCM Models (Meta&amp;#039;s Alternative To LLM Models)\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_2ZLd0uZvwbU\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F2ZLd0uZvwbU%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/2ZLd0uZvwbU\" \/><meta itemprop=\"duration\" content=\"PT13M13S\" \/><meta itemprop=\"uploadDate\" content=\"2024-12-16T03:48:31Z\" \/><\/div><div id=\"lyte_2ZLd0uZvwbU\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F2ZLd0uZvwbU%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">Experimenting With LCM Models (Meta&#039;s Alternative To LLM Models)<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/2ZLd0uZvwbU\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F2ZLd0uZvwbU%2F0.jpg\" alt=\"Experimenting With LCM Models (Meta&amp;#039;s Alternative To LLM Models)\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Link to Colab Notebook: https:\/\/colab.research.google.com\/drive\/1BxPSbAzp724qaeNducQ_tgWUasH7yBip?usp=sharing In this video, Richard Aragon explores Large Concept Models (LCMs), a new architecture developed by Meta. He explains that LCMs are not Transformer models, but rather utilize a small portion of Transformers. Aragon discusses the architecture of LCMs, highlighting their unique approach to combining linear and probabilistic processes. He then shares his experiments with modifying the architecture, including adding curvature to the space and introducing a fractal hidden space. Aragon demonstrates the impressive results of his experiments, showcasing the potential of LCMs to outperform traditional Transformer models. This video is a must-watch for anyone interested in the latest advancements in natural language processing. Keywords: LCM models, Meta, LLM models, Transformer models, natural language processing, deep learning, artificial intelligence\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n\n\n<p><a href=\"https:\/\/colab.research.google.com\/drive\/1BxPSbAzp724qaeNducQ_tgWUasH7yBip?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Colab \u6e2c\u8a66 <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u7a81\u7834\u50b3\u7d71\u4ee5\u55ae\u8a5e\u70ba\u55ae\u4f4d\u7684 LLM\uff0cLCM(Large Concept Model)&nbsp;\u76f4\u63a5\u8655\u7406\u53e5\u5b50\u7d1a\u5225\u7684\u8a9e\u7fa9\u8868\u793a\uff0c\u5373\u300c\u6982\u5ff5\u300d\u3002\u7814\u7a76\u4eba\u54e1\u5229\u7528 SONAR \u5d4c\u5165\u7a7a\u9593\uff0c\u8a13\u7df4 LCM \u9032\u884c\u53e5\u5b50\u9810\u6e2c\uff0c\u4e26\u63a2\u7d22\u4e86\u591a\u7a2e\u6a21\u578b\u67b6\u69cb\u548c\u8a13\u7df4\u65b9\u6cd5\uff0c\u6700\u7d42\u5728 1.6B \u548c 7B \u53c3\u6578\u898f\u6a21\u7684\u6a21\u578b\u4e0a\u53d6\u5f97\u4e86\u512a\u7570\u7684\u591a\u8a9e\u8a00\u96f6\u6a23\u672c\u6cdb\u5316\u80fd\u529b\uff0c\u5c24\u5176\u5728\u6458\u8981\u548c\u6458\u8981\u64f4\u5c55\u4efb\u52d9\u4e0a\u8868\u73fe\u7a81\u51fa\u3002 \u8a72\u7814\u7a76\u6210\u679c\u53ca\u7a0b\u5f0f\u78bc\u7686\u5df2\u516c\u958b\u91cb\u51fa\u3002 Jepa (Joint Embedding Predictive Architecture) \u662f\u4e00\u7a2e\u5728\u5d4c\u5165\u7a7a\u9593\u4e2d\u9810\u6e2c\u4e0b\u4e00\u500b\u89c0\u5bdf\u8868\u793a\u7684\u65b9\u6cd5\uff0cV-JEPA (Video-JEPA) \u662f Jepa \u7684\u4e00\u7a2e\u4f38\u5ef6\uff0c\u52a0\u5165\u5f71\u50cf\u4f5c\u70ba\u4e00\u7a2e\u81ea\u6211\u76e3\u7763\u7684\u65b9\u5f0f\u4f86\u5b78\u7fd2\u5f71\u7247\u7684\u8868\u793a\u3002 \u5be6\u6230\uff1a Colab \u6e2c\u8a66<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[23],"tags":[],"class_list":["post-4122","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/4122","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=4122"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/4122\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=4122"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=4122"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=4122"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}