{"id":4769,"date":"2025-02-26T03:06:38","date_gmt":"2025-02-25T19:06:38","guid":{"rendered":"https:\/\/infernews.com\/?p=4769"},"modified":"2025-02-26T03:10:04","modified_gmt":"2025-02-25T19:10:04","slug":"google-titans-transformer-2-0","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/google-titans-transformer-2-0\/","title":{"rendered":"Google Titans &#8211; Transformer 2.0?"},"content":{"rendered":"\n<p>\u8c37\u6b4c\u7684 Titans \u67b6\u69cb\u9748\u611f\u4f86\u81ea\u4eba\u985e\u8a18\u61b6\u65b9\u5f0f\uff0c\u5305\u62ec\u77ed\u671f\u3001\u9577\u671f\u548c\u6301\u4e45\u8a18\u61b6\u3002<a href=\"https:\/\/arxiv.org\/abs\/2501.00663\" target=\"_blank\" rel=\"noreferrer noopener\">Titans<\/a> \u7684\u9577\u671f\u8a18\u61b6\u80fd\u5920\u4e3b\u52d5\u6435\u51fa\u76f8\u95dc\u8cc7\u8a0a\u53ca\u6642\u66f4\u65b0\uff0c\u800c\u6301\u4e45\u8a18\u61b6\u5c31\u53ef\u4ee5\u5132\u5b58\u63a8\u7406\u6280\u80fd\uff0c\u56e0\u6b64\u80fd\u5920\u64f4\u5c55\u524d\u6587\u5f8c\u7406\uff0c\u4e26\u4e14\u80fd\u5920\u4fdd\u6301\u9ad8\u6e96\u78ba\u6027\u3002<\/p>\n\n\n\n<figure class=\"wp-block-audio\"><audio controls src=\"\/blog\/wp-content\/uploads\/2025\/02\/1740510276852477104-241489220321523.mp3\"><\/audio><\/figure>\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"How Google&amp;#039;s &amp;quot;Transformer 2.0&amp;quot; Might Be The AI Breakthrough We Need\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_UMkCmOTX5Ow\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2FUMkCmOTX5Ow%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/UMkCmOTX5Ow\" \/><meta itemprop=\"duration\" content=\"PT9M53S\" \/><meta itemprop=\"uploadDate\" content=\"2025-02-24T15:45:53Z\" \/><\/div><div id=\"lyte_UMkCmOTX5Ow\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2FUMkCmOTX5Ow%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">How Google&#039;s &quot;Transformer 2.0&quot; Might Be The AI Breakthrough We Need<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/UMkCmOTX5Ow\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2FUMkCmOTX5Ow%2F0.jpg\" alt=\"How Google&amp;#039;s &amp;quot;Transformer 2.0&amp;quot; Might Be The AI Breakthrough We Need\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Try Mammouth now for only &#36;10\/mo! https:\/\/mammouth.ai In this video, I will be sharing the research that aims to solve the problem of context window, kv-cache, and memory recall efficiency. Even though the title only mentions Google&#039;s research, I also included research from Meta and Sakana AI. They paved a good way to introduce to the idea of AI memory. My Newletter https:\/\/mail.bycloud.ai\/ My Patreon https:\/\/www.patreon.com\/c\/bycloud An Evolved Universal Transformer Memory [Paper] https:\/\/arxiv.org\/abs\/2410.13166 Memory Layers at Scale [Paper] https:\/\/arxiv.org\/abs\/2412.09764 Titans: Learning to Memorize at Test Time [Paper] https:\/\/arxiv.org\/abs\/2501.00663 This video is supported by the kind Patrons &amp; YouTube Members: \ud83d\ude4fAndrew Lescelius, Ben Shaener, Chris LeDoux, Miguilim, Deagan, FiFa\u0141, Robert Zawiasa, Marcelo Ferreira, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Rich\u00e1rd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kyt\u00f6l\u00e4, SO, Rich\u00e1rd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz, jiye, Anushka, Henrik Sundt, Julian A\u00dfmann, Thomas Lin, Sid_Cypher, Mark Buckler, Kevin Tai, NO U, Gonzalo Fidalgo, Igor Alvarez, Alon Pluda, Cl\u00e9ment Veyssi\u00e8re, Sander Zwaenepoel, etrotta, Binnie Yiu, Matej Macak, c zhou, Berhane-Meskel, sai sandeep mandava, Leo, Asad Dhamani, Charlie C, tantan assawade, \u00c2ngelo Fonseca, Stefan Lorenz, Paperboy, mika, Leo, Utsav Soi [Discord] https:\/\/discord.gg\/NhJZGtH [Twitter] https:\/\/twitter.com\/bycloudai [Patreon] https:\/\/www.patreon.com\/bycloud [Business Inquiries] bycloudai@gmail.com [Music] massobeats - lavender [Profile &amp; Banner Art] https:\/\/twitter.com\/pygm7 [Video Editor] @Booga04 [3D Animation] @F_E_U [Bitcoin (BTC)] 3JFMJQVGXNA2HJE5V9qCwLiqy6wHY9Vhdx [Ethereum (ETH)] 0x3d784F55E0bE5f35c1566B2E014598C0f354f190 [Litecoin (LTC)] MGHnqALjyU2W6NuJSSW9fTWV4dcHfwHZd7 [Bitcoin Cash (BCH)] 1LkyGfzHxnSfqMF8tN7ZGDwUTyBB6vcii9 [Solana (SOL)] 6XyMCEdVhtxJQRjMKgUJaySL8cGoBPzzA2NPDMPfVkKN [Ko-fi] https:\/\/ko-fi.com\/bycloudai\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8c37\u6b4c\u7684 Titans \u67b6\u69cb\u9748\u611f\u4f86\u81ea\u4eba\u985e\u8a18\u61b6\u65b9\u5f0f\uff0c\u5305\u62ec\u77ed\u671f\u3001\u9577\u671f\u548c\u6301\u4e45\u8a18\u61b6\u3002Titans \u7684\u9577\u671f\u8a18\u61b6\u80fd\u5920\u4e3b\u52d5\u6435\u51fa\u76f8\u95dc\u8cc7\u8a0a\u53ca\u6642\u66f4\u65b0\uff0c\u800c\u6301\u4e45\u8a18\u61b6\u5c31\u53ef\u4ee5\u5132\u5b58\u63a8\u7406\u6280\u80fd\uff0c\u56e0\u6b64\u80fd\u5920\u64f4\u5c55\u524d\u6587\u5f8c\u7406\uff0c\u4e26\u4e14\u80fd\u5920\u4fdd\u6301\u9ad8\u6e96\u78ba\u6027\u3002<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[23],"tags":[],"class_list":["post-4769","post","type-post","status-publish","format-standard","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/4769","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=4769"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/4769\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=4769"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=4769"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=4769"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}