{"id":6164,"date":"2025-08-15T23:45:47","date_gmt":"2025-08-15T15:45:47","guid":{"rendered":"https:\/\/infernews.com\/?p=6164"},"modified":"2025-08-16T00:04:03","modified_gmt":"2025-08-15T16:04:03","slug":"%e6%9c%ac%e5%9c%b0%e8%aa%9e%e9%9f%b3%e8%81%8a%e5%a4%a9%e6%a9%9f%e5%99%a8%e4%ba%ba","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/%e6%9c%ac%e5%9c%b0%e8%aa%9e%e9%9f%b3%e8%81%8a%e5%a4%a9%e6%a9%9f%e5%99%a8%e4%ba%ba\/","title":{"rendered":"\u672c\u5730\u8a9e\u97f3\u804a\u5929\u6a5f\u5668\u4eba"},"content":{"rendered":"<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"Local Talking LLM - Jarvis mark1 Speech | Whisper STT - Ollama - Chatterbox TTS\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_2VHzYy45kPw\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F2VHzYy45kPw%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/2VHzYy45kPw\" \/><meta itemprop=\"duration\" content=\"PT14M59S\" \/><meta itemprop=\"uploadDate\" content=\"2025-08-12T23:08:34Z\" \/><\/div><div id=\"lyte_2VHzYy45kPw\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F2VHzYy45kPw%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">Local Talking LLM - Jarvis mark1 Speech | Whisper STT - Ollama - Chatterbox TTS<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/2VHzYy45kPw\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F2VHzYy45kPw%2F0.jpg\" alt=\"Local Talking LLM - Jarvis mark1 Speech | Whisper STT - Ollama - Chatterbox TTS\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Ever wanted your own personal AI assistant? You know, like Jarvis from Iron Man? Well, today we&#039;re not just dreaming about it\u2014we&#039;re building it, right on our own computer, completely local and private. Forget cloud services; we can run it completely open source. This is the project that\u2019s going to make our Jarvis dream a reality - atleast the speech AI. It&#039;s called local-talking-llm, and it&#039;s an amazing open-source project that combines some of the best AI tools out there. We&#039;re talking Whisper for speech-to-text, Ollama for our large language model, and Chatterbox TTS for text-to-speech. This is just the beginning. Imagine the possibilities! You could connect this to other services to control your smart home, schedule tasks, or even write code with just your voice. Pre-requisite Setup: - UV - Python project and package management tool: https:\/\/youtu.be\/HqUBlMeI3mI?si=ZivuWrhFkbhGxzFJ - Ollama - Local LLM inference: https:\/\/youtu.be\/LJPmdlpxVQw?si=jaBvbI8odHLF0UvK - Neovim (Optional): https:\/\/youtu.be\/Aig-KJvyn8I?si=fiq9OyoqZPG4v5r8 Links: - Github Project: https:\/\/github.com\/vndee\/local-talking-llm - Blog: https:\/\/blog.duy.dev\/build-your-own-voice-assistant-and-run-it-locally\/ Timestamps: 00:00 - Intro 00:50 - Pipeline 01:28 - Setup 03:14 - Run app 05:54 - Interaction 1 07:49 - Interaction 2 08:59 - System Prompt 09:22 - Interaction 3 10:12 - Interaction 4 14:11 - Conclusion --- \u2615\ufe0f Buy me a coffee to help me stay awake to edit the next videos: https:\/\/ko-fi.com\/noobmldude \ud83c\udf1f If this was helpful, hit the Subscribe button now to let us know. --- \ud83d\udcf2 Social Media Youtube: \/ NoobMLDude X.com : \/NoobMLDude Substack: \/NoobMLDude --- #local #private #talking #speech #speechtotext #texttospeech #llm #whisper #openai #chatterbox #ollama #google #deepmind #ai #aituber #mac #macos #macbook #noob #ml\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n\n\n<ul class=\"wp-block-list\">\n<li>\ud83c\udfaf<strong>\u8a9e\u97f3\u514b\u9686<\/strong>\uff1a\u53ea\u9700\u4e00\u6bb5\u7c21\u77ed\u7684\u97f3\u8a0a\u6a23\u672c\u5373\u53ef\u514b\u9686\u4efb\u4f55\u8072\u97f3<\/li>\n\n\n\n<li>\ud83c\udfad<strong>\u60c5\u7dd2\u63a7\u5236<\/strong>\uff1a\u8abf\u6574\u56de\u61c9\u7684\u60c5\u7dd2\u8868\u9054<\/li>\n\n\n\n<li>\ud83d\ude80<strong>\u6548\u80fd\u66f4\u4f73<\/strong>\uff1a0.5B \u53c3\u6578\u6a21\u578b\uff0c\u63a8\u7406\u901f\u5ea6\u66f4\u5feb<\/li>\n\n\n\n<li>\ud83d\udca7<strong>\u97f3\u983b\u6d6e\u6c34\u5370<\/strong>\uff1a\u5167\u5efa\u795e\u7d93\u6d6e\u6c34\u5370\uff0c\u78ba\u4fdd\u771f\u5be6\u6027<\/li>\n<\/ul>\n\n\n\n<p><a href=\"https:\/\/github.com\/vndee\/local-talking-llm\">Github Repository<\/a><\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Github Repository<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[128,133],"tags":[],"class_list":["post-6164","post","type-post","status-publish","format-standard","hentry","category-128","category-133"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/6164","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=6164"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/6164\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=6164"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=6164"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=6164"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}