{"id":3595,"date":"2024-11-16T22:23:06","date_gmt":"2024-11-16T14:23:06","guid":{"rendered":"https:\/\/infernews.com\/?p=3595"},"modified":"2024-11-16T22:23:52","modified_gmt":"2024-11-16T14:23:52","slug":"ollama-%e6%94%af%e6%8c%81-vision-model","status":"publish","type":"post","link":"https:\/\/infernews.com\/blog\/ollama-%e6%94%af%e6%8c%81-vision-model\/","title":{"rendered":"Ollama \u652f\u6301 Vision model"},"content":{"rendered":"<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"lyte-wrapper\" title=\"Ollama with Vision - Enabling Multimodal RAG\" style=\"width:853px;max-width:100%;margin:5px auto;\"><div class=\"lyMe\" id=\"WYL_45LJT-bt500\" itemprop=\"video\" itemscope itemtype=\"https:\/\/schema.org\/VideoObject\"><div><meta itemprop=\"thumbnailUrl\" content=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F45LJT-bt500%2Fhqdefault.jpg\" \/><meta itemprop=\"embedURL\" content=\"https:\/\/www.youtube.com\/embed\/45LJT-bt500\" \/><meta itemprop=\"duration\" content=\"PT13M1S\" \/><meta itemprop=\"uploadDate\" content=\"2024-11-07T17:32:43Z\" \/><\/div><div id=\"lyte_45LJT-bt500\" data-src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F45LJT-bt500%2Fhqdefault.jpg\" class=\"pL\"><div class=\"tC\"><div class=\"tT\" itemprop=\"name\">Ollama with Vision - Enabling Multimodal RAG<\/div><\/div><div class=\"play\"><\/div><div class=\"ctrl\"><div class=\"Lctrl\"><\/div><div class=\"Rctrl\"><\/div><\/div><\/div><noscript><a href=\"https:\/\/youtu.be\/45LJT-bt500\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/infernews.com\/blog\/wp-content\/plugins\/wp-youtube-lyte\/lyteCache.php?origThumbUrl=https%3A%2F%2Fi.ytimg.com%2Fvi%2F45LJT-bt500%2F0.jpg\" alt=\"Ollama with Vision - Enabling Multimodal RAG\" width=\"853\" height=\"460\" \/><br \/>Watch this video on YouTube<\/a><\/noscript><meta itemprop=\"description\" content=\"Ollama just added support for llama3.2 vision models. This enables models to see and process images. In this video, I will walk you through a step by step process on how to set up the vision models with Ollama and use it in a RAG system for retrieval augmented generation. LINKS: https:\/\/ollama.com\/blog\/llama3.2-vision Multimodal RAG: https:\/\/youtu.be\/YPs4eGDpIY4 LocalGPT-Vision: https:\/\/github.com\/PromtEngineer\/localGPT-Vision \ud83d\udcbb RAG Beyond Basics Course: https:\/\/prompt-s-site.thinkific.com\/courses\/rag Let&#039;s Connect: \ud83e\uddbe Discord: https:\/\/discord.com\/invite\/t4eYQRUcXB \u2615 Buy me a Coffee: https:\/\/ko-fi.com\/promptengineering |\ud83d\udd34 Patreon: https:\/\/www.patreon.com\/PromptEngineering \ud83d\udcbcConsulting: https:\/\/calendly.com\/engineerprompt\/consulting-call \ud83d\udce7 Business Contact: engineerprompt@gmail.com Become Member: http:\/\/tinyurl.com\/y5h28s6h \ud83d\udcbb Pre-configured localGPT VM: https:\/\/bit.ly\/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https:\/\/tally.so\/r\/3y9bb0 00:00 Introduction to OLAMA&#039;s New Vision Model Support 00:50 Setting Up OLAMA for Vision Models 01:55 Running and Testing Vision Models 03:18 Advanced Testing and Jailbreaking 06:00 Practical Use Cases and Python SDK Integration 07:38 Multimodal RAG 10:09 localGPT-Vision All Interesting Videos: Everything LangChain: https:\/\/www.youtube.com\/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr Everything LLM: https:\/\/youtube.com\/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw Everything Midjourney: https:\/\/youtube.com\/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw AI Image Generation: https:\/\/youtube.com\/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z\"><\/div><\/div><div class=\"lL\" style=\"max-width:100%;width:853px;margin:5px auto;\"><\/div><figcaption><\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"categories":[122,27],"tags":[],"class_list":["post-3595","post","type-post","status-publish","format-standard","hentry","category-ollama","category-paper"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/3595","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=3595"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/posts\/3595\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=3595"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/categories?post=3595"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/tags?post=3595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}