How To Connect Local LLMs to CrewAI [Ollama, Llama2, Mistral]

How To Connect Local LLMs to CrewAI [Ollama, Llama2, Mistral]

3 Video Views·Feb 17, 2025

🤖 Download the Source Code Here:
https://brandonhancock.io/crewai-ollama

Don't forget to Like and Subscribe if you're a fan of free source code 😉

📆 Need help with CrewAI, join our free Skool Community:
skool.com/ai-developer-accelerator/about

This video is perfect for anyone eager to integrate powerful Local Large Language Models like Llama2 and Mistral with CrewAI using Ollama for smarter, faster project development.We'll show you the easiest way to link these LLMs with CrewAI, step by step. By the end of this tutorial, you'll know how to set up, customize, and use these AI models to automate tasks and boost your project's intelligence. Get ready to upgrade your tech skills and make your work with AI more productive and innovative. Start now and see how simple it is to bring the power of local LLMs into CrewAI.

📰 Stay updated with my latest projects and insights:
LinkedIn: https://www.linkedin.com/in/brandon-hancock-ai/
Twitter: https://twitter.com/bhancock_ai

Resources:
- CrewAI Crash Course - https://youtu.be/sPzc6hMg7So
- Updated CrewAI Tutorial -https://youtu.be/Jl6BuoXcZPE
- ollama: https://ollama.com/
- llama 2: https://llama.meta.com/llama2/
- mistral: https://mistral.ai/news/announcing-mistral-7b/
- Configure LLMs for CrewAI - https://docs.crewai.com/how-to/LLM-Connections/
- CrewAI Examples Markdown - https://github.com/joaomdmoura/crewAI-examples/tree/main/markdown_validator
- CrewAI Example Stock Analysis - https://github.com/joaomdmoura/crewAI-examples/tree/main/stock_analysis

Timestamps:
00:00 Introduction
00:47 Video Overview
01:13 Ollama Review
01:38 Llama 2 Review
02:38 Mistral Review
03:04 CrewAI Review
03:52 Download & Setup Ollama
06:24 Configure LLMs To Work With CrewAI
11:01 Connect CrewAI to LLama 2 (Simple Example)
18:08 Connect CrewAI to Mistral (Advanced Example)
24:33 Outro