---
title: 'JARVIS That Runs FREE Forever (100% Offline) 🤯'
source: 'https://youtube.com/watch?v=UXaET1n3i7I'
video_id: 'UXaET1n3i7I'
date: 2026-11-09
duration_sec: 461
channel: 'Julian Goldie SEO'
---

# JARVIS That Runs FREE Forever (100% Offline) 🤯

> Source: [JARVIS That Runs FREE Forever (100% Offline) 🤯](https://youtube.com/watch?v=UXaET1n3i7I)

## Summary

The video presents Jarvis Local Core, a free and fully offline AI assistant that runs on a Mac. It demonstrates features like a second brain for notes, memory, tool use, and voice control, all powered by local models via Ollama. The creator also shows how to set it up in about two minutes.

### Key Points

- **Introduction to Jarvis Local Core** [00:02] — Jarvis Local Core is a personal AI assistant that runs completely offline, using Ollama to run models locally. The demo shows it running on an M4 Mac with 16GB.
- **Dashboard Features** [00:31] — The dashboard has a neural core on the left listing models, a reactor in the center, and a second brain (3D galaxy of notes) on the right. Models include Gemma 3 4B, Qwen 2.5 7B, and GPT-OSS 20B with size and tool support info.
- **Voice Output** [01:58] — The voice is Kokoro, an open-source British voice, that starts instantly and speaks sentence by sentence.
- **Second Brain and Embeddings** [03:07] — The second brain converts markdown notes into embeddings using a local model (MX Bait Embed Large) and plots them in 3D, allowing the AI to find relevant notes in response to questions.
- **Memory Feature** [04:21] — Facts can be saved via 'remember that' commands, stored as files that persist across restarts.
- **Tool Usage** [04:36] — The AI can perform actions like setting timers, creating notes, and opening apps using tools, with transparency shown in the transcript.
- **Privacy Bar** [05:32] — The privacy bar shows offline status, counting local model calls to zero cloud calls and zero data sent.
- **Model Requirements** [05:49] — Model sizes: Qwen 2.5 7B is 4.7 GB, Gemma 3 4B is 3.3 GB, GPT-OSS 20B is ~14 GB. Recommended models for 16GB are 4B and 7B.
- **Setup Instructions** [06:15] — Setup: install Ollama, pull models via terminal, then run 'node server.js' and open localhost:7777. Then add notes to the brain folder and ask questions.

## Transcript

&gt;&gt; I am running 100% offline [music] on your Mac, sir. &gt;&gt; That's Jarvis Local Core, a personal AI [music] assistant that runs completely offline on my own Mac. Local brain, local voice, local memory. What does my
&gt;&gt; [music] &gt;&gt; You wake at 6:00, gym at 7:00, deep work from 9:00 to 12:00, no meetings, then record videos [music] in the afternoon. Walk after lunch, sir. &gt;&gt; He pulled that straight from my own
notes on my own Mac. And look at the dashboard, a glowing reactor in the middle, a 3D galaxy of my notes on the right, and every AI model on my computer lined up on the left. In this video, I'll show you what it does, the exact
prompts I use with it, and how to run it yourself in about 2 minutes. So, here's what I wanted. Jarvis from the films, but private. Client notes, business plans, my daily routine, none of that going to a server somewhere. So, the
whole thing runs on Ollama, which runs AI models on your own computer. My Mac is an M4 with 16 GB of memory, a normal machine. And it's one small project, one server file, and one web page. No accounts, no API keys, nothing to
install from NPM. Let's walk through it. On the left is the neural core. Every model I've downloaded with Ollama. Gemma 3 at 4 billion parameters, Qwen 2.5 at 7 3 at 4 billion parameters, Qwen 2.5 at 7 billion, GPT-OSS at 20 billion. Each
card shows the size, whether the model can use tools, whether it can see images, and how much of your memory it fills. Blue bar, it fits comfortably. Orange bar, it takes most of your machine. I keep him on Qwen 2.5. It's
quick, it can use tools, and it leaves plenty of memory for everything else on my Mac. In the middle is the reactor. Cyan when he's waiting, amber when he's thinking, red when he's listening. And when he talks, the rings move with his
voice. That voice is Kokoro, an open-source British voice. Runs on your Mac, so it starts instantly. And he speaks each sentence as soon as it's whole reply. How's the system holding up?
&gt;&gt; The system is operating efficiently with adequate resources. adequate resources. &gt;&gt; Down here on the left is telemetry. CPU, memory, tokens per second, and how long the first word took. On my Mac, Kwin
runs at about 20 to 30 tokens a second. If you want my best setups for local AI, prompts I use with it every day, they're inside the AI Profit Boardroom. You get
the full Jarvis project, the second brain template, and the faceless video skill I used to make this video. There's a short guide for each one, so you can set it up without guessing. And there's a community of people building their own
versions. So, if you get stuck, someone has usually solved it already. The link is in the comments and the description, or go to aiprofitboardroom.com. Now, my favorite part, the second brain. This galaxy on the right is my notes.
Every dot is a markdown file. Business notes, content plans, ideas, my team, my routine. Each color is a folder. Jarvis turns every note into an embedding with a small local model called MX by embed large, then plots them in 3D. Notes
about similar things sit close together. You can drag the galaxy to spin it, and hover over a dot to see the file. Watch what happens when I ask a question. What are my Q4 goals? &gt;&gt; Q4 goals are to publish three YouTube
videos a day, grow the community, launch an AI assistant course, and move routine AI work onto local models. &gt;&gt; The Q4 goals note lit up. A line shot out to it from the center, and he answered from that note. I never told
him which file to open. What's on my video ideas list? &gt;&gt; Video ideas include comparing a llama to cloud APIs, showcasing 10 everyday uses for private AI assistant, and exploring unified memory requirements for local
LLMs. &gt;&gt; Next, memory. Remember that I record videos at 2:00 p.m. &gt;&gt; Noted, sir. I'll remember that you record videos at 2:00 p.m. &gt;&gt; That fact is saved to a file on my Mac,
and it joins the galaxy as a new red dot. So, it's still there after a dot. So, it's still there after a restart. When do I record videos? &gt;&gt; You record videos at 2:00 p.m., sir. &gt;&gt; Now, tools. On a model that supports
tools, like Qwen 2.5, Jarvis can do things as well as talk. Set a 25-minute focus timer. &gt;&gt; A timer for 25 minutes has been set, sir. &gt;&gt; A timer appears at the top and counts
down. When it ends, he tells you out loud. Write a note called client onboarding checklist with the steps for welcoming a new client. &gt;&gt; The client onboarding checklist has been created and saved.
&gt;&gt; A new markdown file and a new dot in the galaxy. He can also open apps on your Mac. Say, open calendar, and calendar opens. Every tool call shows up in the
transcript on the right in amber. The tool name, what it was given, and what came back. So, you always know what he did. And at the top, there's a privacy bar. It says offline. It counts every call to a local model. Cloud calls stay
at zero, and data sent stays at zero bytes. So, what machine do you need? The model files tell you. On a llama, Qwen 2.57B 2.57B is 4.7 GB. Gemma 34B is 3.3. GPT-OSS 20B
is 4.7 GB. Gemma 34B is 3.3. GPT-OSS 20B is about 14. On my 16 GB Mac, the four and seven billion models feel smooth. 20 billion runs, but it fills most of the memory, which is why its bar is orange. More unified memory lets you load a
bigger brain. Here's how to run it. First, install a llama from a llama.com. Then pull three models in your terminal. A llama pull Qwen 2.57b,
A llama pull Qwen 2.57b, a llama pull Gemma 34b, and a llama pull MX by embed large, which powers the second brain. Then go into the Jarvis folder and type node server.js. Open your browser at localhost:7777.
You'll see the boot sequence, then the dashboard. The first thing I'd do, open the brain folder and drop in five notes about your business, your goals, your clients, your content plan, your team, your weekly routine. Plain markdown
files. They appear in the galaxy as soon as Jarvis starts. Then ask him about your goals and watch the right note light up. Tell him three facts about how you work, starting each one with remember that. Now he knows you. And to
talk instead of type, hold the spacebar or click the mic, and let go when you're done. Thanks, Jarvis. That's all for now. &gt;&gt; You're welcome, sir. Is there anything else you need assistance with in the
future? &gt;&gt; So that's Jarvis local core, a private assistant with a second brain, memory, tools, and a voice all on your own Mac. If you want the full Jarvis project, the second brain template, and the prompts
from this video, they're inside the AI Profit Boardroom, along with the faceless video skill I used to make this. The link is in the comments and the description. Or go to AI Profit Boardroom.com.
Thanks for watching, and I'll see you in the next one.
