MistAI Desktop Assistant Documentation

What is MistAI Desktop?

Remember MistAI? Now it lives on your computer. MistAI Desktop brings your AI assistant out of the browser and onto your system, listening for your voice, watching your screen, and taking action in real time.

Built by Kristian, MistAI Desktop expands the MistAI ecosystem with multiple AI personalities powered by different LLM backends—optimized for speed, reasoning, and balanced performance.

The Three Personalities

⭐

Nova

Fast, lightweight, creative. Powered by Gemini 2.5 Flash.

🤖

Sage

Strong reasoning and memory. Runs on Command-R7B.

🌬️

Flux

Balanced speed and performance. Powered by Mistral.

Core Features

🎤

Wake Word Detection

Say "Mist" or "Hey Mist" to activate hands-free. Includes fuzzy matching for natural speech.

👁️

Screen Vision

Reads and clicks on UI elements using advanced OCR and computer vision.

📺

Live Captions

See real-time overlays of what MistAI is saying and doing at the bottom of your screen.

💡

Proactive Mode

Get smart suggestions based on what you're working on—before you even ask.

🚀

App Control

Opens and focuses applications instantly with voice or text commands.

🔗

Multi-Step Actions

Chain multiple commands together for complex workflows.

🧠

Context Memory

Remembers conversations, tracks apps, and knows what you're working on.

⚡

Smart Recovery

When actions fail, MistAI asks its AI brain for recovery strategies.

Installation

Download MistAI Desktop

MistAI Desktop is available as a standalone executable for Windows, macOS, and Linux. No Python installation required—just download and run!

Download Latest Release

Windows • macOS • Linux • ~50MB • Built with PyInstaller

OCR Limitation: The bundled Tesseract OCR (screen vision) only works on Windows. macOS and Linux builds will function normally but without OCR capabilities unless you install Tesseract separately on your system.

Requirements

Windows 10/11 or macOS or Linux
Microphone – For voice control
Internet Connection – Required for AI processing
Vision OCR (Optional) – Windows: Built-in | macOS/Linux: Install Tesseract

About OCR (Screen Vision):

Windows builds include Tesseract bundled. macOS/Linux users can install Tesseract separately to enable screen vision features. Without Tesseract, all other features (voice control, app automation, proactive mode, captions) work normally.

Caption System

The caption system provides real-time visual feedback for everything MistAI says and does. Captions appear at the bottom of your screen in elegant, non-intrusive overlays.

Assistant Messages – Green background for MistAI responses
System Notifications – Yellow background for status updates
Proactive Suggestions – Purple background for smart tips
Privacy First – User messages are never shown in captions

🤖 Assistant: Opening Firefox now

ℹ️ System: Wake word detection enabled

💡 Suggestion: Would you like me to maximize this window?

How to Use

Wake Words

Mist Hey Mist MistAI Mist AI

Example Commands

👤 "Hey Mist, open Discord"

👤 "Mist, click on Settings"

👤 "Search YouTube for AI tutorials"

👤 "Scroll down"

Available Actions

open_app – Open/focus applications

click_on_text – Find and click UI elements

type_search – Type and submit text

scroll – Scroll up or down

volume – Control system volume

press_key – Press keyboard keys

maximize – Maximize current window

fullscreen – Toggle fullscreen (F11)

multi_step – Chain multiple actions

Frequently Asked Questions

Is MistAI free to use?

Yes! MistAI Desktop Assistant is completely free and open-source. The backend API is also free to use.

Does MistAI work offline?

No, MistAI requires an internet connection to communicate with the AI backend. However, the computer vision and automation features work locally.

Is my data private and secure?

MistAI only sends your voice commands and screen text to the AI backend for processing. Screenshots are processed locally and not uploaded. Your conversations are not stored permanently.

Can I use MistAI on Mac or Linux?

Yes! MistAI Desktop is available for Windows, macOS, and Linux. However, the bundled Tesseract OCR (screen vision) is Windows-only. macOS and Linux users can install Tesseract separately to enable OCR features. All other functionality (voice control, app automation, captions) works across all platforms.

How accurate is the wake word detection?

MistAI uses Google's speech recognition with fuzzy matching. It's quite accurate in quiet environments but may have issues with background noise.

What's the difference between Nova, Sage, and Flux?

Nova: Fast and efficient for general tasks (Gemini 2.5 Flash)
Sage: Better at complex reasoning (Command-R7B)
Flux: Balanced performance (Mistral)

Do I need to know Python?

No! The executable version requires zero coding knowledge. Just download and run.

Can I contribute to the project?

Absolutely! MistAI is open-source. Check out the GitHub repo, submit issues, or create pull requests. Contributions are always welcome!

Troubleshooting

Wake word not responding

Check microphone permissions and ensure wake word toggle is enabled in the UI.

OCR not finding text

Windows: OCR is bundled and should work automatically. macOS/Linux: Install Tesseract separately. MistAI will continue working without OCR—it just won't be able to see screen text.

No text-to-speech

Check system volume settings and restart MistAI if the issue persists.

Connection errors

Verify your internet connection. The status indicator shows connectivity.

Future Updates

V 1.5 (Full) – Enhanced proactive suggestions with smarter context awareness

V 2.0 – Cross-application workflows (e.g., "Screenshot and email it")

V 2.5 – Custom wake word training

V 3.0 – Plugin system for custom actions

V 4.0 – Multi-monitor support with per-screen awareness

Ready to Get Started?

Download MistAI Desktop Assistant and bring AI to your desktop!

Download Now

MistAI Desktop Assistant

Your Jarvis-like AI companion powered by Nova, Sage, and Flux