Axly.com
ThothAI local AI document assistant logo

Thoth AI

The Librarian

A private, offline AI document assistant for Windows and iOS. Upload your PDFs, build custom knowledge bases, and get answers with source citations — all processed locally on your device. No cloud. No internet. No data ever leaves your machine.

See How It Works

How It Works

ThothAI runs entirely on your device. Download the AI model once, then everything works offline — no account, no subscription, no cloud processing.

Download the AI Model

A one-time download of about 843 MB. ThothAI uses LiquidAI LFM models optimized for on-device inference. After this, you never need an internet connection again.

Build a Knowledge Base

Create collections of PDFs organized by topic — work documents, recipes, study notes, product manuals, whatever you need. Import from your device, iCloud Drive, Dropbox, or Google Drive.

Ask Questions

Type a question in plain language. ThothAI searches your documents, finds relevant passages, and generates an answer with source citations — including exact page numbers you can tap to verify.

Features

RAG Intelligence

Retrieval-Augmented Generation at its core. Ingest your PDFs into custom knowledge bases and ThothAI searches them to answer your questions — citing specific documents and page numbers so you can verify every claim.

Natural Conversation

Talk to your data as naturally as you talk to a friend. Thoth understands context, nuance, and complex queries across your entire library. Conversation history is saved and searchable so you can pick up where you left off.

100% Private

Your knowledge stays yours. The AI model runs directly on your device — no server, no API calls, no account required. Sensitive legal documents, medical records, financial data, proprietary research — none of it ever leaves your control.

Web Search

Need answers beyond your documents? Toggle on Web Search in Chatbot mode. ThothAI queries the web through DuckDuckGo for privacy and generates answers with clickable source links — while all AI processing still happens on your device.

Multiple AI Models

Choose from several LiquidAI LFM models downloaded from Hugging Face. ThothAI shows your available memory budget and recommends the best model for your device. Swap models anytime depending on your speed and quality needs.

Real-Time Performance

Every response shows live stats — token count, generation speed (tokens per second), and retrieval time. You always know exactly how fast ThothAI is working and can optimize by closing background apps or switching models.

Who It's For

Anyone who works with documents and values privacy. ThothAI turns static PDFs into searchable, conversational knowledge — without trusting a third party with your data.

Legal Professionals

Search case files, contracts, and briefs without uploading confidential client data to the cloud.

Students & Researchers

Build knowledge bases from textbooks, papers, and lecture notes. Get answers with page citations.

Healthcare Workers

Reference medical literature, protocols, and guidelines without HIPAA concerns.

Business & IT

Query internal docs, SOPs, product manuals, and compliance documents on your own terms.

Dual Modes

Chat Mode

Standard interaction with the LLM. Perfect for brainstorming, creative writing, coding assistance, and general knowledge queries. It's the AI assistant you know and love, but sharper.

RAG Mode

The Librarian enters the archives. In this mode, Thoth strictly uses your ingested Knowledgebases to answer questions, citing sources and providing page references for every claim.

Available Platforms

Windows Desktop Performance
iOS Mobile Wisdom

Mac & Android versions coming soon.

Resources

User Manual

Complete guide to ThothAI for iOS — setup, knowledge bases, RAG mode, web search, and more.

Download PDF

Privacy Policy

How ThothAI handles your data (short version: it doesn't leave your device).

Read Policy

Axly's Customs

ThothAI is built by Axly's Customs — a workshop for practical AI tools and creative projects.

Visit Home