E
Engram
v1.6.0 — latest

Your AI.
On Your Device.

The local-first AI OS for high-liability environments. Complete privacy. Complete control.

View on GitHub
No API keys·No telemetry·Air-gap capable
engram — local inference
~ engram chat
Connected · llama3.1:latest · 0 remote endpoints
> summarize Q3 risk report
thinking locally...
AI: Three material risks identified in §4.2:
counterparty concentration (38% single vendor),
FX exposure on EUR/USD position,
pending litigation reserve — underfunded by ~$2.1M.
0 external calls
local · MPS
Zero-Knowledge Storage

Data Upload + Ingestion

Ingest PDFs, Markdown, and CSVs directly into a local Qdrant instance. Zero cloud upload. Your documents are indexed on-device.

  • Format Agnostic
  • RAG Pipeline
  • Automatic version tracking
engram.local

Desktop Empty

Why Engram

Your Data is the Product.
Until Now.

Engram decouples intelligence from the cloud, giving you state-of-the-art AI without the privacy trade-off.

01

Data Sovereignty

No API keys for inference. No telemetry. No model training on your text. Third-party integrations use credentials stored only on your machine — never transmitted.

Data egress comparison

Cloud AI

Your prompt
API call
Remote server
Model training
Other tenants

Engram

Your prompt
Local Ollama
Local Qdrant
Your machine
Only you
02

Local Performance

Inference runs on local silicon via Docker — no network round-trips, no rate limits, no per-token costs. Vector retrieval from Qdrant typically under 200ms.

Avg. first-token latency

ChatGPT API820ms
Claude API640ms
Engram (local)165ms

Measured on M2 MacBook Pro · llama3.1:8b · no GPU

03

Model Agnostic

Run Llama 3.1, Mistral, Gemma, or DeepSeek by changing one environment variable. Swap models without rewriting a line of application code.

Active inference model

llama3.1:latest8B
llama3.1:latest8B
mistral:latest7B
gemma2:latest9B
deepseek-r1:latest7B

Set via OLLAMA_MODEL in .env

The Privacy Argument

AI Without the Exit Door.

Every cloud AI tool creates a data egress path. Engram doesn't.

Cloud AIdata leaves machine

Your prompt

leaves your machine

HTTPS → API server

OpenAI, Anthropic, etc.

Remote model host

multi-tenant, shared

Training data pool?

depends on your tier

Other customers

same infrastructure

Engram OSzero egress

Your prompt

stays on your machine

Local Ollama

llama3.1, mistral, gemma

Local Qdrant

your vector store only

Your machine only

no egress, no exceptions

Zero external calls

air-gap capable

Engram has no telemetry endpoint, no analytics SDK, and no call home mechanism. Verify in source.

Local-First Pipeline

Engineered for Zero Trust.

No cloud vectors. No API keys for inference. Python and Docker on your local hardware — every component is inspectable, replaceable, and air-gap capable.

ingestor.py
Watchdog
class FileHandler(FileSystemEventHandler):
def on_modified(self, event):
# Triggered instantly on save
if event.path.endswith(".pdf"):
vectorize_local(event.path)
print(f"Ingesting...")
Trigger: drop → embed → store
qdrant_local
Vector DB
Zero-Knowledge Storage
terminal
Ollama
~ ollama run llama3
user: summarize Q3_budget.pdf
AI: Found 3 expense anomalies in the marketing ledger...
Metal Accelerated (MPS/CUDA)
Sector Agnostic Privacy

When "The Cloud" Isn't an Option.

For professionals who manage high-liability data, privacy isn't a feature—it's a regulatory requirement.

Legal Counsel

Ingest case files and discovery documents. Search for liability clauses across thousands of PDFs without breaking attorney-client privilege.

No BAA needed — there's no third party.

Privilege Intact

Healthcare

Analyze patient notes and research papers locally. Data never leaves the machine, eliminating a key class of HIPAA data-egress risk.

No cloud upload. No third-party model training on patient data.

HIPAA-Aligned · GDPR-Ready

R&D / IP

Index proprietary codebases, chemical schematics, and trade secrets. Your Intellectual Property stays strictly on your hard drive.

IP Sovereign

Talent & HR

Screen candidates against internal salary bands and sensitive roadmaps. Keep PII and compensation data completely off the cloud.

GDPR-Aligned

Finance & Gov

From M&A due diligence to public sector clearance. If it's too sensitive for standard AI tools, it belongs in Engram.

Zero Leaks