VoiceMem vs Vectorize

Side-by-side comparison of features, pricing, and ratings

Analysis reviewed Live tool data as of 2026-09-29
Cross-checked through our multi-step verification ·
Saved

At a glance

DimensionVoiceMemVectorize
PricingFree (Apache-2.0)Freemium — free self-host (MIT), pay-as-you-go cloud per token/call
LicenseApache-2.0MIT
Core focusDual-brain: facts + persona/emotion, streaming at 134msLearning from mistakes — Retain/Recall/Reflect/Mental Models
Best modalityReal-time multi-party voice with ASR, speaker ID, emotionText/MCP agents (Claude Code, Cursor, Google ADK)
DeploymentSelf-host only, v0.0.2 research project, no vendor SLASingle Docker command self-host or managed cloud
Maturity signalResearch-published (LoCoMo 91.2% Top-5), eval scripts + ChatMem-400KProduction-positioned, integrations with Claude Code/Cursor/ADK/Slack
VoiceMem
VoiceMem

Open-source dual-brain memory for real-time voice agents — facts in the left brain, emotion in the right, streaming at 134ms.

Visit Website
Vectorize
Vectorize

Open-source agent memory that learns from your agent's mistakes and carries the lesson forward

Visit Website
Pricing
Free
Freemium
Plans
$0
$0/mo
Pay as you go
Custom
Popularity
2 views
4.5k views
Skill Level
Advanced
Intermediate
API Available
Platforms
APICLIWeb
WebDesktopAPIPluginCLI
Categories
🧠 Agent Memory & Runtimes
🧠 Agent Memory & Runtimes
Features
Dual-brain memory: left brain stores factual schemas and entities, right brain stores persona, emotion, relationships
Fully streaming pipeline: audio segmentation, ASR, memory extraction, and graph writes while the user speaks
Speculative prefetching inside a voice turn (0–300 ms) so retrieval starts before the user finishes
Top-K memory routing and ranking controls context length
~300 tokens per single-turn query (project benchmark ~430 memory tokens per turn)
Published 134 ms response time vs Mem0's 1,440 ms
91.2% on LoCoMo with Top-5 memories (Mem0: 61.68%) and 69.44% on PersonaMem
Multi-modal memory from real audio: voice, speaker, sound events, multi-party conversations, music
Built-in ASR, speaker verification, scene detection, emotion recognition, and local embedding modules
Swappable components including the underlying memory engine and a pluggable TTS layer
SessionBuffer isolates per-session context, with temporary conversations purged at session end
Two-stage barge-in: VAD pauses and preserves audio queue, clears on stop or stable ASR text
PCM-sample-based output timeline with AudioWorklet render progress for interrupt handling
VoiceMem official model families (fine-tuned Qwen reply model) that read WireMem memories
ChatMem-400K dataset plus finetune pipeline and evaluation scripts for custom training
Learns from agent mistakes and failed tool calls
Four memory networks: Retain, Recall, Reflect, Mental Models
Automatic pattern detection via the reflection layer
Curated mental models that guide recurring situations
Per-user persistent memory with separate preferences and history
Cross-session context persistence across weeks
Parallel memory recall returning results in under 100ms
Model-agnostic layer — swap LLMs without losing learned memory
Single-command MCP skill install via npx add-skill
Registers remember, recall, and reflect MCP tools automatically
Compound memory shared across multiple agents
Self-host with a single Docker command under MIT license
Embedded PostgreSQL for self-hosted deployments
Python SDK and REST API
LongMemEval benchmark score of 94.6%
Integrations
Claude Code
Cursor
Google ADK
Slack

Feature-by-feature

The feature sets barely intersect even though both brands say 'memory.' Vectorize's differentiator is a learning loop: Retain stores, Recall retrieves, Reflect synthesizes patterns from tool-call failures and user corrections, and Mental Models apply that judgment in recurring situations. Its four networks exist to make an agent stop repeating mistakes, with per-user isolation and compound memory shared across collaborating agents. Recall is quoted under 100ms with parallel search, and it's model-agnostic, so you can swap LLMs without losing accumulated learning. Install is a single MCP skill command (npx add-skill), and it plugs into Claude Code, Cursor, Google ADK, and Slack.

VoiceMem is engineered for the audio pipeline, not text agents. It splits memory into a left brain (factual schemas/entities) and a right brain (persona, emotion, relationships), and runs a fully streaming path — segmentation, ASR, extraction, and graph writes while the user is still speaking. Speculative prefetching within a 0–300ms voice turn starts retrieval before the utterance finishes, with a published 134ms response time vs Mem0's 1,440ms. It claims 91.2% on LoCoMo at Top-5 (Mem0: 61.68%) and 69.44% on PersonaMem. Bundled modules include ASR, speaker verification, scene detection, emotion recognition, and local embeddings, plus a swappable memory engine and pluggable TTS. SessionBuffer purges temporary conversations at session end.

If your agent reads text and calls tools, Vectorize's reflexivity is the relevant capability. If your agent hears multi-party audio and must respond mid-turn, VoiceMem's streaming and emotion layers are the relevant ones — different problems, different feature lists.

Pricing compared

Vectorize is freemium with two paths. The free path is a self-host under MIT: one Docker command, and you supply the Postgres and compute. The paid path is a cloud billed pay-as-you-go per token and per call, which suits teams who don't want to run infrastructure. The pricing risk Vectorize itself flags is high-retain-volume workloads sensitive to per-token memory costs — if you write a lot of memory, the meter moves. There's no seat-based pricing described, so cost scales with usage, not headcount.

VoiceMem is free under Apache-2.0 with no listed paid tier, managed service, or vendor support. That's genuinely zero license cost, but the operating cost is your time: model downloads, local warmup, source-level debugging, and self-hosted infrastructure. The vendor explicitly warns it's a v0.0.2 research project with no production SLAs. For a prototype or MVP with tight per-turn token budgets (it quotes ~430 memory tokens per query turn), that trade can be excellent value. For anything customer-facing on an uptime contract, the hidden cost is engineering hours and the absence of a support line when something breaks.

Bottom line: Vectorize gives you a paid escape hatch from ops; VoiceMem keeps everything free and hands the ops back to you. Budget accordingly — Vectorize's cost is a bill, VoiceMem's cost is an engineer.

Who should pick which

  • Developer building a text/MCP coding or support agent
    Pick: Vectorize

    Native install path into Claude Code, Cursor, and Google ADK plus a Reflect layer that turns tool failures and user corrections into reusable judgment.

  • Team building a real-time voice assistant with emotional recall
    Pick: VoiceMem

    Dual-brain persona/emotion memory and a 134ms streaming pipeline with speculative prefetch are built specifically for in-turn voice retrieval.

  • Self-hosting team that wants to avoid per-token memory bills
    Pick: VoiceMem

    Free Apache-2.0 with no cloud meter, and a ~430 memory-token-per-turn footprint keeps per-conversation cost bounded.

  • Company that needs a managed memory service with vendor accountability
    Pick: Vectorize

    Vectorize offers a pay-as-you-go managed cloud; VoiceMem is a v0.0.2 research project with no SLA or support.

  • Researcher or prototyper validating voice-memory architectures
    Pick: VoiceMem

    Open technical report, eval scripts, and the ChatMem-400K dataset give you reproducible artifacts to build on — though benchmarks are self-reported.

Frequently Asked Questions

Can VoiceMem and Vectorize be used together?

Not cleanly out of the box. Vectorize ships an MCP skill (`npx add-skill`) for text agents; VoiceMem is a self-hosted streaming stack with its own ASR, extraction, and memory graph. Combining them means writing custom glue between VoiceMem's audio pipeline and Vectorize's networks — feasible, but neither vendor documents the integration.

Which one works with Claude Code, Cursor, or Google ADK?

Vectorize. Those are among its listed integrations, and it installs as a single MCP skill command. VoiceMem lists no integrations and is aimed at builders wiring voice pipelines themselves.

Is VoiceMem's 134ms latency number trustworthy?

It's published by the VoiceMem team alongside LoCoMo and PersonaMem scores, not independently replicated. The vendor's own 'not for' list flags buyers who require third-party benchmark replication — treat the figures as vendor-reported until you reproduce them.

Do I need to run Postgres for both?

Vectorize's self-host path names Postgres as part of the stack, and it lists teams with strict data locality and no appetite for Docker/Postgres as a poor fit. VoiceMem ships local embedding and ASR modules, so expect model downloads and warmup regardless of database choice.

What happens to memory when a voice session ends in VoiceMem?

SessionBuffer isolates per-session context and temporary conversations are purged at session end, while the left- and right-brain stores persist longer-term memory. That split lets you keep throwaway exchanges out of the graph without losing persona and factual recall.

Which is cheaper at scale?

VoiceMem has no license or per-call fee but consumes engineering time for self-hosting and debugging. Vectorize's self-host is also free under MIT, but its cloud is billed per token and per call, and the vendor cautions that high-retain-volume workloads are cost-sensitive. The cheaper option depends on whether you're paying in dollars or in engineer hours.

Does Vectorize replace a vector database?

It's positioned as a learning memory layer, not just retrieval — Reflect and Mental Models synthesize patterns rather than only storing and fetching facts. It still performs recall, but the differentiator is compounding judgment, so evaluate it against your retrieval stack rather than assuming it's a drop-in swap.

More VoiceMem or Vectorize comparisons

Explore each tool further

Browse these categories

Still deciding? Get the weekly AI tools brief

One email a week — new tools, honest comparisons, no spam.

Last reviewed: September 21, 2026