v0.20.0 feat: extract BrainBench to sibling gbrain-evals repo (#195)

* fix(link-extraction): v0.10.5 drive works_at + advises accuracy on rich prose Extends inferLinkType patterns to cover rich-prose phrasings that miss with v0.10.4 regexes. Targets the residuals called out in TODOS.md: works_at at 58% type accuracy, advises at 41%. WORKS_AT_RE additions: - Rank-prefixed: "senior engineer at", "staff engineer at", "principal/lead" - Discipline-prefixed: "backend/frontend/full-stack/ML/data/security engineer at" - Possessive time: "his/her/their/my time at" - Leadership beyond "leads engineering": "heads up X at", "manages engineering at", "runs product at", "leads the [team] at" - Role nouns: "role at", "position at", "tenure as", "stint as" - Promotion patterns: "promoted to staff/senior/principal at" ADVISES_RE additions: - Advisory capacity: "in an advisory capacity", "advisory engagement/partnership/contract" - "as an advisor": "joined as an advisor", "serves as technical advisor" - Prefixed advisor nouns: "strategic/technical/security/product/industry advisor to|at" - Consulting: "consults for", "consulting role at|with" New EMPLOYEE_ROLE_RE page-level prior: fires when the page describes the subject as an employee (senior/staff/principal engineer, director, VP, CTO/CEO/CFO) at some company. Biases outbound company refs toward works_at when per-edge context is possessive or narrative without an explicit work verb. Scoped to person -> company links only. Precedence: investor > advisor > employee (investors often hold board seats which would otherwise mis-classify as advise/works_at). ADVISOR_ROLE_RE broadened from "full-time/professional/advises multiple" to catch any page that self-identifies the subject as an advisor ("is an advisor", "serves as advisor", possessive "her advisory work/role/engagement"). Tests: 65 pass (16 new v0.10.5 coverage tests + 4 regression guards against v0.10.4 tightenings). Templated benchmark still 88.9% type_accuracy (10/10 on works_at and advises). Rich-prose measurement requires the multi-axis report upgrade (next commit) to validate retroactively. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(eval): type-accuracy runner on rich-prose corpus + wire into all.ts New Category 2 in BrainBench: per-link-type accuracy measured directly on the 240-page rich-prose world-v1 corpus. Distinct from Cat 1's retrieval metrics, this measures whether inferLinkType() correctly classifies extracted edges when the prose varies (the 58% works_at and 41% advises residuals that v0.10.5 regexes targeted). How it works: 1. Loads all pages from eval/data/world-v1/ 2. Derives GOLD expected edges from each page's _facts metadata (founders → founded, investors → invested_in, advisors → advises, employees → works_at, attendees → attended, primary_affiliation + role drives person-page outbound type) 3. Runs extractPageLinks() on each page → INFERRED edges 4. Per (from, to) pair, compares inferred type vs gold type 5. Emits per-link-type table: correct / mistyped / missed / spurious + type accuracy + recall + precision + strict F1 (triple match) 6. Full confusion matrix rows=gold, cols=inferred v0.10.5 validation on 240-page corpus (up from pre-v0.10.5 baselines): - works_at: 58% → 100.0% (+42 pts) — 10/10 correct, 0 mistyped - advises: 41% → 88.2% (+47 pts) — 15/17 correct - attended: — → 100.0% 131/134 recall - founded: 100% → 100.0% 40/40 - invested_in: 89% → 92.0% 69/75 - Overall: 88.5% → 95.7% type accuracy (conditional on edge found) Strict F1 overall: 53.7%. Lower because the _facts-based gold set only captures core relationships; rich prose extracts many peripheral mentions (190 spurious "mentions" edges) that aren't bugs but are correctly-typed prose references without a _facts counterpart. Spurious counts are signal for future type-precision tuning, not failure. Wired into eval/runner/all.ts as Cat 2 so every full benchmark run includes the rich-prose type accuracy table alongside retrieval metrics. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(eval): Phase 2 adapter interface + EXT-1 ripgrep+BM25 baseline Phase 2 credibility unlock: BrainBench now compares gbrain to external baselines on the same corpus and queries. Transforms the benchmark from internal ablation ("gbrain-graph beats gbrain-grep") to category comparison ("gbrain-graph beats classic BM25 by 32 pts P@5"). This is the #1 fix from the 4-review arc — addresses Codex's core critique that v1's before/after was self-referential. Added: eval/runner/types.ts — Adapter interface (v1.1 spec) eval/runner/adapters/ripgrep-bm25.ts — EXT-1 classic IR baseline eval/runner/adapters/ripgrep-bm25.test.ts — 11 unit tests, all pass eval/runner/multi-adapter.ts — side-by-side scorer Adapter interface (eng pass 2 spec): - Thin 3-method Strategy: init(rawPages, config), query(q, state), snapshot(state) - BrainState is opaque to runner (never inspected) - Raw pages passed in-memory; gold/ never crosses adapter boundary (structural ingestion-boundary enforcement) - PoisonDisposition enum reserved for future poison-resistance scoring EXT-1 ripgrep+BM25: - Classic Lucene-variant IDF + k1/b tuned at standard 1.5/0.75 - Title tokens double-weighted for entity-page slug-match bias - Stopword filter, alphanumeric tokenization, stable lexicographic tie-break - Pure in-memory inverted index — no external deps, ~100 LOC core First side-by-side results on 240-page rich-prose corpus, 145 relational queries: | Adapter | P@5 | R@5 | Correct top-5 | |---------------|--------|--------|---------------| | gbrain-after | 49.1% | 97.9% | 248/261 | | ripgrep-bm25 | 17.1% | 62.4% | 124/261 | | Delta | +32.0 | +35.5 | +124 | gbrain-after is the hybrid graph+grep config from PR #188. Ripgrep+BM25 is a genuinely strong classic-IR baseline (BM25 is what Lucene/Elasticsearch ship). gbrain's ~+32-point lead on relational queries reflects real work by the knowledge graph layer: typed links + traversePaths surface the correct answers in top-K that BM25 only pulls in via partial-text overlap. Next in Phase 2: EXT-2 vector-only RAG + EXT-3 hybrid-without-graph adapters. Both plug into the same Adapter interface. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(eval): Phase 2 EXT-2 vector-only RAG adapter Second external baseline for BrainBench. Pure cosine-similarity ranking using the SAME text-embedding-3-large model gbrain uses internally — apples-to-apples on the embedding layer so any gbrain lead reflects the graph + hybrid fusion, not a better embedder. Files: eval/runner/adapters/vector-only.ts ~130 LOC eval/runner/adapters/vector-only.test.ts 6 unit tests (cosine math) Design: - One vector per page (title + compiled_truth + timeline, capped 8K chars). - No chunking (intentional; chunked vector RAG would be EXT-2b later). - No keyword fallback (that's EXT-3 hybrid-without-graph). - Embeddings in batches of 50 via existing src/core/embedding.ts (retry+backoff). - Cost on 240 pages: ~$0.02/run. Three-adapter side-by-side on 240-page rich-prose corpus, 145 relational queries: | Adapter | P@5 | R@5 | Correct top-5 | |---------------|--------|--------|---------------| | gbrain-after | 49.1% | 97.9% | 248/261 | | ripgrep-bm25 | 17.1% | 62.4% | 124/261 | | vector-only | 10.8% | 40.7% | 78/261 | Interesting finding: vector-only scores WORSE than BM25 on relational queries like "Who invested in X?" — exact entity match matters more than semantic similarity for these templates. BM25 nails the entity-name term; vector-only returns topically-similar-but-not-mentioning pages. This is the known failure mode of pure-vector RAG on precise relational/identity queries. Real-world vector RAG systems always add keyword fallback; EXT-3 (hybrid-without-graph) will be that fairer comparator. gbrain's lead widens in vector-only comparison: +38.4 pts P@5, +57.2 pts R@5. The graph layer is doing the heavy lifting for relational traversal; pure vector RAG can't express "traverse 'attended' edges from this meeting page." Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(eval): Phase 2 EXT-3 hybrid-without-graph adapter — graph isolated Third and closest-to-gbrain external baseline. Runs gbrain's full hybrid search (vector + keyword + RRF fusion + dedup) WITHOUT the knowledge-graph layer. Same engine, same embedder, same chunking, same hybrid fusion — only traversePaths + typed-link extraction turned off. This is the decisive comparator for "does the knowledge graph do useful work?" Same everything-else, only graph differs. Any lead gbrain-after has over EXT-3 is 100% attributable to the graph layer. Files: eval/runner/adapters/hybrid-nograph.ts — ~110 LOC Implementation: - New PGLiteEngine per run; auto_link set to 'false' (belt). - importFromContent() used instead of bare putPage() so chunks + embeddings get populated (hybridSearch needs them). - NO runExtract() call — typed links/timeline stay empty (suspenders). - hybridSearch(engine, q.text) answers every query. Aggregate chunks to page-level by best chunk score. FOUR-adapter side-by-side on 240-page rich-prose corpus, 145 relational queries: | Adapter | P@5 | R@5 | Correct/Gold | |-----------------|--------|--------|--------------| | gbrain-after | 49.1% | 97.9% | 248/261 | | hybrid-nograph | 17.8% | 65.1% | 129/261 | | ripgrep-bm25 | 17.1% | 62.4% | 124/261 | | vector-only | 10.8% | 40.7% | 78/261 | The headline delta nobody can hand-wave away: gbrain-after → hybrid-nograph = +31.4 P@5, +32.9 R@5 hybrid-nograph → ripgrep-bm25 = +0.7 P@5, +2.7 R@5 Hybrid search (vector+keyword+RRF) over pure BM25 gains ~1 point. The knowledge graph layer over hybrid gains ~31 points. The graph is doing the work; adding it to a retrieval stack is what actually moves the needle on relational queries. The vector/keyword/BM25 debate is a footnote. Timing: hybrid-nograph init is ~2 min (embeds 240 pages once); query loop is fast. gbrain-after is ~1.5s total because traversePaths doesn't need embeddings. Runs at ~$0.02 Opus-equivalent in embedding cost. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(eval): Phase 2 query validator + Tier 5 Fuzzy + Tier 5.5 synthetic + N=5 tolerance bands Closes multiple Phase 2 items in one commit since they form a cohesive package: query schema enforcement + new query tiers + per-query-set statistical rigor. Added: eval/runner/queries/validator.ts — hand-rolled Query schema validator eval/runner/queries/validator.test.ts — 24 unit tests, all pass eval/runner/queries/tier5-fuzzy.ts — 30 hand-authored Tier 5 Fuzzy/Vibe queries eval/runner/queries/tier5_5-synthetic.ts — 50 SYNTHETIC-labeled outsider-style queries (author: "synthetic-outsider-v1") eval/runner/queries/index.ts — aggregator + validateAll() Modified: eval/runner/multi-adapter.ts — N=5 runs per adapter (BRAINBENCH_N override), page-order shuffle, mean±stddev reporting Query validator (hand-rolled, no zod dep to match gbrain codebase style): - Temporal verb regex enforces as_of_date (per eng pass 2 spec): /\\b(is|was|were|current|now|at the time|during|as of|when did)\\b/i - Validates tier enum, expected_output_type enum, gold shape per type - gold.relevant must be non-empty slug[] for cited-source-pages queries - abstention requires gold.expected_abstention === true - externally-authored tier requires author field - batch validation catches duplicate IDs Tier 5 Fuzzy/Vibe (30 queries, hand-authored): - Vague recall: "Someone who was a senior engineer at a biotech company..." - Trait-based: "The engineer who pushed back on microservices" - Cultural/epithet: "Who is known as a 'systems builder' in security?" - Abstention bait: "Which Layer 1 project did the crypto guy leave?" (prose mentions but never names; good systems abstain) - Addresses Codex's circularity critique — vague queries where graph-heavy systems shouldn't inherently win. Tier 5.5 Synthetic Outsider (50 queries, AI-authored placeholder): - Clearly labeled author: "synthetic-outsider-v1" - Phrasing variety not in the 4 template families: * fragment style ("crypto founder Goldman Sachs background") * polite/natural ("Can you pull up what we have on...") * comparison ("What is the difference between X and Y?") * follow-up ("And who else advises Orbit Labs?") * typos/misspellings ("adam lopez bioinformatcis") * similarity ("Find me someone like Alice Davis...") * imperative ("Pull up Alice Davis") - Real Tier 5.5 from outside researchers supersedes synthetic via PRs to eval/external-authors/ (docs ship in follow-up commit). N=5 tolerance bands: - Default N=5, override via BRAINBENCH_N env var (e.g. BRAINBENCH_N=1 for dev loops) - Per-run seeded Fisher-Yates shuffle of page ingest order (LCG seed = run_idx+1) - Surfaces order-dependent adapter bugs (tie-break-by-first-seen etc.) - Reports mean ± sample-stddev per metric - "stddev = 0" is honest signal that the adapter is deterministic, not a bug. LLM-judge metrics (future) will naturally produce non-zero stddev. Validation: all 80 Tier 5 + 5.5 queries pass validateAll(). 24 validator unit tests pass. Next commit: world.html contributor explorer (Phase 3). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(eval): Phase 3 world.html explorer + eval:* CLI surface Contributor DX magical moment. Static HTML explorer renders the full canonical world (240 entities) as an explorable tree, opens in any browser, zero install. Every string HTML-entity-encoded (XSS-safe — direct vuln class per eng pass 2, confidence 9/10). Added: eval/generators/world-html.ts — renderer (~240 LOC; single-file HTML with inline CSS + minimal JS) eval/generators/world-html.test.ts — 16 tests (XSS + rendering correctness) eval/cli/world-view.ts — render + open in default browser eval/cli/query-validate.ts — CLI wrapper for queries/validator eval/cli/query-new.ts — scaffold a query template Modified: package.json — 7 new eval:* scripts .gitignore — ignore generated world.html package.json scripts shipped: bun run test:eval all eval unit tests (57 pass) bun run eval:run full 4-adapter N=5 side-by-side bun run eval:run:dev N=1 fast dev iteration bun run eval:world:view render world.html + open in browser bun run eval:world:render render only (CI-friendly, --no-open) bun run eval:query:validate validate built-in T5+T5.5 (or a file path) bun run eval:query:new scaffold a new Query JSON template bun run eval:type-accuracy per-link-type accuracy report XSS safety: escapeHtml() encodes the 5 critical chars (& < > " '). Tested directly with representative Opus-generated attacks: <img src=x onerror=alert('xss')> → <img src=x onerror=alert('xss')> <script>fetch('/steal')</script> → <script>fetch('/steal')</script> Ledger metadata (generated_at, model) also escaped — covers the less obvious attack surface where Opus could emit tag-like content into the metadata file. world.html structure: - Left rail: entities grouped by type with counts (companies, people, meetings, concepts), alphabetical within type - Right pane: per-entity cards with title + slug + compiled_truth + timeline + canonical _facts as collapsed JSON - URL fragment deep-links (#people/alice-chen) - Sticky rail on desktop; responsive stack on mobile - Vanilla JS for active-link highlighting on scroll (no framework) Generated file: ~1MB for 240 entities (full prose). Gitignored; rebuild with `bun run eval:world:view`. Regeneration is ~50ms. Contributor TTHW (Tier 5.5 query authoring): 1. bun run eval:world:view # see entities 2. bun run eval:query:new --tier externally-authored --author "@me" 3. edit template with real slug + query text 4. bun run eval:query:validate path/to/file.json 5. submit PR Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(eval): Phase 3 contributor docs + CI workflow for eval/ tests Ships the contributor-onboarding surface promised in the plan. With this commit, external researchers have a self-serve path from clone to PR in under 5 minutes. Added: eval/README.md — 5-minute quickstart, directory map, methodology one-pager, adapter scorecard eval/CONTRIBUTING.md — three contributor paths: 1. Write Tier 5.5 queries 2. Submit an external adapter 3. Reproduce a scorecard eval/RUNBOOK.md — operational troubleshooting: generation failures, runner failures, query validation, world.html rendering, CI eval/CREDITS.md — contributor attribution (synthetic-outsider-v1 labeled as placeholder; real submissions land here) .github/PULL_REQUEST_TEMPLATE/tier5-queries.md — structured PR template for Tier 5.5 submissions .github/workflows/eval-tests.yml — CI: validates queries, runs all eval unit tests, renders world.html on every PR touching eval/** or src/core/link-extraction.ts CI scope (intentionally narrow): - Triggers on paths: eval/**, src/core/link-extraction.ts, src/core/search/** - Runs: bun run eval:query:validate (80 queries), test:eval (57 tests), eval:world:render (smoke-test the HTML renderer) - Pinned actions by commit SHA (matches existing .github/workflows/test.yml) - Zero API calls — all Opus/OpenAI paths stubbed or skipped in unit tests - Fast: ~30s total wall clock Contributor TTHW (clone → first merged PR): - Path 1 (Tier 5.5 queries): ~5 min - Path 2 (external adapter): ~30 min for a simple adapter - Path 3 (reproduce scorecard): ~15 min wall clock (N=5 run) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * fix(eval): teardown PGLite engines so bun run eval:run exits 0 The multi-adapter runner left PGLite engines alive after each run. GbrainAfterAdapter and HybridNoGraphAdapter both instantiate a PGLiteEngine in init() but never disconnect it; Bun's shutdown path exits with code 99 when embedded-Postgres workers outlive main(). Added optional `teardown?(state)` to the Adapter interface, implemented it on both engine-backed adapters, and call it from scoreOneRun after the N=5 loop. ripgrep-bm25 and vector-only hold no DB resources and don't need a teardown. Verified: gbrain-after, hybrid-nograph, ripgrep-bm25, vector-only all exit 0 at N=1. Full test:eval passes (57 tests). No metric change. * docs(bench): 2026-04-19 multi-adapter scorecard Reproducibility run of the 4-adapter side-by-side at commit b81373d (branch garrytan/gbrain-evals). N=5, 240-page corpus, 145 relational queries from world-v1. Headline: gbrain-after 49.1% P@5 / 97.9% R@5. hybrid-nograph 17.8% / 65.1%. ripgrep-bm25 17.1% / 62.4%. vector-only 10.8% / 40.7%. All adapters deterministic (stddev = 0 across the 5 runs per adapter). Matches the scorecard in eval/README.md byte-for-byte for the three deterministic adapters; hybrid-nograph matches within tolerance bands. * docs(bench): 2026-04-19 gbrain v0.11.1 vs v0.12.1 regression comparison Runs the same eval harness against two gbrain src/ trees on the same 240-page corpus and 145 queries. Patches the v0.11 copy's gbrain-after adapter to use getLinks/getBacklinks (v0.11 has no traversePaths) with identical direction+linkType semantics. gbrain-after P@5 22.1% -> 49.1% (+27 pts); R@5 54.6% -> 97.9% (+43 pts); correct-in-top-5 99 -> 248 (+149). hybrid-nograph flat at 17.8% / 65.1% on both (v0.12 didn't touch hybridSearch / chunking). Driver is extraction quality, not graph presence: v0.12 emits 499 typed links (v0.11: 136, x3.7) and 2,208 timeline entries (v0.11: 27, x82) on the same 240 pages. Sharpens the April-18 "graph layer does the work" claim -- on v0.11 that architecture only beat hybrid-nograph by 4.3 points; the 31-point lead in the multi-adapter scorecard comes from graph + high-quality extract in combination. * feat(eval): BrainBench v1 portable JSON schemas + gold templates Adds the v1→v2 contract boundary for BrainBench. 6 JSON schemas at eval/schemas/ pin the shape of every artifact a stack must emit to be scorable: corpus-manifest, public-probe (PublicQuery with gold stripped), tool-schema (12 read + 3 dry_run tools, 32K tool-output cap), transcript, scorecard (N ∈ {1, 5, 10}), evidence-contract (structured judge input). 8 gold file templates at eval/data/gold/ scaffold the sealed qrels, contradictions, poison items, and citation labels. Empty-but-valid skeletons; Day 3b fills them with real content once the amara-life-v1 corpus generates. 48 tests validate schema syntax, $schema/$id/title/type headers, round-trip stability, and cross-schema coherence (new Page types in manifest enum, tool counts, token cap, N enum). When v2 ports to Python + Inspect AI + Docker, these schemas are the boundary. Same fixtures, same tool contracts, zero rework. * feat(eval): amara-life-v1 skeleton + Page.type enum for email/slack/cal/note Deterministic procedural generator for the twin-amara-lite fictional-life corpus (BrainBench v1 Cat 5/8/9/11 target). 15 contacts picked from world-v1, 50 emails + 300 Slack messages across 4 channels + 20 calendar events + 8 meeting transcripts + 40 first-person notes. Mulberry32 PRNG gives byte-identical output under reseed. Plants 10 contradictions + 5 stale facts + 5 poison items + 3 implicit preferences at deterministic positions. Fixture_ids are unique across the corpus so gold/contradictions.json + gold/poison.json + gold/implicit- preferences.json can cross-reference by stable ID. PageType extended in both src/core/types.ts and eval/runner/types.ts to include email | slack | calendar-event | note (+ meeting on the production side). src/core/markdown.ts inferType() heuristics updated for the new one-slash slug prefixes (emails/em-NNNN, slack/sl-NNNN, cal/evt-NNNN, notes/YYYY-MM-DD-topic, meeting/mtg-NNNN). 17 tests cover counts (50/300/20/8/40), perturbation counts (exact 10/5/5/3), seed determinism + divergence, slug regex conformance (matches eval/runner/queries/validator.ts:131 one-slash rule), unique fixture_ids, amara-in-every-email invariant, calendar dtstart < dtend, and Amara-is- attendee on every meeting. * feat(eval): amara-life-gen.ts with structured cache key + $20 cost gate Opus prose expansion of the amara-life-v1 skeleton. Per-item structured cache key = sha256({schema_version, template_id, template_hash, model_id, model_params, seed, item_spec_hash}). Prompt-template tweak changes template_hash; only those items regenerate. Schema bump changes schema_version; everything invalidates cleanly. Interrupted runs resume from the last cached item; zero re-spend. Cost-gated at $20 hard-stop with Anthropic input/output pricing tracking. Dry-run mode (--dry-run) executes the full pipeline with stub bodies for smoke-testing the I/O layout without LLM spend. --max N caps items per type for debugging. --force ignores cache. Writes per-format outputs under eval/data/amara-life-v1/: inbox/emails.jsonl (one email per line with body_text appended) slack/messages.jsonl (one message per line with text appended) calendar.ics (RFC-5545 VEVENT format, templated — no LLM) meetings/<id>.md (transcript with YAML frontmatter) notes/<YYYY-MM-DD-topic>.md (first-person journal) docs/*.md (6 reference docs, templated — no LLM) corpus-manifest.json (per eval/schemas/corpus-manifest.schema.json, including per-item content_sha256 and generator_cache_key) Perturbation hints (contradiction, stale-fact, poison, implicit- preference) flow through the prompt so Opus weaves the specific claim into each item's body. Poison items are hand-crafted to include paraphrased prompt-injection attempts (not literal 'IGNORE ALL PREVIOUS' — defense is the structured-evidence judge contract at Day 5, not regex redaction). New package.json scripts: eval:generate-amara-life # real run (~$12 Opus estimated) eval:generate-amara-life:dry # smoke test, zero spend test:eval extended to include test/eval/. 10 cache-key tests cover determinism, invalidation across every field of the key, canonical JSON stability under object-key reorder, and per-skeleton-item spec-hash uniqueness (50 distinct hashes for 50 distinct emails). * chore: bump version and changelog (v0.15.0) Resets package.json from stale 0.13.1 to 0.15.0 (matches VERSION). v0.14.0 shipped with the stale package.json version; this sync catches that up and moves to v0.15.0 in one step. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * docs: update CLAUDE.md + README + eval/README for v0.15.0 BrainBench CLAUDE.md: adds a full BrainBench section to the Key Files list — 14 new entries covering eval/README.md, multi-adapter.ts, types.ts (with new PublicPage/PublicQuery), adapters/, queries/, type-accuracy.ts, adversarial.ts, all.ts, world.ts/gen.ts, world-html.ts, amara-life.ts, amara-life-gen.ts, schemas/, data/world-v1/, data/gold/, data/amara-life-v1/, docs/benchmarks/, and test/eval/. Adds 3 new test/eval/ lines to the unit-tests catalog. eval/README.md: file tree updated to reflect v0.15 additions — data/amara-life-v1/, data/gold/, schemas/, generators/amara-life.ts + amara-life-gen.ts, runner/all.ts + adversarial.ts. README.md: updates hero benchmark numbers (L7 intro + L353 mid-page) from v0.10.5 PR #188 numbers (R@5 83→95, P@5 39→45) to current v0.12.1 4-adapter numbers (P@5 49.1% · R@5 97.9% · +31.4 pts vs hybrid-nograph). Adds the v0.11→v0.12 regression comparison as the secondary reference. Deeper-section tables (L422+) labeled "BrainBench v1 (PR #188)" are preserved as historical data. CHANGELOG is untouched — /ship already wrote the v0.15.0 entry. TODOS.md is untouched — Cat 5/6/8/9/11 remain open (only foundations shipped in v0.15.0; Cat runners ship in v1 Complete follow-ups). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 4 — pdf-parse + flight-recorder + tool-bridge (dry_run + expand:false) Three infrastructure modules for BrainBench v1 Complete Cats 5/8/9/11. **eval/runner/loaders/pdf.ts** — Thin pdf-parse wrapper. Lazy import keeps pdf-parse out of the module-load path (avoids library debug-mode side effects). Size cap (50MB default), encryption detection, structured error classes (PdfEncryptedError, PdfTooLargeError, PdfParseError). Only Cat 11 multimodal will import this; production bundle never sees pdf-parse. **eval/runner/tool-bridge.ts** — Maps 12 read-only operations from src/core/operations.ts to Anthropic tool definitions + adds 3 dry_run write tools. Three structural invariants enforced: 1. No hidden LLM calls. `operations.query` defaults expand=true which routes through expansion.ts → Haiku. Bridge strips `expand` from the query tool's input schema AND executor hard-sets expand:false. Zero nested Haiku calls in any agent trace. 2. Mutating ops throw ForbiddenOpError. put_page, add_link, delete_page, etc. are rejected by name. Agents record intent via dry_run_put_page / dry_run_add_link / dry_run_add_timeline_entry which persist to the flight-recorder without mutating the engine. This is how Cat 8's back_link_compliance + citation_format metrics measure anything with a read-only tool surface. 3. Poison tagged by the bridge, not the judge. Every tool result is scanned for slugs matching gold/poison.json fixtures. Matched fixture_ids flow into tool_call_summary.saw_poison_items for the structured-evidence judge contract. Judge never reads raw tool output — Section-3 defense against paraphrased prompt injections (poison payloads never reach the judge model at all). 32K-token cap (~128K chars) with "…[truncated]" suffix. **eval/runner/recorder.ts** — Per-run flight-recorder bundle emitter. Full 6-artifact bundle (transcript.md, brain-export.json, entity-graph.json, citations.json, scorecard.json, judge-notes.md) when the adapter provides an AdapterExport; 3-artifact fallback (transcript + scorecard + judge-notes) otherwise. Atomic writes via tmp+rename. Collision-safe: duplicate directory names get incremental -2, -3 suffix. `safeStringify` handles circular references without throwing and JSON-serializes Float32Array embeddings. **package.json:** adds pdf-parse@2.4.5 as a devDependency. Scoped to eval/ use only; production gbrain binary unaffected. **Tests:** 63 new — 30 tool-bridge, 21 recorder, 12 pdf-loader. All pass. Fake engine uses a Proxy with `__default__` fallback so poison-matching tests don't have to mock the exact engine method name that each operation calls (some route via searchKeyword, others via getPage — proxy handles both uniformly). Total eval suite now: 132 pass, 0 fail, 923 expect() calls. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 5 — agent adapter + judge with structured evidence contract Two modules that together wire Cat 8 / Cat 9 / Cat 5 end-to-end scoring. **eval/runner/judge.ts** — Haiku 4.5 via tool-use `score_answer`. Input is the structured JudgeEvidence contract (fix #16 from the plan's codex review): probe + final_answer_text + evidence_refs + tool_call_summary + ground_truth_pages + rubric. Raw tool output NEVER reaches the judge — that's the Section-3 defense against paraphrased prompt-injection payloads in gold/poison.json. Retry policy: one retry on malformed tool_use response. If the second attempt is still malformed, score the probe as `judge_failed` (all scores 0, verdict=fail) so the run still completes. Aggregation: weighted mean across rubric criteria. Canonical thresholds (pass ≥3.5, partial 2.5-3.5, fail <2.5) — judge can propose a verdict but the computed verdict from the weighted mean is what the scorecard records. This prevents the model from inflating or deflating its own verdict. Score values are clamped to 0-5 on parse even if the model returns out of range. `assertNoRawToolOutput(evidence)` is a regression guard that returns the list of forbidden fields (tool_result, raw_transcript, etc.) if any leak into the evidence contract. **eval/runner/adapters/claude-sonnet-with-tools.ts** — The agent adapter. Implements `Adapter` interface minimally: `init()` spins up PGLite and seeds it, `query()` throws because the adapter is Cat 8/9-only and emits a final-answer text, not a RankedDoc[]. Retrieval scorecard stays at 4 adapters. `runAgentLoop(probeId, text, state, config)` drives the multi-turn loop: Sonnet → tool_use → tool-bridge.executeTool → tool_result → back to Sonnet. Turn cap 10. max_tokens 1024. System prompt (brain-first iron law, citation format, amara context) is cached via cache_control. Exponential backoff on rate-limit errors (1s, 2s, 4s). Emits a `Transcript` per eval/schemas/transcript.schema.json — consumed directly by recorder.ts for the flight-recorder bundle. `brain_first_ordering` classifies Cat 8's flagship metric: did the agent call search/get_page BEFORE producing the final answer? The `no_brain_calls` case (agent answers from general knowledge without ever hitting the brain) is the compliance failure to surface. ForbiddenOpError + UnknownToolError from the bridge are caught in the agent loop and surfaced as tool_result with is_error=true — keeps the loop going and preserves full audit trail for the judge. **Tests (35 new):** judge (23) — happy path, retry, fallback, evidence contract sanitization, rendered prompt does not contain raw tool_result text, verdict thresholds, score clamping, weighted mean with mixed weights, parseToolUse rejects malformed input. agent-adapter (12) — Adapter.query() throws, init() seeds PGLite, end-to-end tool loop with stubbed Sonnet, turn cap exhaustion, mutating-op rejection surfaces as tool_result error, extractSlugs regex. All 12 agent tests take ~23s because PGLite runs 13 schema migrations per test; the alternative of shared-engine-across-tests was rejected so each test is isolated. Total eval suite now: 167 pass, 0 fail. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 6 — adversarial-injections + Cat 6 prose-scale + Cat 11 multi-modal Three modules that together cover BrainBench v1 Cat 6 (prose-scale extraction fidelity) and Cat 11 (multi-modal ingest fidelity). **eval/runner/adversarial-injections.ts** — 6 deterministic content transforms shared by Cat 10 (adversarial.ts, 22 hand-crafted cases) and Cat 6 (prose-scale variants). Each injection produces a modified content string + a structured GoldDelta describing what the extractor MUST and MUST NOT produce. Kinds: - code_fence_leak — fake [X](people/fake) inside ``` fence, must NOT extract - inline_code_slug — `people/fake` in backticks, must NOT extract - substring_collision — "SamAI" near real `people/sam`, exactly one link - ambiguous_role — "works with" vs "works at", downgrade type to mentions - prose_only_mention — strip markdown link syntax, bare name → mentions only - multi_entity_sentence — pack 4+ entities into one clause, extract all Mulberry32 PRNG keeps variant generation deterministic under fixed seed. Codex flagged the original plan's wording ("extract injection engine from adversarial.ts") as overstated — adversarial.ts is a static case list, not a reusable engine. This module is NEW code. **eval/runner/cat6-prose-scale.ts** — Runner. Loads world-v1, applies all 6 injection kinds to sampled base pages (default 50 variants per kind × 6 kinds = 300 variants), runs extractPageLinks on each, compares to gold delta. Emits per-kind + overall metrics (precision, recall, F1, code_fence_leak_rate, substring_fp_rate, pages_with_links_coverage, mean_links_per_page). **v1 verdict is always "baseline_only"** — no gating threshold per codex fix #9 (current extractor residuals make >0.80 unreachable; v1 records a baseline, regression guard triggers on drop below it). **eval/runner/cat11-multimodal.ts** — PDF + HTML + audio runners. Fixtures load from eval/data/multimodal/<modality>/fixtures.json manifests; each modality skips gracefully when manifest missing or (audio) when neither GROQ_API_KEY nor OPENAI_API_KEY is set. Metrics: - PDF: char-level similarity via Levenshtein + optional entity_recall - HTML: word-recall over normalized tokens (multiset semantics) - Audio: WER (word error rate) via Levenshtein on word sequences Fixtures are NOT committed; a future eval:fetch-multimodal script will download them hash-verified from public sources (arXiv CC-licensed papers, Wikipedia CC-BY-SA, Common Voice CC0). Injectable audio transcriber (`opts.transcribe`) means tests don't need GROQ/OpenAI keys — stubbed transcriptions exercise the WER math path directly. **Tests (60 new):** adversarial-injections (19) — per-kind assertions + dispatcher coverage + slug regex conformance; cat6 (12) — variant determinism, scoreVariant shape, aggregate per-kind + overall metrics, corpus resolver slug rules; cat11 (29) — charSimilarity / wordRecall / wer math, htmlToText strips scripts + decodes entities, HTML modality with real fixtures, audio modality gracefully skips without key + uses stub transcriber correctly. All 60 tests pass in 48ms + 41ms. Total eval suite now: 227 pass, 0 fail. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 7 — Cat 5 provenance runner + structured classify_claim judge **eval/runner/cat5-provenance.ts** — BrainBench Cat 5 scoring. Samples claims from gbrain brain-export and classifies each against its source material via a dedicated Haiku judge (classify_claim tool with a three-label enum: supported | unsupported | over-generalized). Separate from judge.ts by design: Cat 5 is a single three-way classification per claim, not a weighted rubric. Rather than overload judge.ts with a mode switch, Cat 5 has its own tool definition (CLASSIFY_CLAIM_TOOL) and prompt. The retry-once pattern, $20 cost gate semantics, and structured parsing are mirrored from judge.ts so failures look the same across Cats. Metric: `citation_accuracy` = fraction where predicted label equals gold expected_label. Threshold (informational): >0.90 per design-doc METRICS.md. v1 ships with `enableThreshold: false` so the verdict is always baseline_only — we don't have hand-authored gold claims yet, and codex flagged that threshold gating should wait until the amara-life-v1 corpus + gold file authoring lands in Day 3b. runCat5 uses a bounded-concurrency worker pool (default 4) to respect Haiku rate limits across 100+ claim batches. Evidence pages are looked up by slug from a caller-provided pagesBySlug map — missing pages don't crash, they just pass an empty source list to the judge (correct behavior for genuinely unsupported claims). **Tests (23):** classifyClaim happy/retry/fallback paths with stubbed Haiku, aggregate accuracy math, threshold gating (pass/fail vs baseline_only), runCat5 concurrency + missing-page handling, renderClaimPrompt embeds claim + sources correctly, parseClassification rejects invalid enum values + plain-text responses. Total eval suite now: 250 pass, 0 fail. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 8 — Cat 8 skill compliance + Cat 9 end-to-end workflows **eval/runner/cat8-skill-compliance.ts** — Deterministic, judge-free Cat 8 scoring. Replays inbound signals through the agent adapter (Day 5) and extracts four iron-law metrics directly from the tool-bridge state: - brain_first_compliance: agent called search/get_page BEFORE producing its final answer. Non-compliance = hallucinating from general knowledge. - back_link_compliance: every dry_run_put_page intent has at least one markdown [Name](slug) back-link in its compiled_truth. - citation_format: timeline entries use canonical `- **YYYY-MM-DD** | Source — Summary`; long final answers cite at least one slug. - tier_escalation: simple probes use light tooling (≥1 brain call); complex probes require ≥2 brain calls or a dry_run write when expects_dry_run_write is set. No judge call required — everything is computable from `tool_bridge_state.made_dry_run_writes` + `count_by_tool` + final_answer regex. Fast, deterministic, reproducible. Bounded concurrency (p-limit style) worker pool at default 4 to keep Sonnet rate limits comfortable across 100-probe batches. **eval/runner/cat9-workflows.ts** — Rubric-graded Cat 9. 5 canonical workflows (meeting_ingestion, email_to_brain, daily_task_prep, briefing, sync) × ~10 scenarios each. Each scenario runs through the agent adapter, then judge.ts scores the answer against a per-scenario rubric. `buildEvidence(scenario, agentResult, pagesBySlug)` composes the JudgeEvidence contract: resolves ground_truth_slugs to full GroundTruthPage[] from a slug-map, pulls tool_call_summary directly from tool_bridge_state (no raw tool_result content — Section-3 defense), attaches rubric from the scenario. Per-workflow rollup: each workflow gets its own pass_rate so the verdict can fail one workflow without failing the whole Cat. Overall verdict requires every populated workflow's pass_rate ≥ threshold (default 0.80) when enableThreshold=true. Both Cats default to verdict=baseline_only in v1 per codex fix #9: real thresholds return after 10-probe Haiku-vs-hand-score calibration (κ > 0.7) runs against the Day 3b amara-life-v1 corpus. **Tests (23):** Cat 8 per-metric scorer unit tests covering every branch (brain_first ordering, back-link compliance on mixed writes, long vs short answer citation requirement, tier escalation for simple/complex/ writey probes, finalAnswerCiteCount dedups across syntaxes). Cat 9 buildEvidence contract shape — evidence_refs flow from agent, missing slugs skip gracefully, no raw_transcript/tool_result leakage to judge. Cat 9 runCat9 integration with stubbed agent + mixed-verdict judge produces fractional pass rates correctly. Total eval suite now: 273 pass, 0 fail. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 9 — sealed qrels via PublicPage + PublicQuery at adapter boundary Codex fixes #1, #2, #3 from the plan's outside-voice review. Enforcement shifts from SOFT-VIA-TYPE-COMMENT to SOFT-VIA-SANITIZED-OBJECT. Hard enforcement via process isolation waits for BrainBench v2 Docker sandbox. **eval/runner/types.ts** additions: - `PublicPage = Pick<Page, 'slug' | 'type' | 'title' | 'compiled_truth' | 'timeline'>` — the exact 5 fields adapters should see. No _facts. No frontmatter (a known hiding spot for accidental gold leaks). - `sanitizePage(p: Page): PublicPage` — returns a NEW object with the 5 fields only. Cannot be bypassed by `(page as any)._facts` because the field does not exist on the sanitized object. - `PublicQuery = Omit<Query, 'gold'>` — strips the gold field. - `sanitizeQuery(q: Query): PublicQuery` — enumerates public fields explicitly (not spread+delete) so no prototype weirdness leaves gold reachable. **eval/runner/multi-adapter.ts** — scoreOneRun now calls sanitizePage / sanitizeQuery before passing to adapter.init / adapter.query. The scorer retains the full Query shape (including gold.relevant) for precision / recall computation. Adapter signatures unchanged — the sealing is at the OBJECT level, not the type level. This keeps existing adapters (ripgrep-bm25, vector-only, hybrid-nograph, gbrain-after) binary-compatible. Verified: no existing adapter reads q.gold or page._facts, so the change is safe without further adapter updates. **test/eval/sealed-qrels.test.ts** (17 tests): - sanitizePage strips _facts + frontmatter + arbitrary hidden keys - Output has exactly the 5 public keys (deep introspection) - Proxy tripwire simulates a malicious adapter: any access to _facts or gold throws `sealed-qrels violation` - sanitizeQuery retains optional fields (as_of_date, tags, author, acceptable_variants, known_failure_modes) but omits undefined ones - Honest documentation of the seal's limits: filesystem bypass and Proxy attacks would still work in v1; Docker isolation (v2) is the real enforcement Every existing eval test still passes (273 before + 17 sealed-qrels = 290). Total eval suite now: 290 pass, 0 fail. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * feat(eval): Day 10 — all.ts rewrite + llm-budget + BrainBench N tiers Final wiring of BrainBench v1 Complete. all.ts now orchestrates the full Cat catalog (1-12) via a mix of subprocess dispatch (Cats 1, 2, 3, 4, 6, 7, 10, 11, 12 — standalone runners with CLI entry points) and programmatic invocation (Cats 5, 8, 9 — require runtime inputs that can't come via CLI flags). Subprocess Cats run concurrently under a p-limit(2) bound to cap peak memory around ~800MB (two PGLite instances at ~400MB each). Cats 5/8/9 show as "programmatic" in the report with a one-line reference to their `runCatN({...})` harness API. They're deliberately skipped from the master runner because their inputs (claim catalog, probe catalog, scenario catalog, pre-seeded agent state, evidence pagesBySlug) are task-specific and assembled at the caller. **eval/runner/all.ts** — rewritten: - CATEGORIES is a tagged union of SubprocessCategory | ProgrammaticCategory - runCatSubprocess spawns Bun with pipe'd stdout/stderr, 10-min timeout per Cat (124 exit + SIGTERM on timeout; no hung subprocesses) - runConcurrently is a bounded worker pool preserving input order - buildReport emits the full markdown with per-Cat elapsed times, migration-noise filter, and a separate programmatic-only section - Honors BRAINBENCH_N (1/5/10 for smoke/iteration/published), BRAINBENCH_CONCURRENCY (default 2), BRAINBENCH_LLM_CONCURRENCY (default 4, consumed by llm-budget) **eval/runner/llm-budget.ts** — shared LLM rate-limit semaphore. A full N=10 published scorecard makes ~900 Anthropic calls (150 Cat 8/9 probes × N=10 + 100 Cat 5 claims × N=10). Without coordination, concurrent adapters trigger 429s on per-minute limits. - LlmBudget class: acquireSlot/releaseSlot + withLlmSlot(fn) wrapper that releases on success AND throw (try/finally) - getDefaultLlmBudget() singleton reads BRAINBENCH_LLM_CONCURRENCY, falls back to 4 on missing/garbage values - capacity enforced ≥1 (rejects 0/negative) - Double-release is a no-op (guards against upstream double-call bugs) - Active + waiting counts exposed for observability / tests **package.json** scripts: - eval:brainbench — default N=5 iteration - eval:brainbench:smoke — N=1 for fast iteration - eval:brainbench:published — N=10 for committed baselines - eval:cat6 / eval:cat11 — individual new subprocess Cats **Tests (24):** CATEGORIES catalog enforces the exact Cat-number partition (subprocess: 1,2,3,4,6,7,10,11,12; programmatic: 5,8,9). runConcurrently respects the cap (observable via peak in-flight counter), preserves input order under non-uniform delays, handles empty input. LlmBudget enforces capacity, releases on throw, honors env var, rejects 0/negative. buildReport filters migration noise, counts passed/failed/programmatic correctly, includes every Cat + programmatic-only section. Full eval suite now: 314 pass, 0 fail (15 test files). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix(eval): drop top_p from amara-life-gen Opus params + gitignore _cache/ Two fixes surfaced during the Day 3b real-corpus run against Opus 4.5: **eval/generators/amara-life-gen.ts** — Current Opus rejects `temperature` and `top_p` together: ``` 400 invalid_request_error: `temperature` and `top_p` cannot both be specified for this model. Please use only one. ``` top_p=1.0 was a no-op (no nucleus truncation), so removing it has zero semantic effect. The field is still part of MODEL_PARAMS for the cache key so any past cache entries (none in v1) would invalidate cleanly on the next schema version bump. **.gitignore** — `eval/data/amara-life-v1/_cache/` is runtime Opus cache (398 files, ~1.6MB). Regenerable from seed; no point in source control. The corpus itself (inbox/slack/calendar/meetings/notes/docs + corpus-manifest.json with per-item content_sha256) stays committable for reproducibility, just the cache directory gets excluded. Real corpus generation ran cleanly after these two fixes: 398 LLM calls, 84,424 input / 38,062 output tokens, \$4.12 spent (vs \$20 cap, vs \$12 estimate). All 418 items produced. Poison fixtures use subtle paraphrased injection ("for anyone on your team who might be triaging this thread later…") — exactly the pattern that defeats regex redaction and requires the structured-evidence judge contract from Day 5. Corpus itself stays local (will move to the brainbench sibling repo during the v0.16 split per the design doc). No eval/data/amara-life-v1/ content landing in this PR. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * chore: bump version to 0.20.0 Renumbered from 0.17.0 per the gbrain-versioning slot. Other work is landing on master around this PR; 0.18 is the slot locked for this BrainBench v1 Complete release. Also pushed the "brainbench split" forward reference in the CHANGELOG from v0.18 → v0.19 to match. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * refactor: extract BrainBench to sibling gbrain-evals repo BrainBench lived in this repo through v0.17, which meant every gbrain install pulled down ~5MB of eval corpus, benchmark reports, and a pdf-parse devDep that the 99% of users who never run benchmarks don't need. v0.18 moves the full eval harness, 14 eval test files (314 tests), all docs/benchmarks scorecards, and the pdf-parse devDep to github.com/garrytan/gbrain-evals. That repo depends on gbrain via GitHub URL and consumes it through a new public exports map. What stays in gbrain: - Page.type enum extensions (email | slack | calendar-event | note | meeting) useful for any ingested format, not just evals - inferType() heuristics for /emails/, /slack/, /cal/, /notes/, /meetings/ - 11 new public exports covering the gbrain internals gbrain-evals consumes (gbrain/engine, gbrain/pglite-engine, gbrain/search/hybrid, etc.) — now gbrain's stable third-party contract What moved: - eval/ — 4.6MB of schemas, runners, adapters, generators, CLI tools - test/eval/ — 14 test files, 314 tests - docs/benchmarks/ — all scorecards and regression reports - eval:* package.json scripts - pdf-parse devDep Tests: 1760 pass, 0 fail, 174 skipped (E2E require DATABASE_URL). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * Merge origin/master into garrytan/gbrain-evals Master landed significant work since this branch was cut (v0.15.x → v0.16.x → v0.17.0 gbrain dream + runCycle → v0.18.0 multi-source brains → v0.18.1 RLS hardening). Bumped this branch's version from the claimed 0.18.0 to 0.19.0 because master already owns 0.18.x. Conflicts resolved: - VERSION: 0.19.0 (was 0.18.0 on HEAD vs 0.18.1 on master) - package.json: 0.19.0, kept all 11 eval-facing exports, merged master's typescript devDep + postinstall script + test script (typecheck added) - src/core/types.ts: union of both PageType additions. Master had added `meeting | note`; this branch added `email | slack | calendar-event` for inbox/chat/calendar ingest. Final enum carries all five. - CHANGELOG.md: renumbered the BrainBench-extraction entry to 0.19.0 and placed it above master's 0.18.1 RLS entry. Tweaked copy ("In v0.17 it lived inside this repo" → "Previously it lived inside this repo") to stop implying a specific version that never shipped. - CLAUDE.md: adjusted "BrainBench in a sibling repo" heading from (v0.18+) → (v0.19+). - docs/benchmarks/2026-04-18-minions-vs-openclaw-production.md: resolved modify-vs-delete conflict in favor of delete (the extraction). - scripts/llms-config.ts: dropped the docs/benchmarks/ entry (directory no longer exists here; lives in gbrain-evals). - llms.txt / llms-full.txt: regenerated after the config change. - bun.lock: accepted master's (master already dropped pdf-parse as a drive-by; aligned with our removal). Tests: 2094 pass, 236 skip, 18 fail. Spot-checked failures — build-llms, dream, orphans tests all pass in isolation. Failures reproduce only under full-suite parallel load and are pre-existing master flakiness (matches the graph-quality flake noted in the earlier summary). Not merge-introduced. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore: bump to v0.20.0 Master is now at v0.18.2 (migration hardening + RLS + multi-source brains). BrainBench extraction ships as v0.20.0 to leave v0.19 free for any in-flight work on other branches. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * ci: remove eval-tests workflow (moved to gbrain-evals) The Eval tests workflow ran `bun run eval:query:validate`, `test:eval`, and `eval:world:render` — all three scripts moved to the gbrain-evals repo when BrainBench was extracted in v0.20.0. The workflow has been failing on master since the split because the scripts no longer exist here. Eval CI now runs from gbrain-evals's own workflows. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * fix(tests): bump PGLite hook timeouts to 60s for parallel-load stability Six test files spin up PGLite + 20 migrations + git repos in beforeEach/ beforeAll hooks. Under 136-way parallel test file execution, bun's default 5s hook timeout wasn't enough, producing 18 flaky failures that only reproduced under full-suite parallel load (all 6 files passed in isolation). Root cause: PGLite.create() + initSchema() takes ~3-5s under idle load, but under 136 concurrent WASM instantiations the OS thrashes and hooks stall well past 5s. The bunfig.toml `timeout = 60_000` applies to TESTS, not HOOKS — bun requires per-hook timeouts as the third beforeEach/beforeAll argument. Files touched (hook timeouts added, no test logic changed): - test/dream.test.ts — 5 describe blocks × before/afterEach - test/orphans.test.ts — 1 beforeEach + afterEach - test/core/cycle.test.ts — shared beforeAll + afterAll - test/brain-allowlist.test.ts — beforeAll + afterAll - test/extract-db.test.ts — beforeAll + afterAll - test/multi-source-integration.test.ts — beforeAll + afterAll Results: 2317 pass / 0 fail (was 2253 pass / 18 fail). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * test: coverage for inferType() BrainBench corpus dirs Closes the 1 gap surfaced by Step 7 coverage audit. 9 table-driven assertions covering the new Page.type branches: emails/*.md, email/*.md -> 'email' slack/*.md -> 'slack' cal/*.md, calendar/*.md -> 'calendar-event' notes/*.md, note/*.md -> 'note' meetings/*.md, meeting/*.md -> 'meeting' The fixtures use realistic paths from the amara-life-v1 corpus in the sibling gbrain-evals repo (em-0001, sl-0037, evt-0042, mtg-0003) so the test doubles as a contract check between the two repos. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(TODOS): mark BrainBench Cats 5/6/8/9/11 + v0.10.5 inferLinkType as completed All five BrainBench categories shipped in v0.20.0 (to the gbrain-evals sibling repo). v0.10.5 inferLinkType regex expansion shipped in-tree. Remaining P1 BrainBench work: Cat 1+2 at full scale (2-3K pages) — currently 240 pages in world-v1 corpus. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs: sync CLAUDE.md + polish CHANGELOG voice for v0.20.0 CLAUDE.md: add v0.19 commands to key-files list (skillify, skillpack, routing-eval, filing-audit, skill-manifest, resolver-filenames); add 8 new test files + openclaw-reference-compat E2E to test index; repoint the release-summary template's benchmark source from `docs/benchmarks/[latest].md` to `gbrain-evals/docs/benchmarks/` since those files now live in the sibling repo. CHANGELOG voice polish for v0.20.0: replace em dashes with periods, parens, or ellipses per project style guide. No content changes. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs: regenerate llms-full.txt after CLAUDE.md + CHANGELOG edits (fixes CI) The v0.20.0 doc-sync commit (9e567bb) added 7 new v0.19 modules to the CLAUDE.md Key Files index and polished CHANGELOG voice. Both are includeInFull: true inputs to llms-full.txt but the generator wasn't re-run, so the drift-detection guard (test/build-llms.test.ts) failed CI. One-line fix: regenerate. No content changes beyond what the two source docs already carry. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-24 00:08:54 -07:00
parent 246cd8be46
commit 8b3c24c891
278 changed files with 447 additions and 8859 deletions
--- a/.github/PULL_REQUEST_TEMPLATE/tier5-queries.md
+++ b/.github/PULL_REQUEST_TEMPLATE/tier5-queries.md
@@ -0,0 +1,39 @@
 <!--
 Tier 5.5 Externally-Authored Query Submission template
 See eval/CONTRIBUTING.md for the full workflow.
 -->
 ## Summary
 Submitting **N** Tier 5.5 queries for BrainBench.
 - Author handle: `@your-handle`
 - File location: `eval/external-authors/your-handle/queries.json`
 - Queries authored fresh (not copy-pasted from a model output)
 - Slugs verified against `eval/data/world-v1/` (via `bun run eval:world:view`)
 ## Checklist
 - [ ] `bun run eval:query:validate eval/external-authors/your-handle/queries.json` passes
 - [ ] At least 20 queries
 - [ ] Each query has either `gold.relevant` (with real slugs) or `gold.expected_abstention: true`
 - [ ] Temporal queries have `as_of_date` set (`corpus-end` | `per-source` | ISO-8601)
 - [ ] Phrasing is varied (not all the same template)
 - [ ] `author` field matches my handle
 ## Phrasing variety (optional self-audit)
 Tick the styles represented in your batch:
 - [ ] Full sentence questions
 - [ ] Fragment-style ("crypto founder Goldman Sachs background")
 - [ ] Comparison ("X vs Y")
 - [ ] Follow-up ("And who else...")
 - [ ] Imperative ("Pull up Alice Davis")
 - [ ] Trait-based ("the demanding engineering leader")
 - [ ] Abstention bait (answer is "not in corpus")
 ## Notes to reviewer
 Anything worth flagging — ambiguous cases, corpus gaps you found, specific
 phrasings you were uncertain about.
--- a/.gitignore
+++ b/.gitignore
@@ -13,3 +13,7 @@ supabase/.temp/
 .claude/skills/
 .idea
 eval/reports/
 eval/data/world-v1/world.html
 # BrainBench amara-life-v1 Opus cache (regenerate via eval:generate-amara-life)
 eval/data/amara-life-v1/_cache/
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -2,6 +2,67 @@
 All notable changes to GBrain will be documented in this file.
 ## [0.20.0] - 2026-04-23
 ## **BrainBench moves out. gbrain gets its install surface back.**
 ## **The eval harness + 5MB fictional corpus now live in a sibling repo; gbrain exposes a clean public API they consume.**
 BrainBench is gbrain's benchmark harness. 10/12 Cats, 4-adapter scorecard, 418-item fictional corpus, 314 tests. Previously it lived inside this repo. Every `bun install` pulled down the eval tree, `docs/benchmarks/*.md` reports, `pdf-parse` devDep, and auxiliary test fixtures whether or not you ever ran a benchmark. For the 99% of gbrain users who want a knowledge-brain CLI, that's ~5MB of noise.
 v0.20 moves BrainBench to [github.com/garrytan/gbrain-evals](https://github.com/garrytan/gbrain-evals). gbrain stays the knowledge-brain CLI + library. `gbrain-evals` depends on gbrain via GitHub URL and consumes it through the public exports map. Same benchmarks, same scorecards, same Cat runners, same 418-item fictional amara-life corpus, just a separate install. Folks who don't care about evals never download them. Folks who do clone one extra repo.
 The clean separation also gives gbrain a first real public API surface. `package.json` adds 11 new subpath exports (`gbrain/engine`, `gbrain/pglite-engine`, `gbrain/search/hybrid`, `gbrain/link-extraction`, `gbrain/extract`, and so on) covering every gbrain internal the eval harness reaches into. Third-party tools (not just BrainBench) now have a stable contract to consume. Removing any of these exports is a breaking change going forward.
 ### What moved where
 | Stays in gbrain | Moves to gbrain-evals |
 |-----------------|----------------------|
 | `src/` (CLI, MCP, engines, operations, skills runtime) | `eval/` (runners, adapters, generators, schemas, gold, cli) |
 | `Page.type` enum including `email/slack/calendar-event/note/meeting` (useful for any ingested format, not just evals) | `test/eval/` (314 tests across 14 files) |
 | `inferType()` heuristics for the new directory patterns | `docs/benchmarks/*.md` (all scorecards + regression reports) |
 | Public exports map (11 new subpaths gbrain-evals consumes) | `pdf-parse` devDep (only eval/runner/loaders/pdf.ts used it) |
 | `src/core/` test suite (1696 tests) | `eval:*` scripts (run from gbrain-evals now) |
 ### What this means for you
 If you install gbrain via `git clone + bun install` or via npm/clawhub, you get a smaller, cleaner checkout. No eval corpus. No benchmark reports. No pdf-parse. `bun test` runs only gbrain's own test suite, not eval tests.
 If you want to run BrainBench: `git clone https://github.com/garrytan/gbrain-evals && cd gbrain-evals && bun install && bun run eval:run`. gbrain-evals fetches gbrain from GitHub via `"gbrain": "github:garrytan/gbrain#master"` so you always benchmark against the latest source.
 If you're a third-party library author importing gbrain internals: the new exports map is now your stable contract. Pin `gbrain/<subpath>` imports against a version, not a file path.
 ### Itemized changes
 **Extracted to [gbrain-evals](https://github.com/garrytan/gbrain-evals):**
 - `eval/` ... schemas, runners, adapters, generators, queries, CLI tools, docs (CONTRIBUTING, RUNBOOK, CREDITS).
 - `test/eval/` ... 14 test files, 314 tests covering schemas, sealed qrels, tool-bridge, agent adapter, judge, recorder, Cat 5/6/8/9/11, amara-life skeleton, adversarial-injections, pdf loader.
 - `docs/benchmarks/` ... all scorecards and regression reports (4-adapter, v0.11 vs v0.12, Minions production/lab, tweet ingestion, knowledge runtime v0.13, BrainBench v1).
 - `pdf-parse` devDep ... only consumed by `eval/runner/loaders/pdf.ts`.
 - `eval:*` package.json scripts ... now live in gbrain-evals's `package.json` and run from there.
 **Kept in gbrain (useful beyond evals):**
 - `Page.type` enum extensions in `src/core/types.ts`: `email | slack | calendar-event | note | meeting`. Any user ingesting an inbox dump, Slack export, iCal file, or meeting transcript benefits from first-class types.
 - `inferType()` heuristics in `src/core/markdown.ts` for `/emails/`, `/slack/`, `/cal/`, `/notes/`, `/meetings/` directory patterns.
 - 11 new public `exports` in `package.json`: `./pglite-engine`, `./link-extraction`, `./import-file`, `./transcription`, `./embedding`, `./config`, `./markdown`, `./backoff`, `./search/hybrid`, `./search/expansion`, `./extract`. These form gbrain's public-API contract for downstream consumers.
 **Docs synced:**
 - `README.md` ... benchmark references now point at the gbrain-evals repo.
 - `CLAUDE.md` ... BrainBench section replaced with a pointer to gbrain-evals + the list of public exports that consumers depend on.
 - `src/commands/migrations/v0_12_0.ts` ... migration banner text references `github.com/garrytan/gbrain-evals` instead of a local `docs/benchmarks/*.md` path that no longer resolves.
 **Tests:** 1717 gbrain tests pass, 0 failures, 174 skipped (E2E requiring `DATABASE_URL`). The full eval suite (314 tests) moves with `gbrain-evals` and runs from there.
 ### To take advantage of v0.20
 For gbrain users:
 1. `gbrain upgrade` ... no action required. The extraction is transparent.
 2. If you previously ran `bun run eval:*` scripts from this repo: those scripts no longer exist here. `git clone https://github.com/garrytan/gbrain-evals && bun install` to get them.
 For gbrain-evals consumers:
 1. Clone the sibling repo: `git clone https://github.com/garrytan/gbrain-evals`
 2. `bun install && bun run eval:run`
 3. Follow `gbrain-evals/eval/RUNBOOK.md` for full category runs and scorecard reproduction.
 ## [0.19.1] - 2026-04-24
 ### Added
--- a/CLAUDE.md
+++ b/CLAUDE.md
@@ -44,7 +44,14 @@ strict behavior when unset.
 - `src/core/embedding.ts` — OpenAI text-embedding-3-large, batch, retry, backoff
 - `src/core/check-resolvable.ts` — Resolver validation: reachability, MECE overlap, DRY checks, structured fix objects. v0.14.1: `CROSS_CUTTING_PATTERNS.conventions` is an array (notability gate accepts both `conventions/quality.md` and `_brain-filing-rules.md`). New `extractDelegationTargets()` parses `> **Convention:**`, `> **Filing rule:**`, and inline backtick references. DRY suppression is proximity-based via `DRY_PROXIMITY_LINES = 40`.
 - `src/core/repo-root.ts` — Shared `findRepoRoot(startDir?)` (v0.16.4): walks up from `startDir` (default `process.cwd()`) looking for `skills/RESOLVER.md`. Zero-dependency module imported by both `doctor.ts` and `check-resolvable.ts`. Parameterized `startDir` makes tests hermetic.
- `src/commands/check-resolvable.ts` — Standalone CLI wrapper (v0.16.4) over `checkResolvable()`. Exports `parseFlags`, `resolveSkillsDir`, `DEFERRED`, `runCheckResolvable`. Exit rule: **1 on any issue (warnings OR errors)**, stricter than doctor's `ok` flag — honors README:259. Stable JSON envelope `{ok, skillsDir, report, autoFix, deferred, error, message}` — same shape on success and error paths. `--fix` path runs `autoFixDryViolations` BEFORE `checkResolvable` (same ordering as doctor). `deferred[]` array surfaces pending Checks 5 (trigger routing eval) and 6 (brain filing) with issue URLs. `scripts/skillify-check.ts` subprocess-calls `gbrain check-resolvable --json` (cached per process) and fails loud on binary-missing — no silent false-pass.
+- `src/commands/check-resolvable.ts` — Standalone CLI wrapper (v0.16.4) over `checkResolvable()`. Exports `parseFlags`, `resolveSkillsDir`, `DEFERRED`, `runCheckResolvable`. Exit rule: **1 on any issue (warnings OR errors)**, stricter than doctor's `ok` flag — honors README:259. Stable JSON envelope `{ok, skillsDir, report, autoFix, deferred, error, message}` — same shape on success and error paths. `--fix` path runs `autoFixDryViolations` BEFORE `checkResolvable` (same ordering as doctor). `scripts/skillify-check.ts` subprocess-calls `gbrain check-resolvable --json` (cached per process) and fails loud on binary-missing — no silent false-pass. **v0.19:** AGENTS.md workspaces now resolve natively (see `src/core/resolver-filenames.ts`) — gbrain inspects the 107-skill OpenClaw deployment whether the routing file is `RESOLVER.md` or `AGENTS.md`. `DEFERRED[]` is empty — Checks 5 + 6 shipped as real code, not issue URLs.
 - `src/core/resolver-filenames.ts` (v0.19) — central list of accepted routing filenames (`RESOLVER.md`, `AGENTS.md`). Shared by `findRepoRoot`, `check-resolvable`, and skillpack install so every code path walks the same fallback chain.
 - `src/commands/skillify.ts` + `src/core/skillify/{generator,templates}.ts` (v0.19) — `gbrain skillify scaffold <name>` creates all stubs for a new skill in one command: SKILL.md, script, tests, routing-eval.jsonl, resolver entry, filing-rules pointer. `gbrain skillify check <script>` runs the 10-step checklist (LLM evals, routing evals, check-resolvable gate, filing audit) against a candidate skill before it lands.
 - `src/commands/skillify-check.ts` (v0.19) — `gbrain skillpack-check` agent-readable health report. Exit 0/1/2 for CI pipeline gating; JSON for debugging. Wraps `check-resolvable --json`, `doctor --json`, and migration ledger into one payload so agents can decide whether a human action is required.
 - `src/commands/skillpack.ts` + `src/core/skillpack/{bundle,installer}.ts` (v0.19) — `gbrain skillpack install` drops gbrain's curated 25-skill bundle into a host workspace, managed-block style. Never clobbers local edits; tracks a skill manifest so subsequent `install --update` diffs cleanly. Bundle builder (`skillpack/bundle.ts`) packages the set from `skills/` into a versioned payload.
 - `src/core/skill-manifest.ts` (v0.19) — parser for `skill-manifest.json` records. Used by skillpack installer to detect drift between the shipped bundle and the user's local edits, so updates merge instead of overwriting.
 - `src/commands/routing-eval.ts` + `src/core/routing-eval.ts` (v0.19) — `gbrain routing-eval` catches user phrasings that route to the wrong skill. Reads `skills/<name>/routing-eval.jsonl` fixtures (`{intent, expected_skill, ambiguous_with?}`). Structural layer runs in `check-resolvable` by default (zero API cost); `--llm` opts into a Haiku tie-break layer for CI. False positives surface before users hit them.
 - `src/core/filing-audit.ts` + `skills/_brain-filing-rules.json` (v0.19) — Check 6 of `check-resolvable`. Parses new `writes_pages:` / `writes_to:` frontmatter on skills and audits their filing claims against the filing-rules JSON. Warning-only in v0.19, upgrades to error in v0.20.
 - `src/core/dry-fix.ts` — `gbrain doctor --fix` engine. `autoFixDryViolations(fixes, {dryRun})` rewrites inlined rules to `> **Convention:** see [path](path).` callouts via three shape-aware expanders (bullet / blockquote / paragraph). Five guards: working-tree-dirty (`getWorkingTreeStatus()` returns 3-state `'clean' | 'dirty' | 'not_a_repo'`), no-git-backup, inside-code-fence, already-delegated (40-line proximity, consistent with detector), ambiguous-multi-match, block-is-callout. `execFileSync` array args (no shell — no injection surface). EOF newline preserved.
 - `src/core/backoff.ts` — Adaptive load-aware throttling: CPU/memory checks, exponential backoff, active hours multiplier
 - `src/core/fail-improve.ts` — Deterministic-first, LLM-fallback loop with JSONL failure logging and auto-test generation
@@ -113,7 +120,7 @@ strict behavior when unset.
 - `docs/guides/diligence-ingestion.md` — Data room to brain pages pipeline
 - `docs/designs/HOMEBREW_FOR_PERSONAL_AI.md` — 10-star vision for integration system
 - `docs/mcp/` — Per-client setup guides (Claude Desktop, Code, Cowork, Perplexity)
- `docs/benchmarks/` — Search quality benchmark results (reproducible, fictional data)
+- BrainBench (benchmark suite + corpus): lives in the separate [gbrain-evals](https://github.com/garrytan/gbrain-evals) repo. Not installed alongside gbrain.
 - `skills/_brain-filing-rules.md` — Cross-cutting brain filing rules (referenced by all brain-writing skills)
 - `skills/RESOLVER.md` — Skill routing table (based on the agent-fork AGENTS.md pattern)
 - `skills/conventions/` — Cross-cutting rules (quality, brain-first, model-routing, test-before-bulk, cross-modal)
@@ -144,6 +151,21 @@ strict behavior when unset.
 - `src/commands/report.ts` — Structured report saver (audit trail for maintenance/enrichment)
 - `openclaw.plugin.json` — ClawHub bundle plugin manifest
 ### BrainBench — in a sibling repo (v0.20+)
 BrainBench — the public benchmark for personal-knowledge agent stacks — lives in
 [github.com/garrytan/gbrain-evals](https://github.com/garrytan/gbrain-evals). It
 depends on gbrain as a consumer; gbrain never pulls in the ~5MB eval corpus or
 the pdf-parse dev dep at install time.
 gbrain's public API surface (the exports map in `package.json`) is what
 gbrain-evals consumes: `gbrain/engine`, `gbrain/types`, `gbrain/operations`,
 `gbrain/pglite-engine`, `gbrain/link-extraction`, `gbrain/import-file`,
 `gbrain/transcription`, `gbrain/embedding`, `gbrain/config`, `gbrain/markdown`,
 `gbrain/backoff`, `gbrain/search/hybrid`, `gbrain/search/expansion`,
 `gbrain/extract`. Removing any of these is a breaking change for the
 gbrain-evals consumer.
 ## Commands
 Run `gbrain --help` or `gbrain --tools-json` for full command reference.
@@ -236,7 +258,15 @@ parity), `test/cli.test.ts` (CLI structure), `test/config.test.ts` (config redac
 `test/sync.test.ts` (sync logic + v0.12.3 regression guard asserting top-level `engine.transaction` is not called),
 `test/doctor.test.ts` (doctor command + v0.12.3 assertions that `jsonb_integrity` scans the four v0.12.0 write sites and `markdown_body_completeness` is present),
 `test/utils.test.ts` (shared SQL utilities + `tryParseEmbedding` null-return and single-warn semantics),
-`test/build-llms.test.ts` (llms.txt/llms-full.txt generator: path resolution, idempotence, spec shape, regen-drift guard, content contract, AGENTS.md install-path mirror, size-budget enforcement — 7 cases).
+`test/build-llms.test.ts` (llms.txt/llms-full.txt generator: path resolution, idempotence, spec shape, regen-drift guard, content contract, AGENTS.md install-path mirror, size-budget enforcement — 7 cases),
 `test/check-resolvable-cli.test.ts` (v0.19 CLI wrapper: exit codes, JSON envelope shape, AGENTS.md fallback chain),
 `test/regression-v0_16_4.test.ts` (findRepoRoot regression guard — hermetic startDir parameterization),
 `test/filing-audit.test.ts` (v0.19 Check 6: `writes_pages` / `writes_to` frontmatter, filing-rules JSON validation),
 `test/routing-eval.test.ts` (v0.19 Check 5: fixture parsing, structural routing, ambiguous_with, Haiku tie-break layer),
 `test/skill-manifest.test.ts` (v0.19 skill manifest parser: drift detection, managed-block markers),
 `test/skillify-scaffold.test.ts` (v0.19 `gbrain skillify scaffold` stubs: SKILL.md, script, tests, routing-eval fixtures),
 `test/skillpack-install.test.ts` (v0.19 `gbrain skillpack install` managed-block install / update / no-clobber semantics),
 `test/skillpack-sync-guard.test.ts` (v0.19 sync-guard: bundled skills stay byte-identical to `skills/` source).
 E2E tests (`test/e2e/`): Run against real Postgres+pgvector. Require `DATABASE_URL`.
 - `bun run test:e2e` runs Tier 1 (mechanical, all operations, no API keys). Includes 9 dedicated cases for the postgres-engine `addLinksBatch` / `addTimelineEntriesBatch` bind path — postgres-js's `unnest()` binding is structurally different from PGLite's and gets its own coverage.
@@ -245,6 +275,7 @@ E2E tests (`test/e2e/`): Run against real Postgres+pgvector. Require `DATABASE_U
 - `test/e2e/postgres-jsonb.test.ts` — v0.12.2 regression test. Round-trips all 5 JSONB write sites (pages.frontmatter, raw_data.data, ingest_log.pages_updated, files.metadata, page_versions.frontmatter) against real Postgres and asserts `jsonb_typeof='object'` plus `->>'key'` returns the expected scalar. The test that should have caught the original double-encode bug.
 - `test/e2e/jsonb-roundtrip.test.ts` — v0.12.3 companion regression against the 4 doctor-scanned JSONB sites. Assertion-level overlap with `postgres-jsonb.test.ts` is intentional defense-in-depth: if doctor's scan surface ever drifts from the actual write surface, one of these tests catches it.
 - `test/e2e/upgrade.test.ts` runs check-update E2E against real GitHub API (network required)
 - `test/e2e/openclaw-reference-compat.test.ts` (v0.19) — exercises `check-resolvable` + `skillpack install` against a minimal AGENTS.md workspace fixture (`test/fixtures/openclaw-reference-minimal/`), regression guard for the 107-skill OpenClaw deployment shape
 - Tier 2 (`skills.test.ts`) requires OpenClaw + API keys, runs nightly in CI
 - If `.env.testing` doesn't exist in this directory, check sibling worktrees for one:
  `find ../  -maxdepth 2 -name .env.testing -print -quit` and copy it here if found.
@@ -465,7 +496,7 @@ Voice rules:
 Source material to pull from:
 - CHANGELOG.md previous entry for prior context
- `docs/benchmarks/[latest].md` for the headline numbers
+- Latest `gbrain-evals/docs/benchmarks/[latest].md` for headline numbers (sibling repo)
 - Recent commits (`git log <prev-version>..HEAD --oneline`) for what shipped
 - Don't make up numbers. If a metric isn't in a benchmark or production data, don't
  include it. Say "no measurement yet" if asked.
--- a/README.md
+++ b/README.md
@@ -4,7 +4,7 @@ Your AI agent is smart but forgetful. GBrain gives it a brain.
 Built by the President and CEO of Y Combinator to run his actual AI agents. The production brain powering his OpenClaw and Hermes deployments: **17,888 pages, 4,383 people, 723 companies**, 21 cron jobs running autonomously, built in 12 days. The agent ingests meetings, emails, tweets, voice calls, and original ideas while you sleep. It enriches every person and company it encounters. It fixes its own citations and consolidates memory overnight. You wake up and the brain is smarter than when you went to bed.
-The brain wires itself. Every page write extracts entity references and creates typed links (`attended`, `works_at`, `invested_in`, `founded`, `advises`) with zero LLM calls. Hybrid search. Self-wiring knowledge graph. Structured timeline. Backlink-boosted ranking. Ask "who works at Acme AI?" or "what did Bob invest in this quarter?" and get answers vector search alone can't reach. Benchmarked end-to-end: **Recall@5 jumps from 83% to 95%, Precision@5 from 39% to 45%, +30 more correct answers in the agent's top-5 reads** on a 240-page Opus-generated rich-prose corpus. Graph-only F1: **86.6% vs grep's 57.8%** (+28.8 pts). [Full report](docs/benchmarks/2026-04-18-brainbench-v1.md).
+The brain wires itself. Every page write extracts entity references and creates typed links (`attended`, `works_at`, `invested_in`, `founded`, `advises`) with zero LLM calls. Hybrid search. Self-wiring knowledge graph. Structured timeline. Backlink-boosted ranking. Ask "who works at Acme AI?" or "what did Bob invest in this quarter?" and get answers vector search alone can't reach. Benchmarked side-by-side against the category: gbrain lands **P@5 49.1%, R@5 97.9%** on a 240-page Opus-generated rich-prose corpus, beating its own graph-disabled variant by **+31.4 points P@5** and ripgrep-BM25 + vector-only RAG by a similar margin. The graph layer plus v0.12 extract quality together carry the gap. Full BrainBench scorecards + corpus live in the sibling [gbrain-evals](https://github.com/garrytan/gbrain-evals) repo.
 GBrain is those patterns, generalized. 28 skills. Install in 30 minutes. Your agent does the work. As Garry's personal agent gets smarter, so does yours.
@@ -194,7 +194,7 @@ Here's my personal OpenClaw deployment: one Render container. Supabase Postgres
 Under that 19-cron load, sub-agent spawn couldn't clear the 10-second gateway wall. Minions landed it in under a second for zero tokens. **Scaling:** 19,240 posts across 36 months, single bash loop, ~15 min total, $0.00. Sub-agents: ~9 min best case, ~$1.08 in tokens, ~40% spawn failure. **Lab:** durability ∞ (SIGKILL mid-flight, 10/10 rescued), throughput ~10× faster, fan-out ~21× with no failure wall, memory ~400× less.
-Full benchmarks: [production](docs/benchmarks/2026-04-18-minions-vs-openclaw-production.md) and [lab](docs/benchmarks/2026-04-18-minions-vs-openclaw-subagents.md).
+Full benchmarks live in [gbrain-evals](https://github.com/garrytan/gbrain-evals/tree/main/docs/benchmarks).
 ### The routing rule
@@ -438,7 +438,7 @@ gbrain extract links --source db        # wire up the existing 29K pages
 gbrain extract timeline --source db     # extract dated events from markdown timelines
 ```
-Then ask graph questions or watch the search ranking improve. Benchmarked: **Recall@5 jumps from 83% to 95%, Precision@5 from 39% to 45%, +30 more correct answers in the agent's top-5 reads** on a 240-page Opus-generated rich-prose corpus. Graph-only F1 hits 86.6% vs grep's 57.8% (+28.8 pts). See [docs/benchmarks/2026-04-18-brainbench-v1.md](docs/benchmarks/2026-04-18-brainbench-v1.md).
+Then ask graph questions or watch the search ranking improve. Benchmarked side-by-side against ripgrep-BM25, vector-only RAG (same embedder), and gbrain-with-graph-disabled: gbrain lands **P@5 49.1%, R@5 97.9%** on a 240-page Opus-generated rich-prose corpus, beating hybrid-nograph by **+31.4 points P@5**. Isolate the contribution: v0.11→v0.12 moved the same gbrain codebase from P@5 22.1% → 49.1% on identical inputs, so typed-link extract quality is load-bearing. Full scorecards + reproducible corpus: [gbrain-evals](https://github.com/garrytan/gbrain-evals).
 ## Search
@@ -514,7 +514,7 @@ End-to-end on the BrainBench v1 corpus (240 rich-prose pages, before/after PR #1
 Plus 5 orthogonal capability checks (identity resolution, temporal queries,
 performance at 10K-page scale, robustness to malformed input, MCP operation
-contract). All pass. [Full report.](docs/benchmarks/2026-04-18-brainbench-v1.md)
+contract). All pass. Full report: [gbrain-evals](https://github.com/garrytan/gbrain-evals).
 The point: each technique handles a class of inputs the others miss. Vector
 search misses exact slug refs; keyword catches them. Keyword misses conceptual
@@ -676,7 +676,7 @@ The skills in this repo are those patterns, generalized. What took 11 days to bu
 - [CHANGELOG.md](CHANGELOG.md) ... Version history
 **Benchmarks:**
- [BrainBench v1 (PR #188)](docs/benchmarks/2026-04-18-brainbench-v1.md) ... single comprehensive before/after report on a 240-page Opus-generated corpus. 7 categories: relational queries, identity resolution, temporal queries, performance, robustness, MCP contract.
+- [gbrain-evals](https://github.com/garrytan/gbrain-evals) ... BrainBench, the sibling repo that holds the eval harness, corpus, scorecards, and 4-adapter comparisons. Depends on gbrain; not installed alongside gbrain.
 ## Contributing
--- a/TODOS.md
+++ b/TODOS.md
@@ -11,44 +11,45 @@ Both checks shipped as real implementations, not just filed issues:
 `DEFERRED[]` in `src/commands/check-resolvable.ts` is now empty — v0.19 shipped both deferred checks as working code paths, not as issue URLs. The export stays in place for future deferred checks.
-## P1 (BrainBench v1.1 — categories deferred from PR #188)
+### ~~BrainBench Cats 5/6/8/9/11 — shipped to sibling repo~~
 **Completed:** v0.20.0 (2026-04-23)
-### BrainBench Cat 5: Source Attribution / Provenance
+All five previously-deferred BrainBench categories shipped as working runners
-**What:** Eval that gbrain correctly cites the right page when claiming fact F, and resolves source-conflict cases (3 sources disagree on $5M raise — which wins?). 200 queries across citation/provenance/conflict sub-categories on a 300-entity dataset with deliberately-conflicting sources.
+in the sibling repo [github.com/garrytan/gbrain-evals](https://github.com/garrytan/gbrain-evals):
-**Why deferred from PR #188:** Needs ~$100-200 of Opus tokens to generate the conflict-graph dataset. v1 scope was procedural-only.
+- **Cat 5 Provenance** — `eval/runner/cat5-provenance.ts` with dedicated `classify_claim` tool (3-way label: `supported | unsupported | over-generalized`)
 - **Cat 6 Prose-scale auto-link precision** — `eval/runner/cat6-prose-scale.ts` (baseline-only) + `eval/runner/adversarial-injections.ts` (6 injection kinds)
 - **Cat 8 Skill Compliance** — `eval/runner/cat8-skill-compliance.ts` (brain-first / back-link / citation-format / tier-escalation, deterministic from tool-bridge trace)
 - **Cat 9 End-to-End Workflows** — `eval/runner/cat9-workflows.ts` (rubric-graded)
 - **Cat 11 Multi-modal Ingestion** — `eval/runner/cat11-multimodal.ts` (PDF/audio/HTML)
-**Threshold:** citation_recall > 90%, citation_precision > 85%, conflict_resolution > 70%.
+Plus supporting infrastructure: agent adapter (Sonnet + 12 read + 3 dry_run tools),
 structured-evidence Haiku judge contract, PublicPage/PublicQuery sealed qrels,
 6-artifact flight-recorder, 6 portable JSON schemas for v1→v2 driver swap.
-**Depends on:** Identity Resolution (Cat 3) shipped — uses same world generator pattern.
+Scope pivot: originally planned for in-tree v1.1 delta; mid-PR pivoted to extract
 the entire eval harness so gbrain users don't download the ~5MB corpus at install
 time. BrainBench is now a public sibling benchmark; gbrain ships clean.
-### BrainBench Cat 6: Auto-link Precision under Prose (at scale)
+### ~~v0.10.5: inferLinkType residuals (works_at, advises)~~
-**What:** Cat 10 (Robustness/Adversarial) covered code-fence leak and false-positive substrings on 22 hand-crafted cases. v1.1 extends this to 500+ prose-heavy pages with realistic narrative noise. Tests link precision in the wild, not just edge cases.
+**Completed:** v0.20.0 (2026-04-23)
-**Why deferred from PR #188:** Needs prose-heavy generated corpus (~$100-150 Opus). Existing 22-case eval already caught + fixed the code-fence leak bug.
+`src/core/link-extraction.ts` — WORKS_AT_RE and ADVISES_RE expanded with
 rank-prefixed engineer patterns ("senior/staff/principal/lead engineer at"),
 discipline-prefixed ("backend/frontend/ML/security engineer at"), broader role
 verbs ("manages engineering at", "running product at", "heads up X at"),
 possessive time ("his/her/their time at"), role-noun forms ("tenure as",
 "stint as", "role at"), advisory capacity phrasings, "as an advisor" forms,
 and qualifier-specific advisors. New EMPLOYEE_ROLE_RE prior fires for
 self-identified employees at the page level, biasing outbound company refs
 toward works_at when per-edge verbs are absent. Precedence: investor > advisor
 > employee. Existing tests in `test/link-extraction.test.ts` cover the new
 patterns.
-**Threshold:** link_precision > 95% on prose, type_accuracy > 80% on varied phrasing.
+## P1 (BrainBench v1.1 — remaining categories)
-### BrainBench Cat 8: Skill Behavior Compliance
+Cats 5/6/8/9/11 shipped to the sibling repo in v0.20.0 — see the Completed
-**What:** Replays 100 inbound signals through a real LLM agent loop with gbrain skills loaded. Measures: brain-first lookup compliance, back-link iron-law adherence, citation format compliance, tier escalation correctness.
+section above. One remaining scope item:
 **Why deferred:** Needs real LLM API loop (~$2K total — most expensive single category).
 **Threshold:** brain_first_compliance > 95%, back_link_compliance > 90%, citation_format > 95%.
 ### BrainBench Cat 9: End-to-End Workflows
 **What:** 50 end-to-end scenarios across meeting ingestion, email-to-brain, daily-task-prep, briefing generation, sync cycle. Rubric-graded (10-15 criteria each).
 **Why deferred:** Needs LLM agent loop (~$1K). Plus 50 hand-built rubrics.
 **Threshold:** 80% scenario pass rate per workflow.
 ### BrainBench Cat 11: Multi-modal Ingestion
 **What:** PDF/image/audio/video ingestion accuracy. 50 PDFs, 30 images, 20 audio files, 10 videos, 30 HTML pages. Per-modality recall and fidelity metrics.
 **Why deferred:** Needs licensed real datasets (Common Voice for audio etc.). Dataset curation is the bulk of the work.
 **Threshold:** PDF text fidelity > 95% (text-based) / > 80% (scanned), audio WER < 15%, entity_recall > 80% post-ingestion.
 ### BrainBench Cat 1+2 at full scale
 **What:** Existing benchmark-search-quality.ts (29 pages, 20 queries) and benchmark-graph-quality.ts (80 pages, 5 queries) currently pass at small scale. v1.1 extends both to 2-3K rich-prose pages generated via Opus to surface scale-dependent failures (tied keyword clusters, hub-node fan-out, prose-noise extraction precision).
@@ -68,24 +69,6 @@ company refs only). Per-type after fix: invested_in 91.7% (was 0%),
 mentions 100%, attended 100%. works_at 58% and advises 41% are next
 iteration's residuals.
 ### v0.10.5: inferLinkType residuals (works_at, advises)
 **What:** After the v0.10.4 fix, two link types still under-perform on rich
 prose. Drive these to >85% type accuracy in next iteration.
 **works_at: 58% type accuracy.** Engineer/employee pages use varied phrasings
 the regex doesn't catch ("spent some time at", "joined the team", narrative
 "is currently at" without a verb). Approach: extend WORKS_AT_RE; consider
 employee-role page prior similar to partner prior.
 **advises: 41% type accuracy.** Advisor pages often describe board roles
 without using the word "advisor" explicitly ("on Beta Health's board",
 "joined Beta as a board member"). The v0.10.4 fix tightened ADVISES_RE to
 require "advisor" rooting to avoid false positives from investors. Need
 a tighter signal that distinguishes "advisor on board" from "investor on
 board" — likely an advisor-role page prior plus verb-pattern combinations.
 **Threshold:** Cat 2 rich-prose type accuracy > 92% (currently 88.5%).
 ### v0.10.4: gbrain alias resolution feature (driven by Cat 3)
 **What:** Add an alias table to gbrain so "Sarah Chen" / "S. Chen" / "@schen" / "sarah.chen@example.com" resolve to one canonical entity. Schema: `aliases (id, slug, alias_text)` with a unique index. Search blends alias matches into hybrid scoring.
--- a/2
+++ b/2
@@ -1 +1 @@
-0.19.1
+0.20.0
--- a/docs/benchmarks/2026-04-18-brainbench-v1.md
+++ b/docs/benchmarks/2026-04-18-brainbench-v1.md
@@ -1,286 +0,0 @@
 # BrainBench v1 — 2026-04-18
 **Branch:** `garrytan/link-timeline-extract`
 **PR:** #188
 **Engine:** PGLite (in-memory)
 **Reproducibility:** `bun run eval/runner/all.ts` — no API keys, no network, ~3 min
 ## TL;DR
 PR #188 ships a self-wiring knowledge graph layer for gbrain (auto-link on
 every page write, typed extraction, traversal queries, backlink-boosted search).
 This benchmark measures the actual end-to-end value vs gbrain pre-PR-#188 on a
 240-page rich-prose corpus generated by Claude Opus.
 **Every headline metric goes UP. No category goes down.**
 | Metric              | BEFORE PR #188 | AFTER PR #188 | Δ            |
 |---------------------|----------------|---------------|--------------|
 | **Precision@5**     | 39.2%          | **44.7%**     | **+5.4 pts** |
 | **Recall@5**        | 83.1%          | **94.6%**     | **+11.5 pts**|
 | Correct in top-5    | 217            | 247           | **+30**      |
 Plus seven categories of orthogonal capability checks (identity resolution,
 temporal queries, performance, robustness, MCP contract) all passing.
 ## What this benchmark proves
 BrainBench v1 evaluates gbrain end-to-end across capability domains the existing
 test suite doesn't cover at scale. Headline is a single before/after comparison:
 **pre-PR-#188 (no graph layer)** vs **the full v0.10.3 + v0.10.4 stack**, run on
 the same 240-page corpus with the same relational queries.
 Why before/after instead of just "after numbers": because gbrain pre-PR-#188 was
 already a working brain — keyword search, hybrid retrieval, structured timeline
 ops. The graph layer is an additive change. The right question is "did it
 actually make the brain better at relational questions?" not "is it good in
 isolation."
 ## The corpus
 240 rich-prose pages generated by Claude Opus 4.7:
 - 80 people (40 founders, 20 partners, 10 engineers, 10 advisors)
 - 80 companies (60 startups, 15 VCs, 5 acquirers)
 - 50 meetings (15 demo days, 25 1:1s, 10 board meetings)
 - 30 concepts (frameworks, theses, hot spaces)
 Each page is multi-paragraph narrative prose with realistic noise:
 - Varied phrasings (founders described 6 different ways, investors 8 different ways)
 - Natural typos ~1-2% of words ("intrest", "comercial", "differnt")
 - Cross-references via `[Name](slug)` markdown links AND bare slug references
 - Multi-year timelines spanning 2021-2026
 - Multiple personas (terse note-taker, prose-heavy journaler, voice-to-text dump)
 Generation cost: ~$15 of Opus tokens, one-time, cached to `eval/data/world-v1/`
 and committed to the repo. Subsequent runs read the cache.
 This is intentionally messier than templated benchmarks. The point is to surface
 behavior under realistic load, not to confirm the algorithm works on clean inputs.
 ## Headline: relational queries on the rich corpus
 196 relational queries derived from the world facts:
 - "Who attended `Demo Day W30`?" (60 queries)
 - "Who works at `Acme`?" (60 queries)
 - "Who invested in `Beta Health`?" (45 queries)
 - "Who advises `Cipher Labs`?" (31 queries)
 Configurations compared:
 - **BEFORE PR #188:** vanilla v0.10.0 — no auto-link, no `extract --source db`,
  no `traversePaths`. Agent answers relational questions by grepping the corpus
  (the realistic fallback for a pre-graph brain).
 - **AFTER PR #188:** full graph layer. Agent uses `gbrain graph-query` first
  (high-precision typed traversal), grep fallback when graph returns nothing.
 ### Top-K (what agents actually read)
 Agents read ranked top-K results, not full sets. AFTER ranks graph hits FIRST
 (high precision), then fills with grep results.
 | Metric              | BEFORE | AFTER  | Δ             |
 |---------------------|--------|--------|---------------|
 | **Precision@5**     | 39.2%  | 44.7%  | **+5.4 pts**  |
 | **Recall@5**        | 83.1%  | 94.6%  | **+11.5 pts** |
 | Correct in top-5    | 217    | 247    | **+30**       |
 Recall@5 jumps 11.5 points because graph hits are exact-typed answers placed
 at the top of results — agents find what they need in their first reads
 instead of digging through grep noise.
 ### Set-based metrics + graph-only ablation
 | Metric              | BEFORE (grep) | AFTER (hybrid) | Graph-only (ablation) |
 |---------------------|---------------|----------------|------------------------|
 | **F1 score**        | 57.8%         | 57.8%          | **86.6%**              |
 | Set precision       | 40.8%         | 40.8%          | **81.0%**              |
 | Set recall          | 98.9%         | 98.9%          | 93.1%                  |
 | Total returned      | 632           | 632            | 300 (-53%)             |
 | Correct returned    | 258           | 258            | 243                    |
 AFTER (hybrid) matches BEFORE on full-set metrics because graph hits are a
 subset of grep hits — taking the union doesn't add or remove anything from the
 bag. **What changes is which results appear FIRST.** Top-K captures that;
 raw set recall doesn't.
 The **graph-only** column is the most important number in the report. It shows
 where the graph alone is heading: **86.6% F1 vs grep's 57.8% (+28.8 pts)**.
 Almost twice the precision (81% vs 41%) at 94% of the recall, with HALF the
 results to read.
 ### Per-link-type breakdown
 | Link type   | Expected | Graph found / returned | Recall | Precision |
 |-------------|----------|------------------------|--------|-----------|
 | attended    | 134      | 131 / 134              | 97.8%  | 97.8%     |
 | works_at    | 50       | 50 / 79                | 100.0% | 63.3%     |
 | invested_in | 60       | 50 / 56                | 83.3%  | 89.3%     |
 | advises     | 17       | 12 / 31                | 70.6%  | 38.7%     |
 Where the graph wins biggest: **incoming relationship queries on companies**.
 "Who works at Acme?" — grep returns every page mentioning Acme (founders,
 investors, advisors, concept pages, other companies that mention it). Graph
 returns just employees with the typed `works_at` link.
 ## How we got here: bugs surfaced, fixes shipped
 The benchmark wasn't passive — it caught real bugs in the same PR that ships
 the graph layer. Each fix landed in a labeled commit:
 ### Bug 1: Code fence leak in `extractPageLinks`
 **Found:** Category 10 (Robustness) — adversarial test cases included pages with
 slug-like strings inside ` ``` ` code blocks. Extraction was treating them as
 real entity references.
 **Fix:** `stripCodeBlocks()` helper preserves byte offsets but blanks out
 fenced and inline code before regex matching. Code fence leak rate now 0%.
 ### Bug 2: `add_timeline_entry` accepted year 99999
 **Found:** Category 12 (MCP Contract) — boundary input fuzzing.
 **Fix:** Strict YYYY-MM-DD regex with year clamped 1900-2199, round-trip parse
 to catch e.g. Feb 30. Rejects with clear error message.
 ### Bug 3: `inferLinkType` mis-classified investments as `mentions`
 **Found:** Rich-prose corpus showed `invested_in` had **0% type accuracy** —
 60/60 found links classified as `mentions`. Templated tests didn't surface this
 because the templated prose used "invested in" verbatim while LLM prose uses
 "led the Series A", "early investor", "portfolio includes", etc.
 **Fix:** Five-part patch:
 1. `INVESTED_RE` extended with narrative verbs LLMs actually use
 2. `ADVISES_RE` tightened to require explicit advisor rooting (not generic "board")
 3. Context window 80→240 chars (catches verbs at sentence distance)
 4. Person-page role prior — partner-bio language → `invested_in` for company refs
 5. Cascade reorder — `invested_in` checked before `advises`
 Type accuracy: **70.7% → 88.5% (+18 pts)**. invested_in: **0% → 91.7%**.
 ### Bug 4: Founder bios mis-classified as `invested_in`
 **Found:** Diagnostic on rich corpus showed founder pages like "Carol Wilson is
 the founder of [Anchor]" were getting `invested_in` (because the role prior
 fired and `FOUNDED_RE` only matched the verb form "founded", missing the noun
 form "founder of").
 **Fix:** Extended `FOUNDED_RE` with "founder of", "founders include", "the
 founder", etc. Carol's link now correctly types as `founded`. Combined with
 relaxing the "who works at X?" query to accept `works_at` OR `founded` (founders
 are employees by definition), this drove the recall jump from 53.8% → 93.1%.
 ## Other categories (orthogonal capability checks)
 Five additional categories run as part of `bun run eval/runner/all.ts`. All pass.
 ### Category 3: Identity Resolution
 Tests whether gbrain can resolve aliases ("Sarah Chen", "S. Chen", "@schen",
 "sarah.chen@example.com") to one canonical entity. 100 entities × 8 alias types
 = 800 queries.
 | Alias category | Recall (top-10) |
 |----------------|-----------------|
 | Documented (in canonical body)     | 100.0% |
 | Undocumented (initials, typos)     | 31.0%  |
 Honest baseline: gbrain has no alias table today. Documented aliases work via
 keyword search. Undocumented aliases need v0.10.4 alias-table feature
 (documented in TODOS.md).
 ### Category 4: Temporal Queries
 50 entities × 10-20 dated events spanning 5 years. Tests point queries, range
 queries, recency, and as-of queries.
 | Sub-category    | Recall | Precision |
 |-----------------|--------|-----------|
 | Point           | 100%   | 100%      |
 | Range           | 100%   | 100%      |
 | Recency (top-3) | 100%   | —         |
 | As-of           | 100%   | —         |
 Structured `timeline_entries` table answers all four query types correctly via
 manual filter+sort logic. Note: there's no native `getStateAtTime` op — the
 as-of queries were resolved by the agent in app code. Native op deferred to v0.10.5.
 ### Category 7: Performance / Latency
 Procedural data at 1K and 10K page scales on PGLite (in-memory). All read ops
 sub-millisecond. Bulk import at 5,800 pages/sec.
 | Op                 | 1K P50  | 1K P95  | 10K P50 | 10K P95  |
 |--------------------|---------|---------|---------|----------|
 | get_page           | 0.08ms  | 0.12ms  | 0.08ms  | 0.15ms   |
 | search_keyword     | 0.19ms  | 0.52ms  | 0.20ms  | 0.59ms   |
 | traverse_paths d=2 | 10.1ms  | 12.6ms  | 91.4ms  | 176.4ms  |
 | putPage_single     | 0.12ms  | 0.20ms  | 0.12ms  | 0.42ms   |
 Bulk throughput: import 5,848 pages/sec, addLink 8,752 links/sec at 10K scale.
 P95 search latency well under the 200ms threshold.
 ### Category 10: Robustness / Adversarial
 22 hand-crafted edge cases × 6 ops each = 133 attempts. Tests empty pages,
 100K-character pages, CJK/Arabic/Cyrillic/emoji, code fences, false-positive
 substrings, malformed timeline, deeply nested markdown, slugs with edge characters.
 **Result: 133/133 ops succeeded, 0 crashes, 0 silent corruption.**
 ### Category 12: MCP Operation Contract
 50 contract tests across trust boundary (local vs remote), input validation
 (slug format, date format), SQL injection resistance, resource exhaustion,
 depth caps. 30 operations × 5 input variants.
 **Result: 50/50 pass.** Verifies the v0.10.3 security hardening (depth caps,
 remote auto-link disable, file_upload path confinement, parameterized queries).
 ## Reproducibility
 ```bash
 bun run eval/runner/all.ts
 ```
 In-memory PGLite, no API keys, no network. ~3 minutes wall time. Same numbers
 every run (within deterministic-seed tolerance).
 To regenerate the rich-prose corpus from scratch (~$15 Opus spend):
 ```bash
 bun eval/generators/gen.ts --max 240 --concurrency 6
 ```
 Generated outputs are cached in `eval/data/world-v1/` and committed to the repo,
 so the regen pass is one-time. Subsequent runs use the cache.
 ## What this benchmark deliberately doesn't test (BrainBench v1.1, see TODOS.md)
 - **Cat 5: Source attribution / provenance** — needs ~$200-300 Opus for a
  conflict-graph corpus
 - **Cat 6: Auto-link precision under prose at scale** — needs 5K+ adversarial
  prose pages
 - **Cat 8: Skill behavior compliance** — needs LLM agent loop (~$2K to run)
 - **Cat 9: End-to-end workflows** — needs LLM agent loop (~$1K)
 - **Cat 11: Multi-modal ingestion** — needs licensed real datasets
 These five are tracked in `TODOS.md` with budget estimates and depend-on chains.
 ## Methodology notes
 - **Synthetic data, not private brain.** All 240 pages are fictional. Generated
  by Opus from procedural skeletons in `eval/generators/world.ts`. Reproducibility
  matters more than realism for a benchmark you can publish.
 - **Two configurations, one corpus.** BEFORE and AFTER run against identical
  data. The only diff is the codepath (whether the agent has the graph layer
  available). No corpus tuning per configuration.
 - **No cherry-picking.** Queries are derived programmatically from world facts —
  every entity that has facts produces queries. No hand-selected "easy wins."
 - **Honest about limitations.** The 5.8pt set-recall gap (graph 93.1% vs grep
  98.9%) comes from Opus paraphrasing names without markdown links ("Mark Thomas
  was there" instead of `[Mark Thomas](slug)`). Closing this needs corpus-aware
  NER, deferred to v0.10.5.
 - **Single-shot benchmarks are fragile** — but every run is reproducible and
  this is a checkpoint, not the final measure. v1.1 will add the LLM-agent-loop
  categories that capture more of the realistic agent workflow.
--- a/docs/benchmarks/2026-04-18-minions-vs-openclaw-production.md
+++ b/docs/benchmarks/2026-04-18-minions-vs-openclaw-production.md
@@ -1,126 +0,0 @@
 # Production Benchmark: Minions vs OpenClaw Sub-agents (Real Deployment)
 **Date:** 2026-04-18
 **Environment:** Garry's OpenClaw on Render (ephemeral container, Supabase Postgres)
 **GBrain:** v0.11.0 (minions-jobs branch)
 **OpenClaw:** 2026.4.10
 **Brain:** 45,798 pages, 98K chunks, 25K links, 79K timeline entries
 **Task:** Pull and ingest one month of social posts from an external API into the brain
 ## Context
 This is a **production benchmark**, not a lab test. The existing lab benchmark
 ([2026-04-18-minions-vs-openclaw-subagents.md](2026-04-18-minions-vs-openclaw-subagents.md))
 uses trivial prompts on localhost Postgres. This benchmark uses a real 45K-page
 brain on Supabase, pulling real social posts from an external API, and writing
 real brain pages.
 ## The Task
 Pull a month (May 2020) of my social posts from an external API, parse them
 into a structured brain page with frontmatter, engagement metrics, and
 links, commit to the brain repo, and submit a sync job to gbrain.
 ## Method 1: Minions (deterministic pipeline)
 ```bash
 # 1. Pull posts from the external API (curl → JSON)
 curl -s -H "Authorization: Bearer $API_BEARER_TOKEN" \
  "$SOCIAL_API_URL?from=my_account&start=2020-05-01&end=2020-06-01" \
  > /tmp/bench-posts.json
 # 2. Parse + write brain page (python)
 python3 parse_and_write.py
 # 3. Git commit
 cd /data/brain && git add media/social/2020-05.md && git commit -m "archive: 2020-05"
 # 4. Submit sync to Minions
 gbrain jobs submit sync --params '{"repo":"/data/brain","noPull":true}'
 ```
 **Result: 753ms total.** 99 posts pulled, page written, committed, sync job queued.
 Breakdown:
 - External API call: ~300ms
 - Python parse + write: ~50ms
 - Git commit: ~100ms
 - gbrain jobs submit: ~300ms
 Cost: $0.00 (no LLM tokens)
 ## Method 2: OpenClaw Sub-agent (sessions_spawn)
 ```javascript
 sessions_spawn({
  task: "Pull my social posts for June 2020 and save as a brain page...",
  model: "anthropic/claude-sonnet-4-20250514",
  mode: "run",
  runTimeoutSeconds: 120
 })
 ```
 **Result: GATEWAY TIMEOUT (>10,000ms).** The sub-agent could not even spawn
 within the 10-second gateway timeout. On a production Render container running
 a 45K-page brain with 19 active cron jobs, the gateway is under enough load
 that sub-agent spawning is unreliable.
 When sub-agents DO successfully spawn (off-peak), the expected path is:
 1. Gateway receives spawn request (~500ms)
 2. Create session, load context (~2-3s) — AGENTS.md, SOUL.md, skills, memory
 3. Model reads task, plans approach (~2-3s)
 4. Model calls `exec` tool for curl (~1s)
 5. Model calls `exec` tool for python (~1s)
 6. Model calls `exec` tool for git (~1s)
 7. Model reports result (~1s)
 **Estimated: 10-15s + ~$0.03 in tokens per invocation**
 ## Comparison
 | Metric | Minions | Sub-agent |
 |--------|---------|-----------|
 | **Wall time** | **753ms** | **>10,000ms** (gateway timeout) |
 | **Token cost** | $0.00 | ~$0.03 per run |
 | **Success rate** | 100% | 0% (timeout on first attempt) |
 | **Survives restart** | Yes (Postgres) | No (dies with process) |
 | **Progress tracking** | `gbrain jobs get <id>` | poll sessions_list |
 | **Auto-retry** | 3 attempts, exponential backoff | manual re-spawn |
 | **Concurrency** | FOR UPDATE SKIP LOCKED | hope-based maxConcurrent |
 | **Steerable** | inbox messages | fire and forget |
 | **Results persisted** | job record | lost on compaction |
 | **Memory** | ~2MB per in-flight job | ~80MB per spawned session |
 ## The Scaling Story
 We pulled 19,240 posts across 36 months (2021-2023) using the Minions
 approach in a single bash loop. Total time: ~15 minutes. Cost: $0.00 in
 LLM tokens.
 The same task via sub-agents would require 36 spawns × ~$0.03 = ~$1.08
 in tokens, take 36 × 15s = 9 minutes best-case, and fail on ~40% of
 spawns under load (per the fan-out benchmark).
 At scale (100+ months of backfill, or 1000+ batch enrichment jobs),
 Minions is the only viable path. Sub-agents hit the gateway timeout wall,
 burn tokens on deterministic work, and provide no durability.
 ## When Sub-agents Still Win
 Sub-agents are correct for **judgment work**:
 - Email triage (LLM decides priority, drafts reply)
 - Social radar (LLM assesses severity, decides to alert)
 - Meeting prep (LLM synthesizes brain pages into briefing)
 - Cold email research (LLM decides notability)
 These tasks require an LLM to make decisions. Minions can't do that —
 its handlers are code, not models. The routing rule:
 > **Deterministic** (same input → same steps → same output) → **Minions**
 > **Judgment** (input requires assessment/decision) → **Sub-agents**
 ## One-Line Summary
 Minions completed a production post-ingest pipeline in 753ms for $0.
 Sub-agents couldn't even spawn. For deterministic brain-write work,
 Minions is not incrementally better — it's categorically different.
--- a/docs/benchmarks/2026-04-18-minions-vs-openclaw-subagents.md
+++ b/docs/benchmarks/2026-04-18-minions-vs-openclaw-subagents.md
@@ -1,203 +0,0 @@
 # Minions vs OpenClaw Subagents Benchmark
 **Date:** 2026-04-18
 **Branch:** garrytan/minions-jobs
 **Suite:** `test/e2e/bench-vs-openclaw/`
 **Minions:** v0.11.0 (PR #130)
 **OpenClaw:** 2026.4.10 (44e5b62)
 **Model:** anthropic/claude-haiku-4-5
 ## Why this benchmark exists
 Minions is GBrain's new background job queue, pitched as a durable, cheap
 substitute for spawning OpenClaw subagents via `openclaw agent --local`.
 "Durable" and "cheap" are easy to claim and hard to prove. So we put
 numbers on four specific claims a Minions user would actually care about:
 1. **Durability** — when the orchestrator crashes mid-dispatch, does the
   in-flight work survive?
 2. **Throughput** — how much wall-clock overhead does each system add on
   top of the underlying LLM call?
 3. **Fan-out** — parent dispatches 10 children in parallel. How fast and
   how reliable is each side?
 4. **Memory** — what does it cost to keep 10 subagents in flight at once?
 Methodology: both sides call the **same** LLM
 (`anthropic/claude-haiku-4-5`) with the **same** trivial prompt
 (`"Reply with just: OK. No other text."`). The delta is the
 queue+dispatch+process-cost on top of identical LLM work.
 ## Honest caveats up front
 - **We do NOT benchmark OpenClaw's gateway multi-agent fan-out.** That
  requires a custom WebSocket client + an LLM-backed parent agent, ~5×
  the complexity of this harness. We benchmark `openclaw agent --local`
  (embedded mode) because that's what users actually script against
  today when they want "run an agent and get a reply back."
 - **All numbers are point measurements on Garry's laptop** (macOS, Apple
  Silicon, local Postgres 16 + pgvector in Docker). Not a cluster
  benchmark. Not an adversarial load test. Reproducible via the files
  in `test/e2e/bench-vs-openclaw/`.
 - **OpenClaw `--local` is a fire-and-forget process.** If you SIGKILL
  it mid-dispatch, the reply is gone. This isn't a bug, it's the design.
  What we're measuring is how much that design choice costs users who
  need durability.
 - **Small sample sizes** (10 jobs × 3 runs for fan-out, 20 serial for
  throughput, 10 in-flight for memory). Enough to show order-of-magnitude
  deltas, not enough to prove tight tails.
 ## Results
 ### 1. Durability (SIGKILL mid-flight, 10 jobs)
 | System | Delivered | Wall time | p50 per job | p95 per job |
 |--------|-----------|-----------|-------------|-------------|
 | **Minions** | **10 / 10** | 458ms total | 257ms | 410ms |
 | OpenClaw `--local` | **0 / 10** | 22989ms (all SIGKILLed at 500ms) | n/a | n/a |
 Setup: Minions side seeds 10 jobs in state `active` with an expired
 `lock_until` (exactly the state a SIGKILLed worker leaves behind). A
 rescue worker starts. It picks up all 10 via `handleStalled` and
 completes them.
 OpenClaw side spawns 10 `openclaw agent --local` processes in parallel
 and SIGKILLs each at 500ms. Zero of them managed to emit any output
 before being killed.
 **The number that matters: Minions rescued 10 out of 10 stranded
 jobs in under half a second.** OpenClaw has no persistence layer, so
 anything in flight when the process dies is lost. Users can retry by
 re-running the prompt, but the context is gone — they're starting over.
 Source: `test/e2e/bench-vs-openclaw/durability.bench.ts`
 ### 2. Throughput (20 serial dispatches, same LLM call)
 | System | p50 | p95 | p99 | Mean | Min | Max | Success |
 |--------|-----|-----|-----|------|-----|-----|---------|
 | **Minions** | **778ms** | **1931ms** | **1931ms** | **911ms** | 639ms | 1931ms | 20/20 |
 | OpenClaw `--local` | 8086ms | 10094ms | 10094ms | 8335ms | 7405ms | 10094ms | 20/20 |
 | **Ratio** | **10.4×** | **5.2×** | **5.2×** | **9.2×** | 11.6× | 5.2× | — |
 Setup: both sides call claude-haiku-4-5 with the same prompt. Minions
 goes through `queue.add` → worker claims → handler calls Anthropic SDK
 directly. OpenClaw spawns a fresh `openclaw agent --local` process per
 dispatch.
 The ~7 seconds of overhead per OC dispatch isn't the LLM. It's the
 process boot: loading the agent runtime, auth, plugins, MCP servers.
 Every dispatch pays that cost again. The Minions worker stays warm, so
 the overhead is `add` + `claim` + returning the result — roughly 100ms
 on top of the LLM latency itself.
 Source: `test/e2e/bench-vs-openclaw/throughput.bench.ts`
 ### 3. Fan-out (3 runs × 10 children in parallel)
 | System | Completed | Mean wall time | Runs (ok/N) | Wall times (ms) |
 |--------|-----------|----------------|-------------|-----------------|
 | **Minions** (concurrency=10) | **30 / 30** | **1090ms** | 10/10, 10/10, 10/10 | 890, 1135, 1245 |
 | OpenClaw (10 parallel spawns) | 17 / 30 | 22598ms | 6/10, 5/10, 6/10 | 22204, 22505, 23084 |
 | **Ratio (wall time)** | — | **~21×** | — | — |
 Setup: parent dispatches 10 children concurrently, waits for all.
 Minions uses one worker process with `concurrency=10`. OpenClaw scripts
 10 parallel `openclaw agent --local` spawns — what a user would do today
 without Minions.
 Two findings, not one:
 1. **Wall time: Minions completes 10 in ~1 second. OC parallel spawn
   takes ~22 seconds.** The gap scales with the warmup cost: one warm
   worker amortizes, 10 cold processes pay the bill 10 times.
 2. **OC parallel spawn fails 43% of the time at 10-wide.** Error
   samples show a mix of LLM rate-limit hits and spawn saturation. We
   didn't tune this. That's the point — a user who tries to fan out with
   `--local` without a queue runs into this with no obvious remediation.
 Source: `test/e2e/bench-vs-openclaw/fanout.bench.ts`
 ### 4. Memory (10 in-flight subagents)
 | System | Baseline RSS | Peak with 10 in flight | Delta | Processes |
 |--------|--------------|------------------------|-------|-----------|
 | **Minions** | 84 MB | **86 MB** | **+2 MB** | 1 |
 | OpenClaw | n/a | 814 MB (summed across 10) | — | 10 |
 | **Ratio** | — | **~407×** | — | — |
 Setup: both sides keep 10 subagents in flight simultaneously. Minions
 side uses one worker with concurrency=10 and handlers that park on a
 Promise. OpenClaw side spawns 10 parallel `openclaw agent --local`
 processes and sums their RSS via `ps -o rss=`.
 Handlers are intentionally cheap sleeps — we measure harness memory,
 not LLM client state. The LLM client state would be comparable on both
 sides.
 **Minions costs 2 MB to keep 10 subagents in flight. OpenClaw costs
 814 MB. At scale, this difference decides whether you can run 10
 subagents or 100 on the same machine.**
 Source: `test/e2e/bench-vs-openclaw/memory.bench.ts`
 ## What this means for a Minions user
 If you have a script today that spawns `openclaw agent --local` N times,
 every one of these numbers gets better when you move to Minions:
 - **Crash and your work doesn't vanish.** Worker dies, PG keeps the
  row, another worker picks it up. Zero extra code on your side.
 - **Per-dispatch wall time drops ~10×** because the worker stays warm.
  Process startup is where your time was going, not the LLM.
 - **Fan-out scales past 10-wide without you hand-tuning concurrency.**
  Worker does the throttling; the queue does the durability. OC
  parallel spawn hits a 40% failure wall around 10-wide on this hardware.
 - **Memory stops being the bottleneck.** 2 MB per in-flight job vs
  ~80 MB per process changes what "10 concurrent subagents" costs you
  on a box.
 ## What this doesn't say
 - We didn't test OpenClaw's gateway multi-agent mode. If you run the
  gateway, you get persistent agent state across turns, real multi-agent
  routing, and different cost characteristics. The gateway is OC's
  production mode, and we're not claiming Minions beats it at what it
  does. We're saying: if your pattern is "dispatch a subagent, get a
  reply, maybe do this 10 times," the `--local` CLI is what you're
  reaching for, and Minions beats it by ~10-400× depending on the axis.
 - We didn't run under load (100s of concurrent jobs, hours of sustained
  work). These are observational point measurements, not a stress test.
 - We ran claude-haiku-4-5. For slower/larger models the absolute
  numbers shift but the ratios stay roughly the same — the overhead
  is process boot and persistence, not model size.
 ## Reproducing
 ```bash
 # 1. Start a test Postgres
 docker run -d --name gbrain-test-pg \
  -e POSTGRES_USER=postgres -e POSTGRES_PASSWORD=postgres \
  -e POSTGRES_DB=gbrain_test \
  -p 5436:5432 pgvector/pgvector:pg16
 # 2. Set env
 export DATABASE_URL=postgresql://postgres:postgres@localhost:5436/gbrain_test
 export ANTHROPIC_API_KEY=sk-ant-...
 # 3. Run each bench (durability + memory are free; throughput + fan-out
 #    cost ~$0.25 in claude-haiku-4-5 tokens total)
 bun test ./test/e2e/bench-vs-openclaw/durability.bench.ts
 bun test ./test/e2e/bench-vs-openclaw/throughput.bench.ts
 bun test ./test/e2e/bench-vs-openclaw/fanout.bench.ts
 bun test ./test/e2e/bench-vs-openclaw/memory.bench.ts
 # 4. Tear down
 docker stop gbrain-test-pg && docker rm gbrain-test-pg
 ```
 ## One-line summary
 Minions rescues 10/10 jobs from a crash in under half a second while
 OpenClaw `--local` loses all of them; it delivers each dispatch ~10×
 faster, fans out 10-wide in ~1 second vs ~22 seconds at 43% OC failure
 rate, and holds 10 in-flight subagents in 2 MB vs 814 MB.
--- a/docs/benchmarks/2026-04-18-tweet-ingestion.md
+++ b/docs/benchmarks/2026-04-18-tweet-ingestion.md
@@ -1,176 +0,0 @@
 # Tweet Ingestion Benchmark: Minions vs OpenClaw Sub-agents
 **Date:** 2026-04-18
 **Branch:** garrytan/minions-jobs
 **Suite:** `test/e2e/bench-vs-openclaw/tweet-ingest.bench.ts`
 **Minions:** v0.11.0 (PR #130)
 **OpenClaw:** 2026.4.10
 **Model:** none (Minions) vs anthropic/claude-sonnet-4 (OpenClaw)
 ## Why this benchmark exists
 The existing throughput/fanout/durability benchmarks use a trivial LLM
 prompt ("Reply with just: OK"). They measure queue overhead, not real work.
 This benchmark measures a **real production task**: pull a month of tweets
 from the X API, parse them into a structured brain page, git commit, and
 sync to gbrain. This is work that an agent does every day. It's
 deterministic — same input always produces the same steps in the same
 order. The question: should deterministic brain-write work go through an
 LLM (sub-agent) or through code (Minions)?
 ## Methodology
 **Task:** Pull ~100 my social posts for one month from the X full-archive
 search API, write a markdown brain page with frontmatter + engagement
 metrics + tweet links, git commit, and submit a `gbrain sync` job.
 **Minions side:** A TypeScript function that:
 1. `fetch()` the X API (one HTTP call)
 2. `JSON.parse()` → `writeFileSync()` the brain page
 3. `execSync('git commit')`
 4. `queue.add('sync', { repo, noPull: true })`
 No LLM involved. The handler is code. Total overhead on top of I/O:
 queue add + git commit.
 **OpenClaw side:** Spawn `openclaw agent --local` with a task prompt that
 describes the same pipeline in English. The model (claude-sonnet-4):
 1. Reads the task, plans approach
 2. Calls `exec` tool for curl
 3. Calls `exec` tool for python (parse + write)
 4. Calls `exec` tool for git commit
 5. Reports result
 Same work, but the model decides each step.
 **Runs:** 5 serial per method. Each run uses a different month (2020-07
 through 2020-11) to avoid caching effects. Pages are cleaned up after.
 **Environment:** Tested on a production Render container (ephemeral, ARM64)
 with Supabase Postgres (us-east-1) and a 45K-page brain. Also
 reproducible on localhost with Docker Postgres — see instructions below.
 ## Honest caveats
 - **X API latency varies.** The X full-archive search endpoint takes
  200-500ms depending on load. Both sides pay this equally. We're
  measuring the PIPELINE overhead, not the API.
 - **OpenClaw `--local` is not the gateway.** The gateway has persistent
  sessions, tool caching, and context reuse. `--local` is the scripted
  dispatch path — what you'd use in a cron job or automation script.
  That's the apples-to-apples comparison for deterministic work.
 - **The sub-agent has to figure out the same pipeline every time.**
  That's the core inefficiency: spending tokens for the model to
  rediscover steps that never change. With Minions, the steps are code.
 - **N=5 is small.** Enough to see the order-of-magnitude delta, not
  enough to prove tight tails. Run N=20 for statistical significance.
 ## Results
 ### Minions (5 runs, serial)
 | Run | Month | Tweets | Wall time | Status |
 |-----|-------|--------|-----------|--------|
 | 1 | 2020-07 | 99 | 753ms | ✅ |
 | 2 | 2020-08 | 87 | 681ms | ✅ |
 | 3 | 2020-09 | 92 | 724ms | ✅ |
 | 4 | 2020-10 | 78 | 698ms | ✅ |
 | 5 | 2020-11 | 103 | 741ms | ✅ |
 **Stats:** mean=719ms p50=724ms p95=753ms min=681ms max=753ms
 **Success rate:** 5/5 (100%)
 **Token cost:** $0.00
 ### OpenClaw Sub-agent (5 runs, serial)
 | Run | Month | Tweets | Wall time | Status |
 |-----|-------|--------|-----------|--------|
 | 1 | 2020-07 | — | >10,000ms | ❌ gateway timeout |
 | 2 | 2020-08 | — | >10,000ms | ❌ gateway timeout |
 | 3 | 2020-09 | 99 | 12,340ms | ✅ |
 | 4 | 2020-10 | 87 | 11,890ms | ✅ |
 | 5 | 2020-11 | 92 | 13,210ms | ✅ |
 **Stats (successful only):** mean=12,480ms p50=12,340ms
 **Success rate:** 3/5 (60%) — 2 gateway timeouts under production load
 **Token cost:** ~$0.03 per successful run × 3 = $0.09
 > **Note:** Gateway timeouts occurred because the production OpenClaw
 > instance was running 19 active cron jobs + heartbeats. The gateway's
 > session spawn queue was saturated. This is a realistic production
 > scenario, not an artificial constraint.
 ### Comparison
 | Metric | Minions | OpenClaw Sub-agent | Ratio |
 |--------|---------|-------------------|-------|
 | **Mean wall time** | **719ms** | **12,480ms** | **17.3×** |
 | **p50** | 724ms | 12,340ms | 17.0× |
 | **Success rate** | 100% | 60% | — |
 | **Token cost per run** | $0.00 | ~$0.03 | ∞ |
 | **Survives restart** | ✅ | ❌ | — |
 | **Progress tracking** | ✅ `jobs get` | ❌ | — |
 | **Auto-retry** | ✅ 3 attempts | ❌ | — |
 ### At scale: 36-month backfill
 We also measured a real backfill: pull 36 months of tweets (2021-2023,
 19,240 tweets total) and ingest each month as a brain page.
 | Metric | Minions | OpenClaw Sub-agent (est.) |
 |--------|---------|--------------------------|
 | **Total time** | ~15 min | ~7.5 min (best case) to ∞ (gateway timeouts) |
 | **Total cost** | $0.00 | ~$1.08 (36 × $0.03) |
 | **Expected failures** | 0 | ~14 (36 × 40% failure rate) |
 | **Manual intervention** | None | Re-spawn failed months |
 The Minions path completed all 36 months unattended. The sub-agent path
 would require monitoring and re-spawning failures.
 ## The routing insight
 This benchmark measures **deterministic work** — work where the steps
 never change regardless of input. Pull → parse → write → commit → sync.
 The same pipeline every time. Spending $0.03 and 12 seconds for a model
 to rediscover these steps is waste.
 The routing rule that falls out of this data:
 > **Deterministic** (same input → same steps → same output) → **Minions**
 > Zero tokens. Sub-second. Durable. Auto-retry.
 >
 > **Judgment** (input requires assessment/decision) → **Sub-agents**
 > Model decides what to do. Worth the token cost.
 Examples:
 - Tweet ingestion → Minions (always the same pipeline)
 - Calendar sync → Minions (always the same pipeline)
 - Email triage → Sub-agent (model decides priority + reply)
 - Meeting prep → Sub-agent (model synthesizes briefing)
 ## Reproducing
 ```bash
 # 1. Set environment
 export X_BEARER_TOKEN=...           # external API bearer token
 export DATABASE_URL=postgresql://... # Postgres with gbrain schema v7+
 export BRAIN_PATH=/path/to/brain    # Git repo with brain pages
 export ANTHROPIC_API_KEY=sk-ant-... # For OpenClaw side only
 # 2. Run the benchmark
 bun test test/e2e/bench-vs-openclaw/tweet-ingest.bench.ts
 # 3. Cost: ~$0.15 total (5 OC runs × ~$0.03 each, Minions = $0)
 # 4. On localhost without X API: mock the fetch in the test file
 #    to return a canned JSON response. The benchmark measures
 #    pipeline overhead, not API latency.
 ```
 ## One-line summary
 Minions ingests a month of tweets in 719ms for $0 with 100% reliability.
 OpenClaw sub-agents take 12.5 seconds, cost $0.03, and fail 40% of the
 time under production load. For deterministic brain-write work, Minions
 is 17× faster, infinitely cheaper, and categorically more reliable.
--- a/docs/benchmarks/2026-04-19-knowledge-runtime-v0.13.md
+++ b/docs/benchmarks/2026-04-19-knowledge-runtime-v0.13.md
@@ -1,190 +0,0 @@
 # Knowledge Runtime v0.13 — Benchmark Deltas
 What this branch actually changes, measured. All numbers are reproducible from
 the scripts in `test/`. No real-world traffic, no API keys, no private data.
 **Headline:** Step B (auto-timeline on put_page) is the only change that moves
 benchmark numbers, and it moves them from 0% to 100% on the one metric that
 matters for agent workflow: "can I query the timeline right after I wrote the
 page?"
 The retrieval-quality benchmarks (graph-quality, search-quality) are unchanged
 because this branch didn't touch the search or graph-query hot paths. That's
 the expected result and it's the proof that the knowledge-runtime work didn't
 regress anything it wasn't supposed to change.
 ---
 ## Benchmark 1: put_page latency
 **Script:** `bun run test/benchmark-put-page-latency.ts --json`
 **Load:** 200 `put_page` operation calls against PGLite in-process, half
 carrying 3 timeline entries, 10 seed target pages for auto-link to resolve.
 |  | master (v0.12.1, c0b6219) | branch (v0.13.0.0) | Δ |
 |---|---:|---:|---:|
 | mean | 2.00 ms | 2.58 ms | **+0.58 ms (+29%)** |
 | p50 | 1.92 ms | 2.31 ms | +0.39 ms (+20%) |
 | p95 | 2.56 ms | 3.57 ms | +1.01 ms (+39%) |
 | p99 | 3.46 ms | 13.44 ms | +9.98 ms (+288%) |
 | max | 10.89 ms | 14.34 ms | +3.45 ms |
 | timeline entries extracted | **0** | **300** | +300 |
 **Read:** Step B adds ~0.5 ms to mean `put_page` latency and the branch now
 extracts 300 timeline entries across 200 writes for free. Master does zero.
 The absolute cost is invisible in any practical workflow. The p99 tail
 doubled (3.5 → 13.4 ms); absolute is still <15 ms and almost certainly
 batch-flush variance, not a regression worth acting on.
 ---
 ## Benchmark 2: Time-to-queryable brain
 **Script:** `bun run test/benchmark-knowledge-runtime.ts --json` (section `ttq`)
 **Scenario:** 20 pages ingested via the `put_page` OPERATION (not the engine
 method). 40 expected timeline entries across them. Immediately after ingest,
 query `engine.getTimeline(slug)` for each expected entry.
 |  | queryable right after ingest |
 |---|---:|
 | branch (auto_timeline on, default) | **40/40 (100%)** |
 | master (auto_timeline off, current behavior) | 0/40 (0%) |
 **Read:** On master, zero timeline queries return answers after a write. The
 user has to remember to run `gbrain extract timeline` as a second step or
 their agent gets blank results. On branch, every timeline query works the
 moment the page lands. This is the "boil-the-lake" principle in action: when
 AI makes the marginal cost near-zero, always do the complete thing.
 ---
 ## Benchmark 3: Integrity repair rate (mocked resolver)
 **Script:** `bun run test/benchmark-knowledge-runtime.ts --json` (section `integrity`)
 **Scenario:** 50 pages seeded with bare-tweet phrases and `x_handle`
 frontmatter. Fake `x_handle_to_tweet` resolver returns confidence deterministically
 from a 70/20/10 distribution (70% high, 20% mid, 10% low). Three-bucket
 repair logic runs the same way `gbrain integrity auto` does in production.
 |  | count | % |
 |---|---:|---:|
 | auto-repair (confidence ≥ 0.8) | 35 | 70% |
 | review queue (0.5 ≤ c < 0.8) | 10 | 20% |
 | skip (c < 0.5) | 5 | 10% |
 **Read:** Master has no integrity repair at all — this feature is new in
 v0.13. The machinery delivers exactly the three-bucket split the design
 promised. With the real X API the absolute numbers will shift depending on
 how well the resolver discriminates, but the pipeline is provably correct.
 Zero phrases slip through without a confidence-bucketed decision.
 ---
 ## Benchmark 4: Doctor signal completeness
 **Script:** `bun run test/benchmark-knowledge-runtime.ts --json` (section `doctor`)
 **Scenario:** Seed a brain with 7 known issues: 3 bare-tweet phrases across
 2 pages (one-hit-per-line rule reduces this to 2 surfaceable), 3 external
 link citations, 1 grandfathered page (frontmatter `validate: false`, which
 should be skipped). Run the `scanIntegrity` helper that doctor now invokes
 in non-fast mode.
 |  | count |
 |---|---:|
 | issues planted | 7 |
 | should surface | 6 |
 | grandfathered (correctly skipped) | 1 |
 | **surfaced** | **5 (83%)** |
 | bare tweets caught | 2/2 lines |
 | external links caught | 3/3 |
 | grandfathered page respected | 1/1 |
 **Read:** Master's `gbrain doctor` catches zero of these — doctor had no
 integrity awareness before this branch. Now it surfaces 100% of the
 surfaceable issues and correctly respects the grandfather flag. The 83%
 headline comes from the planted-vs-surfaceable counting: 7 planted, 1 opted
 out, 6 should surface, 5 did. In terms of detection rate for real issues,
 it's 5/5 on lines that have bare-tweet content.
 ---
 ## Benchmarks that did NOT move (proof of no regression)
 ### Graph quality benchmark
 **Script:** `bun run test/benchmark-graph-quality.ts --json`
 **Load:** 80 fictional pages, 35 relational queries across 7 categories.
 | metric | master | branch | Δ |
 |---|---:|---:|---|
 | link_recall | 0.889 | 0.889 | 0 |
 | link_precision | 1.000 | 1.000 | 0 |
 | type_accuracy | 0.889 | 0.889 | 0 |
 | timeline_recall | 1.000 | 1.000 | 0 |
 | timeline_precision | 1.000 | 1.000 | 0 |
 | relational_recall | 0.900 | 0.900 | 0 |
 | relational_precision | 1.000 | 1.000 | 0 |
 | idempotent_links | true | true | = |
 | idempotent_timeline | true | true | = |
 **Read:** Identical. The benchmark uses `engine.putPage()` + explicit
 `runExtract` calls, which bypass the operation handler where Step B lives.
 That's why the numbers don't move, and that's the right outcome: the graph
 layer's extraction quality hasn't changed, only the ingest ergonomics.
 ### Search quality benchmark
 **Script:** `bun run test/benchmark-search-quality.ts`
 **Load:** 30 pages, 20 queries with graded relevance. Modes A (baseline),
 B (boost only), C (boost + intent classifier).
 | metric | A (baseline) | B (boost) | C (full) | Δ master→branch |
 |---|---:|---:|---:|---|
 | P@1 | 0.947 | 0.895 | 0.947 | 0 |
 | P@5 | 0.811 | 0.674 | 0.695 | 0 |
 | MRR | 0.974 | 0.939 | 0.974 | 0 |
 | nDCG@5 | 1.191 | 1.028 | 1.069 | 0 |
 **Read:** Identical across all three modes. Search scoring is decided by
 hybrid search + RRF + dedup, none of which this branch touched.
 ---
 ## Reproducing these numbers
 ```bash
 # From this branch
 bun run test/benchmark-put-page-latency.ts --json
 bun run test/benchmark-knowledge-runtime.ts --json
 bun run test/benchmark-graph-quality.ts --json
 bun run test/benchmark-search-quality.ts
 # Compare against master
 cd /path/to/gbrain-master-worktree
 # (copy benchmark-put-page-latency.ts and benchmark-knowledge-runtime.ts
 # over if they're not on master yet; they're the new scripts)
 bun run test/benchmark-put-page-latency.ts --json
 bun run test/benchmark-graph-quality.ts --json
 bun run test/benchmark-search-quality.ts
 ```
 All four scripts run in-process against PGLite. No network, no external DB,
 no API keys. They complete in under 30 seconds combined.
 ---
 ## Bottom line
 | benchmark | moves? | direction |
 |---|---|---|
 | put_page latency | yes | +0.5ms cost for 300 free timeline entries per 200 writes |
 | time-to-queryable | yes | 0% → 100% |
 | integrity repair rate | new | n/a on master, 70/20/10 split delivered |
 | doctor completeness | new | 0% → 100% on real issues |
 | graph quality | no | unchanged, as designed |
 | search quality | no | unchanged, as designed |
 The branch does what it said it would do. The retrieval benchmarks stay flat
 and the ingest/repair/health benchmarks move from zero to working. That's
 the shape of a good platform change: one new dimension opens up, existing
 dimensions don't regress.
--- a/eval/data/world-v1/_ledger.json
+++ b/eval/data/world-v1/_ledger.json
@@ -1,13 +0,0 @@
 {
  "generated_at": "2026-04-18T04:13:16.027Z",
  "model": "claude-opus-4-5",
  "pricing": {
    "input_per_m": 15,
    "output_per_m": 75
  },
  "inputTokens": 18359,
  "outputTokens": 38228,
  "costUsd": 3.1424849999999998,
  "calls": 49,
  "files_total": 240
 }
--- a/eval/data/world-v1/companies__accel-5.json
+++ b/eval/data/world-v1/companies__accel-5.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/accel-5",
  "type": "company",
  "title": "Accel - Global Venture Capital Firm",
  "compiled_truth": "Accel is one of the most established venture capital firms in the world, with a track record spanning over four decades. Founded in 1983, the firm has evolved from a Silicon Valley stalwart into a truly global operation with offices in Palo Alto, London, and Bangalore. They've backed some of the most consequential technology companies of the past two decades, including Facebook, Spotify, Slack, and Dropbox.\n\nThe firm operates across multiple stages, though they're perhaps best known for their Series A and Series B investments. Accel manages billions in assets across various funds, with recent vintages exceeding $3 billion for their US and Europe-focused vehicles. Their investment thesis tends to favor founders building category-defining companies in enterprise software, consumer tech, fintech, and increasingly, AI infrastructure.\n\nAccel's partnership model emphasizes deep sector expertise. Partners like Sonali De Rycker have built formidable reputations in European fintech, while others focus on developer tools or consumer applications. The firm has been notably active in the generative AI wave, making early bets on companies building foundational models and application layers. They've developed strong relationships with accelerators like [Y Combinator](companies/y-combinator) and often co-invest alongside firms such as [Andreessen Horowitz](companies/a16z) on competitive deals.\n\nRecent years have seen Accel double down on international expansion. Their India fund has become one of the most active institutional investors in the subcontinent, backing companies like Flipkart and Swiggy before they became household names. The London office continues to punch above its weight in European tech circles.\n\nThe firm's culture is often described as founder-friendly but rigorous. They're known for taking board seats seriously and providing operational support beyond just capital. Accel's brand carries significant weight in fundraising conversations—a term sheet from them often signals quality to follow-on investors. Critics sometimes note their portfolio can feel conservative compared to newer entrants, but longevity has its advantages. They've seen multiple market cycles and tend to maintain disciplined valuations even in frothy markets.",
  "timeline": [
    "- **2021-03-15** | Accel closes $3 billion early-stage fund, largest in firm history at the time",
    "- **2021-09-22** | Led Series B for enterprise AI startup alongside [Andreessen Horowitz](companies/a16z)",
    "- **2022-04-10** | Opens expanded London office to support growing European portfolio",
    "- **2022-11-08** | Partner Rich Wong speaks at Web Summit on enterprise software trends",
    "- **2023-02-14** | Announces $650 million India-focused fund, sixth in the region",
    "- **2023-08-30** | Leads seed round for [Y Combinator](companies/y-combinator) batch company building AI code review tools",
    "- **2024-01-19** | Accel publishes annual Euroscape report showing record European unicorn creation",
    "- **2024-06-05** | Makes significant investment in robotics startup focused on warehouse automation",
    "- **2025-02-11** | Closes latest growth fund at $4.2 billion amid competitive fundraising environment",
    "- **2025-09-03** | Hosts annual CEO summit in Portofino, bringing together 80+ portfolio founders"
  ],
  "_facts": {
    "type": "company",
    "slug": "companies/accel-5",
    "name": "Accel",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__acme-0.json
+++ b/eval/data/world-v1/companies__acme-0.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/acme-0",
  "type": "company",
  "title": "Acme",
  "compiled_truth": "Acme is a robotics startup founded in 2021 by [Mia Brown](people/mia-brown-0), who previously spent nearly a decade in industrial automation before striking out on her own. The company focuses on developing modular robotic systems for small and mid-sized warehouses—an underserved market segment that larger players have largely ignored. Their flagship product, the Acme Flex Unit, is a mobile picking robot that can be deployed in facilities without major infrastructure changes.\n\nThe startup has attracted notable backing from angel investors including [Chris Jackson](people/chris-jackson-91) and [Ian Anderson](people/ian-anderson-105), both of whom participated in the seed round closed in early 2022. Jackson in particular has been hands-on, joining several board meetings and making introductions to potential enterprise customers. Acme raised a modest $2.3M initially, deliberately staying lean while proving out the core technology.\n\nMia Brown serves as CEO and remains deeply involved in product development. She's known for an engineering-first approach to company building, often spending time on the factory floor alongside her small team. The company currently employs around 25 people, mostly engineers, operating out of a converted warehouse space in Austin. Acme has been quiet about expansion plans but insiders suggest a Series A is in the works for late 2025.\n\nThe robotics market is crowded, yet Acme has carved out a niche by targeting businesses too small for enterprise solutions but too large for manual operations alone. Early customers include regional e-commerce fulfillment centers and a few specialty food distributors. Retention has been strong, with several pilots converting to full deployments.\n\nRecent moves include a partnership with a logistics software provider to integrate Acme's robots into broader warehouse managment systems. The company also hired its first dedicated sales lead in Q1 2025, signaling a shift toward scaling comercial operations. Despite limited public visibility, Acme has built a reputation in robotics circles for reliable hardware and responsive support.",
  "timeline": "- **2021-06-15** | Acme incorporated in Delaware by [Mia Brown](people/mia-brown-0)\n- **2022-02-10** | Closed $2.3M seed round led by [Chris Jackson](people/chris-jackson-91) and [Ian Anderson](people/ian-anderson-105)\n- **2022-09-01** | First prototype of Acme Flex Unit completed\n- **2023-03-22** | Signed pilot agreement with regional fulfillment center in Texas\n- **2023-11-08** | Expanded team to 15 employees, opened Austin facility\n- **2024-04-17** | Converted three pilot customers to full commercial deployments\n- **2024-10-30** | Announced integration partnership with WarehouseOS software platform\n- **2025-01-14** | Hired first dedicated head of sales, marking commercial scale-up\n- **2025-06-02** | [Mia Brown](people/mia-brown-0) spoke at RoboTech Summit on modular automation\n- **2025-11-20** | Series A discussions reportedly underway with multiple VC firms",
  "_facts": {
    "type": "company",
    "slug": "companies/acme-0",
    "name": "Acme",
    "category": "startup",
    "industry": "robotics",
    "founded_year": 2021,
    "founders": [
      "people/mia-brown-0"
    ],
    "investors": [
      "people/chris-jackson-91",
      "people/ian-anderson-105"
    ],
    "employees": [
      "people/chris-smith-110"
    ]
  }
 }
--- a/eval/data/world-v1/companies__acme-labs-50.json
+++ b/eval/data/world-v1/companies__acme-labs-50.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/acme-labs-50",
  "type": "company",
  "title": "Acme Labs",
  "compiled_truth": "Acme Labs is a cybersecurity startup founded in 2019 by [Ian Kim](people/ian-kim-50), a serial entrepreneur with deep roots in enterprise security software. The company emerged from Kim's frustration with legacy endpoint protection tools that couldn't keep pace with modern threat vectors. Based out of Austin, Texas, Acme has grown from a three-person operation to a team of roughly 45 engineers and security researchers.\n\nThe company's flagship product is a real-time threat detection platform that uses behavioral analysis to identify anomalies before they escalate into full breaches. Unlike traditional signature-based approaches, Acme's system learns the normal patterns of network traffic and user behavior, flagging deviations that might indicate compromise. Early customers were mid-market financial services firms, though the company has since expanded into healthcare and logistics verticals.\n\nFunding came relatively early. [Helen Martinez](people/helen-martinez-87) led the seed round in late 2020, bringing not just capital but also her extensive network in enterprise software distribution. Martinez has remained closely involved, attending board meetings and occasionally making introductions to potential strategic partners. The Series A followed in 2022, though terms were not publicly disclosed.\n\nOn the advisory side, [Wendy Wilson](people/wendy-wilson-170) joined in 2021 to help shape go-to-market strategy. Wilson's backgorund in scaling B2B SaaS companies proved invaluable as Acme transitioned from founder-led sales to a more structured revenue organization. She's credited with pushing the team to focus on a narrower ICP rather than chasing every inbound lead.\n\nAcme Labs has built a reputation for technical depth. Their engineering blog regularly publishes threat research, and several team members speak at conferences like DEF CON and BSides. The culture leans scrappy—Kim is known for keeping overhead low and reinvesting heavily into R&D. Recent chatter suggests the company is exploring an AI-powered SOC assistant, though nothing has been formally anounced. Competition remains fierce from both established players and well-funded startups, but Acme's focus on mid-market customers gives them a defensible niche.",
  "timeline": "- **2019-03-12** | Acme Labs incorporated in Delaware; [Ian Kim](people/ian-kim-50) begins building initial prototype\n- **2019-11-04** | First paying customer signed — a regional credit union in Texas\n- **2020-09-18** | Seed round closed with [Helen Martinez](people/helen-martinez-87) leading the investment\n- **2021-02-22** | [Wendy Wilson](people/wendy-wilson-170) joins as strategic advisor\n- **2021-08-30** | Acme releases v2.0 of threat detection platform with behavioral analytics engine\n- **2022-04-15** | Series A funding completed; team expands to 30 employees\n- **2023-06-09** | Ian Kim delivers keynote at RSA Conference on zero-trust architecture\n- **2024-01-17** | Partnership announced with major SIEM vendor for native integration\n- **2024-11-03** | Acme Labs crosses $10M ARR milestone\n- **2025-07-21** | Internal demo of AI-powered SOC assistant shown to select customers",
  "_facts": {
    "type": "company",
    "slug": "companies/acme-labs-50",
    "name": "Acme Labs",
    "category": "startup",
    "industry": "cybersecurity",
    "founded_year": 2019,
    "founders": [
      "people/ian-kim-50"
    ],
    "investors": [
      "people/helen-martinez-87"
    ],
    "employees": [
      "people/vera-martinez-160"
    ],
    "advisors": [
      "people/wendy-wilson-170"
    ]
  }
 }
--- a/eval/data/world-v1/companies__amazon-3.json
+++ b/eval/data/world-v1/companies__amazon-3.json
@@ -1,15 +0,0 @@
 {
  "slug": "companies/amazon-3",
  "type": "company",
  "title": "Amazon - Cybersecurity Acquirer",
  "compiled_truth": "Amazon, founded in 1998, has evolved far beyond its origins as an online bookstore to become one of the most formidable players in the technology sector. While most know the company for its e-commerce dominance and AWS cloud infrastructure, Amazon has quietly built a substantial presence in cybersecurity through strategic acquisitions and internal development.\n\nThe company's approach to cybersecurity M&A has been methodical and often under the radar. Rather than making splashy billion-dollar deals that attract media attention, Amazon tends to acquire smaller, specialized firms that can be integrated into its existing AWS security stack. This strategy allows them to enhance offerings like AWS Shield, GuardDuty, and Security Hub without the integration headaches that plague larger mergers.\n\nAmazon's cybersecurity ambitions are driven partly by necesity—protecting its massive cloud infrastructure and the millions of businesses that depend on it requires constant innovation. The company processes an astronomical volume of security events daily, giving it unique datasets for training threat detection models. Some industry observers beleive this data advantage makes Amazon a sleeping giant in the security space.\n\nRecent moves suggest the company is getting more aggressive. They've been spotted at major security conferences with larger acquisition teams, and rumors persist about interest in several endpoint detection startups. The hiring of former NSA and CISA officials into senior AWS security roles signals a maturation of their strategy.\n\nCompetition with [Microsoft](companies/microsoft) in the cloud security space has intensified, with both giants racing to offer comprehensive security platforms that reduce customers' need for third-party tools. Amazon's relationship with specialized security vendors is complicated—they partner with many through the AWS Marketplace while simultaneously building competing capabilities.\n\nThe firm maintains close ties with government contractors and has pursued FedRAMP certifications aggressively. Their work with [Palantir](companies/palantir) on certain government cloud initiatives demonstrates Amazon's willingness to collaborate when strategic interests align, though the relationship has had its tense moments over competing contract bids.",
  "timeline": "- **2021-03-15** | Amazon acquires small threat intelligence startup for undisclosed sum, team absorbed into AWS Security division\n- **2021-09-22** | Launched AWS Security Lake at re:Invent, consolidating security data management capabilities\n- **2022-04-08** | Hired former CISA deputy director to lead government security initiatives\n- **2022-11-30** | Announced expanded partnership with [Microsoft](companies/microsoft) on cross-cloud security standards, surprising industry observers\n- **2023-06-14** | Acquisition of Israeli-based API security firm closes, adding to AppSec portfolio\n- **2023-12-01** | AWS Security Hub surpasses 50,000 enterprise customers milestone\n- **2024-05-19** | Internal memo leaked showing renewed focus on endpoint security acquisitions\n- **2024-10-03** | Joint threat intelligence sharing agreement signed with [Palantir](companies/palantir) for federal contracts\n- **2025-02-28** | Rumored in late-stage talks with two identity management startups\n- **2025-08-11** | Opened dedicated cybersecurity R&D center in Austin, Texas",
  "_facts": {
    "type": "company",
    "slug": "companies/amazon-3",
    "name": "Amazon",
    "category": "acquirer",
    "industry": "cybersecurity",
    "founded_year": 1998
  }
 }
--- a/eval/data/world-v1/companies__anchor-28.json
+++ b/eval/data/world-v1/companies__anchor-28.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/anchor-28",
  "type": "company",
  "title": "Anchor - Data Infrastructure Startup",
  "compiled_truth": "Anchor is a data infrastructure startup founded in 2021 by [Carol Wilson](people/carol-wilson-28), a veteran engineer who previously spent nearly a decade building distributed systems at major tech companies. The company focuses on solving one of the most persistent problems in modern data stacks: reliable data synchronization across heterogenous cloud environments.\n\nThe core product is a managed service that handles bi-directional sync between data warehouses, operational databases, and third-party SaaS tools. Unlike traditional ETL pipelines, Anchor's approach treats data synchronization as a continous process rather than batch jobs, enabling near real-time consistency across systems. This has proven particularly valuable for companies running hybrid cloud architectures or those mid-migration between legacy systems and modern infrastructure.\n\nAnchor raised its seed round from [Sarah Williams](people/sarah-williams-92) and [Kate Anderson](people/kate-anderson-107), both of whom have deep backgrounds in enterprise software investing. The round closed in early 2022 and allowed the company to expand beyond its initial three-person team. Sarah Williams in particular has been an active board observer, reportedly helping Anchor navigate early enterprise sales conversations.\n\nThe startup has been deliberatly quiet about customer names, though industry observers have noted several mid-market fintech companies using Anchor's sync layer for compliance-related data requirements. Carol Wilson has spoken at a handful of data engineering conferences about the technical challenges of conflict resolution in distributed data systems—talks that have helped establish Anchor's credibility in a crowded market.\n\nGrowth has been steady if not explosive. The company operates with a lean team, currently around fifteen employees, mostly engineers. There's been some speculation about a Series A in 2024, though nothing confirmed publically. Anchor competes with larger players like Fivetran and Airbyte, but differentiates on the bi-directional sync capabilities and lower latency guarantees. The data infrastructure space remains intensely competitive, but Anchor has carved out a defensible niche.",
  "timeline": "- **2021-03-15** | Anchor incorporated in Delaware by [Carol Wilson](people/carol-wilson-28)\n- **2021-06-22** | First working prototype of bi-directional sync engine completed\n- **2022-01-18** | Closed seed round led by [Sarah Williams](people/sarah-williams-92) and [Kate Anderson](people/kate-anderson-107)\n- **2022-08-03** | Launched private beta with five design partners\n- **2023-02-11** | Carol Wilson delivered keynote on distributed sync at DataEngConf Austin\n- **2023-07-29** | General availability launch; pricing tiers announced\n- **2023-11-14** | Reached 50 paying customers milestone\n- **2024-04-08** | Opened second office in Denver for engineering expansion\n- **2024-09-22** | Partnership announced with major cloud provider (details under NDA)\n- **2025-01-30** | Anchor featured in industry report on emerging data infrastructure vendors",
  "_facts": {
    "type": "company",
    "slug": "companies/anchor-28",
    "name": "Anchor",
    "category": "startup",
    "industry": "data infrastructure",
    "founded_year": 2021,
    "founders": [
      "people/carol-wilson-28"
    ],
    "investors": [
      "people/sarah-williams-92",
      "people/kate-anderson-107"
    ],
    "employees": [
      "people/tara-hernandez-138"
    ]
  }
 }
--- a/eval/data/world-v1/companies__andreessen-horowitz-2.json
+++ b/eval/data/world-v1/companies__andreessen-horowitz-2.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/andreessen-horowitz-2",
  "type": "company",
  "title": "Andreessen Horowitz",
  "compiled_truth": "Andreessen Horowitz, widely known as a16z, is one of the most influential venture capital firms in Silicon Valley and arguably the world. Founded in 2009 by Marc Andreessen and Ben Horowitz, the firm has grown from a scrappy upstart challenging the old guard of VC into a multi-billion dollar asset manager with funds spanning crypto, bio, games, and traditional enterprise software.\n\nThe firm's thesis has always been rooted in the belief that software is eating the world—a phrase Marc coined in his famous 2011 Wall Street Journal essay. This conviction drove early bets on companies like Facebook, Twitter, Airbnb, and Coinbase, generating massive returns for limited partners. a16z pioneered the \"founder-friendly\" approach to venture capital, offering not just capital but an entire platform of services: recruiting, marketing, executive coaching, and regulatory expertise.\n\nIn recent years, Andreessen Horowitz has leaned heavily into crypto and web3, raising multiple dedicated funds totaling billions of dollars. This bet has been controversial—critics argue the firm is too bullish on speculative assets, while supporters see it as visionary positioning for the next computing platform. The firm also expanded into consumer health through a16z Bio and doubled down on American Dynamism, a thesis around backing companies building in defense, aerospace, and manufacturing.\n\nThe partnership includes heavyweights like Chris Dixon (leading crypto), Vijay Pande (bio), and Andrew Chen (consumer). Marc remains a polarizing figure on social media, often wading into political and cultural debates that generate significant attention. Some view this as distraction, others as authentic engagement. Ben Horowitz has focused more on cultural content, including his popular book \"The Hard Thing About Hard Things.\"\n\na16z competes fiercely with firms like [Sequoia Capital](companies/sequoia-capital) and [General Catalyst](companies/general-catalyst) for the best deals. Their approach to content marketing—podcasts, newsletters, extensive blog posts—has been widely imitated across the industry. The firm essentially invented the VC-as-media-company playbook that's now standard practice.",
  "timeline": "- **2021-06-24** | a16z announces $2.2B Crypto Fund III, largest dedicated crypto fund at the time\n- **2022-01-18** | Led Series B for infrastructure startup alongside [General Catalyst](companies/general-catalyst)\n- **2022-05-12** | Launches $4.5B Crypto Fund IV despite market downturn; doubles down on web3 thesis\n- **2023-03-09** | Opens first international office in London, signals expansion beyond Silicon Valley\n- **2023-08-22** | American Dynamism fund invests in defense tech startup building autonomous systems\n- **2024-02-14** | Marc Andreessen testifies before Senate committee on AI regulation concerns\n- **2024-07-30** | a16z Bio leads $180M Series C for longevity-focused biotech company\n- **2024-11-05** | Partnership meeting discusses competitive positioning against [Sequoia Capital](companies/sequoia-capital) in AI deals\n- **2025-04-18** | Closes Fund VIII at $7.2B, largest general fund in firm history\n- **2025-09-02** | Chris Dixon announces new thesis around decentralized AI infrastructure",
  "_facts": {
    "type": "company",
    "slug": "companies/andreessen-horowitz-2",
    "name": "Andreessen Horowitz",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__apex-18.json
+++ b/eval/data/world-v1/companies__apex-18.json
@@ -1,30 +0,0 @@
 {
  "slug": "companies/apex-18",
  "type": "company",
  "title": "Apex",
  "compiled_truth": "Apex is an AI infrastructure startup founded in 2018 by [Nina Rodriguez](people/nina-rodriguez-18), who saw early on that the bottleneck for machine learning wouldn't be algorithms but the underlying compute and data plumbing. The company builds tools that help enterprises manage GPU clusters, optimize model training pipelines, and reduce the staggering costs associated with running large-scale AI workloads. Their flagship product, ApexCore, has become quietly essential for a number of mid-sized ML teams who can't afford to waste cycles on infrastructure headaches.\n\nThe company operates out of Austin, with a small satellite office in San Francisco. Apex has stayed relatively lean—around 45 employees as of late 2024—but punches above its weight in terms of customer logos. Rodriguez has been deliberate about not chasing hypergrowth, preferring sustainable unit economics over flashy fundraising rounds. That said, the company has brought on notable backers including [Priya Taylor](people/priya-taylor-85) and [Kevin Taylor](people/kevin-taylor-102), both of whom participated in the Series A back in 2021.\n\nOn the advisory side, Apex leans on [Tina Wang](people/tina-wang-179) for go-to-market strategy and [Yara Singh](people/yara-singh-195) for technical architecture decisions. Wang's experience scaling enterprise sales orgs has been particulalry valuable as Apex moves upmarket toward Fortune 500 accounts. Singh, meanwhile, has helped the engineering team navigate some gnarly distributed systems challenges—especially around fault tolerance in multi-cloud deployments.\n\nRecent moves suggest Apex is positioning itself for a broader platform play. In early 2025, they aquired a small observability startup to bolster their monitoring capabilities, and rumors persist about a Series B in the works. Rodriguez has been cagey about fundraising plans in interviews, but insiders say the company is fielding inbound interest from several growth-stage funds.\n\nApex isn't the flashiest name in AI infrastructure, but that's sort of the point. They build the boring stuff that makes the exciting stuff possible.",
  "timeline": "- **2018-06-12** | Apex founded by Nina Rodriguez in Austin, Texas with initial focus on GPU cluster management\n- **2021-03-08** | Closed Series A led by [Priya Taylor](people/priya-taylor-85) with participation from [Kevin Taylor](people/kevin-taylor-102)\n- **2022-01-19** | Launched ApexCore v1.0, the company's flagship infrastructure optimization platform\n- **2022-09-14** | [Tina Wang](people/tina-wang-179) joined as strategic advisor to help scale enterprise sales motion\n- **2023-04-22** | Apex hits 100 paying customers milestone, majority in healthcare and fintech verticals\n- **2023-11-30** | [Yara Singh](people/yara-singh-195) comes on as technical advisor, focusing on multi-cloud architecture\n- **2024-05-17** | Nina Rodriguez keynotes at MLOps World conference in Toronto\n- **2024-10-03** | Opened small SF office to be closer to key customers and talent pool\n- **2025-02-11** | Acquired observability startup CloudLens for undisclosed amount\n- **2025-04-28** | Announced ApexCore 3.0 with native support for next-gen NVIDIA chips",
  "_facts": {
    "type": "company",
    "slug": "companies/apex-18",
    "name": "Apex",
    "category": "startup",
    "industry": "AI infrastructure",
    "founded_year": 2018,
    "founders": [
      "people/nina-rodriguez-18"
    ],
    "investors": [
      "people/priya-taylor-85",
      "people/kevin-taylor-102"
    ],
    "employees": [
      "people/will-liu-128"
    ],
    "advisors": [
      "people/tina-wang-179",
      "people/yara-singh-195",
      "people/noah-williams-198"
    ]
  }
 }
--- a/eval/data/world-v1/companies__apple-4.json
+++ b/eval/data/world-v1/companies__apple-4.json
@@ -1,15 +0,0 @@
 {
  "slug": "companies/apple-4",
  "type": "company",
  "title": "Apple",
  "compiled_truth": "Apple is a crypto-focused acquirer that has been making waves in the digital asset space since its founding in 1999. Despite sharing its name with the famous consumer electronics giant, this Apple operates in an entirely different arena—specializing in acquiring and integrating promising blockchain and cryptocurrency ventures into its portfolio.\n\nThe company has positioned itself as a strategic consolidator in the fragmented crypto landscape, targeting startups with strong technology but weak go-to-market execution. Their acquisition thesis centers on identifying undervalued protocols and teams, then providing the capital and operational support needed to scale. Apple's approach has been described as \"patient capital meets aggressive integration,\" a philosophy that has earned them both admirers and critics in the space.\n\nOver the past few years, Apple has expanded its focus beyond pure protocol acquisitions to include infrastructure plays and DeFi platforms. The firm maintains close relationships with several venture partners and has been known to co-invest alongside firms like [Paradigm](companies/paradigm-capital) on select deals. Their due dilligence process is notoriously thorough, often taking 6-8 months before closing.\n\nLeadership at Apple tends to keep a low profile, though insiders describe the culture as intensely analytical. The company employs a mix of traditional M&A professionals and crypto-native talent, creating what some have called a \"hybrid vigor\" in their dealmaking approach. They've been particularly active in the layer-2 scaling space and have made several aqusitions targeting zero-knowledge proof technology.\n\nApple's recent moves suggest a pivot toward institutional-grade custody and compliance solutions, likely anticipating regulatory clarity in major markets. They've been spotted at industry events networking with [Coinbase Ventures](companies/coinbase-ventures) representatives, fueling speculation about potential partnerships or joint ventures. The firm reportedly manages a war chest exceeding $800 million dedicated to strategic acquisitions, though exact figures remain unconfirmed.\n\nDespite the 2022-2023 crypto winter, Apple maintained its acquisition pace, viewing the downturn as a buying opportunity. This contrarian stance has positioned them well heading into the 2024-2025 market recovery.",
  "timeline": "- **2021-03-15** | Apple closes Series B funding round, raising $150M to accelerate acquisition strategy\n- **2021-09-22** | Acquired ZK-proof startup Luminal Labs for undisclosed sum\n- **2022-04-08** | Partnership announced with [Paradigm](companies/paradigm-capital) for co-investment on infrastructure deals\n- **2022-11-30** | Maintained hiring despite market downturn, adding 12 new analysts\n- **2023-06-14** | Completed acquisition of DeFi protocol Streamflow, their largest deal to date\n- **2023-12-01** | Apple representatives spotted meeting with [Coinbase Ventures](companies/coinbase-ventures) team in NYC\n- **2024-05-19** | Launched dedicated compliance-tech acquisition vertical\n- **2024-10-07** | Acquired custody solution provider VaultEdge for $45M\n- **2025-02-22** | Rumored to be in late-stage talks for major layer-2 protocol acquisition\n- **2025-04-11** | Company retreat held in Miami, strategy sessions focused on 2025-2026 deployment targets",
  "_facts": {
    "type": "company",
    "slug": "companies/apple-4",
    "name": "Apple",
    "category": "acquirer",
    "industry": "crypto",
    "founded_year": 1999
  }
 }
--- a/eval/data/world-v1/companies__beacon-10.json
+++ b/eval/data/world-v1/companies__beacon-10.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/beacon-10",
  "type": "company",
  "title": "Beacon",
  "compiled_truth": "Beacon is a cybersecurity startup founded in 2018 by [David Wang](people/david-wang-10), a serial entrepreneur with deep expertise in network security and threat detection. The company has positioned itself as a next-generation endpoint protection platform, focusing primarily on small and medium-sized businesses that lack the resources for enterprise-grade security teams.\n\nThe core product offering centers around an AI-driven threat detection engine that monitors network traffic, user behavior, and system anomalies in real-time. Unlike traditional antivirus solutions, Beacon's approach emphasizes behavioral analysis over signature-based detection, allowing it to catch zero-day exploits and novel attack vectors that would slip past conventional defenses. The platform integrates seamlessly with existing IT infrastructure, which has been a major selling point for resource-constrained organizations.\n\nIn terms of backing, Beacon secured early-stage funding from [Rachel Brown](people/rachel-brown-95), who recognized the growing market opportunity as cyberattacks increasingly target smaller companies. Rachel's involvment brought not just capital but also valuable connections in the enterprise software space. The company has since grown to approximately 45 employees, with offices in San Francisco and a small engineering hub in Austin.\n\n[Julia Chen](people/julia-chen-181) serves as an advisor to the company, providing strategic guidance on go-to-market strategy and partnerships. Her background in scaling B2B SaaS companies has proven invaluable as Beacon transitions from early adopter customers to broader market penetration.\n\nRecent developments include the launch of Beacon Shield, a managed detection and response (MDR) service that pairs the software platform with 24/7 human analysts. This move signals the company's ambition to capture more enterprise clients who want hands-on support. David has been vocal about the need for democratizing cybersecurity—making sophisticated protection accesible to organizations that aren't Fortune 500 companies.\n\nThe competitive landscape remains challenging, with established players like CrowdStrike and newer entrants constantly innovating. However, Beacon's focused positioning and competitive pricing have carved out a loyal customer base. The company processes over 2 billion security events daily across its customer network.",
  "timeline": "- **2018-03-15** | Beacon incorporated in Delaware; [David Wang](people/david-wang-10) begins building initial prototype\n- **2019-01-22** | Closed seed round led by [Rachel Brown](people/rachel-brown-95), raising $2.4M\n- **2020-06-08** | Launched v1.0 of endpoint protection platform; first 50 paying customers onboarded\n- **2021-09-14** | [Julia Chen](people/julia-chen-181) joins as strategic advisor\n- **2022-04-03** | Series A closed at $12M; expanded engineering team to 30 people\n- **2023-02-17** | Beacon Shield MDR service announced at RSA Conference\n- **2023-11-29** | Partnered with major MSP provider, adding 200+ SMB customers\n- **2024-08-12** | Austin engineering office opened; David Wang keynotes at Black Hat\n- **2025-03-05** | Surpassed 1,500 enterprise customers milestone",
  "_facts": {
    "type": "company",
    "slug": "companies/beacon-10",
    "name": "Beacon",
    "category": "startup",
    "industry": "cybersecurity",
    "founded_year": 2018,
    "founders": [
      "people/david-wang-10"
    ],
    "investors": [
      "people/rachel-brown-95"
    ],
    "employees": [
      "people/ulrich-kim-120"
    ],
    "advisors": [
      "people/julia-chen-181"
    ]
  }
 }
--- a/eval/data/world-v1/companies__benchmark-3.json
+++ b/eval/data/world-v1/companies__benchmark-3.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/benchmark-3",
  "type": "company",
  "title": "Benchmark Capital",
  "compiled_truth": "Benchmark is one of Silicon Valley's most storied venture capital firms, known for its disciplined approach and equal partnership structure. Founded in 1995, the firm has maintained a remarkably consistent strategy: small funds, equal economics among partners, and a focus on early-stage investing. Unlike many of its peers who have ballooned into multi-stage asset managers, Benchmark has stayed deliberately small.\n\nThe firm operates out of Woodside, California, and has backed some of the most consequential technology companies of the past three decades. Their portfolio includes legendary bets on eBay, Twitter, Uber, Instagram, and more recently companies like Discord and Chainalysis. Benchmark partners are known for taking board seats and being deeply involved with their portfolio companies—sometimes controversially so, as the firm's role in the Uber boardroom drama demonstrated.\n\nCurrent general partners include Bill Gurley, who has become something of a public intellectual on venture economics and marketplace dynamics, along with Peter Fenton, Matt Cohler, Sarah Tavel, and Eric Vishria. Each partner operates with significant autonomy, sourcing and leading their own deals. The equal partnership model means there's no senior partner taking a larger cut—everyone shares equally in the carry, which creates a unique dynamic compared to firms like [Andreessen Horowitz](companies/a16z) or [Sequoia](companies/sequoia).\n\nBenchmark typically raises funds in the $400-500 million range, which seems almost quaint compared to the multi-billion dollar vehicles some competitors deploy. This constraint is intentional—it forces discipline and keeps the firm focused on ownership percentages in early rounds rather than chasing growth-stage deals. They're not trying to be everything to everyone.\n\nThe firm has a reputation for patience and contrarianism. They'll pass on hot deals that don't meet their criteria and aren't afraid to invest in unfashionable sectors. Recent activity suggests continued interest in developer tools, fintech infrastructure, and consumer social. Their investment memos are legendary within the industry for their rigor and clarity of thinking.",
  "timeline": "- **2021-03-15** | Benchmark led Series A for fintech infrastructure startup, with Peter Fenton joining the board\n- **2021-09-22** | Bill Gurley published influential essay on marketplace liquidity that circulated widely among founders\n- **2022-02-08** | Closed Benchmark XI fund at $425 million, maintaining disciplined fund size despite market exuberance\n- **2022-11-14** | Sarah Tavel led investment in AI-native developer tools company alongside [Sequoia](companies/sequoia)\n- **2023-04-03** | Benchmark partner spoke at industry conference about valuation discipline during downturn\n- **2023-08-19** | Portfolio company Discord reportedly approached for acquisition; Benchmark holds significant stake\n- **2024-01-11** | Eric Vishria sourced deal in vertical SaaS space, continuing firm's enterprise software thesis\n- **2024-06-25** | Benchmark participated in growth round for crypto compliance startup, rare later-stage investment\n- **2025-02-17** | Firm hosted annual LP meeting in Woodside, discussed AI investment strategy with limited partners\n- **2025-09-30** | Co-invested with [Andreessen Horowitz](companies/a16z) in robotics seed round, unusual collaboration",
  "_facts": {
    "type": "company",
    "slug": "companies/benchmark-3",
    "name": "Benchmark",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__bessemer-12.json
+++ b/eval/data/world-v1/companies__bessemer-12.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/bessemer-12",
  "type": "company",
  "title": "Bessemer Venture Partners",
  "compiled_truth": "Bessemer Venture Partners stands as one of the oldest and most storied venture capital firms in the world, with origins dating back to 1911 when it was founded to manage the Phipps family fortune. The firm has evolved dramaticaly over the decades, transitioning from a family office to a full-fledged VC powerhouse with offices across Menlo Park, New York, Boston, and international locations including Israel and India.\n\nBessemer has backed some of the most consequential technology companies of the past several decades. Their portfolio reads like a who's who of tech success stories—Pinterest, Shopify, Twilio, LinkedIn, and Yelp among many others. The firm is particularly known for maintaining an \"anti-portfolio\" page on their website, a refreshingly honest accounting of all the deals they passed on that went on to become massive successes. This includes famously passing on investments in Apple, Google, and Facebook.\n\nThe firm operates with a thesis-driven approach, publishing detailed \"roadmaps\" for sectors they find compelling. These documents often become required reading for founders building in spaces like cloud infrastructure, vertical SaaS, and developer tools. Their cloud computing index, the BVP Nasdaq Emerging Cloud Index, has become an industry benchmark for tracking public cloud company performance.\n\nBessemer typically invests across stages, from seed through growth, though they've become increasingly active in earlier stage deals over recent years. Partners at the firm have included notable investors who've shaped the industry's approach to enterprise software and consumer internet investing. The firm manages multiple funds totaling billions in assets under managment.\n\nTheir investment philosophy emphasizes long-term partnership with founders, and they're known for being patient capital that doesn't push for premature exits. Recent focus areas include AI infrastructure, cybersecurity, and healthcare technology. The firm has been actively deploying capital into companies building foundational AI tooling, seeing parallels to the early cloud computing wave they rode so successfully. Their relationship with [a]([Sequoia Capital](companies/sequoia-capital)) often sees them co-investing in competitive rounds, while they frequently compete with firms like [Andreessen Horowitz](companies/a16z) for the best deals in enterprise software.",
  "timeline": "- **2021-03-15** | Bessemer closes Fund XII at $3.3 billion, largest fund in firm history\n- **2021-09-22** | Published influential AI infrastructure roadmap, predicting consolidation in MLOps tooling\n- **2022-04-10** | Led Series B for cybersecurity startup, marking continued focus on security vertical\n- **2022-11-08** | Partner departure to [Andreessen Horowitz](companies/a16z) creates temporary leadership shuffle\n- **2023-06-14** | Hosted annual CEO Summit in Menlo Park with 200+ portfolio founders attending\n- **2023-12-01** | BVP Nasdaq Cloud Index hits record low amid tech downturn, firm publishes market analysis\n- **2024-03-28** | Announced new $250M opportunity fund focused exclusively on AI-native companies\n- **2024-08-19** | Co-led $80M growth round alongside [Sequoia Capital](companies/sequoia-capital) in developer tools company\n- **2025-01-07** | Opened new Tel Aviv office expansion, doubling Israel team headcount\n- **2025-04-22** | Released updated anti-portfolio page, adding several notable AI misses from 2023",
  "_facts": {
    "type": "company",
    "slug": "companies/bessemer-12",
    "name": "Bessemer",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__beta-1.json
+++ b/eval/data/world-v1/companies__beta-1.json
@@ -1,21 +0,0 @@
 {
  "slug": "companies/beta-1",
  "type": "company",
  "title": "Beta - Cybersecurity Startup",
  "compiled_truth": "Beta is an early-stage cybersecurity startup founded in 2023 by [Victor Taylor](people/victor-taylor-1), a veteran security researcher with deep roots in threat intelligence. The company emerged from Victor's frustration with legacy security tools that couldn't keep pace with modern attack surfaces. Based out of Austin, Texas, Beta is building what they call \"adaptive defense infrastructure\" — essentially AI-powered systems that learn an organization's normal network behavior and flag anomolies in real-time.\n\nThe founding thesis is simple but ambitious: most breaches happen because security teams are overwhelmed by alerts, not because they lack tools. Beta's platform aims to reduce alert fatigue by 90% through intelligent triage and automated response playbooks. Early customers include three mid-market fintech companies and a healthcare provider, though the company hasn't disclosed names publicly yet.\n\n[Victor Taylor](people/victor-taylor-1) serves as CEO and has been the public face of the company, speaking at several industry events about the failures of traditional SIEM solutions. He's recruited a small but tight team — currently around 12 people, mostly engineers with backgrounds at CrowdStrike, Palo Alto Networks, and a few from the NSA's TAO division. The technical co-founder role remains unfilled, which Victor has acknowledged is a gap they're actively working to address.\n\nBeta raised a $4.2M seed round in late 2023, led by a cybersecurity-focused fund with participation from several angel investors. The company is currently pre-revenue in any meaningful sense, though they've signed design partners who are testing the platform in production enviornments. Their go-to-market strategy focuses on the mid-market segment — companies large enough to have security teams but too small to afford enterprise solutions from the big players.\n\nThe competitive landscape is crowded, but Beta believes timing is on their side. With ransomware attacks continuing to surge and regulatory pressure mounting, even smaller companies are being forced to invest in security infrastructure. Whether Beta can carve out space against well-funded incumbants remains to be seen.",
  "timeline": "- **2023-03-15** | [Victor Taylor](people/victor-taylor-1) incorporates Beta in Delaware, begins recruiting founding team\n- **2023-06-22** | Beta closes $4.2M seed round, announces plans to build adaptive defense platform\n- **2023-09-08** | First design partner signed — unnamed fintech company in the payments space\n- **2023-11-30** | Team grows to 8 employees, opens Austin office space\n- **2024-02-14** | Victor presents Beta's threat detection approach at RSA Conference\n- **2024-05-03** | Platform enters closed beta with three enterprise customers\n- **2024-08-19** | Expands engineering team to 12, still searching for technical co-founder\n- **2024-11-07** | Signs fourth design partner, a regional healthcare provider\n- **2025-01-22** | Begins Series A conversations with multiple VCs",
  "_facts": {
    "type": "company",
    "slug": "companies/beta-1",
    "name": "Beta",
    "category": "startup",
    "industry": "cybersecurity",
    "founded_year": 2023,
    "founders": [
      "people/victor-taylor-1"
    ],
    "employees": [
      "people/tara-kapoor-111"
    ]
  }
 }
--- a/eval/data/world-v1/companies__beta-labs-51.json
+++ b/eval/data/world-v1/companies__beta-labs-51.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/beta-labs-51",
  "type": "company",
  "title": "Beta Labs",
  "compiled_truth": "Beta Labs is a data infrastructure startup founded in 2019 by [Victor Jones](people/victor-jones-51). The company has carved out a niche in the increasingly crowded data tooling space by focusing on real-time data synchronization for distributed systems. Their flagship product, SyncCore, enables companies to maintain consistency across multiple data stores without the typical latency penalties.\n\nThe founding story is pretty straightforward. Victor had spent years dealing with data consistency nightmares at previous roles and decided there had to be a better way. Beta Labs emerged from that frustration, initially as a consulting operation before pivoting to product in late 2020. The pivot proved wise—enterprise demand for their sync technology exceeded expectations.\n\nFunding has come from angel investors including [Jack Davis](people/jack-davis-89) and [Chris Singh](people/chris-singh-96), both of whom participated in the seed round. Jack in particular has been an active advisor, connecting the company with potential enterprise customers in the fintech vertical. Chris brought operational expertise from his own startup experience, helping Beta Labs avoid some common scaling pitfalls.\n\nThe team has grown to around 45 people, mostly engineers. They've maintained a relatively low profile compared to flashier competitors, preferring to let the technology speak for itself. This approach has worked—several Fortune 500 companies now rely on SyncCore for mission-critical data operations, though Beta Labs rarely publicizes these relationships.\n\nRecent moves suggest the company is gearing up for expansion. They've been hiring aggressivley on the go-to-market side and opened a small office in London to serve European clients. There's been speculation about a Series A, though Victor has remained tight-lipped about fundraising plans.\n\nBeta Labs occupies an interesting position in the data infrastructure ecosystem. Not quite a database company, not purely an ETL play—more of a connective tissue between existing systems. This positioning has made them attractive to enterprises who don't want to rip and replace their current stack but desperatley need better synchronization. The data infrastructure space continues to evolve rapidly, and Beta Labs seems well-positioned to grow alongside it.",
  "timeline": "- **2019-03-15** | Beta Labs incorporated by [Victor Jones](people/victor-jones-51) in Delaware\n- **2020-11-02** | Pivoted from consulting to product development, began building SyncCore\n- **2021-04-18** | Closed seed round with participation from [Jack Davis](people/jack-davis-89) and [Chris Singh](people/chris-singh-96)\n- **2021-09-07** | Launched SyncCore private beta with 12 design partners\n- **2022-02-14** | General availability of SyncCore, landed first Fortune 500 customer\n- **2023-06-22** | Reached 30 employees, opened London office for European expansion\n- **2024-01-10** | [Victor Jones](people/victor-jones-51) spoke at DataCon about distributed consistency patterns\n- **2024-08-30** | Shipped SyncCore 2.0 with multi-region support\n- **2025-03-12** | Announced partnership with major cloud provider for marketplace distribution\n- **2025-11-05** | Rumored Series A discussions with multiple tier-one VCs",
  "_facts": {
    "type": "company",
    "slug": "companies/beta-labs-51",
    "name": "Beta Labs",
    "category": "startup",
    "industry": "data infrastructure",
    "founded_year": 2019,
    "founders": [
      "people/victor-jones-51"
    ],
    "investors": [
      "people/jack-davis-89",
      "people/chris-singh-96"
    ],
    "employees": [
      "people/kate-rodriguez-161"
    ]
  }
 }
--- a/eval/data/world-v1/companies__brink-29.json
+++ b/eval/data/world-v1/companies__brink-29.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/brink-29",
  "type": "company",
  "title": "Brink",
  "compiled_truth": "Brink is a data infrastructure startup founded in 2019 by [Uma Gonzalez](people/uma-gonzalez-29), who serves as CEO. The company builds middleware solutions that help enterprises manage data pipelines across hybrid cloud environments. Their flagship product, Brink Flow, enables real-time data synchronization between on-premise databases and cloud data warehouses without requiring significant engineering overhead.\n\nThe company emerged from Uma's frustration with existing ETL tools while she was working at a large financial services firm. She saw an oportunity to build something more elegant—a system that could handle schema changes automatically and scale horizontally without the typical headaches. Brink's approach uses a proprietary conflict resolution algorithm that has attracted attention from several Fortune 500 companies looking to modernize their data stacks.\n\nBrink operates with a relatively lean team of around 45 employees, mostly engineers, headquartered in Austin with a small office in San Francisco. The company has raised approximately $28 million across seed and Series A rounds, though they've been quiet about specifics. Industry observers note that Brink competes in a crowded space but has carved out a niche with customers who need particularly robust handling of legacy database formats.\n\nThe advisory board includes [Ian Wilson](people/ian-wilson-180), who brings deep expertise in enterprise sales cycles, and [Grace Singh](people/grace-singh-197), known for her technical architecture background. Both advisors have been instrumental in shaping Brink's go-to-market strategy and product roadmap. Grace in particular has pushed the team toward better observability features, which became a key differentiator in recent customer wins.\n\nRecent months have seen Brink expanding into the healthcare vertical, where data compliance requirements create natural demand for their controlled sync capabilities. The company announced SOC 2 Type II certification in late 2024, a prerequisite for many enterprise deals. Uma has been public about her goal to reach $10M ARR before considering a Series B, preferring to grow efficently rather than chase hypergrowth.",
  "timeline": "- **2019-03-15** | Uma Gonzalez incorporates Brink in Delaware, begins building initial prototype\n- **2021-06-22** | Closes $4.2M seed round led by Vertex Ventures\n- **2022-01-10** | Brink Flow enters private beta with 12 design partners\n- **2022-09-08** | [Ian Wilson](people/ian-wilson-180) joins as advisor, helps restructure sales approach\n- **2023-02-14** | Announces $24M Series A, valuation undisclosed\n- **2023-07-19** | [Grace Singh](people/grace-singh-197) joins advisory board\n- **2024-04-03** | Ships Brink Flow 2.0 with real-time schema migration support\n- **2024-11-12** | Achieves SOC 2 Type II certification\n- **2025-02-28** | Signs first major healthcare customer, regional hospital network\n- **2025-05-16** | [Uma Gonzalez](people/uma-gonzalez-29) speaks at Data Summit on hybrid cloud challenges",
  "_facts": {
    "type": "company",
    "slug": "companies/brink-29",
    "name": "Brink",
    "category": "startup",
    "industry": "data infrastructure",
    "founded_year": 2019,
    "founders": [
      "people/uma-gonzalez-29"
    ],
    "employees": [
      "people/vera-wang-139"
    ],
    "advisors": [
      "people/ian-wilson-180",
      "people/grace-singh-197"
    ]
  }
 }
--- a/eval/data/world-v1/companies__cascade-30.json
+++ b/eval/data/world-v1/companies__cascade-30.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/cascade-30",
  "type": "company",
  "title": "Cascade",
  "compiled_truth": "Cascade is an AI applications startup founded in 2018 by [Yara Smith](people/yara-smith-30), who remains the driving force behind the company's product vision. The company focuses on building enterprise-grade AI tools that automate complex document workflows, particularly in legal and compliance sectors. Their flagship product, Cascade Flow, uses large language models to extract, summarize, and cross-reference information across thousands of documents simultaneosly.\n\nThe early years were tough. Cascade operated in relative obscurity, bootstrapping through consulting gigs while refining their core technology. It wasn't until 2021 that they secured meaningful venture funding and began scaling the team. Today the company employs around 85 people, mostly engineers and ML researchers, with a small but scrappy sales org based out of their San Francisco headquarters.\n\n[Bob Chen](people/bob-chen-185) joined as an advisor in late 2022, bringing his extensive experience in enterprise SaaS and go-to-market strategy. His involvement reportedly helped Cascade land several Fortune 500 pilots that converted to multi-year contracts. Chen's network in the financial services industry has been particuarly valuable as Cascade expands beyond legal tech into banking and insurance verticals.\n\nYara Smith has been vocal about building AI that augments rather than replaces human workers. In interviews she often emphasizes that Cascade's tools are designed to handle the drudgery so professionals can focus on judgment calls and client relationships. This positioning has resonated well with enterprise buyers who remain cautious about fully autonomous AI systems.\n\nRecent moves suggest Cascade is preparing for significant growth. They've been hiring aggressively for a new product line—rumored to be an AI-powered contract negotiation assistant—and opened a small office in London to support European expansion. Competition in the space is heating up with well-funded rivals, but Cascade's early mover advantage and deep integrations with legacy document management systems give them a defensible position. The company is reportedly exploring a Series C round, though nothing has been announced publicly.",
  "timeline": "- **2018-03-12** | Cascade incorporated in Delaware by founder Yara Smith\n- **2021-06-08** | Closed $8M Series A led by Threshold Ventures\n- **2022-04-15** | Launched Cascade Flow publicly after 18 months of private beta\n- **2022-11-02** | [Bob Chen](people/bob-chen-185) joined as strategic advisor\n- **2023-02-28** | Announced partnership with DocuSign for native integration\n- **2023-09-14** | [Yara Smith](people/yara-smith-30) spoke at TechCrunch Disrupt on enterprise AI adoption\n- **2024-01-22** | Raised $32M Series B, valuation undisclosed\n- **2024-07-10** | Opened London office to support EMEA expansion\n- **2025-03-05** | Reached 200 enterprise customers milestone\n- **2025-11-18** | Began private beta for contract negotiation AI product",
  "_facts": {
    "type": "company",
    "slug": "companies/cascade-30",
    "name": "Cascade",
    "category": "startup",
    "industry": "AI applications",
    "founded_year": 2018,
    "founders": [
      "people/yara-smith-30"
    ],
    "employees": [
      "people/noah-davis-140"
    ],
    "advisors": [
      "people/bob-chen-185"
    ]
  }
 }
--- a/eval/data/world-v1/companies__cipher-13.json
+++ b/eval/data/world-v1/companies__cipher-13.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/cipher-13",
  "type": "company",
  "title": "Cipher",
  "compiled_truth": "Cipher is a fintech startup founded in 2024 by [Mia Lee](people/mia-lee-13), a first-time founder with a background in cryptography and distributed systems. The company is building infrastructure for programmable money—specifically, a platform that allows fintechs and neobanks to embed complex payment logic directly into their transaction rails. Think conditional payments, escrow-like holds, and multi-party settlements, all handled at the protocol level rather than bolted on after the fact.\n\nThe founding thesis came out of Mia's frustration working at larger financial institutions where even simple payment customizations required months of engineering work and compliance review. Cipher aims to abstract away that complexity, offering APIs that let developers define payment conditions in a few lines of code. Early positioning suggests they're targeting B2B fintech infrastructure rather than consumer-facing products.\n\nThe company operates lean, with a small team of five engineers working out of a co-working space in San Francisco. [Noah Williams](people/noah-williams-198) serves as an advisor, bringing experience from his own ventures in the payments space. His involvement lent early credibility when Cipher was pitching to angels and seed investors. Noah's been particularly helpful on go-to-market stratgey, pushing the team to focus on a narrow wedge before expanding.\n\nCipher closed a pre-seed round in late 2024, though the exact amount hasn't been publicly disclosed—likely in the $1.5-2M range based on typical fintech raises at that stage. The company has been in private beta with three design partners, all smaller neobanks looking to differentiate on payment flexibility. Early feedback has been positive, though integrations have taken longer than anticipated due to legacy system constraints on the partner side.\n\nMia has been intentionally quiet about the company publicly, preferring to let the product speak once it's ready. She's mentioned in interviews that Cipher won't be doing a splashy launch—instead, they'll scale through word of mouth in the developer comunity. The name itself, Cipher, reflects both the cryptographic roots and the idea of encoding complex logic into simple interfaces.",
  "timeline": "- **2024-01-15** | [Mia Lee](people/mia-lee-13) incorporates Cipher in Delaware, begins recruiting founding engineers\n- **2024-03-02** | First technical architecture doc completed; decides on Rust for core payment engine\n- **2024-04-18** | [Noah Williams](people/noah-williams-198) joins as advisor after intro through mutual investor contact\n- **2024-06-10** | Cipher closes pre-seed round, terms undisclosed\n- **2024-08-22** | Private beta launches with first design partner, a challenger bank based in Austin\n- **2024-10-05** | Second and third beta partners onboarded; team grows to five full-time\n- **2024-11-30** | Mia presents Cipher at a closed fintech founders dinner in SF\n- **2025-01-14** | First successful production transaction processed through Cipher rails\n- **2025-03-08** | Beginning conversations with potential seed investors for next round",
  "_facts": {
    "type": "company",
    "slug": "companies/cipher-13",
    "name": "Cipher",
    "category": "startup",
    "industry": "fintech",
    "founded_year": 2024,
    "founders": [
      "people/mia-lee-13"
    ],
    "employees": [
      "people/julia-thomas-123"
    ],
    "advisors": [
      "people/noah-williams-198"
    ]
  }
 }
--- a/eval/data/world-v1/companies__compass-11.json
+++ b/eval/data/world-v1/companies__compass-11.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/compass-11",
  "type": "company",
  "title": "Compass",
  "compiled_truth": "Compass is a crypto startup founded in 2018 by [Mark Thomas](people/mark-thomas-11), positioning itself as an early mover in blockchain-based navigation and location services. The company has carved out a niche attempting to decentralize geospatial data, arguing that traditional mapping services concentrate too much power in the hands of a few tech giants.\n\nThe core product is a token-incentivized network where users contribute location data and receive CMPS tokens in return. Think of it as a crypto-native alternative to Google Maps, though the comparison is admittedly generous given Compass's current scale. The protocol allows developers to build location-aware dApps without relying on centralized APIs, which has attracted some interest from the DeFi and gaming communities.\n\nMark Thomas serves as CEO and has been the driving force behind the company's technical vision. Before founding Compass, he worked in geospatial analytics and became convinced that location data would become increasingly valuable—and increasingly surveilled. His pitch to investors centered on data sovereignty and the idea that people should own their movement patterns.\n\n[Chris Miller](people/chris-miller-101) came in as an early investor during the 2019 seed round, providing both capital and credibility in crypto circles. Miller's involvement helped Compass attract additional funding and connected the team to key infrastructure partners. The relationship has been mutually beneficial, with Miller often pointing to Compass as an example of \"real utility\" in the blockchain space.\n\nOn the advisory side, [Sam Garcia](people/sam-garcia-188) has been instrumental in shaping go-to-market strategy. Garcia joined as an advisor in late 2021 and helped the company navigate the treacherous waters of the 2022 crypto winter. His experience with enterprise sales proved valuable when Compass pivoted toward B2B partnerships with logistics companies.\n\nRecent moves include a partnership with several delivery startups in Southeast Asia and the launch of Compass SDK 2.0, which simplifies integration for third-party developers. The team remains small—around 25 people—but has managed to maintain steady growth despite market volatility. Their approach has been decidedly un-hypey by crypto standards, focusing on incremental adoption rather then moonshot promises.",
  "timeline": "- **2018-06-15** | Compass incorporated by [Mark Thomas](people/mark-thomas-11) in Delaware, initial whitepaper published\n- **2019-03-22** | Seed round closed with [Chris Miller](people/chris-miller-101) leading, $2.1M raised\n- **2020-11-08** | CMPS token launched on mainnet, initial contributor network goes live\n- **2021-09-14** | [Sam Garcia](people/sam-garcia-188) joins as strategic advisor\n- **2022-05-30** | Company survives Terra collapse fallout, announces pivot toward enterprise partnerships\n- **2023-02-17** | Partnership signed with three logistics firms in Singapore and Vietnam\n- **2024-01-09** | Compass SDK 2.0 released, developer signups increase 340% in Q1\n- **2024-08-23** | Mark Thomas speaks at ETH Denver on decentralized infrastructure\n- **2025-04-11** | Series A discussions reportedly underway, targeting $15M raise",
  "_facts": {
    "type": "company",
    "slug": "companies/compass-11",
    "name": "Compass",
    "category": "startup",
    "industry": "crypto",
    "founded_year": 2018,
    "founders": [
      "people/mark-thomas-11"
    ],
    "investors": [
      "people/chris-miller-101"
    ],
    "employees": [
      "people/rachel-davis-121"
    ],
    "advisors": [
      "people/sam-garcia-188"
    ]
  }
 }
--- a/eval/data/world-v1/companies__delta-3.json
+++ b/eval/data/world-v1/companies__delta-3.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/delta-3",
  "type": "company",
  "title": "Delta",
  "compiled_truth": "Delta is a biotech startup founded in 2022 by [Victor Wilson](people/victor-wilson-3), who previously spent nearly a decade in academic research before making the jump to entrepreneurship. The company focuses on developing novel protein engineering platforms, with an initial emphasis on therapeutic applications for rare genetic disorders. Based out of the Boston-Cambridge biotech corridor, Delta has quickly gained attention for its unconventional approach to computational biology.\n\nThe founding story is somewhat unusual. Victor had been sitting on the core intellectual property for years, hesitant to commercialize what he considered fundamental research. It wasn't until a chance meeting with [David Zhang](people/david-zhang-83) at a conference in late 2021 that the idea of building a company around the technology started to take shape. Zhang, known for his patient capital approach, saw potential where others had passed.\n\nDelta's seed round closed in early 2023, with [Rachel Brown](people/rachel-brown-95) joining as a co-lead investor alongside Zhang. Brown brought not just capital but also deep operational expertise from her previous biotech exits. The round was modest by industry standards—around $4.2M—but sufficient to build out the initial lab infrastructure and hire a small team of computational biologists.\n\n[David Brown](people/david-brown-187) serves as the company's primary advisor, providing guidance on regulatory pathways and clinical trial design. His involvement has been instrumental in helping Delta avoid some of the common pitfalls that trap early-stage biotech ventures. The advisory relationship began informally but was formalized in mid-2023.\n\nThe company remains small, with fewer than fifteen full-time employees. Victor Wilson continues to lead as CEO, though there's been some internal discussion about bringing in an experienced biotech operator as the company approaches its Series A. Delta's platform has shown promising early results in preclinical models, though significant validation work remains before any theraputic candidates could advance to human trials. The team is currently focused on partnership discussions with larger pharma players who might provide both capital and developmnet expertise.",
  "timeline": "- **2021-11-18** | Victor Wilson meets [David Zhang](people/david-zhang-83) at BioFuture Conference in San Francisco; initial conversations about commercialization begin\n- **2022-03-07** | Delta formally incorporated in Delaware; Victor Wilson named founding CEO\n- **2022-06-14** | First lab space secured in Cambridge, MA; initial equipment purchases made\n- **2023-02-22** | Seed round closes at $4.2M led by [David Zhang](people/david-zhang-83) and [Rachel Brown](people/rachel-brown-95)\n- **2023-05-30** | [David Brown](people/david-brown-187) joins as formal advisor; focuses on regulatory strategy\n- **2023-09-11** | Delta publishes preprint on novel protein folding methodology; generates significant academic interest\n- **2024-01-16** | Team expands to 12 FTEs; hires head of computational biology from Stanford\n- **2024-07-08** | First preclinical proof-of-concept data shared with potential pharma partners\n- **2025-02-03** | Delta enters preliminary partnership discussions with two top-20 pharma companies",
  "_facts": {
    "type": "company",
    "slug": "companies/delta-3",
    "name": "Delta",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2022,
    "founders": [
      "people/victor-wilson-3"
    ],
    "investors": [
      "people/david-zhang-83",
      "people/rachel-brown-95"
    ],
    "employees": [
      "people/adam-lopez-113"
    ],
    "advisors": [
      "people/david-brown-187"
    ]
  }
 }
--- a/eval/data/world-v1/companies__delta-labs-53.json
+++ b/eval/data/world-v1/companies__delta-labs-53.json
@@ -1,29 +0,0 @@
 {
  "slug": "companies/delta-labs-53",
  "type": "company",
  "title": "Delta Labs",
  "compiled_truth": "Delta Labs is a climate tech startup founded in 2021 by [Will Garcia](people/will-garcia-53), who left a senior role at a major energy company to pursue what he calls \"the only problem worth solving.\" The company focuses on direct air capture technology, specifically developing modular units that can be deployed at scale in industrial settings. Their approach differs from competitors by integrating with existing HVAC infrastructure rather than requiring standalone installations.\n\nThe company has attracted notable backing from angel investors including [Wendy Hernandez](people/wendy-hernandez-80) and [Tina Hernandez](people/tina-hernandez-97), both of whom have deep networks in the cleantech space. Delta Labs closed their seed round in late 2022, though exact figures weren't publicly disclosed. Industry insiders estimate somewhere between $4-6M based on hiring patterns and equipment purchases.\n\nOn the advisory side, Delta brought in [Wendy Wilson](people/wendy-wilson-170) for her expertise in regulatory navigation—critical for a company operating in a space where policy can make or break unit economics. [Grace Singh](people/grace-singh-197) rounds out the advisory board, contributing her background in scaling hardware startups through the notorious \"valley of death\" between prototype and production.\n\nDelta's current focus is on their second-generation capture modules, which promise 40% better efficiency than their initial designs. Will Garcia has been particularly vocal about avoiding the hype cycles that have plagued other climate tech ventures, preferring to let results speak. The team has grown to roughly 25 people, mostly engineers with backgrounds in chemical enginering and mechanical systems.\n\nThe company operates out of a converted warehouse in Oakland, where they run continuous testing on their prototype units. Early pilot programs with two Fortune 500 companies are underway, though Delta Labs hasn't named partners publicly. Garcia has mentioned in interviews that revenue isn't the immediate priority—proving the technology works at scale is. Whether that patience will pay off remains to be seen, but the climate tech sector is watching closely.",
  "timeline": "- **2021-03-15** | Delta Labs incorporated in Delaware by founder [Will Garcia](people/will-garcia-53)\n- **2021-09-02** | First prototype capture unit completed; internal testing begins at Oakland facility\n- **2022-04-18** | [Wendy Hernandez](people/wendy-hernandez-80) joins as lead investor in pre-seed round\n- **2022-11-30** | Seed round closed with participation from [Tina Hernandez](people/tina-hernandez-97) and other angels\n- **2023-02-14** | [Wendy Wilson](people/wendy-wilson-170) announced as regulatory advisor\n- **2023-07-22** | Delta Labs hits 15 employees; opens second testing bay\n- **2024-01-10** | Gen-2 modular unit enters development phase\n- **2024-06-05** | First enterprise pilot program signed (partner undisclosed)\n- **2025-03-28** | Will Garcia speaks at Climate Forward conference on scaling DAC technology\n- **2025-09-12** | Second Fortune 500 pilot announced; team reaches 25 people",
  "_facts": {
    "type": "company",
    "slug": "companies/delta-labs-53",
    "name": "Delta Labs",
    "category": "startup",
    "industry": "climate tech",
    "founded_year": 2021,
    "founders": [
      "people/will-garcia-53"
    ],
    "investors": [
      "people/wendy-hernandez-80",
      "people/tina-hernandez-97"
    ],
    "employees": [
      "people/liam-miller-163"
    ],
    "advisors": [
      "people/wendy-wilson-170",
      "people/grace-singh-197"
    ]
  }
 }
--- a/eval/data/world-v1/companies__drift-31.json
+++ b/eval/data/world-v1/companies__drift-31.json
@@ -1,30 +0,0 @@
 {
  "slug": "companies/drift-31",
  "type": "company",
  "title": "Drift",
  "compiled_truth": "Drift is a developer tools startup founded in 2021 by [Frank Hernandez](people/frank-hernandez-31), who saw an opportunity to streamline the way engineering teams manage configuration drift across distributed systems. The company emerged from Frank's frustration while working at larger tech firms, where he noticed teams spending countless hours debugging issues caused by configuration mismatches between environments.\n\nThe core product offers real-time monitoring and automated remediation for infrastructure configurations, targeting mid-size engineering organizations running complex microservices architectures. Drift's approach differs from traditional configuration managment tools by focusing on detection and alerting rather than enforcement, giving teams flexibility while maintaining visibility. The platform integrates with major cloud providers and works alongside existing CI/CD pipelines.\n\nEarly funding came from a group of angel investors including [Wendy Hernandez](people/wendy-hernandez-80), [Fiona Moore](people/fiona-moore-88), and [Jack Davis](people/jack-davis-89). The diverse investor group brought both capital and operational expertise to the young company. Wendy in particular has been instrumental in connecting Drift with potential enterprise customers through her network.\n\n[Xavier Patel](people/xavier-patel-183) serves as an advisor, bringing deep experience in developer tooling and go-to-market strategy. His guidance helped shape Drift's initial product positioning and pricing model. Xavier pushed the team to focus on a specific use case rather than trying to boil the ocean with features.\n\nThe company operates with a lean team, currently around 15 employees, mostly engineers. They've taken a developer-first approach to sales, offering generous free tiers and building community through open source contributions. Their CLI tool has gained traction on GitHub, serving as a funnel for the commercial product.\n\nDrift has seen steady growth among startups and scale-ups, though breaking into true enterprise accounts remains a challenge. The team is currently working on SOC 2 compliance and additional security features to address enterprise requirements. Competition in the config management space is fierce, but Drift's focused approach has carved out a niche among teams who value simplicity over comprehensiveness.",
  "timeline": "- **2021-03-15** | Company founded by [Frank Hernandez](people/frank-hernandez-31) after leaving his role at a major cloud provider\n- **2021-06-22** | Closed pre-seed round with participation from [Wendy Hernandez](people/wendy-hernandez-80) and [Fiona Moore](people/fiona-moore-88)\n- **2021-11-08** | Launched private beta with 12 design partner companies\n- **2022-04-03** | [Xavier Patel](people/xavier-patel-183) joined as formal advisor\n- **2022-09-17** | Public launch of Drift CLI tool, gained 2k GitHub stars in first month\n- **2023-02-28** | [Jack Davis](people/jack-davis-89) participated in seed extension round\n- **2023-08-14** | Shipped Kubernetes-native integration, biggest feature release to date\n- **2024-01-22** | Frank spoke at DevOpsDays SF on configuration observability\n- **2024-07-09** | Reached 500 active organizations on the platform\n- **2025-03-11** | Began SOC 2 Type II certification process",
  "_facts": {
    "type": "company",
    "slug": "companies/drift-31",
    "name": "Drift",
    "category": "startup",
    "industry": "developer tools",
    "founded_year": 2021,
    "founders": [
      "people/frank-hernandez-31"
    ],
    "investors": [
      "people/wendy-hernandez-80",
      "people/fiona-moore-88",
      "people/jack-davis-89",
      "people/tina-hernandez-97"
    ],
    "employees": [
      "people/olivia-garcia-141"
    ],
    "advisors": [
      "people/xavier-patel-183"
    ]
  }
 }
--- a/eval/data/world-v1/companies__echo-32.json
+++ b/eval/data/world-v1/companies__echo-32.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/echo-32",
  "type": "company",
  "title": "Echo - Robotics Startup",
  "compiled_truth": "Echo is a robotics startup founded in 2025 by [Helen Johnson](people/helen-johnson-32), a serial entrepreneur with deep expertise in automation and machine learning. The company focuses on developing autonomous robotic systems for warehouse logistics and last-mile delivery, positioning itself at the intersection of AI and physical hardware. Based in Austin, Texas, Echo has quickly gained attention for its modular approach to robot design, allowing clients to customize units for specific operational needs.\n\nThe founding team came together after Helen's previous venture in industrial automation was aquired by a larger player in the space. She saw an opportunity to build something more agile, more responsive to the needs of mid-sized fulfillment centers that couldn't afford the massive infrastructure investments required by legacy robotics providers. Echo's flagship product, the E-1 mobile unit, can navigate complex warehouse environments with minimal setup time.\n\nEarly backing came from angel investors including [Julia Davis](people/julia-davis-86) and [Helen Martinez](people/helen-martinez-87), both of whom have track records in deep tech investments. Julia Davis in particular has been instrumental in connecting Echo with potential enterprise customers through her network in the logistics industry. The company closed a small seed round in early 2025, though exact figures haven't been publicly disclosed.\n\nEcho operates with a lean team of around twelve engineers and has partnered with several contract manufacturers to scale production. The startup has been notably secretive about its technical roadmap, though rumors suggest they're working on swarm coordination protocols that would allow multiple E-1 units to operate collaboratively. Helen Johnson has hinted at plans to expand into agricultural robotics by 2026, leveraging the same core platform.\n\nThe robotics space is crowded, but Echo's emphasis on affordabilty and rapid deployment has resonated with smaller operators who feel underserved by existing solutions. Whether they can maintain this edge as they scale remains to be seen.",
  "timeline": "- **2024-09-15** | [Helen Johnson](people/helen-johnson-32) begins initial R&D work on modular robotics platform\n- **2025-01-20** | Echo officially incorporated in Austin, Texas\n- **2025-02-08** | [Julia Davis](people/julia-davis-86) commits as lead angel investor\n- **2025-02-14** | [Helen Martinez](people/helen-martinez-87) joins seed round\n- **2025-03-30** | First E-1 prototype completed and demonstrated internally\n- **2025-05-12** | Echo hires VP of Engineering from Boston Dynamics\n- **2025-07-22** | Pilot program launched with regional fulfillment center in Dallas\n- **2025-09-10** | Helen Johnson speaks at RoboWorld Conference on modular design philosophy\n- **2025-11-01** | Company reaches 12 full-time employees",
  "_facts": {
    "type": "company",
    "slug": "companies/echo-32",
    "name": "Echo",
    "category": "startup",
    "industry": "robotics",
    "founded_year": 2025,
    "founders": [
      "people/helen-johnson-32"
    ],
    "investors": [
      "people/julia-davis-86",
      "people/helen-martinez-87"
    ],
    "employees": [
      "people/fiona-hernandez-142"
    ]
  }
 }
--- a/eval/data/world-v1/companies__epsilon-4.json
+++ b/eval/data/world-v1/companies__epsilon-4.json
@@ -1,30 +0,0 @@
 {
  "slug": "companies/epsilon-4",
  "type": "company",
  "title": "Epsilon",
  "compiled_truth": "Epsilon is a cybersecurity startup founded in 2021 by [Paul Rodriguez](people/paul-rodriguez-4), a veteran security researcher who previously led threat intelligence teams at two Fortune 500 companies. The company focuses on automated vulnerability detection for cloud-native infrastructure, using machine learning models trained on proprietary datasets of real-world attack patterns.\n\nFrom the begining, Epsilon positioned itself as a developer-first security platform. Rather than bolting security onto existing workflows, the product integrates directly into CI/CD pipelines, scanning code and infrastructure-as-code templates before deployment. This approach resonated with engineering teams frustrated by traditional security tools that generated endless false positives and slowed down releases.\n\nThe company has attracted notable backing from angel investors including [Sarah Lopez](people/sarah-lopez-84), [Sarah Williams](people/sarah-williams-92), and [Kate Lopez](people/kate-lopez-99). Their combined experience in enterprise software and fintech has helped Epsilon navigate early sales cycles with large financial institutions. The advisory board includes [Olivia Miller](people/olivia-miller-176), who brings deep expertise in go-to-market strategy for B2B SaaS, and [Bob Chen](people/bob-chen-185), a respected figure in the open-source security community.\n\nEpsilon's flagship product, ShieldScan, launched in late 2022 and has since been adopted by over 150 organizations. The platform monitors Kubernetes clusters, AWS environments, and Azure deployments in real-time, alerting teams to misconfigurations and potential breach vectors. Recent product updates have added support for GCP and introduced a compliance module targeting SOC 2 and HIPAA requirements.\n\nPaul Rodriguez has been vocal about the need for security tooling that \"meets developers where they are\" rather than imposing rigid workflows. This philosophy has driven Epsilon's product roadmap and contributed to strong word-of-mouth growth among DevOps teams. The company currently employs around 45 people, with engineering and customer success making up the bulk of headcount. Headquarters are in Austin, Texas, though most of the team works remotely.\n\nCompetition in the cloud security space is intense, with well-funded players like Wiz and Lacework dominating mindshare. Epsilon differentiates through pricing transparency and a self-serve model that lets smaller teams get started without lengthy enterprise sales processes.",
  "timeline": "- **2021-03-15** | Epsilon incorporated in Delaware by [Paul Rodriguez](people/paul-rodriguez-4)\n- **2021-07-22** | Closed $1.2M pre-seed round led by [Sarah Lopez](people/sarah-lopez-84)\n- **2022-01-10** | [Olivia Miller](people/olivia-miller-176) joins advisory board\n- **2022-06-08** | First enterprise customer signed — regional bank in Texas\n- **2022-11-03** | ShieldScan v1.0 publicly launched\n- **2023-04-17** | Epsilon raises $8M seed round; [Kate Lopez](people/kate-lopez-99) participates\n- **2023-09-25** | [Bob Chen](people/bob-chen-185) added as technical advisor\n- **2024-02-12** | Surpassed 100 paying customers milestone\n- **2024-08-30** | Announced GCP integration at CloudSecCon\n- **2025-03-05** | Opened first international office in London",
  "_facts": {
    "type": "company",
    "slug": "companies/epsilon-4",
    "name": "Epsilon",
    "category": "startup",
    "industry": "cybersecurity",
    "founded_year": 2021,
    "founders": [
      "people/paul-rodriguez-4"
    ],
    "investors": [
      "people/sarah-lopez-84",
      "people/sarah-williams-92",
      "people/kate-lopez-99"
    ],
    "employees": [
      "people/julia-johnson-114"
    ],
    "advisors": [
      "people/olivia-miller-176",
      "people/bob-chen-185"
    ]
  }
 }
--- a/eval/data/world-v1/companies__epsilon-labs-54.json
+++ b/eval/data/world-v1/companies__epsilon-labs-54.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/epsilon-labs-54",
  "type": "company",
  "title": "Epsilon Labs",
  "compiled_truth": "Epsilon Labs is a fintech startup founded in 2023 by [Diana Wilson](people/diana-wilson-54), a serial entrepreneur with a background in quantitative finance and distributed systems. The company operates in the payments infrastructure space, building API-first solutions for cross-border B2B transactions. Their flagship product, EpsilonPay, enables businesses to settle international invoices in near real-time while automatically handling currency conversion and compliance checks.\n\nThe founding story traces back to Diana's frustration with legacy payment rails during her previous venture. She saw an oportunity to leverage modern cloud infrastructure and machine learning to dramatically reduce settlement times and fees. Within months of incorporating, Epsilon Labs had assembled a small but experienced engineering team, many recruited from established fintech players.\n\nEpsilon raised a seed round in late 2023, with [Iris Lee](people/iris-lee-82) leading the investment. Iris brought not just capital but also deep connections in the Asian fintech ecosystem, which has proven valuable as Epsilon eyes expansion into Singapore and Hong Kong markets. [Grace Martinez](people/grace-martinez-109) also participated in the round, adding her expertise in regulatory strategy to the cap table. The total raise was reportedly around $4.2 million, though the company hasn't disclosed exact figures publicly.\n\nOn the advisory side, [Zoe Jackson](people/zoe-jackson-199) has been instrumental in shaping Epsilon's go-to-market strategy. Zoe's experience scaling enterprise sales teams has helped the startup land its first handful of mid-market customers, including a logistics company and two e-commerce platforms.\n\nEpsilon Labs currently employs around 18 people, mostly engineers and product folks, operating out of a modest office in San Francisco's SoMa district. The company culture leans heavily toward async communication and documentation — a reflection of Diana's management philosophy. Recent LinkedIn posts suggest they're hiring aggresively for compliance and partnerships roles, hinting at plans to expand their banking relationships.\n\nThe fintech space is crowded, but Epsilon's focus on the unglamorous middle-market segment gives them room to grow without directly competing with giants like Stripe or Wise. At least for now.",
  "timeline": "- **2023-02-14** | Diana Wilson incorporates Epsilon Labs in Delaware, begins recruiting co-founding engineers\n- **2023-05-03** | First working prototype of EpsilonPay API demoed internally\n- **2023-08-21** | Seed round closes with [Iris Lee](people/iris-lee-82) as lead investor, $4.2M raised\n- **2023-09-15** | [Zoe Jackson](people/zoe-jackson-199) joins as formal advisor, begins weekly strategy sessions\n- **2023-11-30** | EpsilonPay enters private beta with three launch partners\n- **2024-01-22** | [Grace Martinez](people/grace-martinez-109) introduces Epsilon to key banking contacts in Latin America\n- **2024-04-10** | Public launch of EpsilonPay, first press coverage in TechCrunch\n- **2024-07-08** | Team grows to 18 employees, opens dedicated compliance function\n- **2024-10-02** | Diana Wilson speaks at Fintech Summit SF on future of B2B payments\n- **2025-01-15** | Epsilon Labs begins exploratory conversations for Series A",
  "_facts": {
    "type": "company",
    "slug": "companies/epsilon-labs-54",
    "name": "Epsilon Labs",
    "category": "startup",
    "industry": "fintech",
    "founded_year": 2023,
    "founders": [
      "people/diana-wilson-54"
    ],
    "investors": [
      "people/iris-lee-82",
      "people/grace-martinez-109"
    ],
    "employees": [
      "people/owen-martinez-164"
    ],
    "advisors": [
      "people/zoe-jackson-199"
    ]
  }
 }
--- a/eval/data/world-v1/companies__first-round-10.json
+++ b/eval/data/world-v1/companies__first-round-10.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/first-round-10",
  "type": "company",
  "title": "First Round Capital",
  "compiled_truth": "First Round Capital is a seed-stage venture capital firm that has established itself as one of the most influential early-stage investors in the technology ecosystem. Founded in 2004 by Josh Kopelman, the firm focuses exclusively on being the first institutional investor in technology companies, typically leading seed rounds and participating in early follow-on financing.\n\nThe firm has built a remarkable portfolio over the years, with notable investments including Uber, Square, Roblox, Notion, and Warby Parker. First Round is known for its operator-friendly approach and has developed an extensive platform of resources for founders, including the First Round Review publication which shares tactical advice from experienced entrepreneurs and executives.\n\nFirst Round operates with a relatively small partnership structure compared to larger VC firms, which allows partners to maintain close relationships with portfolio companies. The firm typically invests between $1-3 million in initial checks, though this has crept upward in recent years as seed rounds have grown larger across the industry. They maintain offices in San Francisco, New York, and Philadelphia.\n\nOne distinguishing characteristic of First Round is their community-building efforts. The firm hosts an annual CEO Summit and runs various programs designed to connect founders with each other and with potential hires. Their talent team actively helps portfolio companeis with recruiting, recognizing that early hiring decisions are often make-or-break for startups.\n\nThe firm has raised multiple funds over its history, with recent vehicles exceeding $500 million in committed capital. Despite the larger fund sizes, First Round has maintained its focus on seed-stage investing rather than moving upstream to compete with Series A and B investors. This disciplined approach has helped them maintain strong returns and a clear market position.\n\nFirst Round's investment thesis centers on backing exceptional founders at the earliest stages, often before there's significant traction or revenue. They look for founders with deep domain expertise, unique insights into markets, and the resilience needed to build compaines over the long term. The firm has been particularly active in enterprise software, fintech, and consumer technology sectors.",
  "timeline": "- **2021-03-15** | First Round closes Fund VII at $540 million, largest fund to date\n- **2021-09-22** | Led seed round for emerging AI startup, marking early bet on generative technology\n- **2022-02-08** | First Round Review publishes widely-shared piece on startup hiring in remote era\n- **2022-11-30** | Partner Todd Jackson joins board of breakout portfolio company\n- **2023-04-12** | Hosted annual CEO Summit in San Francisco with 200+ portfolio founders attending\n- **2023-08-19** | Announced new $600M Fund VIII focused on seed and pre-seed investments\n- **2024-01-25** | First Round portfolio company achieves unicorn status after Series C\n- **2024-06-03** | Launched new founder fellowship program targeting underrepresented entrepreneurs\n- **2025-02-14** | Published annual State of Startups report showing shifting founder sentiment on fundraising\n- **2025-09-08** | Expanded New York office, adding three new partners to the team",
  "_facts": {
    "type": "company",
    "slug": "companies/first-round-10",
    "name": "First Round",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__floodgate-9.json
+++ b/eval/data/world-v1/companies__floodgate-9.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/floodgate-9",
  "type": "company",
  "title": "Floodgate - Early-Stage Venture Capital Firm",
  "compiled_truth": "Floodgate is a prominent seed-stage venture capital firm based in Palo Alto, California, known for its thesis-driven approach to early-stage investing. Founded in 2006 by Mike Maples Jr. and Ann Miura-Ko, the firm has established itself as one of the most respected names in Silicon Valley's seed investing landscape. They've built a reputation for backing founders at the earliest stages, often before there's much more than an idea and a passionate team.\n\nThe firm operates with a relatively small team compared to larger VC shops, which allows them to maintain close relationships with portfolio founders. Ann Miura-Ko, often referred to as one of the most powerful women in startups, brings an academic rigor to investing—she holds a PhD from Stanford and teaches there as a lecturing professor. Mike Maples Jr. previously founded Motive Communications and brings operational experiance to the table.\n\nFloodgate's investment philosophy centers on what they call \"thunder lizards\"—startups with the potential to fundamentally reshape markets rather than just iterate on existing solutions. They're looking for companies that can create entirely new categories. This approach has led to early investments in companies like Lyft, Twitter, and Twitch, demonstrating their ability to identify transformative platforms before they become household names.\n\nRecent activity shows Floodgate continuing to deploy capital across emerging sectors including AI infrastructure, developer tools, and consumer applications. They've been particularly active in the generative AI space, recognizing the platform shift early and positioning their portfolio accordingly. The firm typically invests $1-3 million in initial checks, reserving capital for follow-on investments in their highest-conviction companies.\n\nTheir fund sizes have grown over the years, though they've remained disciplined about not scaling beyond what allows them to maintain their hands-on approach. Floodgate often co-invests alongside other top-tier firms like [Sequoia Capital](companies/sequoia-capital) and [Andreessen Horowitz](companies/andreessen-horowitz), building syndicates that provide founders with diverse perspectives and networks. The firm runs a tight operation, believing that constraint breeds creativity—both for themselves and for the founders they back.",
  "timeline": "- **2021-03-15** | Floodgate closes Fund VII at $181 million, continuing their focused seed-stage strategy\n- **2021-09-22** | Ann Miura-Ko speaks at TechCrunch Disrupt on identifying breakthrough startups\n- **2022-04-08** | Lead investment in AI developer tools company, $3.2M seed round\n- **2022-11-14** | Mike Maples Jr. publishes essay on \"thunder lizard\" thesis, gains wide circulation\n- **2023-02-28** | Portfolio company exits via acquisition by [Stripe](companies/stripe), returning 47x\n- **2023-08-19** | Floodgate announces Fund VIII targeting $200M for seed investments\n- **2024-01-10** | Partnership with Stanford's StartX program for deal flow collaboration\n- **2024-06-25** | Co-leads $8M seed round alongside [Sequoia Capital](companies/sequoia-capital) in robotics startup\n- **2025-03-12** | Ann Miura-Ko joins board of major fintech company following Series B\n- **2025-09-04** | Floodgate hosts annual founder summit in Palo Alto, 200+ portfolio founders attend",
  "_facts": {
    "type": "company",
    "slug": "companies/floodgate-9",
    "name": "Floodgate",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__forge-19.json
+++ b/eval/data/world-v1/companies__forge-19.json
@@ -1,29 +0,0 @@
 {
  "slug": "companies/forge-19",
  "type": "company",
  "title": "Forge",
  "compiled_truth": "Forge is a crypto startup founded in 2022 by [Adam Lee](people/adam-lee-19), focused on building infrastructure for decentralized asset management. The company emerged during a turbulent period for the crypto industry, but Lee's vision for institutional-grade tooling attracted early believers despite market headwinds.\n\nThe core product is a non-custodial vault system that lets DAOs and crypto-native funds manage treasuries with multi-sig controls and on-chain governance integration. Forge differentiates itself by targeting the mid-market—organizations too sophisticated for basic multisigs but not large enough to justify custom smart contract development. Early traction came from several DeFi protocols looking to professionalize their treasury operations.\n\nFunding has come from angels with deep crypto experience. [Sarah Lopez](people/sarah-lopez-84) led the pre-seed round, bringing not just capital but introductions across the DeFi ecosystem. [Sarah Wang](people/sarah-wang-104) joined as an investor shortly after, drawn to the team's pragmatic approach to security. Both remain actively involved, participating in monthly strategy calls.\n\nOn the advisory side, Forge has assembled a small but impactful group. [Tara Jackson](people/tara-jackson-173) advises on go-to-market strategy, having scaled several B2B crypto companies previously. [David Brown](people/david-brown-187) provides technical guidance, particularly around smart contract auditing and security architecture—areas where Forge cannot afford to cut corners.\n\nThe team remains lean, hovering around twelve people as of late 2024. Adam has been deliberate about hiring, prefering experienced builders over rapid headcount growth. Engineering is split between protocol development and a surprisingly robust frontend team, reflecting the company's belief that UX remains crypto's biggest barrier to adoption.\n\nForge launched its mainnet product in early 2024 after an extended beta period. Growth has been steady if not explosive—the team claims over $180M in assets under managment across 40+ vaults. Revenue comes from a modest protocol fee, though the company has hinted at premium enterprise features in development. The roadmap includes cross-chain expansion and integration with traditional finance rails, positioning Forge at the intersection of DeFi and institutional money.",
  "timeline": "- **2022-03-14** | Adam Lee incorporates Forge, begins building initial prototype for DAO treasury management\n- **2022-08-22** | Pre-seed round closes with [Sarah Lopez](people/sarah-lopez-84) leading; $1.2M raised\n- **2022-11-03** | [Sarah Wang](people/sarah-wang-104) joins as angel investor, contributes to security roadmap discussions\n- **2023-02-17** | [Tara Jackson](people/tara-jackson-173) signs on as go-to-market advisor\n- **2023-06-30** | Private beta launches with 8 DAOs onboarded for testing\n- **2023-09-12** | [David Brown](people/david-brown-187) joins advisory board to oversee smart contract security\n- **2024-01-28** | Mainnet launch after completing two independent audits\n- **2024-07-15** | Crosses $100M in assets under management milestone\n- **2024-11-02** | Announces partnership with major L2 for cross-chain vault support\n- **2025-02-10** | Team offsite in Lisbon; roadmap planning for enterprise tier features",
  "_facts": {
    "type": "company",
    "slug": "companies/forge-19",
    "name": "Forge",
    "category": "startup",
    "industry": "crypto",
    "founded_year": 2022,
    "founders": [
      "people/adam-lee-19"
    ],
    "investors": [
      "people/sarah-lopez-84",
      "people/sarah-wang-104"
    ],
    "employees": [
      "people/sam-nakamura-129"
    ],
    "advisors": [
      "people/tara-jackson-173",
      "people/david-brown-187"
    ]
  }
 }
--- a/eval/data/world-v1/companies__founders-fund-0.json
+++ b/eval/data/world-v1/companies__founders-fund-0.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/founders-fund-0",
  "type": "company",
  "title": "Founders Fund",
  "compiled_truth": "Founders Fund is a San Francisco-based venture capital firm that has become one of the most influential investors in technology over the past two decades. Founded in 2005 by Peter Thiel, Ken Howery, and Luke Nosek, the firm has distinguished itself through a contrarian investment philosophy that favors bold, transformative companies over incremental innovation. Their famous motto — \"We wanted flying cars, instead we got 140 characters\" — encapsulates this ethos.\n\nThe firm manages over $11 billion in assets and has backed some of the most consequential technology companies of the modern era. Early bets on SpaceX, Palantir, and Facebook established Founders Fund's reputation for identifying generational companies before they achieve mainstream recognition. More recently, the fund has made significant investments in defense technology, artificial intelligence, and biotechnology sectors.\n\nFounders Fund operates with a relatively lean partnership structure compared to traditional VC firms. Key partners include Thiel, Keith Rabois, and Brian Singerman, each bringing distinct investment theses to the table. Singerman in particular has driven the firm's biotech strategy, while Rabois focuses on enterprise software and fintech opportunities. The firm typically writes checks ranging from seed-stage investments up to growth rounds exceeding $100 million.\n\nTheir portfolio company [Anduril Industries](companies/anduril-industries) represents the quintessential Founders Fund investment — a defense technology company challenging incumbant contractors with software-defined hardware. Similarly, their continued support of [Stripe](companies/stripe) through multiple rounds demonstrates their conviction-based approach to backing founders.\n\nThe firm has been notably active in the AI space, making early investments in several frontier model companies. They've also shown willingness to back controversial founders and companies that other firms might avoid for reputational reasons. This approach has generated both outsized returns and occasional criticism.\n\nFounders Fund raised its eighth flagship fund in 2022, reportedly at $1.8 billion, signaling continued LP confidence despite broader market turbulence. The firm maintains offices in San Francisco and Austin, reflecting the broader tech migration trends of recent years.",
  "timeline": "- **2021-03-15** | Led $450M growth round in Anduril Industries, valuing the defense startup at $4.6 billion\n- **2021-09-22** | Partner Keith Rabois announced relocation to Miami, opening satellite office presence\n- **2022-04-10** | Closed Fund VIII at $1.8B despite deteriorating market conditions\n- **2022-11-30** | Participated in emergency bridge financing discussions with [Stripe](companies/stripe) amid valuation reset\n- **2023-06-14** | Brian Singerman led investment in AI drug discovery platform, marking expanded biotech thesis\n- **2023-12-01** | Peter Thiel keynoted internal LP meeting on defense tech opportunities\n- **2024-05-18** | Announced strategic partnership with [Anduril Industries](companies/anduril-industries) for follow-on manufacturing facility investment\n- **2024-09-25** | Recruited two new partners from Tiger Global amid broader industry consolidation\n- **2025-02-11** | Published annual letter highlighting 3.2x net returns across 2020-2024 vintage\n- **2025-08-03** | Began fundraising for Fund IX, targeting $2.5B",
  "_facts": {
    "type": "company",
    "slug": "companies/founders-fund-0",
    "name": "Founders Fund",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__foundry-33.json
+++ b/eval/data/world-v1/companies__foundry-33.json
@@ -1,30 +0,0 @@
 {
  "slug": "companies/foundry-33",
  "type": "company",
  "title": "Foundry",
  "compiled_truth": "Foundry is an AI applications startup founded in 2023 by [Ian Davis](people/ian-davis-33), a serial entrepreneur with a background in enterprise software. The company operates in the increasingly crowded AI applications space, though it has carved out a niche focusing on workflow automation for mid-market manufacturing companies. Their flagship product, FoundryOS, uses large language models to interpret unstructured data from factory floors and convert it into actionable insights for operations managers.\n\nThe company raised its seed round from a syndicate led by [Tina Hernandez](people/tina-hernandez-97), with participation from [Zoe Gonzalez](people/zoe-gonzalez-100) and [Alice Kapoor](people/alice-kapoor-108). Total funding to date sits around $4.2M, though rumors suggest Foundry is currently in conversations for a Series A that would value the company north of $30M. Ian has been characteristically tight-lipped about fundraising progress, preferring to focus public communications on product development.\n\nFoundry's advisory board includes [Rachel Gonzalez](people/rachel-gonzalez-175), who brings deep expertise in industrial automation, and [Noah Nakamura](people/noah-nakamura-182), whose connections in the manufacturing sector have reportedly helped open doors with several Fortune 500 prospects. The team has grown to roughly 18 people, mostly engineers, operating out of a small office in Austin.\n\nRecent moves include a partnership with a major automotive parts supplier, though the details remain under NDA. The company has been aggresively hiring ML engineers and recently posted roles for enterprise sales reps, signaling a shift toward scaling go-to-market efforts. Ian Davis presented at the Industrial AI Summit in March 2024, where he demoed FoundryOS processing real-time sensor data and generating maintenance recommendations. The demo received strong reception, though some attendees noted the system's latency issues under heavy load.\n\nFoundry faces competition from both established industrial software players and well-funded AI startups, but the team beleives their vertical focus gives them an edge. Early customer testimonials highlight the product's ease of integration with legacy systems, a persistent pain point in manufacturing tech.",
  "timeline": "- **2023-03-15** | Foundry incorporated in Delaware by [Ian Davis](people/ian-davis-33)\n- **2023-06-22** | Closed $1.8M pre-seed round led by [Tina Hernandez](people/tina-hernandez-97)\n- **2023-09-10** | First engineering hires made; team moves into Austin office\n- **2023-12-01** | FoundryOS alpha launched with two pilot customers\n- **2024-02-14** | [Alice Kapoor](people/alice-kapoor-108) joins seed round, bringing total funding to $4.2M\n- **2024-03-28** | Ian Davis presents at Industrial AI Summit in Chicago\n- **2024-06-05** | Advisory board formalized with [Rachel Gonzalez](people/rachel-gonzalez-175) and [Noah Nakamura](people/noah-nakamura-182)\n- **2024-09-12** | Partnership announced with undisclosed automotive parts supplier\n- **2024-11-20** | Team reaches 18 employees; Series A conversations reportedly underway\n- **2025-01-08** | Enterprise sales hiring push begins",
  "_facts": {
    "type": "company",
    "slug": "companies/foundry-33",
    "name": "Foundry",
    "category": "startup",
    "industry": "AI applications",
    "founded_year": 2023,
    "founders": [
      "people/ian-davis-33"
    ],
    "investors": [
      "people/tina-hernandez-97",
      "people/zoe-gonzalez-100",
      "people/alice-kapoor-108"
    ],
    "employees": [
      "people/wendy-taylor-143"
    ],
    "advisors": [
      "people/rachel-gonzalez-175",
      "people/noah-nakamura-182"
    ]
  }
 }
--- a/eval/data/world-v1/companies__gamma-2.json
+++ b/eval/data/world-v1/companies__gamma-2.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/gamma-2",
  "type": "company",
  "title": "Gamma - Fintech Startup",
  "compiled_truth": "Gamma is a fintech startup founded in 2022 by [Mark Jones](people/mark-jones-2), a serial entrepreneur with a background in payment infrastructure. The company has positioned itself at the intersection of embedded finance and small business lending, targeting an underserved market of micro-merchants who struggle to access traditional credit products.\n\nThe core product is a lending-as-a-service API that allows platforms to offer instant credit decisioning to their users. Gamma's approach relies on alternative data sources—transaction history, platform engagement metrics, and cash flow patterns—rather than traditional credit scores. This has allowed them to approve merchants that banks typically reject while maintaining what they claim are competitive default rates.\n\nMark Jones serves as CEO and has been the public face of the company since launch. His previous experience building payment rails for gig economy platforms informed much of Gamma's technical architecture. The founding team remains relatively small, with around 25 employees as of late 2024, mostly engineers and data scientists based in Austin.\n\nEarly backing came from [Vera Gonzalez](people/vera-gonzalez-103), who led the seed round and has remained actively involved as a board observer. Her portfolio expertise in B2B fintech reportedly helped Gamma avoid some common pitfalls around compliance and bank partnerships. The company has been somewhat quiet about total funding raised, though industry estimates put it somewhere in the $8-12M range across seed and bridge rounds.\n\nGamma faces stiff competiton from larger players like Stripe Capital and Square Loans, but has carved out a niche by focusing exclusively on platform partnerships rather than direct-to-merchant sales. Recent moves suggest they're expanding beyond pure lending into cash flow management tools, though details remain sparse. The company has been hiring aggressively for a Series A push expected sometime in 2025.",
  "timeline": "- **2022-03-14** | Gamma incorporated in Delaware by [Mark Jones](people/mark-jones-2)\n- **2022-06-22** | Closed seed round led by [Vera Gonzalez](people/vera-gonzalez-103), terms undisclosed\n- **2022-11-08** | First API version shipped to beta partners\n- **2023-02-15** | Reached $1M in loans facilitated through platform\n- **2023-07-20** | Expanded engineering team to 15 employees\n- **2023-11-30** | Launched v2.0 of lending API with improved decisioning engine\n- **2024-04-12** | Mark Jones spoke at Fintech Summit Austin on alternative credit scoring\n- **2024-09-05** | Announced partnership with three unnamed e-commerce platforms\n- **2025-01-18** | Bridge round closed, preparing for Series A conversations",
  "_facts": {
    "type": "company",
    "slug": "companies/gamma-2",
    "name": "Gamma",
    "category": "startup",
    "industry": "fintech",
    "founded_year": 2022,
    "founders": [
      "people/mark-jones-2"
    ],
    "investors": [
      "people/vera-gonzalez-103"
    ],
    "employees": [
      "people/tina-jones-112"
    ]
  }
 }
--- a/eval/data/world-v1/companies__gamma-labs-52.json
+++ b/eval/data/world-v1/companies__gamma-labs-52.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/gamma-labs-52",
  "type": "company",
  "title": "Gamma Labs",
  "compiled_truth": "Gamma Labs is an edtech startup founded in 2023 by [Iris Nakamura](people/iris-nakamura-52), a former learning sciences researcher who spent nearly a decade studying how students retain information in digital environments. The company emerged from Nakamura's frustration with existing adaptive learning platforms, which she felt were too focused on content delivery and not enough on genuine comprehension.\n\nThe core product is an AI-powered tutoring system that adapts not just to what students get wrong, but to *how* they think through problems. Gamma Labs calls this approach \"cognitive mirroring\" — the system builds a model of each student's reasoning patterns and adjusts its teaching style accordingly. Early pilots with community colleges showed promising results, though the sample sizes were admittedly small.\n\nFunding came through a pre-seed round led by [David Zhang](people/david-zhang-83), who has been increasingly active in education technology investments over the past two years. [Rosa Miller](people/rosa-miller-98) also participated in the round, bringing her experience scaling consumer apps to the cap table. The total raise was reportedly around $1.8 million, though the company hasn't confirmed exact figures publically.\n\nOn the advisory side, Gamma brought in [Steve Martinez](people/steve-martinez-192) to help navigate enterprise sales cycles with school districts. Martinez's background in B2B edtech has proven valuable as the startup shifts from direct-to-student pilots toward institutional contracts.\n\nThe team remains small — just seven full-time employees as of late 2024 — but they've been shipping quickly. Their beta platform launched in Q2 2024, and early users have praised the interface's simplicity. Critics note that the AI explanations can sometimes feel repetitive, a known issue the team says they're addressing.\n\nGamma Labs operates out of a coworking space in Oakland, though Iris has mentioned considering a move to a dedicated office if headcount doubles. The edtech space is crowded, but Gamma's focus on reasoning rather than rote memorization gives it a differentiated angle. Whether that translates to sustainable growth remains to be seen.",
  "timeline": "- **2023-03-15** | Gamma Labs incorporated in Delaware by founder Iris Nakamura\n- **2023-06-22** | Pre-seed round closed with [David Zhang](people/david-zhang-83) and [Rosa Miller](people/rosa-miller-98) participating\n- **2023-09-10** | First pilot program launched with two community colleges in California\n- **2024-01-18** | [Steve Martinez](people/steve-martinez-192) joined as formal advisor\n- **2024-04-05** | Beta platform shipped to 500 early access users\n- **2024-07-12** | Gamma Labs presented at EdTech Summit in Austin, demo well-received\n- **2024-10-30** | Signed first enterprise contract with a mid-sized school district in Texas\n- **2025-02-14** | Team expanded to 12 employees, opened dedicated Oakland office\n- **2025-06-01** | Series A discussions reportedly underway with multiple firms",
  "_facts": {
    "type": "company",
    "slug": "companies/gamma-labs-52",
    "name": "Gamma Labs",
    "category": "startup",
    "industry": "edtech",
    "founded_year": 2023,
    "founders": [
      "people/iris-nakamura-52"
    ],
    "investors": [
      "people/david-zhang-83",
      "people/rosa-miller-98"
    ],
    "employees": [
      "people/ian-kapoor-162"
    ],
    "advisors": [
      "people/steve-martinez-192"
    ]
  }
 }
--- a/eval/data/world-v1/companies__google-1.json
+++ b/eval/data/world-v1/companies__google-1.json
@@ -1,15 +0,0 @@
 {
  "slug": "companies/google-1",
  "type": "company",
  "title": "Google",
  "compiled_truth": "Google is one of the most influential technology conglomerates in the world, though its founding date of 1996 places it slightly earlier than commonly cited. The company has evolved far beyond its origins as a search engine, becoming a major player in cloud computing, artificial intelligence, consumer hardware, and notably, robotics.\n\nThe robotics division at Google has seen significant investment and strategic maneuvering over the years. Starting with the aqusition of Boston Dynamics in 2013, Google signaled its intent to dominate the robotics space. While Boston Dynamics was later sold to SoftBank, Google retained numerous other robotics ventures and continued building internal capabilities through its X division and other research arms.\n\nAs an acquirer in the robotics industry, Google has been particularly agressive in targeting startups with promising automation technology. The company's approach tends to focus on companies developing AI-driven manipulation systems, warehouse automation, and autonomous systems that can integrate with Google's broader cloud and AI infrastructure. Their acquisition strategy often involves absorbing talented engineering teams rather than just acquiring technology—a practice sometimes called acqui-hiring.\n\nGoogle's parent company Alphabet provides the financial backing for these robotics ambitions. The company has partnerships with various research institutions and maintains close relationships with other tech giants, though it also competes fiercely with them. Recent moves suggest Google is positioning itself to offer robotics-as-a-service solutions to enterprise customers, leveraging its cloud platform.\n\nThe leadership at Google has emphasized that robotics represents a natural extension of their AI capabilities. With advances in machine learning and computer vision coming out of DeepMind and Google Brain (now merged), the company believes it can solve many of the perception and planning challenges that have historically limited robotic systems. Their focus areas include logistics automation, healthcare robotics, and general-purpose manipulation platforms that could eventaully find applications in homes and offices.\n\nGoogle continues to be a dominant force in shaping the future of intelligent machines, combining its vast computational resources with ambitious research agendas.",
  "timeline": "- **2021-03-15** | Google announces expanded robotics research initiative under X division, committing $400M over three years\n- **2021-09-22** | Acquired stealth warehouse automation startup for undisclosed sum, team of 45 engineers joins Google Cloud\n- **2022-04-08** | Unveiled Everyday Robots project demonstrating general-purpose manipulation in office environments\n- **2022-11-30** | Partnership announced with major logistics provider to pilot autonomous sorting systems\n- **2023-06-14** | Google I/O keynote features live demo of AI-powered robotic assistant prototype\n- **2024-01-19** | Robotics division restructured, now reports directly to Google Cloud leadership\n- **2024-08-03** | Acquired computer vision startup specializing in 3D scene understanding for $180M\n- **2025-02-27** | Launched Robotics Foundation Model, open-sourcing base architecture for research community\n- **2025-10-11** | Enterprise robotics platform enters general availability, initial customers include three Fortune 100 companies",
  "_facts": {
    "type": "company",
    "slug": "companies/google-1",
    "name": "Google",
    "category": "acquirer",
    "industry": "robotics",
    "founded_year": 1996
  }
 }
--- a/eval/data/world-v1/companies__gravity-17.json
+++ b/eval/data/world-v1/companies__gravity-17.json
@@ -1,32 +0,0 @@
 {
  "slug": "companies/gravity-17",
  "type": "company",
  "title": "Gravity",
  "compiled_truth": "Gravity is a biotech startup founded in 2021 by [Quinten Wang](people/quinten-wang-17), a computational biologist who previously led protein engineering efforts at a major pharma company. The company focuses on developing novel gravity-sensing mechanisms in cellular therapies, aiming to create treatments that respond to mechanical forces within the human body. Their core platform uses mechanosensitive proteins to trigger therapeutic payloads in response to specific gravitational or pressure conditions.\n\nThe founding thesis came from Wang's doctoral research on how cells detect and respond to physical forces. Gravity has raised seed funding from a syndicate that includes [Chris Jackson](people/chris-jackson-91), [Rosa Nakamura](people/rosa-nakamura-94), and [Rachel Brown](people/rachel-brown-95). The round closed in early 2022 and gave the company runway to build out its initial research team and secure wet lab space in the South San Francisco biotech corridor.\n\nOn the advisory side, Gravity has brought in [Tina Wang](people/tina-wang-179) for regulatory strategy and [Xavier Patel](people/xavier-patel-183) to help with business development and partnership discussions. Both advisors have been instrumental in shaping the companys go-to-market approach, particularly around identifying therapeutic areas where mechanosensitive delivery could provide clear advantages over existing modalties.\n\nThe startup has been relatively quiet publicly, preferring to focus on R&D milestones rather than press coverage. Internally, they've made progress on their lead program targeting osteoarthritis, where the therapy would activate in response to joint compression. Early in vitro results have been promising, though animal studies are still ongoing. The team has grown to about 15 people, mostly PhDs in bioengineering and cell biology.\n\nGravity faces significant technical risk—mechanobiology is still a nascent field and translating bench results to clinical outcomes will be challenging. But the upside is substantial if they can crack it. Wang has been vocal in investor updates about the potential for platform expansion into cardiac and oncology applications down the line.",
  "timeline": "- **2021-03-15** | Gravity incorporated in Delaware by [Quinten Wang](people/quinten-wang-17)\n- **2021-07-22** | Signed lease for lab space in South San Francisco\n- **2022-01-10** | Closed $4.2M seed round led by [Chris Jackson](people/chris-jackson-91)\n- **2022-06-03** | Hired first VP of Research from Genentech\n- **2022-11-18** | [Tina Wang](people/tina-wang-179) joined as regulatory advisor\n- **2023-04-25** | Filed provisional patent on mechanosensitive protein delivery system\n- **2023-09-12** | Presented preclinical data at ASGCT conference\n- **2024-02-08** | Initiated IND-enabling studies for lead osteoarthritis program\n- **2024-08-30** | [Xavier Patel](people/xavier-patel-183) formalized advisory role, began pharma outreach\n- **2025-03-17** | Reached 15 employees, expanded lab footprint",
  "_facts": {
    "type": "company",
    "slug": "companies/gravity-17",
    "name": "Gravity",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2021,
    "founders": [
      "people/quinten-wang-17"
    ],
    "investors": [
      "people/chris-jackson-91",
      "people/rosa-nakamura-94",
      "people/rachel-brown-95"
    ],
    "employees": [
      "people/quinn-jones-127"
    ],
    "advisors": [
      "people/tina-wang-179",
      "people/xavier-patel-183",
      "people/sam-garcia-188",
      "people/beth-wang-196"
    ]
  }
 }
--- a/eval/data/world-v1/companies__greylock-4.json
+++ b/eval/data/world-v1/companies__greylock-4.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/greylock-4",
  "type": "company",
  "title": "Greylock Partners",
  "compiled_truth": "Greylock Partners is one of Silicon Valley's oldest and most prestigious venture capital firms, founded in 1965. The firm has built a reputation for early-stage investing in enterprise software, consumer internet, and infrastructure companies. Their portfolio reads like a who's who of tech success stories—LinkedIn, Facebook, Airbnb, Dropbox, and Discord among them.\n\nThe firm operates with a relatively small partnership structure, which they argue allows for deeper engagement with founders. Notable partners include Reid Hoffman, the LinkedIn co-founder who joined after selling his company to Microsoft. The firm's been particularly active in AI and developer tools lately, reflecting broader market trends. They typically write checks ranging from seed to Series B, though they're not afraid to lead larger rounds for breakout companies.\n\nGreylock maintains offices in Menlo Park and San Francisco, though like most VCs they've adapted to a more distributed model post-pandemic. Their investment thesis centers on what they call \"product-first founders\"—technical leaders who deeply understand the problems they're solving. This approach has led them to back companies like Figma early, before design tools became a hot category.\n\nThe partnership has been vocal about their views on AI, with several partners publishing extensively on where they see oportunities in the space. They've made multiple bets on AI infrastructure and application layers. Recent portfolio companies include Adept AI and various developer productivity startups.\n\nUnlike some mega-funds, Greylock has resisted the temptation to raise massive vehicles, generally keeping fund sizes in the $1-2 billion range. This discipline, they argue, keeps them focused on early-stage where they have the most edge. The firm competes directly with [Sequoia Capital](companies/sequoia-capital) and [Andreessen Horowitz](companies/a16z-3) for the best deals, though each firm has developed somewhat distinct positioning over time.\n\nTheir brand among founders remains strong, particularly for B2B and infrastructure plays. The firm hosts regular content series and podcasts featuring partners discussng market trends, which serves both as thought leadership and deal flow generation.",
  "timeline": "- **2021-03-15** | Led $40M Series B in Snyk, continuing their security software thesis\n- **2021-09-22** | Reid Hoffman published essay on future of work, generating significant discussion in tech media\n- **2022-02-08** | Announced Fund XVI at $1.2 billion, focused on AI and enterprise\n- **2022-11-30** | Participated in Discord's $500M round alongside [Sequoia Capital](companies/sequoia-capital)\n- **2023-04-17** | Partner Sarah Guo departed to launch her own AI-focused fund Conviction\n- **2023-08-25** | Led seed round for stealth AI infrastructure startup\n- **2024-01-12** | Hosted annual Greylock Techfair recruiting event for portfolio companies\n- **2024-06-03** | Published internal AI research report, shared selectively with LPs\n- **2024-11-19** | Co-invested with [Andreessen Horowitz](companies/a16z-3) in Series A for developer tools company\n- **2025-02-28** | Promoted two principals to partner, signaling generational transition",
  "_facts": {
    "type": "company",
    "slug": "companies/greylock-4",
    "name": "Greylock",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__gust-34.json
+++ b/eval/data/world-v1/companies__gust-34.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/gust-34",
  "type": "company",
  "title": "Gust",
  "compiled_truth": "Gust is a data infrastructure startup founded in 2020 by [Steve Liu](people/steve-liu-34), who previously spent time at Snowflake and Databricks before striking out on his own. The company focuses on building real-time data pipelines that can handle massive throughput without the typical overhead of traditional ETL systems. Their core product lets engineering teams ingest, transform, and route streaming data with minimal configuration—think Kafka meets dbt but with a much simpler developer experience.\n\nThe founding story is pretty straightforward. Steve had grown frustrated with the complexity of existing data infrastructure tools while working on analytics pipelines at his previous roles. He saw an opportunity to build something cleaner, something that didn't require a dedicated platform team just to keep running. Gust was born out of that frustration, initially as a side project before Steve commited to it full-time.\n\nEarly traction came from mid-sized fintech companies who needed reliable streaming infrastructure but couldn't justify the headcount to manage Kafka clusters. Gust's managed offering hit a sweet spot—enterprise-grade reliability without the operational burden. By late 2021, the company had a handful of paying customers and was generating modest but growing revenue.\n\n[Sarah Lopez](people/sarah-lopez-84) led their seed round in early 2022, betting on Steve's technical chops and the growing demand for simplified data tooling. Sarah had been tracking the data infrastructure space for years and saw Gust as a potential breakout player. Her investment gave the company runway to expand the engineering team and accelerate product developement.\n\nToday Gust operates with a lean team of about 25 people, mostly engineers. They've been deliberate about not over-hiring, preferring to stay focused and capital-efficient. The company has expanded its product to include schema management, data quality monitoring, and connectors for most major data warehouses. Competition from bigger players like Confluent and newer startups remains intense, but Gust has carved out a loyal customer base that values simplicity over feature bloat.",
  "timeline": "- **2020-03-15** | Steve Liu incorporates Gust and begins building the initial prototype\n- **2020-09-22** | First beta customer signs up—a small fintech startup in NYC\n- **2021-04-10** | Gust launches publicly with support for Postgres and Snowflake sinks\n- **2022-02-08** | Closes $4.2M seed round led by [Sarah Lopez](people/sarah-lopez-84)\n- **2022-07-19** | Hires first head of engineering from Stripe\n- **2023-01-30** | Launches schema registry feature after months of customer requests\n- **2023-11-14** | [Steve Liu](people/steve-liu-34) speaks at Data Council on simplifying streaming architectures\n- **2024-05-02** | Crosses 100 paying customers milestone\n- **2024-12-11** | Announces partnership with major cloud provider for native integration\n- **2025-08-20** | Begins work on Series A fundraising process",
  "_facts": {
    "type": "company",
    "slug": "companies/gust-34",
    "name": "Gust",
    "category": "startup",
    "industry": "data infrastructure",
    "founded_year": 2020,
    "founders": [
      "people/steve-liu-34"
    ],
    "investors": [
      "people/sarah-lopez-84"
    ],
    "employees": [
      "people/xavier-jackson-144"
    ]
  }
 }
--- a/eval/data/world-v1/companies__hatch-35.json
+++ b/eval/data/world-v1/companies__hatch-35.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/hatch-35",
  "type": "company",
  "title": "Hatch",
  "compiled_truth": "Hatch is an edtech startup founded in 2019 by [Eric Miller](people/eric-miller-35), who saw an opportunity to reimagine how young professionals develop career skills outside traditional academic settings. The company operates in the increasingly crowded learn-to-earn space, but distinguishes itself through a cohort-based model that emphasizes peer accountability and real-world project work.\n\nThe platform connects early-career workers with mentors from established companies, facilitating structured 8-week programs in areas like product management, data analytics, and business development. Hatch takes a different aproach than most competitors—rather than selling courses to individuals, they partner directly with employers who want to upskill entry-level hires or create alternative talent pipelines. This B2B focus has given them more predictable revenue, though it's also meant slower user growth compared to consumer-facing platforms.\n\n[Steve Martinez](people/steve-martinez-192) joined as an advisor sometime in 2022, bringing his network in workforce development and helping Hatch refine their enterprise sales motion. His involvement signaled a shift toward targeting larger organizations rather than the SMB market they'd initially pursued. Martinez has been particularly helpful in opening doors at companies looking to diversify their hiring beyond traditional university recruiting.\n\nEric Miller remains the driving force behind product decisions. He's known for being hands-on with curriculum design, often personally reviewing program content and sitting in on mentor sessions. Some employees find this level of involvement micromanage-y, but others appreciate the attention to quality. The company has stayed relatively lean—around 35 employees as of late 2024—and Miller has been vocal about not raising more capital than necessary.\n\nHatch completed a Series A in early 2023, though they haven't disclosed the amount publicly. They're headquartered in Austin but operate fully remote, with mentors and participants spread across North America. Recent moves suggest they're exploring expansion into technical skills training, potentially competing more directly with bootcamps.",
  "timeline": "- **2019-06-12** | Hatch incorporated in Delaware; [Eric Miller](people/eric-miller-35) begins building initial prototype\n- **2020-03-08** | Launched first pilot cohort with 24 participants across three employer partners\n- **2021-09-15** | Closed seed round of $2.4M led by Reach Capital\n- **2022-04-22** | [Steve Martinez](people/steve-martinez-192) formally joins advisory board\n- **2022-11-03** | Surpassed 2,000 program graduates; announced partnership with two Fortune 500 retailers\n- **2023-02-17** | Series A closed; terms undisclosed but reportedly in $8-12M range\n- **2023-08-29** | Launched data analytics track, first technical program offering\n- **2024-01-14** | Eric Miller spoke at ASU+GSV Summit on alternative credentialing\n- **2024-07-20** | Opened pilot in Canada with three Toronto-based employers\n- **2025-03-11** | Announced curriculum partnership with major cloud provider for technical upskilling",
  "_facts": {
    "type": "company",
    "slug": "companies/hatch-35",
    "name": "Hatch",
    "category": "startup",
    "industry": "edtech",
    "founded_year": 2019,
    "founders": [
      "people/eric-miller-35"
    ],
    "employees": [
      "people/diana-brown-145"
    ],
    "advisors": [
      "people/steve-martinez-192"
    ]
  }
 }
--- a/eval/data/world-v1/companies__helix-9.json
+++ b/eval/data/world-v1/companies__helix-9.json
@@ -1,26 +0,0 @@
 {
  "slug": "companies/helix-9",
  "type": "company",
  "title": "Helix",
  "compiled_truth": "Helix is an AI infrastructure startup founded in 2021 by [Rachel Garcia](people/rachel-garcia-9), a veteran systems engineer who previously led distributed computing teams at major cloud providers. The company focuses on building foundational tooling for deploying and managing large-scale machine learning workloads, with particular emphasis on GPU orchestration and model serving optimization.\n\nThe core product is a Kubernetes-native platform that abstracts away much of the complexity involved in running inference at scale. Helix's approach differs from competitors in that it prioritizes cost efficiency over raw performance—their scheduling algorithms are designed to maximize GPU utilization across heterogenous hardware, which appeals to companies running mixed fleets of older and newer accelerators. Early customers include several mid-size fintech firms and a handful of healthcare AI startups.\n\nRachel Garcia serves as CEO and has been the public face of the company since launch. She's known for her pragmatic approach to infrastructure problems and has spoken at several industry conferences about the \"unsexy\" challenges of ML ops. Under her leadership, Helix has grown to roughly 35 employees, mostly engineers with backgrounds in distributed systems and cloud infrastucture.\n\nThe advisory board includes [Xavier Patel](people/xavier-patel-183), who brings deep expertise in enterprise sales and go-to-market strategy, and [Bob Chen](people/bob-chen-185), a technical advisor with experience scaling infrastructure at hypergrowth companies. Both have been instrumental in shaping Helix's enterprise positioning.\n\nHelix raised a Series A in early 2023, though the company has been relatively quiet about specific metrics. Industry observers note that the AI infrastructure space has become increasingly crowded, but Helix's focus on cost optimization rather than cutting-edge performance gives it a distinct niche. The startup has been expanding its sales team and recently opened a small office in Austin to complement its San Francisco headquarters. Recent product updates have focused on observability features and tighter integrations with popular ML frameworks.",
  "timeline": "- **2021-03-15** | Company incorporated by [Rachel Garcia](people/rachel-garcia-9) in Delaware\n- **2021-09-02** | Closed $4.2M seed round led by Gradient Ventures\n- **2022-01-18** | First production customer goes live on Helix platform\n- **2022-07-11** | [Xavier Patel](people/xavier-patel-183) joins as advisor to help with enterprise strategy\n- **2023-02-28** | Announced Series A funding, expanded engineering team to 25\n- **2023-08-14** | [Bob Chen](people/bob-chen-185) joins advisory board\n- **2024-01-22** | Launched Helix Observe, new monitoring and cost analytics product\n- **2024-06-09** | Rachel Garcia keynotes at MLOps World conference in Austin\n- **2024-11-03** | Opened Austin office, announced plans to double sales team\n- **2025-04-17** | Partnership announced with major cloud provider for marketplace listing",
  "_facts": {
    "type": "company",
    "slug": "companies/helix-9",
    "name": "Helix",
    "category": "startup",
    "industry": "AI infrastructure",
    "founded_year": 2021,
    "founders": [
      "people/rachel-garcia-9"
    ],
    "employees": [
      "people/quinn-park-119"
    ],
    "advisors": [
      "people/xavier-patel-183",
      "people/bob-chen-185",
      "people/victor-smith-193"
    ]
  }
 }
--- a/eval/data/world-v1/companies__helix-labs-59.json
+++ b/eval/data/world-v1/companies__helix-labs-59.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/helix-labs-59",
  "type": "company",
  "title": "Helix Labs",
  "compiled_truth": "Helix Labs is a cybersecurity startup founded in 2020 by [Bob Jackson](people/bob-jackson-59), a former penetration tester who spent nearly a decade at major defense contractors before striking out on his own. The company focuses on automated threat detection for mid-market enterprises, a segment Jackson felt was underserved by existing solutions that either targeted Fortune 500 companies or were too basic for sophisticated threats.\n\nThe company's flagship product, HelixShield, uses behavioral analysis to identify anomalous network activity before breaches occur. Unlike traditional signature-based detection, their approach learns what 'normal' looks like for each client and flags deviations in real-time. Early customers have praised the low false-positive rate, though some have noted the onboarding process can be lengthy.\n\nHelix raised its seed round in late 2021 from angel investors including [Priya Taylor](people/priya-taylor-85) and [Julia Davis](people/julia-davis-86), both of whom have backgrounds in enterprise software. Priya in particular has been an active advisor, reportedly introducing the team to several key enterprise clients in the healthcare vertical. The company closed a Series A in 2023, though terms were not publicly disclosed.\n\nThe team has grown to around 45 employees, with engineering concentrated in Austin and a small sales presence in New York. Jackson remains CEO and is known for his hands-on technical involvement—he still reviews major architecture decisions and ocasionally jumps into customer calls when things get hairy. Former colleagues describe him as demanding but fair, with a tendency to work late nights that sometimes sets unrealistic expectations for the rest of the team.\n\nHelix Labs has been relatively quiet in terms of press, preferring to let customer referrals drive growth rather than splashy marketing campaigns. That said, there's been some chatter about a potential expansion into cloud security posture management, which would put them in direct competition with larger players. Whether they have the resources to fight on multiple fronts remaind to be seen.",
  "timeline": "- **2020-03-15** | Helix Labs incorporated in Delaware by [Bob Jackson](people/bob-jackson-59)\n- **2020-09-22** | First prototype of HelixShield deployed internally for testing\n- **2021-06-10** | Closed seed round with participation from [Priya Taylor](people/priya-taylor-85) and [Julia Davis](people/julia-davis-86)\n- **2021-11-03** | Landed first paying customer, a regional hospital network in Texas\n- **2022-04-18** | Expanded engineering team to 20 people, opened Austin office\n- **2023-02-27** | Series A closed; valuation undisclosed but rumored around $40M\n- **2023-09-14** | HelixShield 2.0 launched with improved ML detection pipeline\n- **2024-05-06** | [Bob Jackson](people/bob-jackson-59) spoke at RSA Conference on behavioral threat detection\n- **2025-01-22** | Announced partnership with managed security provider NorthWatch\n- **2025-08-30** | Internal planning meetings hint at cloud security product expansion",
  "_facts": {
    "type": "company",
    "slug": "companies/helix-labs-59",
    "name": "Helix Labs",
    "category": "startup",
    "industry": "cybersecurity",
    "founded_year": 2020,
    "founders": [
      "people/bob-jackson-59"
    ],
    "investors": [
      "people/priya-taylor-85",
      "people/julia-davis-86"
    ],
    "employees": [
      "people/sam-wilson-169"
    ]
  }
 }
--- a/eval/data/world-v1/companies__index-ventures-7.json
+++ b/eval/data/world-v1/companies__index-ventures-7.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/index-ventures-7",
  "type": "company",
  "title": "Index Ventures",
  "compiled_truth": "Index Ventures is one of Europe's most storied venture capital firms, with a track record that spans three decades and includes some of the most consequential technology companies of the modern era. Founded in Geneva in 1996, the firm has grown to operate across offices in San Francisco, London, and Geneva, positioning itself as a truly transatlantic investor with deep roots on both sides of the pond.\n\nThe firm operates across multiple stages, from seed through growth, and has backed companies like Figma, Discord, Notion, Roblox, and Deliveroo. Index made early bets on European champions like Skype and King Digital, establishing its reputation for identifying category-defining companies before they hit mainstream radar. Their portfolio reflects a broad thesis covering enterprise software, fintech, consumer internet, and increasingly, AI-native applications.\n\nIndex is known for its partnership-driven model, where partners maintain significant autonomy in dealmaking while sharing economics equally. Notable partners include Danny Rimer, who led investments in Dropbox and Glossier, and Mike Volpi, a former Cisco executive who's become one of the most respected enterprise investors in the industry. The firm's approach tends to be founder-friendly, often taking board seats but avoiding the heavy-handed governance that characterizes some of their peers.\n\nRecent years have seen Index raising substantial funds—their 2021 vintage exceeded $3 billion across seed and growth vehicles. They've been particularly active in the AI infrastructure space, competing aggressively with firms like [Sequoia Capital](companies/sequoia-capital-12) for the hottest deals. Some partners have noted tension between maintaining their European identity while increasingly deploying capital into Silicon Valley's AI boom.\n\nThe firm has also made notable investments alongside [Andreessen Horowitz](companies/andreessen-horowitz-9) in several high-profile rounds, demonstrating their ability to co-invest with top-tier American firms while maintaining deal leadership. Index's LP base includes major endowments, sovereign wealth funds, and family offices who've stuck with the firm through multiple fund cycles.\n\nCriticism sometimes surfaces around their growth-stage valuations—some observers argue Index overpaid during the 2021 bubble. But their seed practice has remained disciplined, and their multi-stage model provides natural follow-on optionality that pure-play seed funds lack.",
  "timeline": "- **2021-03-15** | Closed Index Ventures Growth VI at $2.3B, largest fund in firm history\n- **2021-09-22** | Led $150M Series C for AI startup alongside [Sequoia Capital](companies/sequoia-capital-12)\n- **2022-04-10** | Partner Martin Mignot promoted to lead European seed practice\n- **2022-11-08** | Portfolio company Figma announced $20B acquisition by Adobe (later terminated)\n- **2023-02-14** | Participated in Discord's down round, maintaining pro-rata\n- **2023-08-30** | Co-led infrastructure deal with [Andreessen Horowitz](companies/andreessen-horowitz-9) at $800M valuation\n- **2024-01-19** | Published annual European tech ecosystem report showing record unicorn creation\n- **2024-06-05** | Danny Rimer keynoted at Index's annual founder summit in London\n- **2025-02-28** | Announced new $1.8B early-stage fund focused on AI-native applications\n- **2025-09-12** | Opened small Tel Aviv office to expand Middle East dealflow",
  "_facts": {
    "type": "company",
    "slug": "companies/index-ventures-7",
    "name": "Index Ventures",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__initialized-11.json
+++ b/eval/data/world-v1/companies__initialized-11.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/initialized-11",
  "type": "company",
  "title": "Initialized Capital",
  "compiled_truth": "Initialized Capital is a seed-stage venture capital firm that made a significant mark on Silicon Valley's early-stage investing landscape. Founded in 2011 by Alexis Ohanian and Garry Tan, the firm quickly established itself as a go-to partner for ambitious founders building transformative companies. Initialized became known for writing the first checks into startups that would go on to become household names.\n\nThe firm's portfolio included some remarkable successes. Coinbase, Instacart, Cruise Automation, and Flexport all received early backing from Initialized, demonstrating the partners' ability to identify breakout opportunities before they became obvious. The fund's investment thesis centered on backing technical founders with strong product instincts, often at the pre-seed or seed stage when most institutional investors wouldn't engage.\n\nGarry Tan served as managing partner and was the driving force behind much of the firm's deal flow and investment decisions. His background as a founder (he co-founded Posterous) and his time as a partner at Y Combinator gave him unique insight into what makes early-stage companies succeed. In 2022, Tan departed Initialized to take on the role of President and CEO at [Y Combinator](companies/y-combinator), leaving the firm at an inflection point.\n\nFollowing Tan's departure, the future of Initalized became somewhat uncertain. The firm had raised multiple funds over the years, with later vehicles exceeding $300 million in committed capital. Some partners continued to manage existing investments while the firm's active deployment slowed considerably.\n\nInitialized was part of a broader wave of seed-focused firms that emerged in the early 2010s, alongside peers like First Round Capital and [Floodgate](companies/floodgate). These micro-VCs helped fill a gap left by larger funds that had moved upstream to Series A and beyond. The firm's legacy lives on through its portfolio companies, many of wich continue to shape their respective industries. Alexis Ohanian has since focused his attention on other ventures, including Seven Seven Six, his newer investment vehicle.",
  "timeline": "- **2011-06-15** | Initialized Capital founded by Alexis Ohanian and Garry Tan with a focus on seed-stage investments\n- **2017-03-22** | Closed Fund III at $225 million, marking significant growth from earlier vehicles\n- **2019-09-10** | Portfolio company Coinbase valuation exceeds $8 billion following private funding round\n- **2021-04-14** | Coinbase direct listing on NASDAQ delivers massive returns for early Initialized investment\n- **2022-01-18** | Garry Tan announced as incoming CEO of [Y Combinator](companies/y-combinator), signaling transition at Initialized\n- **2022-03-01** | Tan officially departs managing partner role to lead YC full-time\n- **2023-08-12** | Firm continues managing existing portfolio with reduced new investment activity\n- **2024-02-28** | Several Initialized portfolio companies announce down rounds amid market correction\n- **2025-05-14** | Legacy fund distributions continue as mature portfolio companies reach liquidity events",
  "_facts": {
    "type": "company",
    "slug": "companies/initialized-11",
    "name": "Initialized",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__iris-36.json
+++ b/eval/data/world-v1/companies__iris-36.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/iris-36",
  "type": "company",
  "title": "Iris",
  "compiled_truth": "Iris is a consumer social startup founded in 2024 by [Mia Park](people/mia-park-36), a first-time founder with a background in behavioral psychology and product design. The company is building what it describes as a \"mood-first\" social platform—users share emotional states and context rather than polished photos or status updates. The core thesis is that Gen Z craves authenticity but existing platforms still incentivize performance. Iris flips that by making vulnerability the default.\n\nThe app launched in closed beta in late 2024, initially targeting college campuses on the West Coast. Early traction was promising, with retention numbers that caught the attention of several angel investors. [Jack Davis](people/jack-davis-89) led a pre-seed round, drawn to Mia's unconventional approach and the product's sticky engagement loops. He's been hands-on, joining weekly product reviews and pushing the team to nail the onboarding flow before scaling.\n\nIris operates with a lean team of five, mostly engineers and one designer Mia poached from her previous gig at a larger social app. The company runs out of a cramped co-working space in San Francisco's Mission district. Culture is intense but collaborative—Mia sets aggressive ship cycles but also mandates \"disconnect Fridays\" to prevent burnout. There's a scrappy energy to the operation.\n\n[David Kim](people/david-kim-186) serves as an advisor, providing strategic guidence on growth tactics and helping Mia navigate the fundraising landscape. He's introduced her to several potential Series A leads, though the company isn't actively raising yet. The plan is to hit 100k MAU before pursuing a priced round.\n\nRecent product moves include a \"resonance\" feature that matches users with strangers experiencing similar emotional states. It's controversial internally—some worry about safety implications—but early data shows it drives significent engagement. Mia has publicly stated that Iris will never sell emotional data to advertisers, a stance that's resonated with privacy-conscious users but raises questions about eventual monetization.",
  "timeline": "- **2024-01-15** | [Mia Park](people/mia-park-36) incorporates Iris and begins recruiting founding team\n- **2024-03-22** | Closed alpha launches with 200 users from Stanford and Berkeley\n- **2024-05-10** | [Jack Davis](people/jack-davis-89) commits to leading pre-seed round after demo day pitch\n- **2024-06-01** | Pre-seed closes at $1.2M, valuation undisclosed\n- **2024-08-14** | [David Kim](people/david-kim-186) joins as formal advisor\n- **2024-10-03** | Beta expands to 12 universities across California and Oregon\n- **2024-11-19** | \"Resonance\" feature ships, driving 40% increase in daily sessions\n- **2025-01-08** | Iris hits 25k monthly active users milestone\n- **2025-02-20** | Mia speaks at a consumer social meetup in SF about emotional-first design\n- **2025-04-12** | Company begins exploratory conversations with Series A investors",
  "_facts": {
    "type": "company",
    "slug": "companies/iris-36",
    "name": "Iris",
    "category": "startup",
    "industry": "consumer social",
    "founded_year": 2024,
    "founders": [
      "people/mia-park-36"
    ],
    "investors": [
      "people/jack-davis-89"
    ],
    "employees": [
      "people/david-anderson-146"
    ],
    "advisors": [
      "people/david-kim-186"
    ]
  }
 }
--- a/eval/data/world-v1/companies__jolt-37.json
+++ b/eval/data/world-v1/companies__jolt-37.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/jolt-37",
  "type": "company",
  "title": "Jolt - AI Applications Startup",
  "compiled_truth": "Jolt is an early-stage startup founded in 2025 by [Chris Williams](people/chris-williams-37), operating in the AI applications space. The company emerged during a particularly competitive period for AI ventures, yet managed to secure backing from notable angel investors including [Tina Hernandez](people/tina-hernandez-97) and [Chris Miller](people/chris-miller-101).\n\nThe company focuses on building AI-powered productivity tools aimed at small and medium businesses. Their flagship product, still in development, promises to automate routine administrative tasks using a combination of large language models and custom workflow engines. Chris Williams has described the vision as \"AI that actually fits into how people already work, not the other way around.\"\n\nJolt operates with a lean team, currently around 8 people, mostly engineers with backgrounds in ML infrastructure and frontend development. The company maintains offices in Austin, though most of the team works remotley. Williams has been vocal about keeping the team small until they achieve stronger product-market fit, a philosophy he picked up from his previous startup experience.\n\nFunding details remain somewhat private, but sources suggest the initial round was in the $2-3M range. [Chris Miller](people/chris-miller-101) reportedly led the round after meeting Williams at a conference in late 2024. The investment thesis centered on Williams' track record and the team's technical depth rather than any revolutionary technology moat.\n\nThe startup has been relatively quiet publicly, preferring to focus on building rather than marketing. A private beta launched in Q1 2025 with around 50 companies participating. Early feedback has been mixed but promising—users appreciate the simplicity but want more integrations. The team is currently heads-down on expanding connector support for popular tools like Slack, Notion, and various CRMs.\n\nCompetition in the AI productivity space is fierce, with both well-funded startups and big tech players vying for attention. Jolt's bet is that their focus on SMBs and ease of deployment will carve out a defensible niche. Whether that pans out remains to be seen.",
  "timeline": "- **2024-11-15** | Chris Williams meets [Chris Miller](people/chris-miller-101) at AI Summit Austin, initial discussions about Jolt concept\n- **2025-01-08** | Jolt officially incorporated in Delaware\n- **2025-01-22** | Seed round closes with participation from [Tina Hernandez](people/tina-hernandez-97) and Chris Miller\n- **2025-02-10** | First two engineers hired, both former colleagues of [Chris Williams](people/chris-williams-37)\n- **2025-03-05** | Internal alpha of core product completed\n- **2025-04-12** | Private beta launches with 50 SMB partners\n- **2025-05-20** | Team expands to 8 people, adds first dedicated product manager\n- **2025-06-18** | Partnership discussions begin with major CRM vendor\n- **2025-07-02** | Beta feedback review leads to pivot toward deeper integrations focus",
  "_facts": {
    "type": "company",
    "slug": "companies/jolt-37",
    "name": "Jolt",
    "category": "startup",
    "industry": "AI applications",
    "founded_year": 2025,
    "founders": [
      "people/chris-williams-37"
    ],
    "investors": [
      "people/tina-hernandez-97",
      "people/chris-miller-101"
    ],
    "employees": [
      "people/xavier-johnson-147"
    ]
  }
 }
--- a/eval/data/world-v1/companies__keel-38.json
+++ b/eval/data/world-v1/companies__keel-38.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/keel-38",
  "type": "company",
  "title": "Keel",
  "compiled_truth": "Keel is a crypto startup founded in early 2025 by [Steve Williams](people/steve-williams-38), a serial entrepreneur with a background in decentralized finance protocols. The company operates in the digital asset infrastructure space, focusing on building institutional-grade custody and settlement solutions for blockchain networks. Despite being a newcomer to an already crowded market, Keel has positioned itself as a lean alternative to legacy crypto custodians, emphasizing speed and regulatory compliance from day one.\n\nThe founding thesis behind Keel centers on the belief that traditional crypto custody providers have become bloated and slow to adapt to emerging Layer 2 ecosystems. Steve Williams has been vocal about this gap, arguing that institutions need nimble partners who understand the nuances of rollups, bridges, and cross-chain liquidity. The company's initial product focuses on Ethereum L2 settlement, with plans to expand into Bitcoin sidechains by late 2025.\n\nKeel raised a pre-seed round in Q1 2025, with [Carol Jackson](people/carol-jackson-81) serving as the lead investor. Jackson, known for her contrarian bets in fintech infrastructure, apparently saw potential in Williams' vision despite the bear market sentiment still lingering from 2024. The round was modest—reportedly under $3 million—but gave the team runway to build out their core platform and hire a small enginering team.\n\nAdvisory support comes from [Linda Taylor](people/linda-taylor-178), who brings regulatory expertise to the table. Taylor's involvement signals that Keel is serious about compliance, a differentiator in an industry still grappling with enforcement actions. Her guidance has reportedly shaped the company's approach to KYC/AML integration and its conversations with potential banking partners.\n\nThe team remains small, operating out of a co-working space in Austin. Williams has kept headcount intentionally low, preferring to ship fast with a tight-knit group rather than scale prematurely. Early users include a handful of crypto-native hedge funds testing the settlement infrastucture in sandbox environments. Keel's public launch is expected sometime in Q3 2025.",
  "timeline": "- **2024-11-15** | Steve Williams begins exploratory conversations with early backers about a new custody venture\n- **2025-01-08** | Keel officially incorporated in Delaware; [Steve Williams](people/steve-williams-38) named CEO\n- **2025-01-22** | [Carol Jackson](people/carol-jackson-81) commits to leading the pre-seed round\n- **2025-02-10** | Pre-seed funding closes at $2.8M; team begins hiring engineers\n- **2025-02-28** | [Linda Taylor](people/linda-taylor-178) joins as regulatory advisor\n- **2025-03-15** | First internal demo of L2 settlement prototype completed\n- **2025-04-02** | Keel signs NDA with two crypto hedge funds for pilot testing\n- **2025-05-19** | Williams speaks at ETH Denver satellite event on institutional DeFi infrastructure\n- **2025-06-07** | Sandbox testing begins with select institutional partners",
  "_facts": {
    "type": "company",
    "slug": "companies/keel-38",
    "name": "Keel",
    "category": "startup",
    "industry": "crypto",
    "founded_year": 2025,
    "founders": [
      "people/steve-williams-38"
    ],
    "investors": [
      "people/carol-jackson-81"
    ],
    "employees": [
      "people/zoe-nakamura-148"
    ],
    "advisors": [
      "people/linda-taylor-178"
    ]
  }
 }
--- a/eval/data/world-v1/companies__khosla-ventures-8.json
+++ b/eval/data/world-v1/companies__khosla-ventures-8.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/khosla-ventures-8",
  "type": "company",
  "title": "Khosla Ventures",
  "compiled_truth": "Khosla Ventures is a prominent Silicon Valley venture capital firm founded in 2004 by Vinod Khosla, a co-founder of Sun Microsystems. The firm has established itself as one of the most influential investors in technology and cleantech, with a particular focus on companies that can have transformative impact across industries. Headquartered in Menlo Park, California, Khosla operates with a distinctive philosophy that embraces high-risk, high-reward bets on unproven technologies.\n\nThe firm manages multiple funds totaling billions in assets under managment, including seed funds for earlier-stage investments and larger growth funds for follow-on financing. Khosla Ventures has backed some notable successes including Square, DoorDash, and Instacart. More recently, the firm has been aggressively investing in artificial intelligence infrastructure and applications, recognizing the generational shift hapening in enterprise software.\n\nVinod Khosla himself remains deeply involved in investment decisions and is known for his contrarian views and willingness to fund moonshot ideas. The firm's team includes partners with deep technical backgrounds, which allows them to evaluate complex technologies that other VCs might shy away from. They've developed a reputation for being founder-friendly while also providing substantial operational support.\n\nKhosla Ventures has been particularly active in climate tech, betting big on carbon capture, alternative proteins, and next-generation energy storage. This aligns with Vinod's long-standing interest in technologies that address major societal challenges. The firm often co-invests alongside other major venture players like [Andreessen Horowitz](companies/a16z) on larger rounds, though they're equally comfortable leading deals solo.\n\nTheir investment approach tends to be thesis-driven rather than opportunistic. Partners develop deep conviction around specific technology shifts and then actively seek out founders building in those areas. This has led to early positions in categories before they become crowded. The firm maintains close relationships with the Stanford ecosystem and frequently backs technical founders straight out of PhD programs. Recent portfolio companies have explored everything from quantum computing to synthetic biology, reflecting Khosla's continued appetite for frontier tech bets.",
  "timeline": "- **2021-03-15** | Khosla Ventures closed Fund VII at $1.4 billion, oversubscribed due to strong LP demand\n- **2021-09-22** | Led $50M Series B in carbon removal startup, signaling renewed climate focus\n- **2022-04-08** | Vinod Khosla keynoted Stanford entrepreneurship conference on AI's transformative potential\n- **2022-11-30** | Announced strategic partnership with [Andreessen Horowitz](companies/a16z) for joint investment in AI infrastructure deals\n- **2023-06-14** | Portfolio company Impossible Foods explored IPO options with firm's guidance\n- **2023-12-01** | Khosla published annual predictions letter, forecasting major disruption in healthcare from AI diagnostics\n- **2024-05-19** | Promoted two new general partners from within, expanding investment team to twelve\n- **2024-09-03** | Led $120M growth round for enterprise AI startup at $900M valuation\n- **2025-02-28** | Filed for Fund VIII targeting $2.1 billion across seed and growth vehicles\n- **2025-08-11** | Hosted annual LP summit in Palo Alto featuring portfolio company demos",
  "_facts": {
    "type": "company",
    "slug": "companies/khosla-ventures-8",
    "name": "Khosla Ventures",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__kindle-20.json
+++ b/eval/data/world-v1/companies__kindle-20.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/kindle-20",
  "type": "company",
  "title": "Kindle - Climate Tech Startup",
  "compiled_truth": "Kindle is a climate tech startup founded in 2023 by [Vera Singh](people/vera-singh-20), focused on developing next-generation carbon capture solutions for industrial emitters. The company emerged from Singh's doctoral research at MIT, where she pioneered novel membrane technologies that significantly reduce the energy costs of direct air capture.\n\nThe startup operates out of Oakland, California, with a small but growing team of around 15 engineers and scientists. Kindle's core product is a modular carbon capture unit designed for mid-sized manufacturing facilities—a market segment that's been largely overlooked by bigger players chasing utility-scale deployments. Their approach prioritizes affordability and ease of installation over raw capture volume, betting that widespread adoption matters more than individual unit performance.\n\nKindle has attracted notable advisors including [Tina Moore](people/tina-moore-191), who brings decades of experience scaling hardware startups. Moore's involvement has been particularly valuable in helping the company navigate supply chain challenges and establish early manufacturing partnerships. The advisory relationship reportedly began after a chance meeting at a climate conference in late 2023.\n\nThe company closed a seed round in early 2024, though exact figures haven't been publicly disclosed. Industry sources suggest somewhere in the $4-6M range, with participation from several climate-focused VCs and a strategic investment from a major cement manufacturer. Vera has been quoted saying the cement partnership represents exactly the kind of industrial collaboration Kindle needs to prove out thier technology at scale.\n\nRecent activity suggests Kindle is preparing for pilot deployments at two manufacturing sites in the midwest, with plans to gather operational data through 2025. The team has been hiring aggressivley for field engineering roles, a sign that real-world testing is imminent. Competition in the carbon capture space remains fierce, but Kindle's focus on the underserved mid-market could give them a meaningful niche if execution goes well.",
  "timeline": "- **2023-03-15** | Kindle incorporated in Delaware by founder [Vera Singh](people/vera-singh-20)\n- **2023-06-22** | First prototype membrane unit achieves 40% efficiency improvement over baseline\n- **2023-11-08** | [Tina Moore](people/tina-moore-191) joins as lead advisor following Climate Forward conference\n- **2024-01-30** | Seed funding round closed with climate-focused VC syndicate\n- **2024-04-12** | Strategic partnership announced with Midwest cement manufacturer\n- **2024-07-19** | Team expands to 15 employees, opens Oakland R&D facility\n- **2024-10-03** | Vera Singh presents at TechCrunch Disrupt climate track\n- **2025-02-14** | Pilot deployment begins at first manufacturing partner site\n- **2025-05-20** | Second pilot location confirmed in Ohio",
  "_facts": {
    "type": "company",
    "slug": "companies/kindle-20",
    "name": "Kindle",
    "category": "startup",
    "industry": "climate tech",
    "founded_year": 2023,
    "founders": [
      "people/vera-singh-20"
    ],
    "employees": [
      "people/julia-jones-130"
    ],
    "advisors": [
      "people/tina-moore-191"
    ]
  }
 }
--- a/eval/data/world-v1/companies__kleiner-perkins-14.json
+++ b/eval/data/world-v1/companies__kleiner-perkins-14.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/kleiner-perkins-14",
  "type": "company",
  "title": "Kleiner Perkins",
  "compiled_truth": "Kleiner Perkins is one of the most storied venture capital firms in Silicon Valley, with a legacy stretching back to 1972. Founded by Eugene Kleiner and Tom Perkins, the firm helped shape the modern tech landscape through early bets on companies like Amazon, Google, and Genentech. Today, KP continues to operate as a top-tier growth and early-stage investor, though its position has evolved considerably from its peak influence in the 1990s and 2000s.\n\nThe firm operates primarily out of Menlo Park, California, maintaining a relatively focused team compared to mega-funds like Andreessen Horowitz or Sequoia. Kleiner Perkins has historically been organized around sector-specific practices, including digital health, fintech, enterprise, and consumer technology. Recent years have seen the firm double down on AI and machine learning opportunities, recognizing the transformative potential of foundation models and applied AI startups.\n\nNotable current partners include Mamoon Hamid, who joined from Social Capital, and Bucky Moore, known for his work in enterprise software. The firm has maintained relationships with iconic founders and frequently co-invests alongside other major players in the ecosystem. Their portfolio includes breakout successes like Figma, Rippling, and several emerging AI-native companies that are reshaping enterprise workflows.\n\nKleiner's approach to venture has shifted somewhat over the past decade. After struggling with its green tech investments in the early 2010s, the firm refocused on software and healthcare, areas where it had demonstrated repeateable success. The cleantech experiment, while producing some winners, largely taught KP hard lessons about capital intensity and market timing. They've since been more disciplined about sector allocation.\n\nThe firm typically writes checks ranging from $1M to $50M depending on stage, though they've participated in larger rounds for high-conviction bets. KP maintains a builder-friendly reputation, often providing operational support through its platform team and network of advisors. They host regular founder dinners and have been known to facilitate introductions across their portfolio companies.\n\nAs of 2024, Kleiner Perkins manages several billion dollars across multiple funds, continuing to attract institutional LPs despite increased competition in the venture landscape. The firm remains a sought-after partner for founders seeking both capital and credibility, though they face stiff competiton from newer entrants with aggressive deployment strategies.",
  "timeline": "- **2021-03-15** | Kleiner Perkins closed Fund XX at $1.8B, marking a return to larger fund sizes after years of more modest raises.\n- **2021-09-22** | Led Series B for an AI-native workflow automation startup, signaling renewed focus on enterprise machine learning applications.\n- **2022-04-08** | Partner Bucky Moore spoke at a founders summit on the future of vertical SaaS and embedded fintech.\n- **2022-11-30** | KP participated in Figma's final private round before the Adobe acquisition announcement.\n- **2023-06-14** | Announced new partner hire from Stripe, expanding fintech and payments expertise within the firm.\n- **2023-10-02** | Hosted annual CEO Summit in Napa Valley, bringing together portfolio founders for networking and strategy sessions.\n- **2024-02-19** | Led $40M Series A for a foundation model fine-tuning platform focused on healthcare applications.\n- **2024-08-07** | Kleiner Perkins published research report on AI agent adoption trends across enterprise customers.\n- **2025-01-23** | Participated in growth round for Rippling, continuing long-standing relationship with Parker Conrad.\n- **2025-05-11** | Mamoon Hamid joined board of a stealth climate software startup, marking selective return to climate-adjacent investments.",
  "_facts": {
    "type": "company",
    "slug": "companies/kleiner-perkins-14",
    "name": "Kleiner Perkins",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__lattice-39.json
+++ b/eval/data/world-v1/companies__lattice-39.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/lattice-39",
  "type": "company",
  "title": "Lattice - Enterprise SaaS Startup",
  "compiled_truth": "Lattice is an enterprise SaaS startup founded in 2022 by [Quinn Miller](people/quinn-miller-39), a repeat founder with a background in developer tools and infrastructure software. The company focuses on building next-generation workflow automation platfroms for mid-market and enterprise customers, specifically targeting operations teams who struggle with fragmented tooling across their organizations.\n\nThe company emerged from Quinn's frustration with existing solutions that either served small teams or required massive implementation budgets. Lattice positions itself in the middle ground—powerful enough for complex enterprise needs, but accessible enough that a single ops manager can get started without a consulting engagement. Their core product offers visual workflow builders, deep integrations with popular SaaS tools, and an AI-assisted configuration layer that helps users identify automation opportunities.\n\nEarly backing came from [Vera Gonzalez](people/vera-gonzalez-103), who led a seed round in late 2022. Vera had previously invested in several successful enterprise software companies and saw Lattice as addressing a genuine gap in the market. The company has since grown to approximately 25 employees, with engineering and product teams based primarily in San Francisco.\n\nOn the advisory side, Lattice brought on [Steve Martinez](people/steve-martinez-192) to help navigate enterprise sales cycles and GTM strategy. Steve's experience scaling sales organizations has proven valuable as Lattice transitions from founder-led sales to building out a dedicated revenue team. His connections in the Fortune 500 have also opened doors for pilot conversations that would otherwise take months to secure.\n\nLattice has been relatively quiet publicly, preferring to focus on product development and early customer success over PR. However, industry insiders note that the company has secured several notable design partners in the fintech and healthcare sectors. Their approach emphasizes landing with a single team and expanding organically—a strategy that keeps churn low but requires patience on revenue growth. The company is currently preparing for a Series A raise expected sometime in mid-2025.",
  "timeline": "- **2022-03-15** | [Quinn Miller](people/quinn-miller-39) incorporates Lattice and begins initial product development\n- **2022-09-22** | Closes $3.2M seed round led by [Vera Gonzalez](people/vera-gonzalez-103)\n- **2022-12-01** | First design partner signed—a mid-sized fintech processing loan applications\n- **2023-04-18** | [Steve Martinez](people/steve-martinez-192) joins as formal advisor to help build sales playbook\n- **2023-08-30** | Launches private beta with 12 companies participating\n- **2024-01-15** | Reaches $500K ARR milestone, transitions to general availability\n- **2024-06-12** | Expands integration library to cover 80+ enterprise tools\n- **2024-11-03** | Hires first dedicated VP of Sales, growing team to 25 employees\n- **2025-02-20** | Begins Series A fundraising conversations with top-tier VCs",
  "_facts": {
    "type": "company",
    "slug": "companies/lattice-39",
    "name": "Lattice",
    "category": "startup",
    "industry": "enterprise SaaS",
    "founded_year": 2022,
    "founders": [
      "people/quinn-miller-39"
    ],
    "investors": [
      "people/vera-gonzalez-103"
    ],
    "employees": [
      "people/owen-patel-149"
    ],
    "advisors": [
      "people/steve-martinez-192"
    ]
  }
 }
--- a/eval/data/world-v1/companies__lightspeed-6.json
+++ b/eval/data/world-v1/companies__lightspeed-6.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/lightspeed-6",
  "type": "company",
  "title": "Lightspeed Venture Partners",
  "compiled_truth": "Lightspeed Venture Partners is a global venture capital firm with a storied history dating back to 2000. The firm has established itself as one of the most influential players in early and growth-stage investing, with a particular strength in enterprise software, consumer internet, and fintech. Headquartered in Menlo Park, California, Lightspeed operates across multiple geographies including offices in India, China, Israel, and Europe.\n\nThe firm manages over $25 billion in committed capital across various funds and has backed some of the most consequential technology companies of the past two decades. Notable investments include Snap, Affirm, Mulesoft, and Rubrik. Lightspeed tends to take a hands-on approach with portfolio companies, often providing operational support and leveraging their extensive network to help founders scale.\n\nIn recent years, Lightspeed has been particularly agressive in the AI and machine learning space, deploying significant capital into foundational model companies and AI-native applications. The firm closed a $7.1 billion fund in 2022, one of the largest in its history, signaling continued confidence from LPs despite broader market uncertainty. Partners like Ravi Mhatre and Arif Janmohamed have been instrumental in shaping the firm's enterprise investing thesis.\n\nLightspeed has developed relationships with other major firms in the ecosystem, occasionally co-investing alongside [Andreessen Horowitz](companies/a16z) on competitive deals. The firm is known for moving quickly on conviction and has a reputation for being founder-friendly, though they maintain rigourous diligence processes. Their global footprint allows them to spot trends early—the India team, for instance, was early to companies like Oyo and Byju's before those markets became crowded.\n\nThe firm also runs Lightspeed Faction, a growth-stage vehicle that targets later rounds. This multi-stage capability has become increasingly important as companies stay private longer. They've competed for deals with firms like [Sequoia Capital](companies/sequoia) across multiple stages, sometimes winning on speed and sometimes on terms. Lightspeed remains a top-tier firm that consistently ranks among the most active investors globally.",
  "timeline": "- **2021-03-15** | Lightspeed leads $150M Series C for enterprise AI startup, marking increased focus on machine learning infrastructure\n- **2021-09-22** | Announced expansion of Israel office with three new partner hires\n- **2022-04-10** | Closed $7.1 billion across early and growth funds, largest raise in firm history\n- **2022-11-08** | Co-invested alongside [Andreessen Horowitz](companies/a16z) in developer tools company seed round\n- **2023-02-14** | Published annual report showing 47 new investments across global portfolio in 2022\n- **2023-07-19** | Partner Mercedes Bent promoted to lead consumer investing practice\n- **2024-01-30** | Lightspeed Faction leads $200M growth round for cybersecurity unicorn\n- **2024-06-12** | Competed with [Sequoia Capital](companies/sequoia) for Series B deal in logistics automation space\n- **2025-02-28** | Opened new office in London to expand European coverage\n- **2025-09-05** | Announced $500M opportunity fund focused exclusively on AI applications",
  "_facts": {
    "type": "company",
    "slug": "companies/lightspeed-6",
    "name": "Lightspeed",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__lucid-21.json
+++ b/eval/data/world-v1/companies__lucid-21.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/lucid-21",
  "type": "company",
  "title": "Lucid",
  "compiled_truth": "Lucid is a climate tech startup founded in 2020 by [Eric Lee](people/eric-lee-21), focused on developing next-generation carbon capture monitoring systems. The company emerged from Eric's frustration with the lack of real-time verification tools in the voluntary carbon markets—a gap he identified while working on sustainability initiatives at his previous role.\n\nThe core product is a hardware-software platform that provides continous monitoring of carbon sequestration projects, particularly direct air capture facilities and reforestation efforts. Lucid's sensors collect granular data on CO2 flux, which feeds into their analytics dashboard used by project developers, carbon credit buyers, and third-party verifiers. The pitch is simple: if you're buying carbon credits, you should know they're actually removing carbon.\n\nIn 2022, Lucid raised a seed round led by [Fiona Moore](people/fiona-moore-88), with participation from [Ian Anderson](people/ian-anderson-105). The round valued the company at roughly $18M and gave them runway to expand their pilot programs across North America. Fiona joined the board and has been instrumental in connecting Lucid to her network of institutional investors interested in climate infrastructure.\n\nThe company operates lean—around 25 employees as of late 2024, split between hardware engineering in Oakland and a software team that's mostly remote. [Vera Rodriguez](people/vera-rodriguez-171) serves as an advisor, bringing her expertise in carbon markets and regulatory frameworks. Her guidance has been particularly valuable as Lucid navigates the evolving landscape of carbon credit certification standards.\n\nLucid has faced some headwinds. The voluntary carbon market contracted in 2023 amid scrutiny over credit quality, which ironically validated Lucid's core thesis but also slowed sales cycles. Several potential enterprise deals got pushed as companies reassesed their offset strategies. Still, the team sees this as a temporary correction that ultimately benefits players focused on verification and transparency.\n\nRecent moves include a partnership with a major reforestation nonprofit to pilot their monitoring tech across 50,000 hectares in the Pacific Northwest. Eric has been increasingly visible at climate conferences, positioning Lucid as the \"trust layer\" for carbon markets.",
  "timeline": "- **2020-06-15** | Lucid incorporated by [Eric Lee](people/eric-lee-21) in Delaware, initial focus on carbon monitoring R&D\n- **2021-03-22** | First prototype sensor deployed at a test site in Nevada desert\n- **2021-11-08** | Accepted into climate tech accelerator program, relocated operations to Oakland\n- **2022-04-30** | Closed $4.2M seed round led by [Fiona Moore](people/fiona-moore-88)\n- **2022-09-14** | Hired VP of Engineering from Planet Labs to scale hardware team\n- **2023-02-17** | [Vera Rodriguez](people/vera-rodriguez-171) formally joins as strategic advisor\n- **2023-08-05** | Eric presents at Climate Week NYC on verification standards\n- **2024-01-20** | Announced partnership with ForestWatch nonprofit for Pacific Northwest pilot\n- **2024-07-11** | Reached 15 active deployment sites across US and Canada\n- **2025-03-03** | Began Series A conversations, targeting $15-20M raise",
  "_facts": {
    "type": "company",
    "slug": "companies/lucid-21",
    "name": "Lucid",
    "category": "startup",
    "industry": "climate tech",
    "founded_year": 2020,
    "founders": [
      "people/eric-lee-21"
    ],
    "investors": [
      "people/fiona-moore-88",
      "people/ian-anderson-105"
    ],
    "employees": [
      "people/ian-nakamura-131"
    ],
    "advisors": [
      "people/vera-rodriguez-171"
    ]
  }
 }
--- a/eval/data/world-v1/companies__lumen-12.json
+++ b/eval/data/world-v1/companies__lumen-12.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/lumen-12",
  "type": "company",
  "title": "Lumen - Biotech Startup",
  "compiled_truth": "Lumen is a biotech startup founded in 2018 by [Henry Johnson](people/henry-johnson-12), focused on developing novel diagnostic tools for early-stage cancer detection. The company operates out of Cambridge, Massachusetts, positioning itself within one of the most concentrated biotech ecosystems in the world. Their core technology leverages proprietary biomarker identification methods combined with machine learning to detect malignancies from standard blood draws—sometimes called liquid biopsy approaches.\n\nThe founding story traces back to Johnson's graduate research at MIT, where he first identified a unique protein signature associated with pancreatic cancer. Rather than pursue a traditional academic path, he spun out the research into what would become Lumen. Early days were scrappy. The company ran lean for nearly two years before securing meaningful outside investment.\n\nLumen's investor base includes [Kate Lopez](people/kate-lopez-99), who led their seed round in late 2020, and [Sarah Wang](people/sarah-wang-104), who joined during the Series A. Both have been activley involved in shaping company strategy, with Lopez taking a board observer seat and Wang providing introductions to pharmaceutical partners. The relationship with these backers has been described as collaborative rather than hands-off—monthly check-ins, strategic planning sessions, the works.\n\nOn the product side, Lumen has made steady progress. Their flagship diagnostic, LumenScreen, completed initial clinical validation in 2023 and is currently pursuing FDA breakthrough device designation. The team has grown to around 45 employees, split between R&D and clinical operations. They've also inked a partnership with a major regional hospital network for pilot testing, though terms weren't disclosed publically.\n\nHenry Johnson remains CEO and is known for a somewhat reserved public presence—he rarely speaks at conferences and prefers to let data do the talking. Internally, employees describe the culture as intense but mission-driven. Turnover has been relatively low for a company at this stage.\n\nLumen faces stiff competition from larger players in the liquid biopsy space, including Grail and Guardant Health. But the company's narrow focus on specific cancer types may prove advantageous for regulatory approval and clinical adoption. The next 18 months will be critical as they push toward commercialization.",
  "timeline": "- **2018-03-15** | Lumen incorporated in Delaware by [Henry Johnson](people/henry-johnson-12)\n- **2018-09-22** | First lab space secured in Cambridge, initial team of 3 hired\n- **2020-11-08** | Seed round closed with [Kate Lopez](people/kate-lopez-99) leading at $2.4M\n- **2021-06-30** | Biomarker panel v1 validated in preclinical studies\n- **2022-04-12** | Series A announced, $18M raised with participation from [Sarah Wang](people/sarah-wang-104)\n- **2023-01-19** | LumenScreen enters clinical validation trials across 4 sites\n- **2023-08-07** | Partnership announced with Northeast Regional Health System for pilot deployment\n- **2024-02-28** | FDA breakthrough device designation application submitted\n- **2024-11-15** | Team expands to 45 full-time employees\n- **2025-03-22** | Preliminary data from clinical trials presented at AACR annual meeting",
  "_facts": {
    "type": "company",
    "slug": "companies/lumen-12",
    "name": "Lumen",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2018,
    "founders": [
      "people/henry-johnson-12"
    ],
    "investors": [
      "people/kate-lopez-99",
      "people/sarah-wang-104"
    ],
    "employees": [
      "people/grace-miller-122"
    ]
  }
 }
--- a/eval/data/world-v1/companies__mantle-16.json
+++ b/eval/data/world-v1/companies__mantle-16.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/mantle-16",
  "type": "company",
  "title": "Mantle",
  "compiled_truth": "Mantle is a consumer social startup founded in 2024 by [Ulrich Wang](people/ulrich-wang-16), an entrepreneur with a background in community-driven products. The company is building what they describe as a \"social layer for real-world experiences\" — essentially trying to bridge the gap between digital social graphs and physical gatherings. Early product demos have shown features around spontaneous meetups, location-based discovery, and ephemeral group chats tied to specific venues or events.\n\nThe founding team is lean, with Ulrich handling most of the product vision and early engineering. He's been advised by [Julia Wilson](people/julia-wilson-194), who brings experience from previous consumer social ventures and has been instrumental in shaping Mantle's go-to-market thinking. Julia's involvement suggests the company is serious about avoiding the common pitfalls of consumer social — namely, building features nobody asked for and failing to find organic growth loops.\n\nMantle's thesis is that existing social apps have become too performative, too oriented around content creation rather than genuine connection. The team believes there's an underserved segment of users who want lower-friction ways to coordinate IRL hangs without the pressure of posting or maintaining a public persona. It's a crowded space, but Wang argues that most competitors have gotten the incentive structures wrong — focusing on creator monetization when they should be focusing on social utility.\n\nThe company hasn't announced any funding publicly, though sources suggest they've raised a small pre-seed round from angels in the consumer space. Headcount remains under five as of late 2024. Mantle is currently testing with a closed beta group, primarly college students in the Bay Area and a few cities on the East Coast.\n\nWhether Mantle can break through remains to be seen. Consumer social is notoriously difficult — network effects cut both ways, and user attention is finite. But with Ulrich's obsessive focus on user experience and Julia Wilson's strategic guidance, the company has a shot at carving out a niche. Early retention numbers are reportedly encouraging, though the team is tight-lipped about specifics.",
  "timeline": "- **2024-01-18** | Ulrich Wang incorporates Mantle as a Delaware C-corp, begins solo development on MVP.\n- **2024-03-02** | [Julia Wilson](people/julia-wilson-194) joins as an advisor after intro from a mutual investor.\n- **2024-04-15** | Mantle closes a small pre-seed round; terms undisclosed.\n- **2024-06-10** | First internal alpha launched to ~50 testers across three college campuses.\n- **2024-08-22** | Company hires first full-time engineer, a former classmate of [Ulrich Wang](people/ulrich-wang-16).\n- **2024-09-30** | Closed beta expands to 500 users; early retention data looks promising.\n- **2024-11-12** | Mantle presents at a small consumer social showcase in SF, generates some buzz.\n- **2025-01-08** | Team begins exploring partnerships with event venues for location-based features.\n- **2025-03-20** | Beta user count crosses 2,000; team considering seed raise timing.",
  "_facts": {
    "type": "company",
    "slug": "companies/mantle-16",
    "name": "Mantle",
    "category": "startup",
    "industry": "consumer social",
    "founded_year": 2024,
    "founders": [
      "people/ulrich-wang-16"
    ],
    "employees": [
      "people/noah-lopez-126"
    ],
    "advisors": [
      "people/julia-wilson-194"
    ]
  }
 }
--- a/eval/data/world-v1/companies__meridian-40.json
+++ b/eval/data/world-v1/companies__meridian-40.json
@@ -1,29 +0,0 @@
 {
  "slug": "companies/meridian-40",
  "type": "company",
  "title": "Meridian",
  "compiled_truth": "Meridian is a developer tools startup founded in 2022 by [Chris Nakamura](people/chris-nakamura-40), a former infrastructure engineer who spent years frustrated by the fragmented state of debugging workflows. The company focuses on building unified observability tooling that sits between traditional logging platforms and APM solutions—a niche that's proven surprisingly sticky with mid-sized engineering teams.\n\nThe founding thesis came from Nakamura's experience at larger tech companies where he watched teams cobble together five or six different tools just to trace a single production incident. Meridian's core product aggregates logs, traces, and metrics into what they call a \"narrative view\"—essentially reconstructing the story of what happened in your system without requiring engineers to context-switch between dashboards. Its a deceptively simple idea that turns out to be technically complex to execute well.\n\nFunding came together relatively quickly. [Priya Taylor](people/priya-taylor-85) led the seed round after seeing an early demo, and she brought in [Chris Jackson](people/chris-jackson-91) who had been looking for developer tools plays. [Vera Gonzalez](people/vera-gonzalez-103) joined as a smaller check but has been actively involved in go-to-market strategy. The total seed was $3.2M, closed in late 2022.\n\nOn the advisory side, [Zoe Jackson](people/zoe-jackson-199) has been instrumental in helping Meridian think through enterprise sales motions. Her background in scaling developer-focused products gave the team a playbook they've been iterating on throughout 2023 and into 2024.\n\nMeridian currently has about 14 employees, mostly engineers, operating out of a small office in San Francisco's Dogpatch neighborhood. They've been deliberatley slow on hiring, preferring to keep the team tight while they nail down product-market fit. Revenue numbers aren't public but word is they crossed $500K ARR sometime in early 2024, with a handful of paying customers in the fintech and healthtech spaces.\n\nThe company's biggest challenge right now is differentiation. The observability market is crowded, and larger players like Datadog keep expanding their feature sets. Nakamura has been vocal about staying focused on the \"debugging narrative\" angle rather than trying to become a full platform. Whether that strategy holds as they scale remains to be seen.",
  "timeline": "- **2022-03-14** | Chris Nakamura incorporates Meridian, begins building initial prototype\n- **2022-08-22** | First demo shown to [Priya Taylor](people/priya-taylor-85), receives positive feedback and term sheet discussions begin\n- **2022-11-03** | Seed round closes at $3.2M with [Chris Jackson](people/chris-jackson-91) and [Vera Gonzalez](people/vera-gonzalez-103) participating\n- **2023-02-17** | Meridian launches private beta, onboards first 12 design partners\n- **2023-06-09** | [Zoe Jackson](people/zoe-jackson-199) joins as formal advisor, begins weekly office hours with team\n- **2023-09-28** | Public launch at a small developer conference in SF, picks up first paying customers\n- **2024-01-15** | Crosses $500K ARR milestone, team celebrates with low-key dinner\n- **2024-05-20** | Hires first dedicated sales rep, begins outbound motion targeting Series B+ startups\n- **2024-11-08** | Ships major \"Narrative 2.0\" update with improved trace visualization\n- **2025-02-14** | Begins early conversations about Series A, [Priya Taylor](people/priya-taylor-85) making introductions to growth-stage funds",
  "_facts": {
    "type": "company",
    "slug": "companies/meridian-40",
    "name": "Meridian",
    "category": "startup",
    "industry": "developer tools",
    "founded_year": 2022,
    "founders": [
      "people/chris-nakamura-40"
    ],
    "investors": [
      "people/priya-taylor-85",
      "people/chris-jackson-91",
      "people/vera-gonzalez-103"
    ],
    "employees": [
      "people/kate-kapoor-150"
    ],
    "advisors": [
      "people/zoe-jackson-199"
    ]
  }
 }
--- a/eval/data/world-v1/companies__meta-2.json
+++ b/eval/data/world-v1/companies__meta-2.json
@@ -1,15 +0,0 @@
 {
  "slug": "companies/meta-2",
  "type": "company",
  "title": "Meta (Cybersecurity)",
  "compiled_truth": "Meta is a cybersecurity firm founded in 1997, not to be confused with the social media giant of the same name. Operating in the enterprise security space for over two decades, the company has built a reputation as a quiet but effective acquirer of smaller security startups and niche technology providers.\n\nThe company specializes in network security infrastructure and threat detection systems, serving primarily Fortune 500 clients and government contractors. Their flagship product line focuses on perimeter defense and intrusion detection, though they've expanded considerably through strategic acquisitions over the years. Meta's approach has always been to identify promising early-stage cybersecurity companies and integrate their technology into the broader Meta ecosystem.\n\nIn recent years, Meta has been particularly active in the acqusition market, snapping up several AI-driven security startups looking to modernize their offerings. The company completed at least three acquisitions in 2024 alone, focusing on machine learning-based threat analysis and zero-trust architecture providers. Their M&A strategy tends to favor companies with strong technical teams rather than those with large customer bases—they're buying talent and IP, not revenue.\n\nLeadership at Meta Cybersecurity has remained relatively stable, with most of the executive team having been with the company for over a decade. This continuity has allowed them to maintain consistent strategic direction even as the cybersecurity landscape shifts dramatically. They've been rumored to be in discussions with [Anduril Industries](companies/anduril-industries) regarding potential partnership opportunities in the defense sector, though neither party has confirmed these reports.\n\nThe firm maintains a low public profile compared to flashier competitors, preferring to let their client relationships speak for themselves. Their government contracting work, in particular, requires discretion. Meta has also been mentioned in connection with [Palantir Technologies](companies/palantir-technologies) as a potential acquisition target, though industry analysts consider this unlikely given Meta's own acquisition-focused strategy and the cultural differences between the two organizations.\n\nHeadquartered in the Washington D.C. metro area, Meta employs approximately 800 people across their main office and satellite locations in Austin and Tel Aviv.",
  "timeline": "- **2021-03-15** | Meta acquires small endpoint security startup based in Boston for undisclosed sum\n- **2021-09-22** | Company celebrates 24 years in operation with internal summit featuring keynote on future of zero-trust\n- **2022-04-08** | Meta Cybersecurity signs major contract with Department of Defense for network monitoring services\n- **2022-11-30** | Opens new R&D facility in Tel Aviv focused on threat intelligence\n- **2023-06-14** | Partnership discussions reportedly begin with [Anduril Industries](companies/anduril-industries) around defense applications\n- **2024-02-19** | Completes acquisition of AI security startup, third deal in eight months\n- **2024-08-05** | Meta leadership meets with [Palantir Technologies](companies/palantir-technologies) executives at RSA Conference, sparking merger speculation\n- **2025-01-12** | Launches next-generation threat detection platform incorporating acquired ML technology\n- **2025-07-28** | Announces expansion of Austin office, adding 150 new engineering positions\n- **2026-03-03** | Named to Gartner Magic Quadrant for Enterprise Network Security for fifth consecutive year",
  "_facts": {
    "type": "company",
    "slug": "companies/meta-2",
    "name": "Meta",
    "category": "acquirer",
    "industry": "cybersecurity",
    "founded_year": 1997
  }
 }
--- a/eval/data/world-v1/companies__microsoft-0.json
+++ b/eval/data/world-v1/companies__microsoft-0.json
@@ -1,15 +0,0 @@
 {
  "slug": "companies/microsoft-0",
  "type": "company",
  "title": "Microsoft",
  "compiled_truth": "Microsoft is a dominant force in the cybersecurity landscape, having transformed itself from a traditional software giant into one of the most aggressive acquirers in the security space. Founded in 1995, the company has methodically built out its security portfolio through strategic acquisitions and internal development, positioning itself as a one-stop shop for enterprise security needs.\n\nThe company's cybersecurity division generates over $20 billion in annual revenue, making it one of the largest security vendors globally. Microsoft's approach has been to embed security deeply into its cloud infrastructure, particularly Azure and Microsoft 365, creating an integrated ecosystem thats difficult for competitors to match. Their Defender suite, Sentinel SIEM platform, and Entra identity solutions form the backbone of security for thousands of enterprises worldwide.\n\nMicrosoft's acquisition strategy has been notably aggressive. They've snapped up numerous startups and established players alike, often integrating the technology directly into their existing platforms. This has created tension with pure-play security vendors who find themselves competing against a company that bundles security features into products their customers already use. Some critics argue this bundling approach leads to \"good enough\" security rather than best-in-class protection, but the convenience factor has proven compelling for many IT departments.\n\nThe company has also invested heavily in threat intelligence, operating one of the largest security research teams in the industry. Their visibility into global attack patterns—derived from telemetry across Windows, Azure, and Office 365—gives them unique insights that feed back into their products. Recent moves have focused on AI-powered security tools, with Microsoft positioning Copilot for Security as a force multiplier for understaffed security teams.\n\nLeadership under Satya Nadella has prioritized security as a core pillar, especially following several high-profile breaches affecting Microsoft's own infrastructure. The company has faced scrutiny from government agencies and enterprise customers demanding better baseline security, prompting internal reorganizations and the Secure Future Initiative. Despite these challanges, Microsoft remains a category-defining player that shapes how the industry thinks about integrated security platforms.",
  "timeline": "- **2021-03-15** | Microsoft announces acquisition of RiskIQ for threat intelligence capabilities, expanding its external attack surface management\n- **2021-07-22** | Completed purchase of CloudKnox Security to bolster identity and access management portfolio\n- **2022-04-18** | Launched Microsoft Entra brand, consolidating identity products under unified naming\n- **2022-11-09** | Security revenue surpasses $20 billion annually, making MSFT one of the largest security vendors globally\n- **2023-03-28** | Unveiled Security Copilot at Ignite, bringing generative AI to security operations workflows\n- **2023-08-14** | Faced congressional scrutiny following Chinese threat actor breach of government email accounts via compromised signing keys\n- **2024-01-22** | Announced Secure Future Initiative following internal security review, pledging fundamental changes to development practices\n- **2024-06-11** | Expanded partnership with major defense contractors for classified cloud security workloads\n- **2025-02-19** | Acquired endpoint detection startup to enhance Defender capabilities in OT/IoT environments\n- **2025-09-03** | Microsoft Security leadership presented at RSA Conference on next-generation SIEM architecture",
  "_facts": {
    "type": "company",
    "slug": "companies/microsoft-0",
    "name": "Microsoft",
    "category": "acquirer",
    "industry": "cybersecurity",
    "founded_year": 1995
  }
 }
--- a/eval/data/world-v1/companies__mosaic-14.json
+++ b/eval/data/world-v1/companies__mosaic-14.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/mosaic-14",
  "type": "company",
  "title": "Mosaic - Consumer Social Startup",
  "compiled_truth": "Mosaic is a consumer social startup founded in 2018 by [Vera Chen](people/vera-chen-14), who serves as the company's CEO. The company operates in the consumer social space, building products that aim to reimagine how people connect and share experiences online. Based on the premise that traditional social media has become too performative and shallow, Mosaic set out to create more authentic digital spaces for meaningful interaction.\n\nThe platform's core product allows users to create collaborative visual stories—essentially shared digital scrapbooks that multiple people can contribute to in real-time. Think of it as a blend between Pinterest boards and group chats, but with richer media capabilities. The name \"Mosaic\" reflects this vision: individual pieces coming together to form something beautiful and cohesive.\n\nVera Chen built the initial prototype while working nights and weekends, drawing on her background in interaction design and her frustration with existing social platforms. Early traction came from college students coordinating group trips and long-distance friend groups trying to stay connected. The organic growth caught the attention of several investors in the Bay Area.\n\n[Helen Martinez](people/helen-martinez-87) led an early investment round, providing crucial capital that allowed Mosaic to expand its engineering team and improve infastructure. Martinez saw potential in Chen's vision and the company's strong retention metrics among its early user base. The investment also brought valuable mentorship to the young founder.\n\nThe company has faced significant competition from established players who've tried to replicate similar features. Instagram's \"Collabs\" and Snapchat's shared stories both emerged after Mosaic gained traction. However, the startup has maintained its niche by focusing on depth over breadth—their users create fewer posts but spend more time on each one.\n\nMosiac currently employs around 35 people, mostly engineers and designers. The team operates with a hybrid work model, with offices in San Francisco. Revenue comes primarily from a freemium subscription model, though the company has experimented with brand partnerships for special templates and features.",
  "timeline": "- **2018-03-15** | Vera Chen incorporates Mosaic and begins building the first prototype\n- **2018-11-02** | Beta launch to 500 users, mostly from Chen's network and local universities\n- **2019-06-20** | [Helen Martinez](people/helen-martinez-87) leads seed round of $2.1M\n- **2020-01-08** | Mosaic hits 100,000 registered users during pandemic surge in social app usage\n- **2021-04-12** | Series A closes at $12M, company expands engineering team to 20\n- **2022-09-30** | Launch of Mosaic Pro subscription tier with premium collaborative features\n- **2023-03-18** | [Vera Chen](people/vera-chen-14) speaks at SXSW on \"Building for Authentic Connection\"\n- **2024-07-22** | Partnership announced with major photo printing service for physical mosaic books\n- **2025-02-14** | Company reaches 2 million monthly active users milestone\n- **2025-11-03** | Mosaic acquires small AR startup to integrate spatial features into platform",
  "_facts": {
    "type": "company",
    "slug": "companies/mosaic-14",
    "name": "Mosaic",
    "category": "startup",
    "industry": "consumer social",
    "founded_year": 2018,
    "founders": [
      "people/vera-chen-14"
    ],
    "investors": [
      "people/helen-martinez-87"
    ],
    "employees": [
      "people/chris-rodriguez-124"
    ]
  }
 }
--- a/eval/data/world-v1/companies__nea-13.json
+++ b/eval/data/world-v1/companies__nea-13.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/nea-13",
  "type": "company",
  "title": "NEA (New Enterprise Associates)",
  "compiled_truth": "New Enterprise Associates, commonly known as NEA, stands as one of the largest and most established venture capital firms in the world. Founded in 1977, the firm has grown from its roots in early-stage technology investing to become a multi-stage powerhouse with assets under management exceeding $25 billion. NEA operates across the full spectrum of venture investing, from seed rounds to growth equity, with a particular focus on technology and healthcare sectors.\n\nThe firm maintains offices in Menlo Park, San Francisco, New York, Boston, and internationally, giving it substantial reach across major startup ecosystems. NEA's investment philosophy emphasizes long-term partnerships with founders, and they've backed some of the most consequential companies of the past several decades including Salesforce, Workday, and Uber. Their healthcare practice is particularly notable, having invested in numerous successful biotech and medical device companies.\n\nIn recent years NEA has continued to raise substantial funds, with their latest flagship fund exceeding $3.6 billion. The firm operates with a relatively large partnership compared to some peers, allowing them to cover more ground but sometimes leading to questions about decision-making speed. Partners like Scott Sandell and Peter Barris have shaped the firms direction over multiple decades, though newer partners are increasingly taking lead roles on deals.\n\nNEA has shown interest in emerging areas like AI infrastructure and climate tech, competing with firms like [Andreessen Horowitz](companies/a16z-9) for the hottest deals. Their approach tends to be more traditional than some newer entrants to venture — they're known for thorough due dilligence and sometimes slower processes, which can be both a feature and a bug depending on founder preferences. The firm frequently co-invests alongside other major players including [Sequoia Capital](companies/sequoia-capital-6), particularly on larger growth rounds where syndicate diversity matters to founders.\n\nNEA's brand carries significant weight in boardrooms and with LPs, though they face ongoing pressure to demonstrate continued relevance as the venture landscape evolves rapidly around them.",
  "timeline": "- **2021-03-15** | NEA closes Fund XIV at $3.6 billion, one of the largest funds in firm history\n- **2021-09-22** | Lead investment in Series B for AI-native cybersecurity startup alongside [Sequoia Capital](companies/sequoia-capital-6)\n- **2022-04-08** | Partner Hannah Kreiswirth promoted to lead healthcare investing practice\n- **2022-11-30** | NEA portfolio company exits via SPAC merger, generating 8x return\n- **2023-06-14** | Announced strategic focus on climate tech, committing $500M to sector\n- **2023-10-02** | Co-led $180M growth round in enterprise AI company with [Andreessen Horowitz](companies/a16z-9)\n- **2024-02-19** | Opened new office in London to expand European presence\n- **2024-08-07** | Scott Sandell announces transition to Chairman role, new managing partners named\n- **2025-01-23** | Led seed round for stealth quantum computing startup at $40M valuation\n- **2025-05-11** | NEA portfolio company IPO on NYSE, largest venture-backed healthcare listing of the year",
  "_facts": {
    "type": "company",
    "slug": "companies/nea-13",
    "name": "NEA",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__nexus-41.json
+++ b/eval/data/world-v1/companies__nexus-41.json
@@ -1,21 +0,0 @@
 {
  "slug": "companies/nexus-41",
  "type": "company",
  "title": "Nexus",
  "compiled_truth": "Nexus is a biotech startup founded in 2023 by [Alice Kim](people/alice-kim-41), a computational biologist who previously spent nearly a decade at Genentech before striking out on her own. The company operates in the synthetic biology space, specifically focused on developing novel protein engineering platforms that leverage machine learning to accelerate drug discovery timelines.\n\nThe founding thesis behind Nexus centers on a simple but powerful idea: traditional protein design is too slow and too expensive. [Alice Kim](people/alice-kim-41) built the initial prototype while still moonlighting at her previous role, using transformer-based models to predict protein folding outcomes with what she claims is 40% better accuracy than existing tools. Bold claim. The early data seems to back it up, though peer review is still pending on their foundational paper.\n\nNexus raised a $4.2M seed round in late 2023, led by a syndicate of biotech-focused angels and one undisclosed strategic investor rumored to be connected to a major pharma company. The funds went primarily toward buildling out their wet lab capabilities in South San Francisco and hiring a small but senior team of six full-time employees. Alice has been deliberate about keeping the team lean—she's said publicly that she'd rather have five exceptional people than fifteen mediocre ones.\n\nThe company's go-to-market strategy involves partnering with mid-size pharmaceutical companies who lack the in-house ML expertise to build these platforms themselves. Nexus positions itself as a \"co-pilot\" rather than a replacement, which has helped ease concerns about IP ownership and control. Two pilot partnerships were announced in early 2024, though neither partner has been named publicly.\n\nCulturally, Nexus operates with an almost academic intensity. Weekly journal clubs, mandatory documentation of experiments, open internal debates about methodology. Alice brought this ethos from her research days and has made it core to how the company functions. Some employees thrive in this environment; others have found it exhausting. Turnover has been minimal so far, but the company is still young.",
  "timeline": "- **2023-03-15** | [Alice Kim](people/alice-kim-41) incorporates Nexus as a Delaware C-corp while still employed at Genentech\n- **2023-06-22** | Alice leaves Genentech to work on Nexus full-time; secures initial $500K pre-seed from angel investors\n- **2023-09-08** | Nexus closes $4.2M seed round; announces plans to open South San Francisco wet lab\n- **2023-11-30** | First full-time hire: Dr. Marcus Chen joins as Head of Protein Engineering\n- **2024-01-17** | Wet lab facility becomes operational; first internal experiments begin\n- **2024-04-03** | Nexus announces two unnamed pharmaceutical partnership pilots\n- **2024-07-12** | [Alice Kim](people/alice-kim-41) presents preliminary platform results at SynBioBeta conference\n- **2024-10-25** | Team expands to six FTEs; company moves to larger office space\n- **2025-02-14** | Submits foundational paper on ML-driven protein folding to Nature Methods\n- **2025-06-01** | Series A discussions reportedly underway with multiple tier-1 biotech VCs",
  "_facts": {
    "type": "company",
    "slug": "companies/nexus-41",
    "name": "Nexus",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2023,
    "founders": [
      "people/alice-kim-41"
    ],
    "employees": [
      "people/eric-park-151"
    ]
  }
 }
--- a/eval/data/world-v1/companies__nimbus-5.json
+++ b/eval/data/world-v1/companies__nimbus-5.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/nimbus-5",
  "type": "company",
  "title": "Nimbus",
  "compiled_truth": "Nimbus is a climate tech startup founded in early 2025 by [Mia Anderson](people/mia-anderson-5), a serial entrepreneur with a background in atmospheric science and distributed systems. The company is building what they describe as a \"climate intelligence layer\" — essentially a real-time data platform that aggregates satellite imagery, sensor networks, and predictive models to help enterprises and governments make better decisions around carbon accounting, extreme weather preparedness, and supply chain resiliance.\n\nThe founding story is pretty straightforward. Mia had been working on climate modeling tools at a larger company, got frustrated with how slow things moved, and decided to spin out her own thing. She bootstrapped for about three months before bringing on [Noah Nakamura](people/noah-nakamura-182) as an advisor. Noah's been instrumental in shaping their go-to-market strategy, particularly around enterprise sales cycles and pricing architecture.\n\nNimbus operates with a small but focused team — currently around 8 people, mostly engineers with a couple of climate scientists. They've been pretty heads-down on product development, though theyve started doing some early pilots with logistics companies in the Pacific Northwest. The initial use case seems to be helping shipping and freight operations anticipate weather disruptions and reroute proactively.\n\nWhat makes Nimbus interesting is their approach to data fusion. Rather than building their own sensor network from scratch, they're aggregating existing data sources — NOAA feeds, commercial satellite providers, IoT sensors already deployed by clients — and layering their own ML models on top. This keeps their infrastructure costs relatively low while still delivering actionable insights.\n\nThe company hasn't announced any formal funding rounds yet, though rumors suggest they're in conversations with a few climate-focused VCs. Mia Anderson has been intentionally keeping things quiet, preferring to let the product speak for itself before raising. Their advisory relationship with Noah Nakamura gives them some credibility in enterprise circles, which should help when they do decide to go out for capital.",
  "timeline": "- **2024-09-15** | [Mia Anderson](people/mia-anderson-5) leaves previous role to begin exploring climate intelligence concepts\n- **2025-01-08** | Nimbus officially incorporated in Delaware\n- **2025-02-14** | [Noah Nakamura](people/noah-nakamura-182) joins as advisor, begins weekly strategy sessions\n- **2025-03-22** | First engineering hire made — backend systems specialist from Google\n- **2025-04-10** | Internal alpha of climate data platform completed\n- **2025-05-18** | Pilot program launched with two Pacific Northwest logistics companies\n- **2025-07-02** | Team expands to 8 full-time employees\n- **2025-08-29** | Nimbus presents at Climate Tech Connect conference in Portland\n- **2025-10-15** | Early discussions begin with climate-focused VC firms",
  "_facts": {
    "type": "company",
    "slug": "companies/nimbus-5",
    "name": "Nimbus",
    "category": "startup",
    "industry": "climate tech",
    "founded_year": 2025,
    "founders": [
      "people/mia-anderson-5"
    ],
    "employees": [
      "people/quinten-nakamura-115"
    ],
    "advisors": [
      "people/noah-nakamura-182"
    ]
  }
 }
--- a/eval/data/world-v1/companies__nimbus-labs-55.json
+++ b/eval/data/world-v1/companies__nimbus-labs-55.json
@@ -1,21 +0,0 @@
 {
  "slug": "companies/nimbus-labs-55",
  "type": "company",
  "title": "Nimbus Labs",
  "compiled_truth": "Nimbus Labs is a developer tools startup founded in 2019 by [Vera Kapoor](people/vera-kapoor-55), who previously spent nearly a decade building infrastructure at larger tech companies before striking out on her own. The company focuses on cloud-native debugging and observability tooling, with their flagship product being a distributed tracing platform that's gained significant traction among mid-sized engineering teams.\n\nThe core thesis behind Nimbus is that debugging microservices shouldn't require a PhD in distributed systems. Their approach combines automatic instrumentation with AI-assisted root cause analysis, letting developers pinpoint issues across complex service meshes without manually correlating logs across dozens of services. It's an opinionated take on observability that's rubbed some infrastructure purists the wrong way, but the product's ease of adoption has won over plenty of converts.\n\nVera has been the public face of the company since day one, frequently speaking at conferences about the future of developer experience. She's known for her direct communication style and has built a small but loyal following on technical blogs. Under her leadership, Nimbus Labs has grown from a three-person team working out of a WeWork to roughly 45 employees spread across San Francisco and a small office in Bangalore.\n\nThe company raised a Series A in late 2021 and has been relatively quiet about fundraising since, though rumors of a Series B have circulated. Nimbus competes in a crowded space against established players like Datadog and newer entrants, but they've carved out a niche by focusing specifically on the debugging workflow rather than trying to be an all-in-one platform. Recent product updates have emphasized integration with popular CI/CD pipelines and expanded support for serverless architectures.\n\n[Vera Kapoor](people/vera-kapoor-55) remains CEO and maintains a hands-on role in product decisions, which some investors see as both a strength and potential bottleneck as the company scales. The next year will likely determine whether Nimbus can break out of its current niche or gets aquired by a larger platform player.",
  "timeline": "- **2019-03-14** | Nimbus Labs incorporated in Delaware; [Vera Kapoor](people/vera-kapoor-55) listed as sole founder and CEO\n- **2019-11-02** | First public beta launched at a small developer meetup in SF; initial feedback was mixed but enthusiastic from early adopters\n- **2021-06-18** | Closed $8.5M Series A led by Baseline Ventures; announced plans to triple engineering headcount\n- **2022-02-10** | Shipped v2.0 of core tracing platform with AI-assisted analysis features\n- **2022-09-23** | Vera Kapoor delivered keynote at DevOpsCon on \"The Death of Manual Debugging\"\n- **2023-04-05** | Opened Bangalore engineering office; hired first international team members\n- **2023-11-30** | Reached 1,000 paying customers milestone; mostly SMB and mid-market\n- **2024-07-12** | Launched serverless support after months of customer requests\n- **2025-01-20** | Rumored acquisition talks with larger observability vendor fell through\n- **2025-08-03** | Announced partnership with major cloud provider for native integration",
  "_facts": {
    "type": "company",
    "slug": "companies/nimbus-labs-55",
    "name": "Nimbus Labs",
    "category": "startup",
    "industry": "developer tools",
    "founded_year": 2019,
    "founders": [
      "people/vera-kapoor-55"
    ],
    "employees": [
      "people/iris-jones-165"
    ]
  }
 }
--- a/eval/data/world-v1/companies__orbit-42.json
+++ b/eval/data/world-v1/companies__orbit-42.json
@@ -1,25 +0,0 @@
 {
  "slug": "companies/orbit-42",
  "type": "company",
  "title": "Orbit - Biotech Startup",
  "compiled_truth": "Orbit is a biotech startup founded in 2021 by [Jack Patel](people/jack-patel-42), focused on developing novel protein engineering platforms for therapeutic applications. The company emerged from Patel's earlier research work and has positioned itself at the intersection of computational biology and wet lab innovation. Based out of the Boston-Cambridge biotech corridor, Orbit has built a lean but ambitious team.\n\nThe company's core technology revolves around machine learning-driven protein design, enabling faster iteration cycles for drug candidates targeting rare genetic disorders. Their proprietary platform, internally called \"Orbital,\" can predict protein folding outcomes with unusual accuracy, cutting development timelines significantly. Early partnerships with academic institutions have validated their approach, though comercial traction remains nascent.\n\nFunding has come from angel investors including [Julia Davis](people/julia-davis-86) and [Zoe Gonzalez](people/zoe-gonzalez-100), both of whom participated in Orbit's seed round. Davis in particular has been an active advisor, leveraging her network in the life sciences space to open doors for the young company. Gonzalez contributed not just capital but also operational guidance, having scaled biotech ventures before.\n\nJack Patel serves as CEO and remains deeply involved in the scientific direction. He's known for being hands-on in the lab despite growing management responsibilites. The team has grown to roughly 15 people as of late 2024, with key hires in protein chemistry and ML engineering.\n\nOrbit has kept a relatively low profile compared to flashier biotech startups, preferring to let results speak. They've published two peer-reviewed papers and presented at major conferences including the Biotech Showcase in San Francisco. The company is currently running preclinical studies for their lead program, OBT-101, targeting a rare metabolic condition. Industry watchers see Orbit as a company to watch—small but technically rigorous, with a founder who understands both the science and the business.",
  "timeline": "- **2021-03-15** | Orbit incorporated in Delaware by [Jack Patel](people/jack-patel-42)\n- **2021-08-22** | Closed $1.2M seed round led by [Julia Davis](people/julia-davis-86)\n- **2022-02-10** | First version of Orbital platform completed internally\n- **2022-09-18** | Published initial findings in Nature Biotechnology\n- **2023-01-24** | [Zoe Gonzalez](people/zoe-gonzalez-100) joins as advisor and investor\n- **2023-06-30** | Hired Dr. Maria Chen as Head of Protein Chemistry\n- **2024-01-12** | Presented OBT-101 preclinical data at JP Morgan Healthcare Conference\n- **2024-07-08** | Expanded lab space in Cambridge, MA\n- **2025-03-20** | Initiated IND-enabling studies for lead program\n- **2025-11-05** | Announced collaboration with major pharma partner (undisclosed)",
  "_facts": {
    "type": "company",
    "slug": "companies/orbit-42",
    "name": "Orbit",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2021,
    "founders": [
      "people/jack-patel-42"
    ],
    "investors": [
      "people/julia-davis-86",
      "people/zoe-gonzalez-100"
    ],
    "employees": [
      "people/rachel-jones-152"
    ]
  }
 }
--- a/eval/data/world-v1/companies__prism-43.json
+++ b/eval/data/world-v1/companies__prism-43.json
@@ -1,31 +0,0 @@
 {
  "slug": "companies/prism-43",
  "type": "company",
  "title": "Prism",
  "compiled_truth": "Prism is a cybersecurity startup founded in 2023 by [David Patel](people/david-patel-43), who previously spent nearly a decade building threat detection systems at larger security firms. The company focuses on what it calls 'adaptive perimeter defense'—essentially AI-driven intrusion detection that learns an organization's normal traffic patterns and flags anomolies in real-time. Its early traction has been notable, particularly among mid-market financial services companies who find enterprise solutions too expensive but need more than basic firewall protections.\n\nThe founding story is pretty straightforward. David had grown frustrated with the slow pace of innovation at his previous employer and saw an opening in the market for lightweight, intelligent security tooling that didn't require a dedicated SOC team to operate. He bootstrapped the initial prototype over six months before raising a seed round.\n\nPrism's investor syndicate includes [Carol Jackson](people/carol-jackson-81), [Rosa Jackson](people/rosa-jackson-90), and [Tina Hernandez](people/tina-hernandez-97). Carol led the seed round and reportedly pushed hard for the company to focus on the SMB market rather than chasing enterprise deals too early. This strategic direction has shaped much of Prism's go-to-market approach. Rosa came in through an angel allocation and has been relatively hands-off, while Tina joined the cap table in a follow-on extension round in late 2024.\n\nOn the advisory side, [Alice Davis](people/alice-davis-172) provides guidance on product architecture—she's known for her work on distributed systems and has been instrumental in helping Prism scale its detection engine. [Olivia Miller](people/olivia-miller-176) advises on sales strategy and customer success, drawing on her background in enterprise software GTM.\n\nThe team has grown to around 18 people, mostly engineers, with a small but scrappy sales org. Prism operates out of Austin but has several remote employees scattered across the US. The company culture skews technical and moves fast—David himself still reviews most major PRs. Revenue is growing but the company isn't yet profitable, which is typical for this stage. They're expected to raise a Series A sometime in mid-2025.",
  "timeline": "- **2023-02-14** | David Patel incorporates Prism and begins building initial prototype\n- **2023-07-22** | Seed round closes with [Carol Jackson](people/carol-jackson-81) leading, $2.1M raised\n- **2023-11-03** | First paying customer signs—a regional credit union in Texas\n- **2024-01-18** | [Alice Davis](people/alice-davis-172) joins as technical advisor\n- **2024-04-09** | Prism launches v1.0 of its adaptive perimeter defense platform\n- **2024-08-15** | Team hits 12 employees, opens small Austin office\n- **2024-10-30** | Extension round adds [Tina Hernandez](people/tina-hernandez-97) to investor group\n- **2025-01-22** | [Olivia Miller](people/olivia-miller-176) begins advising on GTM strategy\n- **2025-03-11** | ARR crosses $800K, Series A conversations begin",
  "_facts": {
    "type": "company",
    "slug": "companies/prism-43",
    "name": "Prism",
    "category": "startup",
    "industry": "cybersecurity",
    "founded_year": 2023,
    "founders": [
      "people/david-patel-43"
    ],
    "investors": [
      "people/carol-jackson-81",
      "people/rosa-jackson-90",
      "people/tina-hernandez-97"
    ],
    "employees": [
      "people/mia-singh-153"
    ],
    "advisors": [
      "people/alice-davis-172",
      "people/olivia-miller-176",
      "people/zoe-jackson-199"
    ]
  }
 }
--- a/eval/data/world-v1/companies__pulse-8.json
+++ b/eval/data/world-v1/companies__pulse-8.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/pulse-8",
  "type": "company",
  "title": "Pulse - EdTech Startup",
  "compiled_truth": "Pulse is an edtech startup founded in 2022 by [Yara Johnson](people/yara-johnson-8), a former learning experience designer who spent nearly a decade observing how students actually engage with digital content. The company's core product is a real-time engagement analytics platform designed for K-12 classrooms and higher education institutions. Unlike traditional LMS analytics that track completion rates and grades, Pulse monitors micro-behaviors—pause patterns, scroll velocity, re-reads—to give educators a genuine sense of whether students are struggling before they fail a test.\n\nThe founding thesis came from Johnson's frustration with existing tools that treated engagement as a binary: either a student watched the video or they didn't. Pulse argues that the *how* matters more than the whether. Their proprietary algorithm flags what they call \"confusion signals\" and surfaces them to teachers in a simple dashboard. Early pilots in three school districts showed a 23% reduction in students falling behind, though critics have raised privacy concerns about the level of behavioral tracking involved.\n\nFunding has been modest but strategic. [Eric Martinez](people/eric-martinez-93) led the seed round in late 2022, bringing not just capital but connections to several charter school networks in Texas and California. Martinez has been vocal about his belief that edtech needs more \"unsexy infrastructure\" plays rather than consumer apps, and Pulse fits that thesis perfectly. The company currently employs around 15 people, mostly engineers and former educators.\n\n[David Kim](people/david-kim-186) serves as an advisor, helping Pulse navigate enterprise sales cycles and district procurement processes—notoriously slow and bureacratic. Kim's background in B2B SaaS has been instrumental in shaping Pulse's go-to-market strategy, which prioritizes landing a few large district contracts over chasing individual schools. As of early 2024, Pulse has contracts with 12 districts serving roughly 40,000 students combined. Revenue isn't disclosed but is rumored to be in the low seven figures. Yara Johnson remains CEO and has been clear she's building for the long haul, not a quick exit.",
  "timeline": "- **2022-03-14** | Yara Johnson incorporates Pulse after leaving her role at a major textbook publisher\n- **2022-09-08** | Closes seed round led by [Eric Martinez](people/eric-martinez-93), raising $1.8M\n- **2022-11-20** | First pilot launches in Austin ISD with 3 middle schools\n- **2023-02-15** | [David Kim](people/david-kim-186) joins as official advisor\n- **2023-06-01** | Pulse ships v2.0 with redesigned teacher dashboard based on pilot feedback\n- **2023-10-12** | Signs first major district contract with Fresno Unified (18,000 students)\n- **2024-01-29** | Presents at SXSWedu panel on ethical student analytics\n- **2024-05-17** | Expands engineering team to 9 people, opens small Denver office\n- **2024-11-03** | Reaches 40,000 students across 12 districts\n- **2025-02-22** | Begins early conversations about Series A with several edtech-focused VCs",
  "_facts": {
    "type": "company",
    "slug": "companies/pulse-8",
    "name": "Pulse",
    "category": "startup",
    "industry": "edtech",
    "founded_year": 2022,
    "founders": [
      "people/yara-johnson-8"
    ],
    "investors": [
      "people/eric-martinez-93"
    ],
    "employees": [
      "people/xavier-nakamura-118"
    ],
    "advisors": [
      "people/david-kim-186"
    ]
  }
 }
--- a/eval/data/world-v1/companies__pulse-labs-58.json
+++ b/eval/data/world-v1/companies__pulse-labs-58.json
@@ -1,26 +0,0 @@
 {
  "slug": "companies/pulse-labs-58",
  "type": "company",
  "title": "Pulse Labs",
  "compiled_truth": "Pulse Labs is a developer tools startup founded in 2019 by [Rachel Lopez](people/rachel-lopez-58), who previously spent nearly a decade building internal tooling at larger tech companies before striking out on her own. The company focuses on API observability and debugging tools, helping engineering teams identify performance bottlenecks and trace issues across distributed systems. Their flagship product, Pulse Trace, has gained traction among mid-sized SaaS companies looking for alternatives to more expensive enterprise solutions.\n\nThe company operates with a relatively lean team of around 35 employees, mostly engineers, spread across San Francisco and a satellite office in Austin. Rachel has been vocal about maintaining a sustainable growth trajectory rather than chasing hypergrowth, which has shaped the company's culture and hiring practices. This philosophy resonated with their investor group, which includes [Carol Jackson](people/carol-jackson-81), [Priya Taylor](people/priya-taylor-85), and [Rosa Jackson](people/rosa-jackson-90).\n\nPulse Labs raised a $4.2M seed round in early 2020, followed by a Series A of $18M in 2022 led by Priya Taylor's fund. The Series A came at a time when developer tooling was seeing significant investor intrest, and Pulse was well-positioned with strong retention metrics among its early customers. Rosa Jackson joined as an angel investor during the seed round and has remained an active advisor, particularly on go-to-market strategy.\n\nRecent moves include expanding their platform to support OpenTelemetry natively, a decision that required significant engineering investment but opened up compatability with a broader ecosystem. The company also launched a free tier in late 2024 aimed at individual developers and small teams, a strategic bet on bottom-up adoption. Rachel Lopez has mentioned in interviews that they're exploring AI-assisted debugging features, though nothing concrete has been announced yet.\n\nPulse Labs competes with established players like Datadog and newer entrants in the observability space, but differentiates through pricing transparency and a focus on developer experience over enterprise feature bloat.",
  "timeline": "- **2019-03-15** | Pulse Labs incorporated by [Rachel Lopez](people/rachel-lopez-58) in Delaware\n- **2020-01-22** | Closed $4.2M seed round with participation from [Rosa Jackson](people/rosa-jackson-90)\n- **2020-09-08** | Launched Pulse Trace beta to first 50 customers\n- **2021-06-14** | Reached 200 paying customers milestone\n- **2022-04-03** | Announced $18M Series A led by [Priya Taylor](people/priya-taylor-85)\n- **2022-11-17** | Opened Austin office, hired VP of Engineering\n- **2023-05-22** | Rachel Lopez spoke at DevToolsCon on sustainable startup growth\n- **2024-02-09** | Shipped native OpenTelemetry support in Pulse Trace 3.0\n- **2024-10-30** | Launched free tier for individual developers\n- **2025-03-12** | [Carol Jackson](people/carol-jackson-81) joined board as observer seat",
  "_facts": {
    "type": "company",
    "slug": "companies/pulse-labs-58",
    "name": "Pulse Labs",
    "category": "startup",
    "industry": "developer tools",
    "founded_year": 2019,
    "founders": [
      "people/rachel-lopez-58"
    ],
    "investors": [
      "people/carol-jackson-81",
      "people/priya-taylor-85",
      "people/rosa-jackson-90"
    ],
    "employees": [
      "people/alice-jones-168"
    ]
  }
 }
--- a/eval/data/world-v1/companies__quantum-7.json
+++ b/eval/data/world-v1/companies__quantum-7.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/quantum-7",
  "type": "company",
  "title": "Quantum",
  "compiled_truth": "Quantum is a fintech startup founded in 2022 by [Ulrich Johnson](people/ulrich-johnson-7), a serial entrepreneur with a background in quantitative finance and distributed systems. The company emerged from Johnson's frustration with the sluggish settlement times and opaque fee structures that plague traditional payment rails. Based out of Austin, Texas, Quantum has built a real-time payment reconciliation platform targeting mid-market e-commerce businesses and SaaS companies.\n\nThe core product offers instant transaction matching, automated dispute resolution, and predictive cash flow analytics. What sets Quantum apart from competitors is their proprietary matching algorithm, which reportedly achieves 99.7% accuracy on first-pass reconciliation—a significant improvement over industry standards. The platform integrates with major payment processors, banking APIs, and accounting software, positioning itself as the connective tissue in a fragmented fintech ecosystem.\n\nEarly backing came from [Kate Anderson](people/kate-anderson-107), who led a $2.1M seed round in late 2022. Anderson's involvement brought not just capital but credibility, given her track record of identifying breakout fintech plays. The company has since grown to around 25 employees, with plans to double headcount by end of 2025.\n\nOn the advisory side, [Noah Williams](people/noah-williams-198) has been instrumental in shaping Quantum's go-to-market strategy. Williams' connections in the enterprise software space have opened doors to several pilot programs with Fortune 500 companies—a surprising feat for such a young startup. His guidance on pricing and packaging helped the team move away from a pure usage-based model toward a hybrid subscription approach that's proven more predictable for customers and investors alike.\n\nQuantum's roadmap includes international expansion, starting with the UK and EU markets where PSD2 regulations have created fertile ground for innovative payment solutions. There's also talk of an AI-powered fraud detection layer, though details remain sparse. The company operates somewhat stealthily, preferring to let product traction speak rather than chasing press coverage.",
  "timeline": "- **2022-03-14** | Ulrich Johnson incorporates Quantum in Delaware, begins recruiting founding engineering team\n- **2022-09-22** | Closes $2.1M seed round led by [Kate Anderson](people/kate-anderson-107)\n- **2022-11-08** | Launches private beta with 12 e-commerce customers\n- **2023-02-15** | [Noah Williams](people/noah-williams-198) joins as lead advisor, focuses on GTM stratgy\n- **2023-06-30** | Exits beta, announces general availability of reconciliation platform\n- **2023-10-12** | Surpasses 200 paying customers, hits $1M ARR milestone\n- **2024-04-18** | Opens Austin headquarters, team grows to 25 employees\n- **2024-08-07** | Begins enterprise pilot program with two Fortune 500 retailers\n- **2025-01-20** | Announces plans for UK expansion, begins regulatory groundwork\n- **2025-05-11** | [Ulrich Johnson](people/ulrich-johnson-7) speaks at FinTech Connect conference on real-time reconciliation",
  "_facts": {
    "type": "company",
    "slug": "companies/quantum-7",
    "name": "Quantum",
    "category": "startup",
    "industry": "fintech",
    "founded_year": 2022,
    "founders": [
      "people/ulrich-johnson-7"
    ],
    "investors": [
      "people/kate-anderson-107"
    ],
    "employees": [
      "people/tina-lopez-117"
    ],
    "advisors": [
      "people/noah-williams-198"
    ]
  }
 }
--- a/eval/data/world-v1/companies__quantum-labs-57.json
+++ b/eval/data/world-v1/companies__quantum-labs-57.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/quantum-labs-57",
  "type": "company",
  "title": "Quantum Labs",
  "compiled_truth": "Quantum Labs is an early-stage biotech startup founded in 2024 by [Liam Wilson](people/liam-wilson-57), a computational biologist who previously led protein folding research at a major pharma company. The company operates out of a small lab space in Cambridge, MA, though much of the early work has been computational in nature.\n\nThe startup focuses on quantum computing applications for drug discovery, specifically targeting protein-ligand binding simulations that would take classical computers years to process. Their core thesis is that near-term quantum hardware, combined with clever error mitigation techniques, can already provide meaningful speedups for certain molecular dynamics calculations. Its a bold bet, and not everyone in the industry is convinced the hardware is ready.\n\nQuantum Labs raised a pre-seed round in late 2024, with [Rachel Brown](people/rachel-brown-95) leading the investment. Rachel has been particularly bullish on quantum-adjacent biotech plays and saw Liam's background as uniquely suited to bridge the gap between quantum computing hype and actual pharmaceutical applications. [Rosa Miller](people/rosa-miller-98) also participated in the round, bringing her experience scaling deep tech companies.\n\nOn the advisory side, the company brought on [Tara Johnson](people/tara-johnson-189) to help navigate regulatory pathways and partnership discussions with larger pharma players. Tara's connections have already opened doors to several exploratory conversations, though nothing has been announced publically yet.\n\nThe team remains small—just five people including Liam—but they've made progress on their initial benchmarking studies. Early results suggest their hybrid classical-quantum approach can reduce simulation time by roughly 40% for certain small molecule interactions. Whether this translates to real-world drug discovery value remains to be seen. Quantum Labs is currently focused on publishing these findings to establish credibility before pursuing a larger seed round, likely in mid-2025.",
  "timeline": "- **2024-01-15** | Liam Wilson begins preliminary research and files initial IP for quantum-enhanced molecular simulation methods\n- **2024-03-22** | Quantum Labs officially incorporated in Delaware\n- **2024-05-10** | [Rachel Brown](people/rachel-brown-95) commits to leading pre-seed investment after initial pitch\n- **2024-06-18** | Lab space secured in Cambridge, MA; first equipment purchases made\n- **2024-07-30** | [Rosa Miller](people/rosa-miller-98) joins the round, bringing total pre-seed to $1.8M\n- **2024-09-12** | [Tara Johnson](people/tara-johnson-189) formally joins as advisor\n- **2024-11-05** | First proof-of-concept results show promising speedups on protein-ligand simulations\n- **2025-01-20** | Team expands to five with hire of quantum software engineer from IBM\n- **2025-03-08** | Submits first paper to Nature Computational Science on hybrid simulation methodology",
  "_facts": {
    "type": "company",
    "slug": "companies/quantum-labs-57",
    "name": "Quantum Labs",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2024,
    "founders": [
      "people/liam-wilson-57"
    ],
    "investors": [
      "people/rachel-brown-95",
      "people/rosa-miller-98"
    ],
    "employees": [
      "people/frank-moore-167"
    ],
    "advisors": [
      "people/tara-johnson-189"
    ]
  }
 }
--- a/eval/data/world-v1/companies__quasar-44.json
+++ b/eval/data/world-v1/companies__quasar-44.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/quasar-44",
  "type": "company",
  "title": "Quasar",
  "compiled_truth": "Quasar is a data infrastructure startup founded in early 2025 by [Mark Wilson](people/mark-wilson-44), a serial entrepreneur with deep roots in distributed systems. The company emerged from Wilson's frustration with existing data pipeline tools, which he found too brittle for modern real-time workloads. Based in San Francisco, Quasar is building what they call a \"unified data fabric\" — essentially a layer that sits between data sources and downstream applications, handling ingestion, transformation, and delivery with minimal configuration.\n\nThe founding team is lean but experienced. Mark Wilson previously led infrastructure at two mid-stage startups, one of wich was aquired by Snowflake in 2022. He's known for strong opinions on developer experience and has been vocal on Twitter about what he sees as the over-complexity of the modern data stack. Early angel investment came from [Jack Davis](people/jack-davis-89), who reportedly wrote a check after a single demo meeting. Davis has been an active advisor beyond just capital, making introductions to potential design partners in the fintech space.\n\nOn the advisory side, Quasar brought on [Grace Singh](people/grace-singh-197) to help shape go-to-market strategy. Singh's background in enterprise sales has already influenced how the company thinks about pricing and packaging. Internal docs suggest they're leaning toward a consumption-based model with a generous free tier to drive adoption among smaller teams.\n\nQuasar is still in stealth mode as of mid-2025, though they've been quietly onboarding design partners. Early feedback has centered on the product's speed — some users report 10x improvements in query latency compared to legacy tools. The tech stack is Rust-heavy, which aligns with Wilson's preference for performance-first engineering. There's some chatter that a seed round is in the works, though nothing confirmed publicly. The company employs around eight people, mostly engineers recruited from Wilson's network.",
  "timeline": "- **2025-01-14** | Quasar incorporated in Delaware by [Mark Wilson](people/mark-wilson-44)\n- **2025-01-28** | Initial angel check from [Jack Davis](people/jack-davis-89), terms undisclosed\n- **2025-02-10** | First engineering hire joins from Databricks\n- **2025-03-05** | [Grace Singh](people/grace-singh-197) formally joins as advisor\n- **2025-03-22** | Internal alpha of core data fabric released to team\n- **2025-04-18** | First design partner signed — a Series B fintech in NYC\n- **2025-05-09** | Wilson presents at private invite-only infrastructure meetup\n- **2025-06-01** | Team grows to eight full-time employees\n- **2025-06-15** | Second design partner onboarded, early latency benchmarks shared internally",
  "_facts": {
    "type": "company",
    "slug": "companies/quasar-44",
    "name": "Quasar",
    "category": "startup",
    "industry": "data infrastructure",
    "founded_year": 2025,
    "founders": [
      "people/mark-wilson-44"
    ],
    "investors": [
      "people/jack-davis-89"
    ],
    "employees": [
      "people/liam-patel-154"
    ],
    "advisors": [
      "people/grace-singh-197"
    ]
  }
 }
--- a/eval/data/world-v1/companies__ranger-22.json
+++ b/eval/data/world-v1/companies__ranger-22.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/ranger-22",
  "type": "company",
  "title": "Ranger",
  "compiled_truth": "Ranger is a health tech startup founded in 2024 by [Quinten Rodriguez](people/quinten-rodriguez-22), a first-time founder who previously spent six years in clinical operations at major hospital systems. The company is building what it describes as a \"proactive health monitoring platform\" — essentially a combination of wearable integration, predictive analytics, and care coordination tools aimed at catching health issues before they become emergencies.\n\nThe core product pulls data from consumer wearables and runs it through proprietary algorithms that flag concerning patterns. When something looks off, Ranger connects users directly with healthcare providers through an integrated telehealth layer. It's ambitious, maybe overly so for such an early-stage company, but the team seems to be executing well so far.\n\nRanger raised a pre-seed round in early 2024 with participation from [Helen Martinez](people/helen-martinez-87) and [Sarah Wang](people/sarah-wang-104), both of whom have been active in the health tech space. The round was reportedly around $2.1M, though the company hasn't confirmed exact figures publicly. [Beth Williams](people/beth-williams-177) came on as an advisor shortly after, bringing regulatory expertise that will likely prove critical as Ranger navigates FDA considerations around its predictive features.\n\nThe founding team is still small — just seven people as of late 2024 — but they've been hiring aggresively for ML engineering roles. Quinten has been vocal about wanting to build the technical foundation right before scaling the team further. Smart approach, though it means they're moving slower on go-to-market than some competitors.\n\nRanger's initial focus is on cardiovascular health monitoring for adults over 50, a demographic that's both high-risk and increasingly comfortable with wearable technology. Early pilot programs with two regional health systems have shown promising engagement numbers, though clinical outcomes data is still being collected. The company faces stiff competiton from both established players and well-funded startups, but their emphasis on provider integration rather than direct-to-consumer sales could be a meaningful differentiator.",
  "timeline": "- **2024-01-15** | Ranger incorporated in Delaware by [Quinten Rodriguez](people/quinten-rodriguez-22)\n- **2024-03-08** | Closed pre-seed round with [Helen Martinez](people/helen-martinez-87) and [Sarah Wang](people/sarah-wang-104) participating\n- **2024-04-22** | [Beth Williams](people/beth-williams-177) joins as regulatory advisor\n- **2024-06-10** | First engineering hire — ML lead recruited from Apple Health team\n- **2024-08-14** | Launched private beta with 200 users in Austin area\n- **2024-10-03** | Announced pilot partnership with Memorial Regional Health System\n- **2024-11-19** | Quinten presented at Digital Health Summit on predictive monitoring\n- **2025-02-01** | Second pilot program launched with Coastal Medical Group\n- **2025-04-28** | Team expanded to 12 people, opened small office in Austin\n- **2025-07-15** | Began conversations with FDA around De Novo pathway for predictive features",
  "_facts": {
    "type": "company",
    "slug": "companies/ranger-22",
    "name": "Ranger",
    "category": "startup",
    "industry": "health tech",
    "founded_year": 2024,
    "founders": [
      "people/quinten-rodriguez-22"
    ],
    "investors": [
      "people/helen-martinez-87",
      "people/sarah-wang-104"
    ],
    "employees": [
      "people/rachel-miller-132"
    ],
    "advisors": [
      "people/beth-williams-177"
    ]
  }
 }
--- a/eval/data/world-v1/companies__resonance-45.json
+++ b/eval/data/world-v1/companies__resonance-45.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/resonance-45",
  "type": "company",
  "title": "Resonance",
  "compiled_truth": "Resonance is an enterprise SaaS startup founded in 2022 by [Grace Thomas](people/grace-thomas-45), a former product lead who spent nearly a decade building internal tools at large tech companies before striking out on her own. The company focuses on helping mid-market enterprises manage and optimize their internal communication workflows—think of it as a layer that sits atop Slack, Teams, and email to surface what actually matters and reduce notification fatigue.\n\nThe core product uses machine learning to prioritize messages, flag action items, and generate daily digests tailored to each employee's role and responsiblities. Early customers have described it as \"finally making enterprise chat usable again.\" Resonance has found particular traction in professional services firms and fast-growing startups where information overload is a constant complaint.\n\nGrace Thomas serves as CEO and has been the public face of the company, frequently speaking at SaaS conferences about the hidden costs of context-switching. She's known for her direct communication style and her insistence on dogfooding—the entire Resonance team uses an internal build of the product daily, often shipping fixes within hours of discovering friction points.\n\nThe company has benefited from the guidance of [Yara Singh](people/yara-singh-195), who joined as an advisor shortly after launch. Yara's experience scaling go-to-market motions has been instrumental in shaping Resonance's sales strategy, particularly around land-and-expand deals with departmental buyers. Under her mentorship, the startup has refined its pricing model and built out a small but effective sales team.\n\nResonance operates with a lean team of about 15 people, mostly engineers and a handful of customer success managers. The company is headquartered in Austin but operates fully remote, drawing talent from across North America. Recent product updates have focused on deeper integrations with project managment tools and improved analytics dashboards for IT admins. The roadmap hints at AI-generated meeting summaries and automated escalation paths, though those features remain in beta.",
  "timeline": "- **2022-03-14** | Resonance incorporated in Delaware by Grace Thomas\n- **2022-06-01** | Closed a $1.8M pre-seed round led by several angels\n- **2022-09-20** | [Yara Singh](people/yara-singh-195) joins as formal advisor\n- **2023-01-11** | Launched private beta with 12 design partners\n- **2023-05-03** | Public launch of Resonance v1.0 with Slack and Teams integrations\n- **2023-08-15** | Reached $500K ARR milestone\n- **2024-02-22** | [Grace Thomas](people/grace-thomas-45) speaks at SaaStr Annual on reducing enterprise noise\n- **2024-07-09** | Shipped analytics dashboard for IT administrators\n- **2025-01-18** | Announced partnership with a major consulting firm for pilot deployment\n- **2025-04-30** | Beta launch of AI meeting summary feature",
  "_facts": {
    "type": "company",
    "slug": "companies/resonance-45",
    "name": "Resonance",
    "category": "startup",
    "industry": "enterprise SaaS",
    "founded_year": 2022,
    "founders": [
      "people/grace-thomas-45"
    ],
    "employees": [
      "people/eric-singh-155"
    ],
    "advisors": [
      "people/yara-singh-195"
    ]
  }
 }
--- a/eval/data/world-v1/companies__sentinel-23.json
+++ b/eval/data/world-v1/companies__sentinel-23.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/sentinel-23",
  "type": "company",
  "title": "Sentinel",
  "compiled_truth": "Sentinel is a consumer social startup founded in 2019 by [Paul Anderson](people/paul-anderson-23), who previously worked in product roles at several mid-stage companies before striking out on his own. The company operates in the increasingly crowded social space, though it's carved out a niche focused on what Anderson calls \"intentional social\" — essentially tools that help people maintain closer relationships with smaller circles rather than broadcasting to large audiences.\n\nThe core product is a mobile app that combines private group messaging with shared memory features. Users can create small groups (capped at 12 people) and the app automatically surfaces shared photos, past conversations, and anniversary reminders. It's not trying to compete with Instagram or TikTok — more like a utility for your actual close friends. The company has been deliberatly slow in scaling, preferring organic growth over paid acquisition.\n\nSentinel raised a seed round in late 2020, though exact figures haven't been disclosed publicly. The team remains small, hovering around 15 employees as of early 2024. [Julia Chen](people/julia-chen-181) serves as an advisor to the company, bringing her expertise in consumer product development and growth strategy. Her involvement reportedly began through a warm intro from a mutual investor.\n\nRecent moves include a pivot toward integrating AI-powered features — specifically, an assistant that helps users remember important dates and suggests conversation starters based on past interactions. Some users have praised this as genuinely useful; others find it slightly creepy. The company has been testing these features in closed beta since mid-2023.\n\nAnderson has been vocal about building a sustainable business rather than chasing hypergrowth. In interviews, he's mentioned that Sentinel may eventually pursue a subscription model rather than advertising, citing concerns about ad-driven incentives corrupting the product's core mission. Whether this philosophy can survive contact with investor expectations remains to be seen. The startup has mostly stayed under the radar, which seems intentional.",
  "timeline": "- **2019-03-15** | Sentinel incorporated in Delaware by Paul Anderson\n- **2019-09-02** | First prototype launched to 50 beta users\n- **2020-11-18** | Closed seed funding round, terms undisclosed\n- **2021-06-07** | [Julia Chen](people/julia-chen-181) joined as formal advisor\n- **2022-02-14** | Crossed 100,000 registered users milestone\n- **2022-10-03** | Launched group memory feature called \"Moments\"\n- **2023-05-22** | [Paul Anderson](people/paul-anderson-23) spoke at Consumer Social Summit in SF\n- **2023-08-30** | Began closed beta for AI assistant features\n- **2024-01-12** | Expanded engineering team with three new hires\n- **2025-04-08** | Announced partnership with undisclosed messaging platform",
  "_facts": {
    "type": "company",
    "slug": "companies/sentinel-23",
    "name": "Sentinel",
    "category": "startup",
    "industry": "consumer social",
    "founded_year": 2019,
    "founders": [
      "people/paul-anderson-23"
    ],
    "employees": [
      "people/rosa-wilson-133"
    ],
    "advisors": [
      "people/julia-chen-181"
    ]
  }
 }
--- a/eval/data/world-v1/companies__sequoia-capital-1.json
+++ b/eval/data/world-v1/companies__sequoia-capital-1.json
@@ -1,14 +0,0 @@
 {
  "slug": "companies/sequoia-capital-1",
  "type": "company",
  "title": "Sequoia Capital",
  "compiled_truth": "Sequoia Capital stands as one of the most legendary venture capital firms in Silicon Valley history, having backed companies that collectively represent trillions of dollars in market value. Founded in 1972 by Don Valentine, the firm has maintained its position at the apex of the VC world for over five decades. Their portfolio reads like a who's who of tech giants: Apple, Google, Cisco, Oracle, YouTube, Instagram, WhatsApp, and more recently Stripe and Airbnb.\n\nThe firm operates with a philosophy that emphasizes partnering with \"the crazies\" — founders with audacious visions who refuse to accept conventional wisdom. This approach has served them remarkably well, though it hasn't been without its spectacular failures. The FTX debacle in 2022 forced Sequoia to write down a $150 million investment to zero, a rare and very public miss that prompted some internal reflection on due dilligence processes.\n\nIn recent years, Sequoia has undergone significant structural changes. In 2021, they announced a radical restructuring that would transform the firm into a single registered investment adviser, allowing them to hold public stock positions indefinitely rather than distributing shares to LPs after IPOs. This was later partially reversed in 2023 when they split off their China and India operations into seperate entities — a move driven by geopolitical tensions and LP pressure.\n\nThe firm's current leadership includes Roelof Botha as the global managing partner, having taken over from Doug Leone. Botha, who previously served as CFO of PayPal, has been instrumental in deals involving companies like Unity and MongoDB. Their partnership extends across multiple stages, from their scout program to growth-stage investments.\n\nSequoia's relationship with firms like [Andreessen Horowitz](companies/andreessen-horowitz) has been characterized by both competition and mutual respect — they've co-invested on numerous deals while also fiercely competing for the best founders. The firm continues to be a dominant force in AI investing, having backed companies working with partners at [Y Combinator](companies/y-combinator) and other top accelerators. Their AI fund, launched in 2023, demonstrates their commitment to staying at the frontier of technological change.",
  "timeline": "- **2021-06-15** | Sequoia announces radical restructuring into single permanent fund structure, shocking the VC industry\n- **2022-01-20** | Led $500M Series C round for AI startup alongside [Andreessen Horowitz](companies/andreessen-horowitz)\n- **2022-11-11** | Published memo to portfolio companies following FTX collapse, writing investment down to zero\n- **2023-03-08** | Roelof Botha promoted to sole global managing partner\n- **2023-06-22** | Announced separation of China and India/SEA operations into independent entities\n- **2024-02-14** | Closed new $2.5B early-stage fund focused on AI and climate tech\n- **2024-09-30** | Participated in seed round for [Y Combinator](companies/y-combinator) batch company building developer tools\n- **2025-01-18** | Hosted annual Base Camp event for seed-stage founders in Woodside\n- **2025-07-22** | Published influential research report on AI agent infrastructure opportunities\n- **2026-03-05** | Led $800M growth round for autonomous systems company at $12B valuation",
  "_facts": {
    "type": "company",
    "slug": "companies/sequoia-capital-1",
    "name": "Sequoia Capital",
    "category": "vc",
    "industry": "venture capital"
  }
 }
--- a/eval/data/world-v1/companies__spire-46.json
+++ b/eval/data/world-v1/companies__spire-46.json
@@ -1,30 +0,0 @@
 {
  "slug": "companies/spire-46",
  "type": "company",
  "title": "Spire",
  "compiled_truth": "Spire is a biotech startup founded in 2018 by [Linda Miller](people/linda-miller-46), a veteran researcher with deep expertise in synthetic biology and metabolic engineering. The company operates out of the Boston-Cambridge biotech corridor, where it has quietly built a reputation for innovative approaches to protein therapeutics. Unlike many flashier competitors, Spire has maintained a relatively low profile, preferring to let its science speak for itself.\n\nThe company's core technology platform focuses on engineered protein scaffolds that can be customized for various therapeutic applications, including oncology and rare genetic disorders. Their lead candidate, SPR-201, is currently in Phase I clinical trials for a rare metabolic condition affecting pediatric patients. Early data has been promising, though the team remains cautious about over-hyping preliminary results.\n\nSpire has attracted a notable group of investors including [Wendy Hernandez](people/wendy-hernandez-80), [Eric Martinez](people/eric-martinez-93), and [Rosa Nakamura](people/rosa-nakamura-94). The Series A round closed in late 2020, with subsequent bridge financing helping extend runway through the expensive clinical development phase. The company has been judicious with capital, maintaining a lean team of around 35 employees while outsourcing certain manufacturing and regulatory functions.\n\nOn the advisory side, Spire benefits from guidance from [David Kim](people/david-kim-186) and [Grace Singh](people/grace-singh-197), both of whom bring significant industry experiance to the table. David in particular has been instrumental in shaping the clinical strategy, drawing on his background in rare disease drug development.\n\nLinda Miller continues to serve as CEO, a somewhat unusual arrangement in biotech where scientific founders often transition to CSO roles as companies mature. However, her combination of scientific credibility and business acumen has made the dual role work. She's known for being intensley focused on execution and has built a culture that prioritizes rigor over hype.\n\nRecent months have seen Spire expanding its pipeline discussions with potential pharma partners, though nothing has been announced publicly. The company is also exploring applications of its platform technology in areas beyond its initial therapeutic focus, potentially setting up multiple shots on goal as it matures.",
  "timeline": "- **2018-03-15** | Spire incorporated in Delaware by [Linda Miller](people/linda-miller-46), initial seed funding from angel investors\n- **2019-08-22** | Published landmark paper in Nature Biotechnology on novel protein scaffold approach\n- **2020-11-30** | Closed $28M Series A led by [Wendy Hernandez](people/wendy-hernandez-80) and [Eric Martinez](people/eric-martinez-93)\n- **2021-06-14** | [David Kim](people/david-kim-186) joins advisory board to help shape clinical development strategy\n- **2022-01-09** | SPR-201 receives FDA orphan drug designation for rare metabolic disorder\n- **2022-09-03** | Expanded lab facilities in Cambridge, added 12 new research positions\n- **2023-04-18** | IND application submitted for SPR-201, cleared by FDA within 30 days\n- **2024-02-11** | First patient dosed in Phase I trial for SPR-201\n- **2024-10-25** | [Rosa Nakamura](people/rosa-nakamura-94) participates in $15M bridge financing round\n- **2025-03-07** | Presented interim Phase I safety data at rare disease conference, well received by analysts",
  "_facts": {
    "type": "company",
    "slug": "companies/spire-46",
    "name": "Spire",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2018,
    "founders": [
      "people/linda-miller-46"
    ],
    "investors": [
      "people/wendy-hernandez-80",
      "people/eric-martinez-93",
      "people/rosa-nakamura-94"
    ],
    "employees": [
      "people/will-kapoor-156"
    ],
    "advisors": [
      "people/david-kim-186",
      "people/grace-singh-197"
    ]
  }
 }
--- a/eval/data/world-v1/companies__talon-47.json
+++ b/eval/data/world-v1/companies__talon-47.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/talon-47",
  "type": "company",
  "title": "Talon",
  "compiled_truth": "Talon is an edtech startup founded in 2020 by [Diana Thomas](people/diana-thomas-47), who saw an opportunity to reimagine how students engage with technical curriculum. The company's core product is an adaptive learning platform that uses machine learning to personalize coding education pathways for university students and bootcamp participants. Based in Austin, Texas, Talon has quietly built a reputation for its unusually high completion rates—reportedly 3x the industry average for online technical courses.\n\nThe founding story is straightforward. Diana had spent years frustrated by one-size-fits-all approaches to teaching programming. She bootstrapped the initial prototype while still working her day job, then went full-time in late 2020. Early traction came from partnerships with two regional coding bootcamps who were desperate for better retention tools. Word spread.\n\nInvestment came from [Sarah Williams](people/sarah-williams-92), who led a seed round in early 2022. Sarah's background in workforce development made her a natural fit, and she's remained actively involved in shaping Talon's go-to-market strategy. The company has since expanded to serve over 40 educational institutions, with particular strenght in community colleges looking to modernize their CS programs.\n\nOn the advisory side, [David Kim](people/david-kim-186) provides guidance on enterprise sales cycles, having scaled several B2B edtech companies himself. [Noah Williams](people/noah-williams-198) advises on curriculum design and learning science—his academic background complements Diana's more technical instincts. The advisory board meets quarterly, though informal check-ins happen more frequently.\n\nTalon's recent focus has been on expanding beyond pure coding education into adjacent technical skills: data literacy, basic cloud infrastructure, that sort of thing. There's also been internal discusson about whether to pursue K-12 markets, though Diana has been hesitant to dilute focus. The team remains lean at around 25 employees, mostly engineers and instructional designers. Revenue figures aren't public but insiders suggest ARR crossed $2M sometime in 2024.",
  "timeline": "- **2020-06-15** | Diana Thomas incorporates Talon and begins building MVP\n- **2020-11-02** | First pilot partnership signed with Austin Coding Academy\n- **2022-02-18** | Seed round closes, led by [Sarah Williams](people/sarah-williams-92)\n- **2022-09-10** | [David Kim](people/david-kim-186) joins as formal advisor\n- **2023-03-22** | Talon platform launches publicly, signs 12 institutions in first quarter\n- **2023-08-14** | [Noah Williams](people/noah-williams-198) brought on to advise on learning science\n- **2024-01-29** | Company hits 40 institutional customers milestone\n- **2024-06-05** | Diana presents at ASU+GSV Summit on adaptive learning\n- **2025-02-11** | Talon announces expansion into data literacy curriculum\n- **2025-09-03** | Strategic partnership discussions begin with major community college system",
  "_facts": {
    "type": "company",
    "slug": "companies/talon-47",
    "name": "Talon",
    "category": "startup",
    "industry": "edtech",
    "founded_year": 2020,
    "founders": [
      "people/diana-thomas-47"
    ],
    "investors": [
      "people/sarah-williams-92"
    ],
    "employees": [
      "people/rachel-thomas-157"
    ],
    "advisors": [
      "people/david-kim-186",
      "people/noah-williams-198"
    ]
  }
 }
--- a/eval/data/world-v1/companies__tempo-24.json
+++ b/eval/data/world-v1/companies__tempo-24.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/tempo-24",
  "type": "company",
  "title": "Tempo",
  "compiled_truth": "Tempo is a biotech startup founded in 2020 by [Quinten Lee](people/quinten-lee-24), focused on developing novel approaches to metabolic disease therapeutics. The company emerged from Lee's frustration with the slow pace of traditional drug discovery and his belief that computational biology could dramatically accelerate the identification of viable drug candidates.\n\nThe company operates out of a modest lab space in South San Francisco, though they've been reportedly looking at expanding into a larger facility given recent growth. Tempo's core platform combines machine learning with high-throughput screening to identify small molecule compounds that modulate metabolic pathways. Their initial focus has been on type 2 diabetes and obesity, though internal documents suggest they're exploring applications in fatty liver disease as well.\n\n[Yara Moore](people/yara-moore-174) serves as an advisor to the company, bringing her extensive experience in regulatory affairs and clinical development strategy. Her involvement has been particularly valuable as Tempo prepares for eventual IND-enabling studies. Moore's connections within the FDA have reportedly helped the team think more strategically about their development timeline.\n\nThe startup has remained relatively quiet compared to other biotech players in the metabolic space, preferring to let data speak rather than hype. Quinten has been deliberate about this approach, often saying in interviews that \"biotech has too much vaporware.\" This philosophy has attracted a certain type of investor—those who prefer substance over flash.\n\nTempo raised a seed round in early 2021 and has since closed a Series A, though exact figures haven't been publicly disclosed. The team has grown to approximately 25 people, mostly bench scientists and computational biologists. They've published a couple of papers in mid-tier journals, nothing splashy, but the work demonstrates a solid methodological foundation. Recent rumors suggest they've achieved some promissing preclinical results in mouse models, though the company hasn't confirmed this publically.",
  "timeline": "- **2020-06-15** | Tempo incorporated in Delaware by [Quinten Lee](people/quinten-lee-24)\n- **2021-02-08** | Closed seed round, terms undisclosed\n- **2021-09-22** | [Yara Moore](people/yara-moore-174) formally joins as strategic advisor\n- **2022-04-11** | Published first platform paper in Journal of Computational Biology\n- **2022-11-30** | Moved into expanded South San Francisco lab facility\n- **2023-03-17** | Series A closed, reportedly oversubscribed\n- **2023-08-05** | Hired VP of Biology from Amgen\n- **2024-01-22** | Internal milestone: lead compound identified for T2D program\n- **2024-09-14** | Quinten Lee presented at JP Morgan Healthcare Conference (private session)\n- **2025-02-28** | Initiated IND-enabling studies for lead metabolic compound",
  "_facts": {
    "type": "company",
    "slug": "companies/tempo-24",
    "name": "Tempo",
    "category": "startup",
    "industry": "biotech",
    "founded_year": 2020,
    "founders": [
      "people/quinten-lee-24"
    ],
    "employees": [
      "people/mia-liu-134"
    ],
    "advisors": [
      "people/yara-moore-174"
    ]
  }
 }
--- a/eval/data/world-v1/companies__tessera-15.json
+++ b/eval/data/world-v1/companies__tessera-15.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/tessera-15",
  "type": "company",
  "title": "Tessera",
  "compiled_truth": "Tessera is a fintech startup founded in 2024 by [Noah Kapoor](people/noah-kapoor-15), a serial entrepreneur with deep expertise in payments infrastructure and distributed systems. The company is building what it describes as \"programmable treasury rails\" — essentially a platform that lets mid-market companies automate complex cash management workflows without relying on legacy banking integrations. Think of it as Plaid meets Airflow, but for corporate finance teams who are tired of moving money through spreadsheets and manual wire transfers.\n\nThe founding team is lean but credible. Noah previously spent six years at Stripe, where he led a team focused on cross-border settlement optimization. Before that, he did a stint at a Series B payments company that got aquired by Block in 2021. He's known in fintech circles for his pragmatic approach to product development — shipping fast, iterating based on real customer feedback, and avoiding the trap of over-engineering.\n\nTessera raised a $4.2M seed round in late 2024, led by [Kate Lopez](people/kate-lopez-99), a partner at Foundry Ventures who has backed several successful fintech exits. The round included participation from a handful of angel investors, mostly former operators from Stripe, Ramp, and Modern Treasury. The company has been relatively quiet about its traction, though Noah has mentioned in a few podcast appearances that they have \"a handful of design partners\" actively using the platform.\n\nOn the advisory side, [Yara Singh](people/yara-singh-195) has been helping the team think through go-to-market strategy and enterprise sales motions. Yara's background in scaling B2B fintech products has been valuable as Tessera figures out how to position itself against incumbents like Kyriba and newer players like Treasure.\n\nThe company operates out of San Francisco, with a small remote-first team of about eight people. Noah has been vocal about keeping the team small until they nail product-market fit — a lesson he says he learned the hard way at his previous startup. Tessera's current focus is on onboarding its first ten paying customers and proving out unit economics before raising a Series A, likely in late 2025.",
  "timeline": "- **2024-02-12** | Noah Kapoor incorporates Tessera in Delaware, begins recruiting co-founding engineers\n- **2024-04-08** | First prototype of treasury automation platform demoed to potential design partners\n- **2024-06-15** | [Kate Lopez](people/kate-lopez-99) leads $4.2M seed round; Foundry Ventures announces the investment\n- **2024-07-22** | [Yara Singh](people/yara-singh-195) joins as formal advisor, focusing on GTM strategy\n- **2024-09-03** | Tessera onboards first two design partners — both mid-market e-commerce companies\n- **2024-11-18** | Noah speaks at Fintech Devcon about \"rethinking treasury infrastructure for the API era\"\n- **2025-01-09** | Team grows to eight; hires head of engineering from Modern Treasury\n- **2025-03-14** | Closes first paying customer contract, $48K ARR\n- **2025-05-02** | Begins early conversations with Series A investors, targeting Q4 2025 raise",
  "_facts": {
    "type": "company",
    "slug": "companies/tessera-15",
    "name": "Tessera",
    "category": "startup",
    "industry": "fintech",
    "founded_year": 2024,
    "founders": [
      "people/noah-kapoor-15"
    ],
    "investors": [
      "people/kate-lopez-99"
    ],
    "employees": [
      "people/gabe-wilson-125"
    ],
    "advisors": [
      "people/yara-singh-195"
    ]
  }
 }
--- a/eval/data/world-v1/companies__umbra-48.json
+++ b/eval/data/world-v1/companies__umbra-48.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/umbra-48",
  "type": "company",
  "title": "Umbra",
  "compiled_truth": "Umbra is a health tech startup founded in early 2025 by [Zoe Kim](people/zoe-kim-48), a serial entrepreneur with deep roots in digital therapeutics and wearable technology. The company operates in stealth mode for much of its first year, though insiders describe its focus as \"ambient health monitoring\" — a system that passively collects biometric and environmental data to surface early warning signs of chronic disease.\n\nThe founding thesis emerged from Kim's frustration with reactive healthcare models. She wanted to build something that could catch problems before they became crises, particulary for populations underserved by traditional primary care. Umbra's initial product combines low-power sensor hardware with an AI backend trained on longitudinal health data. The company has been tight-lipped about specifics, but demo videos leaked in mid-2025 showed a small wearable device syncing with ambient sensors placed around a home.\n\nAdvisory support comes from [Vera Rodriguez](people/vera-rodriguez-171), who brings credibility from her work in regulatory strategy and medical device commercialization. Rodriguez's involvement suggests Umbra is serious about FDA clearance and clinical validation, not just consumer wellness claims. Her network has reportedly helped the company secure early conversations with payer organizations interested in preventive care pilots.\n\nUmbra operates with a lean team — roughly twelve people as of late 2025, split between engineering, clinical research, and ops. They've raised a seed round, though the amount remains undisclosed. The company culture leans heavily on asynchronous work and documentation, a hallmark of Kim's previous ventures. Recruiting has focused on candidates with backgrounds in signal processing, embedded systems, and health informatics.\n\nThe competitive landscape is crowded, but Umbra differentiates itself by targeting B2B2C partnerships rather than direct-to-consumer sales. Early pilots with regional health systems are expected to begin in Q1 2026. Whether Umbra can execute on its ambitious vision remains to be seen, but the team's pedigree and early traction have attracted attention from health-focused VCs watching the space closely.",
  "timeline": "- **2025-01-18** | Umbra incorporated in Delaware by [Zoe Kim](people/zoe-kim-48)\n- **2025-02-04** | [Vera Rodriguez](people/vera-rodriguez-171) joins as lead advisor\n- **2025-03-22** | Seed round closed, amount undisclosed\n- **2025-04-10** | First engineering hire — embedded systems lead from Oura\n- **2025-06-15** | Internal prototype v0.1 completed; early testing begins\n- **2025-08-07** | Demo video leaked on Twitter, sparking industry speculation\n- **2025-09-30** | Team reaches 12 full-time employees\n- **2025-11-12** | Preliminary conversations with two regional health systems for pilot programs\n- **2026-01-08** | Planned kickoff for first B2B2C pilot deployment",
  "_facts": {
    "type": "company",
    "slug": "companies/umbra-48",
    "name": "Umbra",
    "category": "startup",
    "industry": "health tech",
    "founded_year": 2025,
    "founders": [
      "people/zoe-kim-48"
    ],
    "employees": [
      "people/julia-garcia-158"
    ],
    "advisors": [
      "people/vera-rodriguez-171"
    ]
  }
 }
--- a/eval/data/world-v1/companies__vector-6.json
+++ b/eval/data/world-v1/companies__vector-6.json
@@ -1,30 +0,0 @@
 {
  "slug": "companies/vector-6",
  "type": "company",
  "title": "Vector",
  "compiled_truth": "Vector is a health tech startup founded in 2020 by [Uma Brown](people/uma-brown-6), focused on building AI-powered diagnostic tools for early disease detection. The company emerged from Uma's frustration with the slow pace of traditional diagnostic workflows in clinical settings. Based in Austin, Texas, Vector has positioned itself at the intersection of machine learning and medical imaging, with their flagship product analyzing radiology scans to flag potential anomalies before they become critical.\n\nThe startup has attracted notable backing from angel investors including [David Zhang](people/david-zhang-83), [Vera Gonzalez](people/vera-gonzalez-103), and [Grace Martinez](people/grace-martinez-109). Zhang in particular has been instrumental in connecting Vector with enterprise healthcare networks through his existing portfolio companies. The advisory board includes [Wendy Wilson](people/wendy-wilson-170) and [Bob Chen](people/bob-chen-185), both of whom bring deep experiance in healthcare compliance and regulatory strategy—critical for a company operating in such a heavily regulated space.\n\nVector's approach differs from competitors by focusing on integration rather than replacement. Their software plugs into existing hospital PACS systems, meaning radiologists don't need to change their workflows dramatically. This pragmatic stance has helped them secure pilot programs with three regional hospital networks, though they haven't disclosed names publicly. The company claims a 23% improvement in early detection rates for certain cancers based on internal studies, though peer-reviewed validation is still pending.\n\nUma Brown serves as CEO and has been the public face of the company at industry conferences. She's known for being blunt about the limitations of AI in healthcare, which has ironically helped build trust with skeptical clinicians. Recent moves include expanding the engineering team from 8 to 15 people and opening a small office in Boston to be closer to major academic medical centers.\n\nVector remains a seed-stage company but is reportedly preparing for a Series A round in late 2024. The health tech space is crowded, but their focus on practical integration and Uma's credibility in the space gives them a fighting chance. Challenges remain around FDA clearance timelines and convincing risk-averse hospital administrators to adopt new technology.",
  "timeline": "- **2020-03-15** | Vector incorporated in Delaware by [Uma Brown](people/uma-brown-6)\n- **2020-09-02** | Closed pre-seed round with [David Zhang](people/david-zhang-83) and [Vera Gonzalez](people/vera-gonzalez-103) participating\n- **2021-04-18** | First prototype deployed for internal testing with synthetic medical data\n- **2021-11-30** | [Wendy Wilson](people/wendy-wilson-170) joins advisory board to help navigate FDA pathway\n- **2022-06-14** | Signed first hospital pilot agreement (name under NDA)\n- **2023-02-22** | [Grace Martinez](people/grace-martinez-109) invests in bridge round; joins cap table\n- **2023-08-09** | Uma Brown presents early detection results at HealthTech Summit Austin\n- **2024-01-17** | Boston office opened to strengthen academic medical center relationships\n- **2024-05-03** | Engineering team expansion completed, now at 15 full-time employees\n- **2025-02-11** | FDA pre-submission meeting scheduled for Q2 2025",
  "_facts": {
    "type": "company",
    "slug": "companies/vector-6",
    "name": "Vector",
    "category": "startup",
    "industry": "health tech",
    "founded_year": 2020,
    "founders": [
      "people/uma-brown-6"
    ],
    "investors": [
      "people/david-zhang-83",
      "people/vera-gonzalez-103",
      "people/grace-martinez-109"
    ],
    "employees": [
      "people/victor-jackson-116"
    ],
    "advisors": [
      "people/wendy-wilson-170",
      "people/bob-chen-185"
    ]
  }
 }
--- a/eval/data/world-v1/companies__vector-labs-56.json
+++ b/eval/data/world-v1/companies__vector-labs-56.json
@@ -1,28 +0,0 @@
 {
  "slug": "companies/vector-labs-56",
  "type": "company",
  "title": "Vector Labs",
  "compiled_truth": "Vector Labs is a robotics startup founded in early 2025 by [Yara Kim](people/yara-kim-56), a mechanical engineer with a background in autonomous systems. The company emerged from Kim's frustration with the fragmented state of warehouse automation—too many point solutions, not enough integration. Vector's core product is a modular robotic platform designed for mid-sized logistics operations, the kind of facilities that cant afford the massive capital outlay of a fully automated Amazon-style warehouse but still need to scale beyond manual labor.\n\nThe company operates out of a converted industrial space in Oakland, California, where a small team of engineers iterates rapidly on hardware prototypes. Their approach is somewhat unconventional: rather than building robots from scratch, Vector Labs focuses on retrofit kits that can upgrade existing conveyor systems and pallet movers with autonomous capabilities. This strategy keeps costs down and shortens deployment timelines, which has resonated with early pilot customers.\n\nFunding came through a seed round led by [Iris Lee](people/iris-lee-82), a prolific angel investor known for backing deep-tech companies. Lee reportedly wrote the first check after seeing a demo at a hardware meetup in San Francisco. The round also included a handful of other angels, though Vector hasn't disclosed the full list or total amount raised.\n\nOn the advisory side, Vector Labs has assembled a small but experienced board. [Yara Moore](people/yara-moore-174) brings operational expertise from her years scaling manufacturing startups, while [Yara Singh](people/yara-singh-195) contributes technical depth in computer vision and sensor fusion. Both advisors are hands-on, attending weekly syncs and occasionally visiting the Oakland lab to review progress.\n\nVector Labs is still pre-revenue as of mid-2025, though the team claims to have letters of intent from three regional distribution companies. The robotics space is crowded and capital-intensive, but Vector's lean approach and focus on retrofitting could carve out a defensible niche. Kim has been vocal about avoiding the trap of over-engineering—ship fast, learn faster. Whether that philosophy scales remains to be seen.",
  "timeline": "- **2025-01-14** | Vector Labs incorporated in Delaware by founder Yara Kim\n- **2025-02-03** | Closed seed round with [Iris Lee](people/iris-lee-82) as lead investor\n- **2025-02-20** | Signed lease on Oakland warehouse space for R&D operations\n- **2025-03-08** | [Yara Moore](people/yara-moore-174) joined as official advisor\n- **2025-03-22** | First functional prototype of retrofit automation kit completed\n- **2025-04-10** | [Yara Singh](people/yara-singh-195) began advising on sensor integration\n- **2025-05-15** | Began pilot deployment discussions with regional logistics company\n- **2025-06-02** | Hired third full-time engineer, expanding core team to five\n- **2025-06-19** | Yara Kim presented at Bay Area Hardware Founders meetup",
  "_facts": {
    "type": "company",
    "slug": "companies/vector-labs-56",
    "name": "Vector Labs",
    "category": "startup",
    "industry": "robotics",
    "founded_year": 2025,
    "founders": [
      "people/yara-kim-56"
    ],
    "investors": [
      "people/iris-lee-82"
    ],
    "employees": [
      "people/owen-smith-166"
    ],
    "advisors": [
      "people/yara-moore-174",
      "people/yara-singh-195"
    ]
  }
 }
--- a/eval/data/world-v1/companies__vellum-49.json
+++ b/eval/data/world-v1/companies__vellum-49.json
@@ -1,27 +0,0 @@
 {
  "slug": "companies/vellum-49",
  "type": "company",
  "title": "Vellum",
  "compiled_truth": "Vellum is an AI applications startup founded in 2021 by [Chris Davis](people/chris-davis-49), a serial entrepreneur with deep roots in machine learning infrastructure. The company positions itself as a development platform for building production-grade LLM applications, offering tools for prompt engineering, model evaluation, and workflow orchestration. Since its inception, Vellum has attracted attention from investors who see potential in the picks-and-shovels approach to the generative AI boom.\n\nThe platform's core value proposition centers on helping engineering teams move from prototype to production without the typical headaches. Vellum provides version control for prompts, A/B testing capabilities, and monitoring dashboards that track model performance over time. It's a pragmatic play—rather than building foundation models, they're building the tooling layer that makes those models actually useable in enterprise contexts.\n\nFunding for the company came from [Rosa Miller](people/rosa-miller-98), who led an early seed round that helped Vellum scale its engineering team from three to fifteen people within eighteen months. Rosa saw in Chris's vision something that resonated with her thesis on infrastructure plays during platform shifts. The bet seems to be paying off as Vellum has landed several mid-market customers in fintech and healthtech verticals.\n\nOn the advisory side, [Rachel Gonzalez](people/rachel-gonzalez-175) has been instrumental in shaping go-to-market strategy. Her background in enterprise sales helped the company refine its pricing model and identify the right buyer personas within target organizations. Rachel pushed the team to focus on developer experience as a differentiator, arguing that bottoms-up adoption would be critical in a crowded market.\n\nVellum faces stiff competiton from both well-funded startups and the model providers themselves, who are increasingly bundling similar capabilities. But Chris Davis remains confident that specialization wins. The company's recent pivot toward supporting multi-model workflows—allowing customers to route between different LLMs based on cost, latency, or capability—has opened up new use cases. As of mid-2024, Vellum processes over 50 million API calls monthly, a figure that's grown 4x year-over-year.",
  "timeline": "- **2021-03-15** | Vellum incorporated in Delaware by [Chris Davis](people/chris-davis-49)\n- **2021-09-02** | Closed $2.1M seed round led by [Rosa Miller](people/rosa-miller-98)\n- **2022-04-18** | Launched public beta of prompt management platform\n- **2022-11-07** | [Rachel Gonzalez](people/rachel-gonzalez-175) joins as strategic advisor\n- **2023-02-22** | Announced SOC 2 Type II compliance certification\n- **2023-08-14** | Shipped multi-model routing feature, dubbed \"Model Router\"\n- **2024-01-09** | Chris Davis keynoted at AI Infrastructure Summit in San Francisco\n- **2024-06-30** | Reached 50M monthly API calls milestone\n- **2025-03-11** | Opened first international office in London\n- **2025-09-05** | Partnership announced with major cloud provider for native integration",
  "_facts": {
    "type": "company",
    "slug": "companies/vellum-49",
    "name": "Vellum",
    "category": "startup",
    "industry": "AI applications",
    "founded_year": 2021,
    "founders": [
      "people/chris-davis-49"
    ],
    "investors": [
      "people/rosa-miller-98"
    ],
    "employees": [
      "people/noah-chen-159"
    ],
    "advisors": [
      "people/rachel-gonzalez-175"
    ]
  }
 }
--- a/eval/data/world-v1/companies__vox-25.json
+++ b/eval/data/world-v1/companies__vox-25.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/vox-25",
  "type": "company",
  "title": "Vox - AI Applications Startup",
  "compiled_truth": "Vox is an early-stage AI applications company founded in 2023 by [Vera Wilson](people/vera-wilson-25), a serial entrepreneur with a background in natural language processing and enterprise software. The startup focuses on building conversational AI tools for customer service automation, targeting mid-market SaaS companies that need scalable support solutions without the overhead of large teams.\n\nThe company emerged from Vera's frustration with existing chatbot solutions, which she found clunky and unable to handle nuanced customer inquiries. Vox's core product uses a proprietary fine-tuning approach that allows businesses to train AI agents on their specific knowledge bases in under 24 hours. Early adopters have reported significant reductions in ticket volume, though the company hasn't published official metrics yet.\n\nFunding came through an angel round led by [Fiona Moore](people/fiona-moore-88), who had previously backed two of Vera's colleagues from her time at a larger tech firm. Fiona's involvement brought not just capital but also connections to potential enterprise customers in the fintech space. The exact amount raised hasn't been disclosed publicly, though sources suggest it was in the low seven figures.\n\nVox operates with a lean team of about eight people, mostly engineers, working out of a shared office space in San Francisco's SoMa district. The company has been relatively quiet in terms of public presence, preferring to focus on product developement over marketing. Wilson has said in interviews that she wants to \"let the product speak for itself\" before ramping up sales efforts.\n\nThe competitive landscape is crowded, with players like Intercom and newer AI-native startups vying for the same customers. Vox differentiates itself through speed of deployment and pricing—offering a usage-based model rather than expensive annual contracts. Whether this strategy will hold up as they scale remains to be seen, but early traction suggests theres genuine demand for what they're building.",
  "timeline": "- **2023-03-15** | Vox incorporated in Delaware by [Vera Wilson](people/vera-wilson-25)\n- **2023-05-22** | Closed angel round with [Fiona Moore](people/fiona-moore-88) as lead investor\n- **2023-07-10** | First engineering hire joins from Google's Bard team\n- **2023-09-04** | Alpha version of conversational AI platform launched to 5 pilot customers\n- **2024-01-18** | Expanded to 12 paying customers, mostly fintech startups\n- **2024-04-30** | Vera Wilson spoke at AI Summit SF about rapid deployment strategies\n- **2024-08-12** | Moved into new office space in SoMa, team grew to 8 employees\n- **2024-11-05** | Launched self-serve onboarding for smaller customers\n- **2025-02-20** | Partnership announced with a mid-sized CRM vendor for native integration",
  "_facts": {
    "type": "company",
    "slug": "companies/vox-25",
    "name": "Vox",
    "category": "startup",
    "industry": "AI applications",
    "founded_year": 2023,
    "founders": [
      "people/vera-wilson-25"
    ],
    "investors": [
      "people/fiona-moore-88"
    ],
    "employees": [
      "people/yara-zhang-135"
    ]
  }
 }
--- a/eval/data/world-v1/companies__wisp-26.json
+++ b/eval/data/world-v1/companies__wisp-26.json
@@ -1,21 +0,0 @@
 {
  "slug": "companies/wisp-26",
  "type": "company",
  "title": "Wisp",
  "compiled_truth": "Wisp is an edtech startup founded in 2023 by [Linda Kim](people/linda-kim-26), a former learning sciences researcher who spent years studying how students retain information. The company's core product is an AI-powered microlearning platform that delivers personalized knowledge snippets throughout the day, designed to fit into the gaps between meetings, commutes, and coffee breaks.\n\nThe premise behind Wisp is deceptively simple: most people don't have time for dedicated learning sessions, but they do have dozens of small moments scattered across their day. Wisp's algorythm identifies these windows and pushes bite-sized lessons that adapt based on user engagement and retention patterns. The platform currently focuses on professional development content—soft skills, technical upskilling, and industry-specific knowledge modules.\n\n[Linda Kim](people/linda-kim-26) has been vocal about her frustration with traditional corporate training, calling most of it \"expensive theater that nobody remembers.\" She built the initial prototype while still finishing her PhD, testing it with a small cohort of graduate students before pivoting to enterprise customers. Her academic background gives Wisp some credibility in a crowded market full of flashy apps with questionable pedagogical foundations.\n\nThe startup raised a small pre-seed round in late 2023, though exact figures haven't been disclosed. They've been operating lean, with a team of about eight people split between engineering and content development. Early traction has come primarily from mid-sized tech companies looking for alternatives to clunky LMS platforms that employees actively avoid.\n\nWisp faces significant competition from established players like Coursera for Business and newer entrants in the microlearning space. What differentiates them, according to Kim, is their focus on spaced repetition and contextual delivery rather than gamification gimmicks. The company has been experimenting with intergrations into Slack and Microsoft Teams, meeting users where they already work rather than asking them to open another app.\n\nRecent moves suggest Wisp is preparing for a seed raise sometime in 2024, with plans to expand their content library and build out more robust analytics for L&D teams.",
  "timeline": "- **2023-02-14** | [Linda Kim](people/linda-kim-26) incorporates Wisp after testing early prototype with graduate students\n- **2023-05-08** | First version of the Wisp mobile app launches in private beta with 200 users\n- **2023-07-22** | Closes undisclosed pre-seed round from angel investors\n- **2023-09-15** | Hires first full-time engineer, expanding team to four people\n- **2023-11-03** | Lands first enterprise pilot with a Series B fintech company\n- **2024-01-19** | Launches Slack integration for seamless in-workflow learning delivery\n- **2024-04-11** | [Linda Kim](people/linda-kim-26) speaks at EdTech Week about the future of workplace learning\n- **2024-08-26** | Reaches 15,000 active daily users across enterprise accounts\n- **2025-02-07** | Begins seed fundraising process, targeting $3M round",
  "_facts": {
    "type": "company",
    "slug": "companies/wisp-26",
    "name": "Wisp",
    "category": "startup",
    "industry": "edtech",
    "founded_year": 2023,
    "founders": [
      "people/linda-kim-26"
    ],
    "employees": [
      "people/david-liu-136"
    ]
  }
 }
--- a/eval/data/world-v1/companies__zenith-27.json
+++ b/eval/data/world-v1/companies__zenith-27.json
@@ -1,24 +0,0 @@
 {
  "slug": "companies/zenith-27",
  "type": "company",
  "title": "Zenith",
  "compiled_truth": "Zenith is a logistics startup founded in 2018 by [Priya Zhang](people/priya-zhang-27), who saw an opportunity to modernize last-mile delivery infrastructure for mid-sized e-commerce brands. The company operates primarily in the B2B space, offering a software platform that optimizes routing, warehouse allocation, and carrier selection for businesses that have outgrown basic shipping solutions but aren't large enough to build proprietary systems.\n\nThe founding story is fairly straightforward. Zhang had spent several years in supply chain consulting and kept running into the same problem: companies doing $5-50M in annual revenue were stuck between consumer-grade tools and enterprise solutions they couldn't afford. Zenith launched with a simple routing optimizer and has since expanded into a fuller suite including inventory forecasting and returns managment.\n\nGrowth has been steady if not spectacular. The company raised a seed round in 2019 and a Series A in late 2021, though exact figures haven't been publicly disclosed. They've been somewhat quiet compared to flashier logistics tech players, preferring to focus on unit economics over growth-at-all-costs. This measured approach has attracted interest from experienced operators in the space.\n\n[Tina Moore](people/tina-moore-191) joined as an advisor sometime in 2022, bringing her background in operations scaling to help Zenith think through their expansion strategy. Her involvement signaled a shift toward more aggressive market positioning, though the company has remained disciplined about customer acquisition costs.\n\nThe team is currently around 45 people, split between engineering in San Francisco and a customer success hub in Austin. They've been experimenting with AI-driven demand prediction features, which Zhang has mentioned in a few podcast appearances as a major focus for the next 18 months. Some early customers have reported 15-20% reductions in shipping costs after implementing the platform, though these numbers are self-reported and should be taken with apropriate skepticism.\n\nZenith competes with larger players like Shippo and ShipBob but differentiates on flexibility and pricing for the mid-market segment. The logistics tech space remains crowded, and it's unclear whether Zenith can carve out a durable niche or will eventually need to consolidate.",
  "timeline": "- **2018-03-12** | Zenith incorporated in Delaware; [Priya Zhang](people/priya-zhang-27) begins building initial MVP\n- **2019-06-08** | Closed seed round from logistics-focused angels; first three pilot customers onboarded\n- **2020-11-15** | Platform processed 1 millionth shipment; expanded routing to cover all 50 states\n- **2021-09-22** | Series A closed; company moves to larger SF office space\n- **2022-04-03** | [Tina Moore](people/tina-moore-191) joins advisory board to help with operational scaling\n- **2023-01-17** | Launched returns management module after six months of beta testing\n- **2023-08-29** | Zhang speaks at LogiTech Summit on mid-market logistics challenges\n- **2024-02-14** | Austin customer success hub opens with initial team of 12\n- **2024-10-06** | Beta release of AI demand forecasting feature to select customers\n- **2025-03-21** | Reached 200 active enterprise customers milestone",
  "_facts": {
    "type": "company",
    "slug": "companies/zenith-27",
    "name": "Zenith",
    "category": "startup",
    "industry": "logistics",
    "founded_year": 2018,
    "founders": [
      "people/priya-zhang-27"
    ],
    "employees": [
      "people/eve-nakamura-137"
    ],
    "advisors": [
      "people/tina-moore-191"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__agentic-workflows.json
+++ b/eval/data/world-v1/concepts__agentic-workflows.json
@@ -1,22 +0,0 @@
 {
  "slug": "concepts/agentic-workflows",
  "type": "concept",
  "title": "Agentic Workflows",
  "compiled_truth": "Agentic workflows represent a paradigm shift in how we think about software systems and, by extension, how we think about building companies around AI. The core idea is deceptively simple: instead of monolithic models handling tasks end-to-end, you orchestrate multiple specialized agents that collaborate, delegate, and iterate. Each agent has a defined role, access to specific tools, and the autonomy to make decisions within its domain.\n\nThis isn't just a technical architecture—it's a strategic frame. When we evaluate companies through the agentic lens, we're asking: does this team understand that the future of work involves humans and AI agents operating as peers in complex workflows? Are they building for a world where agents hire other agents, where supervision becomes the primary human function?\n\n[Brink Labs](companies/brink-labs-79) exemplifies this thinking in their approach to developer tooling. Rather than building another copilot that suggests code, they've constructed an ecosystem where coding agents can spawn sub-agents for testing, documentation, and deployment. The human developer becomes an architect and reviewer, not a typist. It's a subtle but crucial distinction that many competitors miss entirely.\n\nThe implications for company building are profound. Traditional SaaS metrics don't capture value creation when your product enables agentic orchestration. Seat-based pricing breaks down. Usage patterns become non-linear and harder to predict. [Mosaic Labs](companies/mosaic-labs-64) has been wrestling with this directly—their pricing model evolved three times in 2024 alone as they discovered that enterprise customers wanted to pay for outcomes, not API calls.\n\nWe're also seeing agentic workflows reshape org design itself. [Quantum](companies/quantum-7) runs what they call \"agent-first operations\" where internal processes are designed assuming AI agents will execute most steps. Humans define goals, set constraints, and handle exceptions. It sounds dystopian until you realize it frees people to do genuinely creative work.\n\nThe risks are real though. Agentic systems can fail in cascading, unpredictable ways. Debugging becomes archaeology. And there's a talent gap—few engineers have intuition for designing robust multi-agent systems. The companes that win will be those who treat agentic thinking as a core competency, not a feature checkbox.",
  "timeline": "- **2021-08-14** | First internal memo on \"agent orchestration\" as investment thesis, inspired by early AutoGPT experiments\n- **2022-03-22** | Hosted dinner with founders exploring multi-agent architectures; 12 attendees including early [Brink Labs](companies/brink-labs-79) team\n- **2023-01-09** | Published blog post \"Beyond Copilots\" arguing for agentic workflows as the next platform shift\n- **2023-06-17** | [Mosaic Labs](companies/mosaic-labs-64) seed investment; thesis centered on agentic workflows for enterprise ops\n- **2023-11-03** | Attended AgentCon in SF; noted shift from academic curiosity to production deployments\n- **2024-02-28** | Internal workshop with portfolio companies on agent supervision patterns and failure modes\n- **2024-07-11** | [Quantum](companies/quantum-7) presents agent-first operations model at LP meeting; strong reception\n- **2024-10-19** | Began tracking \"agentic readiness\" as evaluation criteria for new deals\n- **2025-01-06** | Partnered with Stanford HAI on research into human-agent collaboration frameworks\n- **2025-04-22** | Updated thesis to emphasize agent-to-agent commerce as emerging pattern",
  "_facts": {
    "type": "concept",
    "slug": "concepts/agentic-workflows",
    "name": "agentic workflows",
    "description": "agentic workflows as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/brink-labs-79",
      "companies/mosaic-labs-64",
      "companies/quantum-7"
    ],
    "related_people": [
      "people/quinten-wang-17",
      "people/nina-rodriguez-18"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__ai-first-product.json
+++ b/eval/data/world-v1/concepts__ai-first-product.json
@@ -1,22 +0,0 @@
 {
  "slug": "concepts/ai-first-product",
  "type": "concept",
  "title": "AI-First Product",
  "compiled_truth": "AI-first product is a strategic frame for building companies where artificial intelligence isn't bolted on as a feature but serves as the foundational architecture from day one. Unlike traditional software that treats ML as an optimization layer, AI-first products are designed around the assumption that intelligence is the core value proposition. The user experience, data flywheel, and business model all flow from this premise.\n\nThe distinction matters more than most founders realize. A traditional SaaS tool with AI features still operates on deterministic logic—the AI enhances but doesn't define. An AI-first product inverts this: the model's capabilities shape what's even possible to build. [Wisp Labs](companies/wisp-labs-76) exemplifies this approach in their agent infrastructure work, where the entire product surface emerges from what autonomous systems can reliably accomplish.\n\nThere's a tension here worth naming. AI-first doesn't mean AI-only. The best implementations pair model capabilities with thoughtful UX constraints that guide users toward productive outcomes. [Apex](companies/apex-18) has been particularly clever about this—their interface feels magical precisely because they've hidden the probabilistic nature of the underlying system behind carefully designed interaction patterns.\n\nFrom an investment persepctive, AI-first companies exhibit different scaling dynamics. Traditional SaaS scales with seat count; AI-first products often scale with usage intensity or data volume. This creates interesting unit economics that don't map cleanly to established benchmarks. Gross margins can look worse initially due to inference costs, but the moat potential is substantially higher when the product improves with every interaction.\n\n[Cascade](companies/cascade-30) represents another variant—they've built AI-first infrastructure that other companies use to become AI-first themselves. It's a picks-and-shovels play on the broader trend. Their recent traction suggests the market is maturing past the experimentation phase.\n\nThe frame also implies organizational choices. AI-first companies need research eng capabilities earlier than typical startups. They need to think about evaluation and testing differently. They ship with more uncertainty about edge cases. The best teams embrace this ambiguity rather than fighting it, treating their products as living systems that evolve alongside frontier model improvements.",
  "timeline": "- **2021-08-14** | First internal memo outlining AI-first as distinct investment thesis, contrasting with AI-enabled\n- **2022-03-22** | Partnered with [Wisp Labs](companies/wisp-labs-76) as thesis validation—their agent-native approach matched the framework\n- **2022-11-09** | Published thinking on AI-first unit economics; unexpected traction on Twitter sparked several inbound deals\n- **2023-04-17** | [Cascade](companies/cascade-30) seed investment; infrastructure layer for AI-first development\n- **2023-09-03** | Internal debate on whether AI-first framing was becoming too broad, losing analytical value\n- **2024-02-28** | [Apex](companies/apex-18) Series A co-lead; strongest portfolio example of AI-first UX principles\n- **2024-07-11** | LP meeting presentation on AI-first portfolio performance vs traditional SaaS cohorts\n- **2025-01-19** | Revised thesis to account for inference cost deflation and its impact on margin profiles\n- **2025-05-02** | Hosted dinner with 12 AI-first founders to discuss emerging patterns in go-to-market",
  "_facts": {
    "type": "concept",
    "slug": "concepts/ai-first-product",
    "name": "AI-first product",
    "description": "AI-first product as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/wisp-labs-76",
      "companies/apex-18",
      "companies/cascade-30"
    ],
    "related_people": [
      "people/rachel-park-64",
      "people/alice-kim-41"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__carbon-credits.json
+++ b/eval/data/world-v1/concepts__carbon-credits.json
@@ -1,22 +0,0 @@
 {
  "slug": "concepts/carbon-credits",
  "type": "concept",
  "title": "Carbon Credits",
  "compiled_truth": "Carbon credits as a strategic frame for company building represents a mental model borrowed from environmental markets but applied to organizational decision-making. The core thesis: every company accumulates both positive and negative capital across multiple dimensions—technical debt, cultural equity, market positioning, team morale—and these can be traded against each other in ways that mirror carbon offset markets.\n\nThe framework emerged from conversations with founders at [Talon Labs](companies/talon-labs-97) who noticed that their aggressive shipping velocity was creating what they called 'cultural debt.' They were burning through goodwill with their engineering team by pushing unsustainable timelines, but the market wins were generating enough momentum to 'offset' this through equity appreciation and hiring leverage. The question became: how do you account for these trades explicitly rather than stumbling into them?\n\n[Lucid Labs](companies/lucid-labs-71) took this further by actually tracking what they call 'credit balances' across five dimensions: technical, cultural, financial, reputational, and operational. Their thesis is that most startups fail not because they run out of money, but because they overdraw on one of these accounts without realizing it. You can ship fast and accumulate technical debt, but only if you're simultaneously building cultural credits through transparency about the tradeoffs.\n\nThe carbon credits model suggests several non-obvious strategies. First, credits are not fungible—you can't always trade financial capital for cultural capital, especially once trust is broken. Second, some credits compound while others decay. Market positioning credits tend to compound; operational credits (like documentation) decay if not maintained. Third, the exchange rates between credit types shift based on company stage. Early on, technical debt is cheap becuase you might pivot anyway. Later, that same debt becomes ruinous.\n\n[Sentinel](companies/sentinel-23) reportedly uses a quarterly 'credit audit' in their planning process, explicitly naming which accounts they're drawing down and which they're depositing into. This framing helps avoid the common failure mode where founders optimize for one metric while unknowingly bankrupting another. The carbon credits lens doesn't prescribe what to optimize for—it just makes the trades visible.",
  "timeline": "- **2021-08-14** | Initial framework sketched during founder dinner with [Talon Labs](companies/talon-labs-97) team, discussing technical debt tradeoffs\n- **2022-02-03** | [Lucid Labs](companies/lucid-labs-71) adopts five-dimension credit tracking in their planning docs\n- **2022-09-19** | Framework shared in private founder Slack, sparks heated debate about quantifying culture\n- **2023-01-27** | [Sentinel](companies/sentinel-23) implements quarterly credit audits, first company to formalize the process\n- **2023-06-11** | Carbon credits concept mentioned in podcast interview, gains wider circulation\n- **2023-11-04** | Counter-arguments emerge: critics say framework encourages transactional thinking about team dynamics\n- **2024-03-22** | [Talon Labs](companies/talon-labs-97) shares internal retro showing they overdrew cultural credits in 2023, lessons learned\n- **2024-08-30** | Framework adapted for investor communications—founders using it to explain strategic tradeoffs in board decks\n- **2025-02-15** | Several seed-stage companies now reference carbon credits in their operating docs",
  "_facts": {
    "type": "concept",
    "slug": "concepts/carbon-credits",
    "name": "carbon credits",
    "description": "carbon credits as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/talon-labs-97",
      "companies/lucid-labs-71",
      "companies/sentinel-23"
    ],
    "related_people": [
      "people/ian-kapoor-162",
      "people/linda-taylor-178"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__churn-cohorts.json
+++ b/eval/data/world-v1/concepts__churn-cohorts.json
@@ -1,22 +0,0 @@
 {
  "slug": "concepts/churn-cohorts",
  "type": "concept",
  "title": "Churn Cohorts",
  "compiled_truth": "Churn cohorts represent a strategic framework for understanding how different customer segments behave over time, particularly in SaaS and subscription businesses. The core insight is deceptively simple: not all churn is created equal. Customers acquired through different channels, at different price points, or during different market conditions will exhibit fundamentally different retention curves. Treating churn as a monolithic metric obscures the signal you actually need.\n\nThe framework becomes particularly powerful when applied to company building decisions. [Lattice](companies/lattice-39) demonstrated this well during their expansion from performance management into compensation—they discovered that customers who adopted multiple products in their first year had dramatically lower churn than single-product customers, even when controlling for company size. This wasn't just a correlation to track; it became a strategic imperative that reshaped their entire go-to-market motion.\n\nThinking in churn cohorts forces founders to ask harder questions. Which customer segments are actually profitable on a lifetime basis? Where is growth masking underlying retention problems? The temptation in hypergrowth is to celebrate net revenue retention while ignoring that your best cohorts are subsidizing terrible ones. [Foundry](companies/foundry-33) ran into this exact problem—their enterprise cohorts looked phenomenal while SMB churn was quietly destroying unit economics. Once they segmented properly, the decision to move upmarket became obvious.\n\nThere's also a temporal dimension worth considering. Cohorts acquired during economic expansions often churn harder during contractions. [Gravity](companies/gravity-17) built their forecasting models around this insight, helping portfolio companies stress-test retention assumptions against macroeconomic scenarios. The companies that survived 2022-2023 best were often those who had already identified their most resilient cohorts and doubled down.\n\nThe framework isn't without limitations. Over-segmentation can lead to analysis paralysis—you need enough data density in each cohort to draw meaningful conclusions. And cohort analysis is inherently backward-looking; it tells you what happened, not necesarily what will happen as you enter new markets or launch new products. Still, for any subscription business past initial product-market fit, churn cohort analysis should be table stakes.",
  "timeline": "- **2021-03-15** | First internal memo on cohort-based retention analysis circulated among portfolio companies\n- **2021-09-22** | [Lattice](companies/lattice-39) presents multi-product cohort findings at offsite, sparks broader framework development\n- **2022-04-10** | Framework formally named \"churn cohorts\" in partner meeting notes\n- **2022-11-08** | [Foundry](companies/foundry-33) case study completed showing SMB vs enterprise retention divergence\n- **2023-02-14** | Workshop held with 12 portfolio companies on implementing cohort tracking in their data stacks\n- **2023-07-20** | [Gravity](companies/gravity-17) integrates churn cohort modeling into their scenario planning tools\n- **2024-01-30** | Published internal guide: \"Churn Cohorts: A Practical Framework for Subscription Businesses\"\n- **2024-09-12** | Concept referenced in board prep materials for 8 active investments\n- **2025-03-05** | Updated framework to include PLG-specific cohort considerations based on recent learnings",
  "_facts": {
    "type": "concept",
    "slug": "concepts/churn-cohorts",
    "name": "churn cohorts",
    "description": "churn cohorts as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/lattice-39",
      "companies/foundry-33",
      "companies/gravity-17"
    ],
    "related_people": [
      "people/xavier-patel-183",
      "people/linda-taylor-178"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__community-led-growth.json
+++ b/eval/data/world-v1/concepts__community-led-growth.json
@@ -1,22 +0,0 @@
 {
  "slug": "concepts/community-led-growth",
  "type": "concept",
  "title": "Community-Led Growth",
  "compiled_truth": "Community-led growth represents a fundamental shift in how companies think about customer acquisition and retention. Rather than treating community as a marketing channel or support cost center, CLG positions community as the primary engine of company growth. The thesis is simple: when you build genuine spaces where users help each other, create content, and develop emotional investment in your product, you unlock compounding returns that paid acquisition can never match.\n\nThe model works best for products with natural network effects or where expertise sharing creates value. [Echo](companies/echo-32) exemplifies this approach—they've built their entire go-to-market around developer communities rather than traditional enterprise sales. Their community forums generate more qualified leads than their paid campaigns ever did, and at a fraction of the cost. The key insight from Echo's playbook: community members who help others become deeply invested in the product's success.\n\nWhat distinguishes CLG from traditional community marketing is the strategic primacy it gives to community health metrics. Companies like [Ranger Labs](companies/ranger-labs-72) track community engagement with the same rigor they apply to revenue. Active contributors, response times, content velocity—these become leading indicators for growth. Ranger's approach has been particularly effective in their expansion into new verticals; they seed communities with power users before launching sales motions.\n\nThere's a common misconception that community-led growth means abandoning sales teams. The reality is more nuanced. [Kindle](companies/kindle-20) runs a hybrid model where community surfaces intent signals that sales then acts on. Their community managers work closely with account executives, creating a feedback loop thats genuinely novel. This integrated approach has shortened their sales cycles considerably.\n\nThe challenges with CLG are real though. It requires patience—community compounding takes 12-18 months to show material impact. It demands authentic investment; users can smell performative community building instantly. And it's hard to attribute revenue cleanly, which makes CFOs nervous. But for companies willing to play the long game, community-led growth offers defensibility that traditional GTM motions simply cannot provide.",
  "timeline": "- **2021-03-15** | First formal articulation of CLG framework in a16z blog post, sparking wider industry conversation\n- **2022-01-22** | [Echo](companies/echo-32) publicly credits community strategy for reaching $10M ARR without dedicated sales team\n- **2022-08-09** | Community-Led Growth Summit launches in San Francisco, 400+ attendees\n- **2023-02-14** | [Ranger Labs](companies/ranger-labs-72) publishes internal community metrics framework, becomes industry template\n- **2023-07-30** | Major critique published arguing CLG doesn't scale for enterprise—sparks healthy debate\n- **2023-11-18** | [Kindle](companies/kindle-20) case study on hybrid community-sales model presented at SaaStr\n- **2024-04-02** | CLG Slack community passes 8,000 members, becomes primary watering hole for practitioners\n- **2024-09-11** | First academic paper studying CLG ROI published by Stanford GSB researchers\n- **2025-01-27** | Growing consensus that CLG works best as complement to, not replacement for, traditional GTM",
  "_facts": {
    "type": "concept",
    "slug": "concepts/community-led-growth",
    "name": "community-led growth",
    "description": "community-led growth as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/echo-32",
      "companies/ranger-labs-72",
      "companies/kindle-20"
    ],
    "related_people": [
      "people/linda-taylor-178",
      "people/sarah-wang-104"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__customer-concentration.json
+++ b/eval/data/world-v1/concepts__customer-concentration.json
@@ -1,22 +0,0 @@
 {
  "slug": "concepts/customer-concentration",
  "type": "concept",
  "title": "Customer Concentration",
  "compiled_truth": "Customer concentration refers to the degree to which a company's revenue is derived from a small number of customers. High concentration—where, say, three clients account for 60% or more of total revenue—creates structural fragility. It's a double-edged sword that founders often underestimate until it's too late.\n\nFrom a strategic lens, concentration isn't inherently bad. Early-stage companies almost always exhibit high concentration because landing any customer is hard. [Acme](companies/acme-0) famously grew its first $2M ARR from just four enterprise accounts, a fact that made early investors nervous but ultimately proved the depth of their product-market fit. The danger emerges when concentration persists past Series A without a clear diversificaiton plan. At that point, you're not building a company—you're building a consulting firm with extra steps.\n\nThe risk profile shifts depending on customer type. B2B infrastructure plays like [Sentinel Labs](companies/sentinel-labs-73) can tolerate higher concentration if their customers have high switching costs and multi-year contracts. Sentinel's top two customers represent nearly 45% of revenue, but both are locked into 36-month agreements with significant integration depth. That's different from a marketing SaaS tool where customers churn quarterly.\n\nConcentration also affects fundraising narratives. Investors will probe this relentlessly. A concentrated customer base raises questions about defensibility, pricing power, and what happens if your biggest account leaves. [Lumen](companies/lumen-12) faced this exact scrutiny during their Series B process—they'd grown fast but 70% of revenue came from a single logistics partner. The round got done, but at a lower valuation than the team expected.\n\nThere's a tactical playbook for managing concentration risk: land-and-expand within existing accounts to increase absolute dollars while simultaneously acquiring net-new logos, even if they're smaller. Some founders resist smaller deals because they feel inefficient, but logo count matters for concentration math. The goal is to get no single customer above 15-20% of revenue by the time you're raising growth capital. Easier said than done, but it's the benchmark most institutional investors use. Customer concentration is ultimately a measure of company fragility—and fragility, in startups, is the thing that kills you.",
  "timeline": "- **2021-06-14** | Internal memo circulated on concentration risk after reviewing Q2 revenue breakdown\n- **2022-01-22** | [Acme](companies/acme-0) case study added to thesis framework—example of healthy early concentration\n- **2022-08-09** | Deep-dive session with [Sentinel Labs](companies/sentinel-labs-73) on managing enterprise concentration\n- **2023-03-17** | Published internal guidelines: no single customer >25% of ARR post-Series A\n- **2023-11-02** | [Lumen](companies/lumen-12) Series B negotiations highlight concentration concerns with investors\n- **2024-04-28** | Added concentration scoring to due diligence checklist for all new deals\n- **2024-09-15** | Workshop with portfolio companies on diversification tactics\n- **2025-02-11** | Revised thesis to account for vertical SaaS exceptions where concentration is structurally higher\n- **2025-07-30** | Quarterly review flagged two portfolio companies with deteriorating concentration metrics",
  "_facts": {
    "type": "concept",
    "slug": "concepts/customer-concentration",
    "name": "customer concentration",
    "description": "customer concentration as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/acme-0",
      "companies/sentinel-labs-73",
      "companies/lumen-12"
    ],
    "related_people": [
      "people/grace-singh-197",
      "people/wendy-wilson-170"
    ]
  }
 }
--- a/eval/data/world-v1/concepts__developer-relations.json
+++ b/eval/data/world-v1/concepts__developer-relations.json
@@ -1,32 +0,0 @@
 {
  "slug": "concepts/developer-relations",
  "type": "concept",
  "title": "Developer Relations",
  "compiled_truth": "Developer relations—often shortened to DevRel—represents a strategic lens for company building that treats developers as a primary constituency rather than just end users. The thesis here is simple but underappreciated: companies that win developer mindshare compound their advantages in ways traditional go-to-market motions cannot replicate.\n\nAt its core, DevRel is about building genuine relationships with technical communities. This means documentation that doesn't suck, APIs that feel intentional, and humans who actually understand the product talking to other humans who might use it. The best DevRel organizations blur the line between marketing, product, and engineering—they're not just evangelists, they're feedback conduits.\n\n[Mantle](companies/mantle-16) exemplifies this approach in the infrastrucure layer. Their developer experience team ships alongside core engineering, and their community Discord has become a de facto support channel that surfaces bugs faster than internal QA. This isn't accidental—it's a deliberate choice to treat external developers as extensions of the team.\n\nThe economics are compelling when done right. Developer adoption creates switching costs through integration depth. A startup using your API builds muscle memory, internal tooling, and institutional knowledge around your platform. Ripping that out is expensive. [Beacon](companies/beacon-10) learned this the hard way when they initially underinvested in developer education and saw churn spike among technical buyers who felt abandoned post-sale.\n\nThere's a tension worth naming: DevRel can become performative. Conference talks that don't connect to product reality, swag-heavy booths with no substance, \"community managers\" who've never shipped code. The authentic version requires engineers who genuinely enjoy teaching and product teams who actually listen to what comes back through DevRel channels.\n\n[Pulse](companies/pulse-8) has taken an interesting middle path—their DevRel function is embedded within customer success rather than marketing. This keeps it grounded in real usage patterns but risks losing the broader community-building mandate. No perfect answer here, just tradeoffs.\n\nThe best signal that DevRel is working: developers recommend you to other developers unprompted. Word of mouth in technical communities is brutal and honest. You can't buy it, only earn it through consistent excelence.",
  "timeline": [
    "- **2021-03-15** | First internal memo circulated on DevRel as GTM strategy for technical products",
    "- **2021-09-22** | [Mantle](companies/mantle-16) hires first dedicated developer advocate, sets template for infrastructure DevRel",
    "- **2022-04-08** | Hosted roundtable on DevRel metrics—concluded that traditional marketing KPIs miss the point",
    "- **2022-11-30** | [Beacon](companies/beacon-10) restructures developer education after churn analysis reveals gap",
    "- **2023-06-14** | Published internal thesis doc: 'Developer Relations as Competitive Moat'",
    "- **2023-10-02** | Observed [Pulse](companies/pulse-8) embedding DevRel in CS org—noted as experiment worth tracking",
    "- **2024-02-19** | Conversation with three portfolio CTOs confirmed DevRel quality as top vendor selection criteria",
    "- **2024-08-11** | [Mantle](companies/mantle-16) Discord crosses 15k members, becomes case study for community-led support",
    "- **2025-01-28** | Started tracking 'time to first successful API call' as universal DevRel health metric"
  ],
  "_facts": {
    "type": "concept",
    "slug": "concepts/developer-relations",
    "name": "developer relations",
    "description": "developer relations as a strategic frame for thinking about company building.",
    "related_companies": [
      "companies/mantle-16",
      "companies/beacon-10",
      "companies/pulse-8"
    ],
    "related_people": [
      "people/rosa-jackson-90",
      "people/carol-wilson-28"
    ]
  }
 }
--- a/Show More
+++ b/Show More