Notes from the context layer.
Engineering deep-dives, benchmarks and customer stories on persistent code context, knowledge graphs, and the AI coding tools we work with daily.
81–90 of 111 · page 9 of 12
End-to-End System Evaluation: The Stress Test of GraphRAG
Individual layers may pass, but systems often fail at the seams. This blog details how to conduct holistic 'System-in-the-Loop' tests, measuring how retrieval noise compounds into generation errors across 25+ repositories. We provide a blueprint for evaluating the full journey from a vague natural language query to a multi-repo pull request.
Evaluating Generation and Grounding in Multi-Repo Systems
Retrieving nodes is only half the battle; the LLM must synthesize code that adheres to cross-repo constraints. This post explores measuring faithfulness, checking execution-level correctness against internal SDKs, and using LLM-as-a-Judge to verify that generated code respects the security and type contracts of separate repositories.









