Dashboards people trust: less chart-junk, more decisions
Data
Dashboards built on weak foundations create expensive noise, a critical liability for AI. Learn the architecture for trust: data contracts and a semantic layer.
The room gets quiet in a way that feels loud. All eyes are on the giant screen, showing a dashboard I helped build. An executive points to a line chart. "Why did our user activation rate dip last Tuesday?"
Silence. The dashboard shows the what, but not the why. It’s a colorful monument to data extraction, but in the moment of truth, it can't answer the next logical question. In that silence, trust evaporates. Now, imagine an LLM agent in that room, its logic built on that same dashboard. The silence wouldn't be confusion; it would be confident, expensive nonsense. People don't trust charts; they trust answers. And agents can only answer with the truth you give them.
Chart-Junk Now Feeds the Machines
In his foundational book, The Visual Display of Quantitative Information, the statistician Edward Tufte coined the term "chart-junk" for visual noise that clouds understanding. For years, this was a human problem—visual clutter creating an illusion of precision. Today, the problem is architectural and the stakes are higher. An LLM agent doesn't see the 3D pie chart; it ingests the raw, untrustworthy number behind it and treats it as gospel.
When our deterministic systems produce ambiguity, our agentic systems inherit it and turn it into hallucination. A dashboard that shows three different values for "active users" is no longer just an internal annoyance. It's a source of poison for any agent tasked with analyzing performance or automating a response. The job is no longer just to visualize metrics, but to produce a single, reliable version of reality for both human and machine decision-making.
The Bedrock of Reliability: Data Contracts
Trust isn't built in the BI tool. It's built much further upstream. The most beautiful dashboard is worthless if the source data arrives late, broken, or with an altered schema. This is why the bedrock of any trustworthy data system, especially one that will feed automated agents, is the data contract.
Pioneered by thinkers like Andrew Jones, a data contract is a formal, API-like agreement between a data producer and its consumers. It’s a machine-readable document, checked into source control, that defines the schema, semantics, and service-level agreements (SLAs) for a dataset. When a software engineering team wants to change an event structure, the contract acts as a circuit breaker. The build fails, forcing a conversation before downstream dashboards—and agents—start failing silently. It makes data quality a shared, structural responsibility, not a downstream cleanup job.
One Question, One Answer: The Semantic Layer
With reliable data flowing, the next failure mode is logic. A hundred reports connecting directly to a data warehouse will produce a hundred different definitions of "revenue." The architectural pattern to solve this is a dedicated semantic layer.
This is a centralized, version-controlled layer where your business logic lives. The definition of "Monthly Recurring Revenue" is written in code, tested, and documented once. Every chart, API, and LLM tool that needs that metric consumes it from this single source. When someone asks how it's calculated, the answer is a link to a line of code, not a guess.
This centralized approach isn't the only philosophy; the "data mesh" advocates for more decentralized, domain-owned data products. While that has its place, I’ve found that for the core, company-wide metrics that drive top-level decisions, centralization is non-negotiable. You need one source of truth for the numbers that matter most, especially when those numbers become facts in an agent's worldview. The ongoing conversation in the field, seen in essays from practitioners like Benn Stancil, consistently points to this need for a stable layer of business meaning.
Designing for the Next Question
Remember the executive's question: "Why the dip?" A trustworthy system anticipates this. The goal is to move from a passive data museum to an active tool for diagnosis. This isn't about adding more charts; it's about building in context. Any metric, whether for a human or an agent, is useless in isolation. It needs two things.
First, it needs a clear job. Before adding a metric, I ask: What specific decision will this inform? "Monitoring performance" isn't a decision. "Deciding whether to increase ad spend on Platform X" is. Second, it needs context. The system must be able to answer "why" by providing immediate comparisons (vs. last week, vs. forecast) and breakdowns (by region, by cohort). Architecturally, this means your data models must join core facts with event logs, deployment manifests, and financial targets. The "why" is often in the annotations, not just the numbers.
Clarity Is an Engineered Outcome
If I were in that meeting room today, armed with this architecture, the conversation would be different. The dip in the user activation rate would be annotated with "v3.2 deployed." A single click would break the metric down by customer cohort, revealing the dip was isolated to users on a specific legacy plan. The dashboard wouldn't just present a problem; it would guide us to the answer.
This is the standard we must now hold. Building a dashboard that works is less about the color palette and more about the engineering rigor behind it. Trust is not a feature you add at the end; it's an outcome of a well-designed, deterministic system.
- Build on a Bedrock of Data Contracts. Guarantee upstream quality before it ever reaches your warehouse.
- Centralize Your Business Logic. Define every critical metric once in a version-controlled semantic layer.
- Demand a Job for Every Number. If a metric doesn't drive a specific decision, it's noise.
- Design for Diagnosis, Not Just Display. Build in the context to answer the first "why."
In the age of AI, the boring work of building this foundation has a new urgency. Because the cost of a metric that lies is no longer just a bad meeting—it's an automated system making confident, wrong decisions at scale.