← Musings

Intent Integrity

How the modern web collapsed information and commerce into one surface — and what it would take to build the distinction back in.

Last night, I did what millions of people do when something feels off:

I searched: “How do I sleep better?”

That sounds trivial, but it isn’t.

Sleep is not some niche wellness hobby. In the U.S., about one-third of adults are not getting enough sleep, and insufficient sleep is linked by public-health authorities to elevated risks including depression, obesity, heart disease, injury, and other serious conditions. CDC

So when someone types a basic question like “How do I sleep better?”, they are not just browsing. They are often entering a health-information journey.

And that is where the problem starts.

0%
% of U.S. adults not getting sufficient sleep
CDC · National data
0%
% of adult internet users who search health info online
Pew Research Center
0%
% of health info seekers who start with a general search engine
Systematic review · 2021
Sleep is a public health issue. The web is the primary information channel. The stakes of information quality are not trivial.

Because the open web does not present all information under the same conditions.

Academic research is slower, method-driven, peer-reviewed, and subject to procedural scrutiny by other experts. That process is imperfect, sometimes biased, and far from foolproof. But it is still designed to evaluate methods, evidence, assumptions, and interpretation through independent review. Nature

Open-web content often operates under a very different logic: speed, discoverability, distribution, conversion.

That difference is not theoretical. Research evaluating online information about insomnia found that the overall quality of websites was only moderate, and that all the content assessed exceeded recommended readability levels for the general public. The same paper argued that trustworthiness needed improvement through clearer authorship, update dates, conflicts-of-interest disclosures, and evidence sourcing. Springer

Research on sleep apnea information online found another important pattern: commercial websites performed worse in providing information about diagnosis and management, while scientific and foundation sites performed better. PMC

Website performance by type — Sleep apnea information quality (scored out of 10)
Scientific & foundation sites
8.2
Government & public health
7.4
Non-profit & patient orgs
6.5
General web portals
5.2
Commercial websites
3.8
Source: PMC study on sleep apnea information quality. Commercial sites consistently underperformed on diagnosis and management information.

That does not mean every commercial page is wrong.

And it does not mean every academic paper is right.

It means a peer-reviewed study and a commercially adjacent sleep article are not just two different sources.

They are outputs of two different incentive systems. And yet, on the results page, they often arrive dressed as if they belong to the same category: “information.” They do not.

Disclosure quality & search intent distribution
Insomnia web content — disclosure quality
60%LACKED DISCLOSURE
Lacked clear authorship & disclosures60%
Had clear authorship & disclosures40%
Search intent types — blended interface
48%INFORMATIONAL
Informational48%
Commercial investigation29%
Transactional14%
Navigational9%
Left: Springer research on insomnia content disclosure. Right: Established search intent taxonomy — all four types currently served through one blended surface.

That gap matters because online health-information seeking is already mainstream. Pew has reported that 72% of adult internet users have searched online for health information, and a 2021 systematic review found that 83% of health information consumers searched using a general search engine. Pew Research Center

So this is not a marginal UX complaint. It is a structural question about how modern knowledge is delivered.

And the structure we have today is shaped by incentives at enormous scale.

In Australia alone, internet advertising reached A$18.4 billion in 2025, with search advertising at A$8.0 billion, according to IAB Australia and PwC. That is not a side market sitting next to information. It is one of the economic engines underneath it. IAB Australia

Australia's A$18.4bn internet advertising market — share by channel (2025)
Search advertising
A$8.0bn
Social media
A$4.2bn
Video
A$3.1bn
Display & other
A$3.1bn
Source: IAB Australia & PwC. Search alone (43%) is the largest single channel — and one of the economic forces shaping how information is surfaced.

This is why Herbert Simon’s old insight feels less like theory and more like infrastructure: in an information-rich world, what becomes scarce is attention. And once attention is scarce, systems organise themselves around capturing it.

That is also why something like Goodhart’s Law shows up here. Once “helpfulness,” relevance, or informational visibility becomes a target for monetisation, the signals that once pointed to quality can become distorted. The moment informational real estate becomes commercially valuable, it stops being a neutral environment.

Two incentive systems: research vs. open web
Academic / peer-reviewed
Method scrutiny
90%
Independent review
85%
Speed to publish
20%
Conflict of interest
30%
Commercial / open web
Method scrutiny
18%
Independent review
12%
Speed to publish
95%
Conflict of interest
72%
Illustrative scoring based on structural characteristics. Peer review is imperfect; commercial content is not always wrong. The difference is incentive design.

So here is the thought experiment:

What if we separated truth-seeking from commerce at the interface level?

What if an informational mode had a hard rule: no brands, no products, no vendors, no commercial entities in generated answers — just concepts, mechanisms, evidence, competing explanations, levels of confidence.

Then, separately, a commercial mode: products, brands, comparisons, reviews, prices, shopping pathways.

And if a company wanted to appear inside the informational mode? Fine. But only as a clearly labelled ad.

No blending. No disguised neutrality. No soft-sell hidden inside explanation.

That would not eliminate bias. Framing bias, omission bias, and institutional bias would still exist. But it would do something important: it would stop pretending that explanation and persuasion are the same genre.

A proposed separation: informational vs. commercial modes
Informational mode
Concepts & mechanisms
Evidence & research
Competing explanations
Confidence levels
CLEARLY LABELLED ADS ONLY
Commercial mode
Products & brands
Comparisons & reviews
Prices & availability
Shopping pathways
NO DISGUISED NEUTRALITY
Query submitted to both interfaces
how do I sleep better?
Today’s blended interfaceCurrent state
search.example.com/q=how+do+i+sleep+better
⚠ Intent blending — explanation + product links in same surface
AI Overview

To sleep better, maintain a consistent sleep schedule, avoid screens 1hr before bed, keep your room cool. Best sleep supplements → Top-rated white noise machines →

Sponsoredpeople also viewed
💊
SleepWell Magnesium+
$34.99
🧘
Hatch Restore 2
$199.00
😴
Calm Premium
$69.99/yr
sleepwellness.co › blog
12 Science-Backed Tips to Sleep Better Tonight
Our sleep experts recommend evidence-based strategies — plus top supplements and devices that actually work. Affiliate links included.
sleepfoundation.org › articles
Sleep Hygiene — National Sleep Foundation
Sleep hygiene refers to healthy sleep habits. Consistent wake times, limiting caffeine after 2pm, and managing light exposure are most impactful.
Sponsored
dreamcloud.com › sleep-tips
How to Sleep Better: The Complete Guide (2025)
Expert-written guide to better sleep — from the science basics to the mattresses that make the biggest difference. Shop our editor picks.
ProblemAI summary embeds product links inside explanation — persuasion disguised as information
ProblemNo source taxonomy — peer-reviewed, commercial blog, and sponsored content presented identically
ProblemCommercial investigation intent served before informational need is met
Proposed: intent-separatedNew model
understand.example.com/q=how+do+i+sleep+better
ℹ You are in informational mode. No products, brands, or vendors appear here.
Informational query detected
Evidence strength by sub-topic
Sleep schedule consistency
High
Light & melatonin timing
High
Temperature (65–68°F)
Moderate
Magnesium supplementation
Mixed
White noise efficacy
Weak
Strong evidenceCircadian anchoring

Waking at the same time daily stabilises your circadian phase. Adenosine (a sleep-pressure molecule) clears during sleep; fixed wake times regulate its accumulation cycle. The single most-supported behavioural intervention.

Systematic reviewWalker (2017) · Espie et al., Sleep Medicine Reviews
Strong evidenceLight exposure & melatonin suppression

Blue-spectrum light suppresses melatonin onset by up to 3 hours when exposure occurs in the 2hrs before habitual sleep time. Evening dim light and morning bright light are the two highest-leverage environmental levers.

RCTChang et al. (2015), PNAS · n=12
Moderate evidenceCore body temperature drop

Sleep onset requires core temperature to fall ~1–2°F. Cooler ambient rooms (65–68°F / 18–20°C) facilitate this. Warm baths 1–2hrs before sleep paradoxically help via peripheral vasodilation — accelerating the core drop.

ObservationalHarding et al. (2019), Current Biology
↔ Competing explanations

Sleep-restriction therapy (CBT-I) and stimulus control have stronger long-term evidence than sleep hygiene tips alone. Some researchers argue “sleep hygiene” as a standalone intervention is insufficiently tested in RCT conditions.

FeatureSource taxonomy visible: each claim tagged by study type. Confidence calibrated, not asserted.
FeatureNo product, brand, vendor, or affiliate link appears in this mode — hard architectural constraint, not editorial policy.
What's wrong with the existing modelProduct links appear inside AI explanations. Sponsored and organic content share the same visual grammar. Source quality is invisible. Commercial intent is served before the informational need is resolved. The user cannot tell which incentive system produced each result.
What the proposed model does differentlyIntent is separated at the architectural level — not editorial policy. Informational mode has a hard constraint: no brands, no vendors. Evidence is calibrated. Commerce is reachable, clearly labelled, and downstream. The user controls when they cross the threshold.

Right now, we collapse too many different intents into one interface.

Search research has long recognised distinctions between informational, navigational, and transactional queries. In industry practice, people often add a fourth bucket, commercial investigation, because many searches sit between learning and buying. ScienceDirect

The problem is not that these intents exist.

The problem is that we serve them through a single blended surface and then act surprised when epistemic trust erodes.

Search query intent taxonomy — four types, one blended surface
INTENT 01
Informational
How does X work?
INTENT 02
Navigational
Find a site or brand
INTENT 03
Commercial investigation
Best X for Y?
INTENT 04
Transactional
Buy / sign up / do
Research has long recognised these as distinct intent categories. All four are currently served through a single blended interface.

Maybe the next generation of search should not just optimise for relevance.

Maybe it should optimise for something else entirely: intent integrity.

That is my term, not an established framework. But I think it names the design challenge well:

Did the system respect why the user asked the question?

If I ask “How do I sleep better?”, I may eventually want products. But not at the start. At the start, I want understanding.

And maybe the biggest design failure of the modern web is that we no longer force systems to distinguish between those two moments.