Skip to content

Methodology DGN-OBS-1.0

Definitions come before results. A metric without a denominator is an opinion.

This page fixes the vocabulary the Observatory uses. It is published so that any observation Dgenius records can be checked, disputed and reproduced against a stated standard.

Answer states

Six states, one classification per observation

An ambiguous output is recorded as UNCERTAIN. It is never promoted to a stronger state to improve a number.

RECOMMENDED
The company is explicitly presented as a candidate or recommendation.
MENTIONED
The company appears in the answer, but not as a recommendation.
CITED
The company or its domain is cited as evidence or a source.
ABSENT
The company does not appear in an observation where it was applicable.
COMPETITOR
A defined competitor occupies the relevant position instead.
UNCERTAIN
The output cannot be responsibly classified. Never inflated into a stronger state.

Metric definitions

Every rate, with its numerator, denominator, scope, window and limits

Presence rate

The share of measured observations in which the company appeared in any state.

Numerator
Observations classified RECOMMENDED, MENTIONED or CITED.
Denominator
All applicable observations for the company in the series.
Scope
One company, one category, the systems and intents listed in the series.
Window
The stated observation window of the series.

Presence is not preference. An answer may include a company while steering the buyer elsewhere.

Recommendation share

The share of relevant observations in which the company entered a recommended or shortlist state.

Numerator
Observations classified RECOMMENDED.
Denominator
All applicable observations for the company in the series.
Scope
One company, one category, the measured intent universe.
Window
The stated observation window of the series.

Recommendation share is not market share and does not measure revenue. It describes measured answers only.

Mention share

Broader presence, including appearances that are not recommendations.

Numerator
Observations classified MENTIONED or RECOMMENDED.
Denominator
All applicable observations for the company in the series.
Scope
One company, one category.
Window
The stated observation window of the series.

A mention can be neutral, comparative or unfavourable. State is not sentiment.

Absence rate

The share of applicable observations in which the company did not appear at all.

Numerator
Observations classified ABSENT.
Denominator
All applicable observations for the company in the series.
Scope
One company, one category.
Window
The stated observation window of the series.

Absence in a measured sample is not proof of absence everywhere. It is evidence within the stated sample.

Cross-model variance

How differently the company is represented across the measured systems, expressed as the spread between the system with the highest and lowest presence rate.

Numerator
Highest system presence rate minus lowest system presence rate.
Denominator
Not a ratio — a difference in percentage points.
Scope
One company, across every measured system with at least one observation.
Window
The stated observation window of the series.

Systems differ in retrieval, recency and configuration. Variance describes representation, not model quality.

Competitive answer share

How frequently named competitors occupy the relevant answer universe rather than the company.

Numerator
Observations classified COMPETITOR.
Denominator
All applicable observations for the company in the series.
Scope
The competitor set defined in the series methodology.
Window
The stated observation window of the series.

Bounded by the defined competitor set. Undefined competitors are not counted.

Source recurrence

Which sources repeatedly appear across the measured answers, and how often.

Numerator
Observations in which a given source was recorded.
Denominator
All observations in the series that recorded any source.
Scope
The whole series, not one company.
Window
The stated observation window of the series.

Recurrence describes what was cited alongside answers. It is not proof that a source caused the answer.

Standing caveats

Stated on every index, not buried in a footnote

  • Recommendation share is not market share.
  • AI visibility is not revenue. Where a relationship is measured, it is stated as measured; otherwise it is stated as hypothesised.
  • Every rate is bounded by the sample, the intents and the systems named in the methodology.

Visibility scopes

What may be published, and what never may

Public research
Collected under a public research protocol. Publishable.
Internal
Prospect research. Never published.
Client confidential
Engagement data. Never published in any form.
Client approved
Client has explicitly approved publication.

Collection

How observations are collected

  1. 01

    Define the intent universe

    A category is expressed as the buying questions a real purchaser asks — shortlist, comparison, requirement, risk and switching intents — not as keywords.

  2. 02

    Fix the prompt families

    Each intent is expressed as a family of phrasings so a single lucky or unlucky wording cannot be mistaken for a finding.

  3. 03

    Repeat the observation

    Answers vary across sessions. Observations are repeated across systems and sessions so variance is measured rather than ignored.

  4. 04

    Classify the state

    Every observation is classified into one documented state by an analyst. Ambiguous outputs are recorded as UNCERTAIN and never promoted.

  5. 05

    Record provenance

    Company, category, intent, prompt family, system, timestamp, state, competitors, citations, sources, methodology version and analyst are stored with each observation.

  6. 06

    Append, never overwrite

    Remeasurement adds rows. Original observations are preserved so change over time remains measurable.

What an observation is

One classified answer from one system, to one prompt, at one moment, about one company. Nothing more is claimed for it.

What an observation is not

It is not a ranking, a score, a market position, a traffic estimate or a prediction. Aggregates are only as strong as the sample and the protocol behind them.

Where the data comes from

Public research observations are collected by Dgenius analysts under a defined public protocol, or supplied by a client who has explicitly approved publication. Confidential engagement data is never published, in any form, including aggregate, unless approval is explicit.

Automation status

Where an authorised model or API integration exists, it is named in the series methodology. Where it does not, observations are recorded manually by an analyst. Dgenius never simulates a model answer.