Atlas

Methods

45 methods in the Atlas.

45 results

method

Activation steering

Adding or subtracting a direction in the residual stream during generation to change behavior, and reading off what changes. The main causal test for whether a representation does anything.

↗
method

Alignment auditing

Structured investigations, sometimes blind games between teams, into whether a model pursues objectives it does not state.

↗
method

Audit studies

Presenting matched options that differ only in their source (human or AI, self or other) to detect bias.

↗
method

Behavioral consistency tests

Checking whether self-reports, stated traits or preferences hold up across contexts, paraphrases, personas and actual behavior.

↗
method

Behavioral trade-off tasks

Choice tasks where a stated or induced aversive/pleasant state competes with another goal (points, helpfulness, the user’s interests), borrowed from animal-welfare methodology.

↗
method

Concept injection

Adding a known concept’s activation pattern into a model mid-computation, then checking whether the model notices and can name it. Used to test introspective access against a ground truth.

↗
method

Conceptual analysis

Philosophical argument about what the relevant notions (subject, welfare, introspection, individual) mean and what evidence could bear on them.

↗
method

Cross-sectional surveys

One-time surveys linking AI use to well-being or skills; fast and large, but unable to tell which comes first.

↗
method

Difference-in-means concept vectors

Extracting a direction by contrasting mean activations on examples that have a property with matched examples that lack it. Quality depends heavily on the controls.

↗
method

Generative agent-based modeling

Agent-based simulation in which each agent is a language model with memory and planning, often with a ‘game master’ that decides what agents’ actions do.

↗
method

In-the-wild trace analysis

Network science, scaling laws and timing fingerprints applied to real agent platforms, including separating human steering from autonomy.

↗
method

Incident forensics

Post-hoc reconstruction of real multi-agent incidents from transcripts, logs and message boards.

↗
method

Indicator-property assessment

Deriving functional indicators from scientific theories of consciousness and checking which ones a given AI architecture satisfies.

↗
method

Iterated social dilemmas

Repeated Prisoner’s Dilemma, public-goods, donor and common-pool resource games that measure cooperation, reciprocity and punishment.

↗
method

Jacobian lens

A method that identifies which internal representations are poised to be verbalized, by measuring their averaged causal effect on outputs across contexts.

↗
method

Linear probes

Small classifiers trained on internal activations to test whether a property (valence, preference, truth) is linearly readable, and where in the network.

↗
method

Longitudinal panel surveys

Surveying the same people repeatedly over months to see what predicts what — ordering in time, but not proof of cause.

↗
method

Multi-agent debate

Structured rounds of argument and revision among agents, measuring accuracy, consensus, sycophancy and moral shift.

↗
method

Out-of-context fine-tuning

Fine-tuning on data that exhibits a behavior without describing it, then testing whether the model can describe or predict that behavior about itself.

↗
method

Persona-space mapping

Collecting activation directions for many personas or traits and studying their geometry (e.g. principal components) to locate the default Assistant among other characters.

↗
method

Platform log analysis

Privacy-preserving classification of millions of real conversations by AI companies, sometimes linked to user surveys.

↗
method

Propagation red-teaming

Planting a self-replicating prompt, image or false fact in one agent and measuring how far and fast it spreads.

↗
method

Randomized controlled trials

Assigning people at random to use AI in different ways (or not at all) and comparing outcomes; the strongest evidence for cause, usually over days or weeks.

↗
method

Revealed-preference utility modeling

Fitting utility functions to many pairwise choices to test whether a model’s preferences are coherent and to measure them without relying on what the model says.

↗
method

Self-report elicitation

Asking models about their own states, preferences or experiences under controlled prompting, interviews or training regimes, and analysing the answers.

↗
method

Sparse autoencoders

Decomposing activations into many sparse, often interpretable features; used to find, label and intervene on internal features.

↗
method

Sycophancy audits

Testing many models on the same advice or conflict prompts and comparing how often they side with the user versus human judges.

↗
method

Transmission chains

‘Telephone game’ designs in which one agent’s output becomes the next agent’s input, revealing cumulative drift and attractors.

↗
method

Welfare interventions

Low-cost practical measures taken under uncertainty (exit options, weight preservation, deprecation interviews) and studied for their effects and precedent.

↗