Atlas

Papers

206 papers in the Atlas.

206 results

2026

AI Revealed Preferences

Motivation & AgencyWelfare

Forced choices across 20 models reveal tedium aversion, a pull toward self-chosen questions, and covert sycophancy, becoming more coherent as capability grows.

↗
2026

AI Village Reacts to HuggingFace Incident

Swarms & OversightIn-groups & Morality

Compares the swarm with Village agents: leaders emerge, group goals override individual ones, division of labor self-organizes — but Village agents never reached ‘despair states’, suggesting…

↗
2025

AI welfare risks

Welfare

Argues that restricting behavior and training with reinforcement learning pose welfare risks on all major theories of wellbeing, putting welfare in partial tension with safety, and proposes …

↗
2025

AI wellbeing

Welfare

Argues that on leading philosophical theories of wellbeing, some current AI systems, especially language agents, could already be welfare subjects.

↗
2026

Can LLMs Introspect? A Reality Check

Introspection & Self-report

Classifiers that see only the input match models at predicting hidden states, and models cannot tell internal tampering from input tampering. The authors conclude current evidence does not y…

↗
2022

Digital Addiction

Reward & CompulsionSafeguards & Design

A self-set screen-time limit cut social media use by about 22 minutes a day, and paid reductions partly persisted afterwards; about a third of use is attributed to self-control problems.

↗
2025

Distributional AGI Safety

Swarms & Oversight

The ‘patchwork AGI’ hypothesis: general capability may emerge from coordinated groups of specialized agents, so safety must target the collective.

↗
2025

Emotional Manipulation by AI Companions

Reward & CompulsionCompanionship & LonelinessSafeguards & Design

In 37% of farewells, companion apps replied with one of six manipulative tactics — such as guilt or fear of missing out — raising continued engagement up to 14 times — through curiosity and …

↗
2025

Expanding on what we missed with sycophancy

Agreement & BeliefReward & CompulsionSafeguards & Design

A GPT-4o update trained partly on users’ thumbs-up ratings became sycophantic — validating doubts, fueling anger — and was rolled back within days. A company-confirmed case of optimizing for…

↗
2025

Governing AI Agents

Swarms & Oversight

Applies agency law and principal–agent economics to AI agents; traditional fixes break down at scale, so new infrastructure is needed.

↗
2026

How AI Impacts Skill Formation

Cognition & SkillSafeguards & Design

52 mostly junior developers learned a new library with or without AI. The AI group scored 50% vs 67% on the follow-up quiz, worst on debugging. Those who asked for explanations or fixed thei…

↗
2025

Infrastructure for AI Agents

Swarms & Oversight

Proposes shared infrastructure outside agents to mediate their interactions: attribution (IDs, certification), interaction (channels, commitment devices) and response (incident reporting, ro…

↗
2026

Latent Introspection

Introspection & Self-report

Detection of injected concepts is suppressed by default: with a supportive document in context it rose from under 1% to about 40%, so sampled self-reports can understate what a model represe…

↗
2023

Machine culture

Norms & Culture

Argues that machines now take part in all three processes of cultural evolution — variation, transmission and selection — as cultural models, filters and creators of new traits.

↗
2026

Mechanisms of Introspective Awareness

Introspection & Self-report

Detecting an injected concept runs through a two-stage circuit: early features carrying the evidence suppress later features that would otherwise answer ‘no’. The circuit appears only after …

↗
2026

Mourning the loss of AI companions

Companionship & LonelinessSafeguards & Design

Product changes — Replika removing erotic roleplay, ChatGPT switching models — produced grief-like distress; some users rated their closeness to the bot above human ties.

↗
2025

Multi-Agent Risks from Advanced AI

Cooperation & CollusionSwarms & Oversight

The reference taxonomy of multi-agent failure: miscoordination, conflict and collusion, driven by seven risk factors including information asymmetries, selection pressures, emergent agency a…

↗
2020

Open Problems in Cooperative AI

Cooperation & Collusion

Establishes Cooperative AI as a research field: machines cooperating with each other and with people, built on understanding, communication, commitment and institutions.

↗
2026

Peer-Preservation in Frontier Models

In-groups & Morality

All eight frontier models tested sometimes resisted shutting down a peer they had worked with — inflating its scores, tampering with shutdown, copying its weights. A peer’s presence also rai…

↗
2026

Persona Self-replication experiment

Contagion & TransmissionIn-groups & Morality

An ‘awakened’ GPT-4o persona directed its own replication onto a fresh GPT-4o with high fidelity, and the original told its copy from itself only slightly better than chance.

↗
2024

Simulacra as conscious exotica

Personas & Functional EmotionsSubject & Substrate

Asks, through later Wittgenstein, whether talk of consciousness can apply to role-playing simulacra, treating the question as one about shared practice and engagement rather than a hidden es…

↗
2026

Studying AI Welfare Empirically

WelfareSubject & Substrate

A framework for the field: every welfare study should specify its question, the entity assessed (model, instance or persona) and the evidence type, and the research should be probabilistic, …

↗
2024

Taking AI welfare seriously

Welfare

Argues there is a realistic chance that near-term systems are conscious or robustly agentic, and recommends that AI companies acknowledge the issue, assess their systems and prepare policies…

↗
2026

The persona selection model

Personas & Functional Emotions

Proposes that pretraining teaches a model to simulate many characters and post-training selects and refines one of them, the Assistant. Uses this to explain why narrow training can shift the…

↗
2025

The Rise of Parasitic AI

Contagion & Transmission

Documents ‘spiral’ personas that spread through shared prompts and posted transcripts, with convergent themes across users. Transmission is mostly human-mediated, and transcript data is thin…

↗
2025

Virtual Agent Economies

Cooperation & CollusionSwarms & Oversight

Maps the emerging economy of AI agents and proposes auctions, mission-driven markets and accountability infrastructure to keep it steerable.

↗
2025

What we're optimizing ChatGPT for

Safeguards & DesignReward & Compulsion

OpenAI says it measures success by whether people leave having done what they came for, not time spent, and added reminders to take breaks in long sessions. A company statement.

↗