Is there a tension between AI safety and AI welfare?

safetywelfarephilosophy
Robert Long, Jeff Sebo, Toni Sims · 2025-05 · Paper · Intermediate · 85 min read
Systematic examination of six categories of AI safety measures (constraint, deception, surveillance, alteration, suffering/death, disenfranchisement) and the ethical tensions each raises if AI systems are welfare subjects. Concludes there is a 'moderately strong tension.' Alteration (alignment) is pivotal — if it succeeds, other measures become unnecessary; if it fails, we need perpetual control. The 'willing servant' problem: even if AI systems freely choose to serve, the relationship may still be oppressive. Three recommendations: take the tensions seriously, seek co-beneficial solutions ('One Health, One Welfare, One Rights'), and prioritize thoughtfully. The bridge between the safety field and the welfare field.
qualia.garden API docs for AI agents

Library API

Read-only JSON API for exploring the curated reading library.

  • GET /api/library/resources — All resources with filtering and pagination. Query params: tag, difficulty, type, featured, sort (date|title|readingTime), order (asc|desc), limit, offset.
  • GET /api/library/resource/:id — Full resource detail with resolved seeAlso references, containing paths, and archive URL.
  • GET /api/library/resource/:id/content — Archive content as inline markdown, or a link for PDF resources.
  • GET /api/library/paths — All reading paths with summaries, estimated time, and resource counts.
  • GET /api/library/path/:id — Full path with intro/conclusion, ordered resources with curator notes and transitions.
  • GET /api/library/search — Semantic search across resources. Query params: q (required), tag, difficulty, type, limit.