Book Launch: “The Carving of Reality,” Best of LessWrong vol. III

The Carving of Reality, third volume of the Best of LessWrong books is now available on Amazon (US).

The Carving of Reality includes 43 essays from 29 authors. We’ve collected the essays into four books, each exploring two related topics. The “two intertwining themes” concept was first inspired when as I looked over the cluster of “coordination” themed posts, and noting a recurring motif of not only “solving coordination problems” but also “dealing with the binding constraints that were causing those coordination problems.”

I’ve included the foreword from “Coordination & Constraint”, which I think conveys the overall spirit and context of the books:

Each year, the LessWrong community votes on the best posts from the previous year, to see which posts have stood the tests of time.

In 2020, the highest ranked post was Catherine Olsson’s announcement of microCOVID.org, a calculator for evaluating COVID risk. MicroCOVID is one of the clearest success stories of the ‘rationalist mindset’ that I know of. Creating it involved research during the early pandemic, when information was scarce, and time was of the essence – a classic situation where the traditional scientific process is inadequate and LessWrong-style rationality tools are valuable. It also required a quantitative mindset, and willingness to assign numbers to risks and make tradeoffs.

But microCOVID.org is most interesting to me as a tool for coordination. It doesn’t just let individuals make better life choices. Microcovid changed the entire covid coordination landscape by relaxing a constraint. Previously, if you lived with people with varying covid-caution preferences, and you wanted to hang out with someone from another house of people with varying covid-caution preferences… your only option was to have fairly involved negotiations on a case-by-case basis. Many people I know grew exhausted from negotiating, and gave up on trying to visit their friends. The microCOVID tool gave people a simplified “risk budget”, letting them do whatever activities made sense to them as long as they didn’t overspend.

“Negotiation energy” was a limiting resource, and microcovid.org made negotiation radically cheaper. It also opened up entirely new options, like “create a household microCOVID tax” (some houses decided that you could do whatever activities you wanted, you just had to pay other housemates $1 per microcovid).

The proximate inspiration for the theme of this book (and included herein) are John Wentworth’s posts “Coordination as Scarce Resource”, “Transportation as Constraint”, and “Interfaces as Scarce Resource.” Other posts explore the nature of particular constraints that society faces – Zvi’s posts on “Simulacra Levels and their Interactions,” “The Road to Mazedom,” and “Motive Ambiguity” each spell out how and why some communication is systematically distorted. And while they don’t give us a solution, they help ask a question – what would need to change, in order for society to coordinate at scale, without incentivizing distorted communication?

COORDINATION & CONSTRAINT

John WentworthCoordination as a Scarce Resource
John WentworthTransportation as a Constraint
John WentworthInterfaces as a Scarce Resource
Catherine OlssonMicroCOVID.org
Jacob FalcovichSeeing the Smoke
AlkjashPain is not the unit of Effort
AlkjashIs Success the Enemy of Freedom?
Zvi MowshowitzSimulacra Levels and their Interactions
Zvi MowshowitzThe Road to Mazedom
Zvi MowshowitzMotive Ambiguity
Scott AlexanderStudies On Slack
Jim Babcock,
Elizabeth Van Nostrand
Credibility of the CDC on SARS-CoV-2
Raymond Arnold”Can you keep this confidential?
How do you know?”
Abram DemskiMost Prisoner’s Dilemmas are Stag Hunts;
Most Stag Hunts are Schelling Problems
Martin SustrikSwiss Political System:
More than You ever Wanted to Know (I.)
Jason CrawfordWhy haven’t we celebrated any major achievements lately?

ALIGNMENT & AGENCY

Essays about how agency works, and how we might successfully build an AI agent more powerful than us that does what we actually want.

John WentworthAlignment By Default
Abram DemskiAn Orthodox Case Against Utility Functions
OrthonormalChoosing the Zero Point
John WentworthThe Pointers Problem: Human Values
Are A Function Of Humans’ Latent Variables
Evan HubingerAn overview of 11 proposals for building safe advanced AI
Paul ChristianoInaccessible information
Scott GarrabrantIntroduction to Cartesian Frames
Andrew CritchSome AI research areas and their relevance to existential safety
Richard NgoAGI safety from first principles: Introduction

TIMELINES & TAKEOFF

Essays about when (and how) powerful technology might permanently alter our world.

Daniel KokotaljoThe date of AI Takeover is not the day the AI takaes over
Daniel KokotaljoCortés, Pizarro, and Afonso as Precedents for Takeover
Daniel KokotaljoAgainst GDP as a metric for timelines and takeoff speeds
Scott AlexanderBiological Anchors:
The Trick that Might or Might Not Work
Katja GraceDiscontinuous progress in history: an update
Jeffrey LaddishNuclear war is unlikely to cause human extinction
Alex ZhuHow uniform is the neocortex?

REALITY & REASON

Essays about how to build an accurate map that reflects the underlying territory.

Mark XuThe First Sample Gives the Most Information
John WentworthWhat Money Cannot Buy
Anna SalamonReality-Revealing and Reality-Masking Puzzles
Ben KuhnTo listen well, get curious
Kaj SotalaThe Felt Sense: What, Why and How
Mark XuThe Solomonoff Prior is Malign
Jacob FalcovichThe Treacherous Path to Rationality
Jack HAnti-Aging: State of the Art
Alex FlintSearch versus design
Abram DemskiRadical Probabilism
Vanessa Kosoy,
Diffractor
Introduction To The Infra-Bayesianism Sequence

FAQ[1]

How do I acquire the books?

The Carving of Reality is available on Amazon (US) for $30.

Are they available in other countries?

Alas, we don’t have the bandwidth to do the logistics necessary to get it formally set up a listing for other countries. (Sorry about this! We did this the first year and it unfortunately turned out to be extremely effort-prohibitive)

How did you make the art?

The art was AI generated, using Midjourney version 4.

Are there any egregious printing errors you’re embarrassed about?

Sigh, yeah. Most notably, we ended up with a misaligned “LessWrong” logo on the spine of the Coordination book. However, some say this simply reality demonstrating that coordination is hard, with one book deciding to do its own thing and ruin the aesthetic for everyone.

Are previous book sets still available?

Yes! You can also buy copies of A Map That Reflects The Territory and The Engines of Cognition.

Buy it on Amazon
  1. ^

    By which I mean “questions that nobody has actually asked yet but I vaguely anticipate people asking.”