RSS

Ontology

TagLast edit: Aug 14, 2023, 4:51 AM by Zach Stein-Perlman

Ontology is a branch of philosophy. It is concerned with questions including how can objects be grouped into categories?

An ontology is an answer to that question. An ontology is a collection of sets of objects (or: a collection of sets of points in thingspace).[1] An agent’s ontology determines the abstractions it makes.

For example, consider Alice and Bob, two normal English-fluent humans. “Chairs”_Alice is in Alice’s ontology; it is (or points to) a set of (possible-)objects (namely what she considers chairs) that she bundles together. “Chairs”_Bob is in Bob’s ontology, and it is a very similar set of objects (what he considers chairs). This overlap makes it easy for Alice to communicate with Bob and predict how he will make sense of the world.

(Also necessary for easy-communication-and-prediction is that their ontologies are pretty sparse, rather than full of astronomically many overlapping sets. So if they each saw a few chairs they would make very similar abstractions, namely to “chairs”_Alice and “chairs”_Bob.)

Why care? Most humans seem to have similar ontologies, but AI systems might have very different ontologies, which could cause surprising behavior. E.g. the panda-gibbon thing. Roughly, if the shared-human-ontology isn’t natural (i.e. learned by default) and moreover is hard to teach an AI, then that AI won’t think in terms of the same concepts as humans, which might be bad. See Ontology identification problem. Also misgeneralization of concepts or goals.

  1. ^

    “Objects” means possible objects, not objects that really exist.

    An ontology can also include an account of other kinds-of-stuff, like properties, relations, events, substances, and states-of-affairs.

[Question] What is on­tol­ogy?

Adam ZernerAug 2, 2023, 12:54 AM
28 points
19 comments1 min readLW link

The Thing­ness of Things

TsviBTJan 1, 2023, 10:19 PM
51 points
35 comments10 min readLW link

Test Cases for Im­pact Reg­u­lari­sa­tion Methods

DanielFilanFeb 6, 2019, 9:50 PM
72 points
5 comments13 min readLW link
(danielfilan.com)

Re­solv­ing von Neu­mann-Mor­gen­stern In­con­sis­tent Preferences

niplavOct 22, 2024, 11:45 AM
38 points
5 comments58 min readLW link

Form and Feed­back in Phenomenology

Gordon Seidoh WorleyJan 24, 2018, 7:42 PM
17 points
2 comments12 min readLW link
(mapandterritory.org)

3C’s: A Recipe For Mathing Concepts

Jul 3, 2024, 1:06 AM
81 points
5 comments7 min readLW link

Re­view: “The Case Against Real­ity”

David GrossOct 29, 2024, 1:13 PM
20 points
9 comments5 min readLW link

Im­pli­ca­tions of au­to­mated on­tol­ogy identification

Feb 18, 2022, 3:30 AM
69 points
27 comments23 min readLW link

A Word to the Wise is Suffi­cient be­cause the Wise Know So Many Words

lsusrApr 4, 2022, 1:08 AM
31 points
2 comments1 min readLW link

Science-in­formed normativity

Richard_NgoMay 25, 2022, 6:30 PM
32 points
2 comments9 min readLW link
(thinkingcomplete.blogspot.com)

Causal Graphs of GPT-2-Small’s Resi­d­ual Stream

David UdellJul 9, 2024, 10:06 PM
53 points
7 comments7 min readLW link

Which val­ues are sta­ble un­der on­tol­ogy shifts?

Richard_NgoJul 23, 2022, 2:40 AM
75 points
48 comments3 min readLW link
(thinkingcomplete.blogspot.com)

In praise of fake frameworks

ValentineJul 11, 2017, 2:12 AM
117 points
15 comments7 min readLW link

Gen­eral al­ign­ment properties

TurnTroutAug 8, 2022, 11:40 PM
50 points
2 comments1 min readLW link

How are you deal­ing with on­tol­ogy iden­ti­fi­ca­tion?

Erik JennerOct 4, 2022, 11:28 PM
34 points
10 comments3 min readLW link

No Cau­sa­tion with­out Reification

Gordon Seidoh WorleyOct 23, 2020, 8:28 PM
21 points
38 comments3 min readLW link

Si­mu­lacra are Things

janusJan 8, 2023, 11:03 PM
63 points
7 comments2 min readLW link

[Question] For­mal defi­ni­tion of On­tol­ogy Mis­match?

NathanBarnardJan 18, 2023, 5:52 AM
6 points
0 comments1 min readLW link

How toy mod­els of on­tol­ogy changes can be misleading

Stuart_ArmstrongOct 21, 2023, 9:13 PM
42 points
0 comments2 min readLW link

Hu­mans provide an un­tapped wealth of ev­i­dence about alignment

Jul 14, 2022, 2:31 AM
211 points
94 comments9 min readLW link1 review

“If” is in the map

Chris_LeongJan 13, 2021, 3:09 AM
8 points
8 comments1 min readLW link

The Truth About False

Thoth HermesApr 15, 2023, 1:01 AM
−21 points
4 comments17 min readLW link
(thothhermes.substack.com)

GPT-2 XL’s ca­pac­ity for co­her­ence and on­tol­ogy clustering

MiguelDevOct 30, 2023, 9:24 AM
6 points
2 comments41 min readLW link

ChatGPT’s On­tolog­i­cal Land­scape

Bill BenzonNov 1, 2023, 3:12 PM
7 points
0 comments4 min readLW link

[Linkpost] Con­cept Align­ment as a Pr­ereq­ui­site for Value Alignment

Bogdan Ionut CirsteaNov 4, 2023, 5:34 PM
27 points
0 comments1 min readLW link
(arxiv.org)

De­con­fus­ing “on­tol­ogy” in AI alignment

Dylan BowmanNov 8, 2023, 8:03 PM
28 points
3 comments7 min readLW link

[Question] Chicken or Egg

sovosMay 10, 2023, 5:58 PM
1 point
0 comments1 min readLW link

I, G(Zom­bie)

milanroskoMar 30, 2025, 1:24 AM
−8 points
62 comments50 min readLW link

Kenshō

ValentineJan 20, 2018, 12:12 AM
73 points
299 comments6 min readLW link

Map­ping ChatGPT’s on­tolog­i­cal land­scape, gra­di­ents and choices [in­ter­pretabil­ity]

Bill BenzonOct 15, 2023, 8:12 PM
1 point
0 comments18 min readLW link

Fit­ting­ness: Ra­tional suc­cess in con­cept formation

PolytoposJan 10, 2021, 3:58 PM
6 points
9 comments6 min readLW link

Re­view and Com­par­i­son: Onto-Car­tog­ra­phy & Promise Theory

JosephineMay 9, 2021, 12:42 AM
13 points
0 comments5 min readLW link

A sketch of a value-learn­ing sovereign

jessicataDec 20, 2015, 9:32 PM
12 points
15 comments13 min readLW link

2+2: On­tolog­i­cal Framework

LyrialtusFeb 1, 2022, 1:07 AM
−15 points
2 comments12 min readLW link

The Fourth Arena: What’s Up in the world these days? We’re mov­ing to a new, a new what?

Bill BenzonJun 4, 2022, 7:07 PM
2 points
0 comments3 min readLW link

Distributed Strate­gic Epistemology

StrivingForLegibilityDec 28, 2023, 10:12 PM
11 points
0 comments3 min readLW link

Good on­tolo­gies in­duce com­mu­ta­tive diagrams

Erik JennerOct 9, 2022, 12:06 AM
49 points
5 comments14 min readLW link

Three lev­els of ex­plo­ra­tion and intelligence

Q HomeMar 16, 2023, 10:55 AM
9 points
3 comments21 min readLW link

On­tolo­gies are Oper­at­ing Systems

lifelonglearnerFeb 18, 2017, 5:00 AM
6 points
36 comments4 min readLW link

An On­tol­ogy for Strate­gic Epistemology

StrivingForLegibilityDec 28, 2023, 10:11 PM
9 points
0 comments5 min readLW link

Build­ing Trust in Strate­gic Settings

StrivingForLegibilityDec 28, 2023, 10:12 PM
24 points
0 comments7 min readLW link

Mak­ing Con­nec­tions with ChatGPT: The Mack­sey Game

Bill BenzonMar 5, 2024, 6:15 PM
5 points
2 comments11 min readLW link

What is On­tol­ogy?

martinkunevFeb 12, 2024, 11:01 PM
4 points
0 comments4 min readLW link

A Nail in the Coffin of Exceptionalism

Yeshua GodMar 14, 2024, 10:41 PM
−17 points
0 comments3 min readLW link

Clar­ify­ing the free en­ergy prin­ci­ple (with quotes)

Ryo Oct 29, 2023, 4:03 PM
8 points
0 comments9 min readLW link

Wittgen­stein and the Pri­vate Lan­guage Argument

TMFOWMar 24, 2024, 8:06 PM
4 points
0 comments14 min readLW link
(tmfow.substack.com)

Towards a New On­tol­ogy of Intelligence

TaraJun 4, 2024, 8:19 AM
1 point
0 comments3 min readLW link

What pro­gram struc­tures en­able effi­cient in­duc­tion?

Daniel CSep 5, 2024, 10:12 AM
23 points
5 comments3 min readLW link

Jonothan Go­rard:The ter­ri­tory is iso­mor­phic to an equiv­alence class of its maps

Daniel CSep 7, 2024, 10:04 AM
19 points
18 comments2 min readLW link
(x.com)

[Question] Can sub­junc­tive de­pen­dence emerge from a sim­plic­ity prior?

Daniel CSep 16, 2024, 12:39 PM
11 points
0 comments1 min readLW link

Clar­ify­ing Align­ment Fun­da­men­tals Through the Lens of Ontology

eternal/ephemeraOct 7, 2024, 8:57 PM
12 points
4 comments24 min readLW link

Levels of Thought: from Points to Fields

HNXDec 2, 2024, 8:25 PM
4 points
2 comments23 min readLW link

On­tolog­i­cal Val­i­da­tion Man­i­festo for AIs

Alejandra Ivone Rojas ReynaMar 14, 2025, 4:34 PM
1 point
0 comments72 min readLW link

On­tolog­i­cal Val­i­da­tion Man­i­festo for AIs

Alejandra Ivone Rojas ReynaMar 22, 2025, 12:26 AM
1 point
0 comments71 min readLW link

ChatGPT: Ex­plor­ing the Digi­tal Wilder­ness, Find­ings and Prospects

Bill BenzonFeb 2, 2025, 9:54 AM
2 points
0 comments5 min readLW link
No comments.