RSS

Pre­dic­tive Processing

TagLast edit: Dec 26, 2022, 6:13 AM by Roman Leventov

(From Wikipedia) predictive processing (a.k.a. predictive coding, the Bayesian Brain hypothesis) is a theory of brain function in which the brain is constantly generating and updating a mental model of the environment. The model is used to generate predictions of sensory input that are compared to actual sensory input. This comparison results in prediction errors that are then used to update and revise the mental model.

Active Inference can be seen as a generalisation of predictive processing. While predictive processing only explains the agent’s perception, Active Inference models both perception and action as inference under the same unifying objective: optimisation of the informational quantity called variational free energy.

External Links:
Book Review: Surfing Uncertainty—Introduction to predictive processing by Scott Alexander
Predictive Processing And Perceptual Control by Scott Alexander

Related Pages: Perceptual Control Theory, Neuroscience

Multi-agent pre­dic­tive minds and AI alignment

Jan_KulveitDec 12, 2018, 11:48 PM
63 points
18 comments10 min readLW link

God Help Us, Let’s Try To Un­der­stand Fris­ton On Free Energy

Scott AlexanderMar 5, 2018, 6:00 AM
54 points
43 comments14 min readLW link
(slatestarcodex.com)

Pre­dic­tive Cod­ing has been Unified with Backpropagation

lsusrApr 2, 2021, 9:42 PM
176 points
51 comments2 min readLW link

How uniform is the neo­cor­tex?

zhukeepaMay 4, 2020, 2:16 AM
80 points
23 comments11 min readLW link1 review

Neu­ral An­neal­ing: Toward a Neu­ral The­ory of Every­thing (cross­post)

Michael Edward JohnsonNov 29, 2019, 5:31 PM
86 points
29 comments40 min readLW link3 reviews

Crav­ing, suffer­ing, and pre­dic­tive pro­cess­ing (three char­ac­ter­is­tics se­ries)

Kaj_SotalaMay 15, 2020, 1:21 PM
96 points
56 comments19 min readLW link

Pre­dic­tive cod­ing & depression

Steven ByrnesJan 3, 2020, 2:38 AM
27 points
9 comments7 min readLW link

Pre­dic­tive cod­ing and mo­tor control

Steven ByrnesFeb 23, 2020, 2:04 AM
22 points
3 comments4 min readLW link

Why Si­mu­la­tor AIs want to be Ac­tive In­fer­ence AIs

Apr 10, 2023, 6:23 PM
94 points
9 comments8 min readLW link1 review

Pre­dic­tive cod­ing = RL + SL + Bayes + MPC

Steven ByrnesDec 10, 2019, 11:45 AM
56 points
8 comments8 min readLW link

Con­fir­ma­tion Bias in Action

Jacob FalkovichJan 24, 2021, 5:38 PM
37 points
1 comment13 min readLW link

[Question] What De­ci­sion The­ory is Im­plied By Pre­dic­tive Pro­cess­ing?

johnswentworthSep 28, 2020, 5:20 PM
56 points
17 comments1 min readLW link

Min­i­miza­tion of pre­dic­tion er­ror as a foun­da­tion for hu­man val­ues in AI alignment

Gordon Seidoh WorleyOct 9, 2019, 6:23 PM
15 points
42 comments5 min readLW link

Pre­dictable Iden­tities—Mid­point Review

Jacob FalkovichSep 12, 2019, 2:39 PM
18 points
0 comments1 min readLW link

Book Re­view: Be­ing You by Anil Seth

AlexanderOct 26, 2021, 5:44 AM
34 points
23 comments11 min readLW link

It’s Bayes All The Way Up

Scott AlexanderSep 12, 2016, 1:35 PM
34 points
0 comments12 min readLW link

Roll for Sanity

eapacheJul 13, 2020, 4:39 PM
16 points
2 comments4 min readLW link

Learned pain as a lead­ing cause of chronic pain

SoerenMindApr 9, 2025, 11:57 AM
116 points
13 comments9 min readLW link

The Great Annealing

Jacob FalkovichMar 30, 2020, 1:08 AM
79 points
5 comments8 min readLW link

Three char­ac­ter­is­tics: impermanence

Kaj_SotalaJun 5, 2020, 7:48 AM
73 points
4 comments18 min readLW link

Towards an In­ten­tional Re­search Agenda

romeostevensitAug 23, 2019, 5:27 AM
21 points
8 comments3 min readLW link

AXRP Epi­sode 32 - Un­der­stand­ing Agency with Jan Kulveit

DanielFilanMay 30, 2024, 3:50 AM
20 points
0 comments53 min readLW link

AI al­ign­ment as a trans­la­tion problem

Roman LeventovFeb 5, 2024, 2:14 PM
22 points
2 comments3 min readLW link

Refine­ment of Ac­tive In­fer­ence agency ontology

Roman LeventovDec 15, 2023, 9:31 AM
16 points
0 comments5 min readLW link
(arxiv.org)

Seth Ex­plains Consciousness

Jacob FalkovichAug 22, 2023, 6:06 PM
39 points
130 comments14 min readLW link1 review
(putanumonit.com)

Toward A Bayesian The­ory Of Willpower

Scott AlexanderMar 26, 2021, 2:33 AM
104 points
28 comments6 min readLW link

Pre­dic­tive Pro­cess­ing, Hetero­sex­u­al­ity and Delu­sions of Grandeur

lsusrDec 17, 2022, 7:37 AM
37 points
13 comments5 min readLW link

Beyond Re­in­force­ment Learn­ing: Pre­dic­tive Pro­cess­ing and Checksums

lsusrFeb 15, 2023, 7:32 AM
13 points
14 comments3 min readLW link

Con­di­tion­ing Pre­dic­tive Models: Outer al­ign­ment via care­ful conditioning

Feb 2, 2023, 8:28 PM
72 points
15 comments57 min readLW link

Con­di­tion­ing Pre­dic­tive Models: Large lan­guage mod­els as predictors

Feb 2, 2023, 8:28 PM
88 points
4 comments13 min readLW link

A Sim­ple The­ory Of Consciousness

SherlockHolmesAug 8, 2023, 6:05 PM
2 points
5 comments1 min readLW link
(peterholmes.medium.com)

A re­ply to Byrnes on the Free En­ergy Principle

Roman LeventovMar 3, 2023, 1:03 PM
28 points
16 comments14 min readLW link

Ba­sic Math­e­mat­ics of Pre­dic­tive Coding

Adam ShaiSep 29, 2023, 2:38 PM
49 points
6 comments9 min readLW link

Biolog­i­cal Holism: A New Paradigm?

WaddingtonMay 9, 2021, 10:42 PM
4 points
9 comments19 min readLW link

Top Left Mood

Jacob FalkovichJul 24, 2018, 2:35 PM
17 points
2 comments1 min readLW link
(putanumonit.com)

The Apol­lo­nian Gas­ket and AI’s Hid­den Geo­met­ric Structure

LikaMenchMar 7, 2025, 8:06 PM
1 point
0 comments3 min readLW link

A po­ten­tially rele­vant ex­change I had re­cently with ChatGPT 4o

roanFeb 22, 2025, 7:59 AM
1 point
0 comments1 min readLW link

The Medium Is The Bandage

party girlAug 10, 2022, 1:45 AM
11 points
0 comments10 min readLW link

“She Wanted It”

sarahconstantinNov 11, 2018, 10:00 PM
120 points
21 comments7 min readLW link
(srconstantin.wordpress.com)

The Echo Principle

Jonathan MoregårdNov 16, 2022, 8:09 PM
4 points
0 comments3 min readLW link
(honestliving.substack.com)
No comments.