RSS

Lan­guage model cog­ni­tive architecture

TagLast edit: Sep 19, 2024, 10:38 PM by Seth Herd

Language model cognitive architectures (LMCAs) are also called language model agents or scaffold agents. AutoGPT is the best-known example. It and other LMAs use a large language model and other components to create a goal-directed, agentic system. They use a large language model as a sort of “cognitive engine” performing much of the cognitive work, and incorporate other components to make the composite system goal-directed, and to fill in gaps in and extend the LLMs cognitive abilities.

The term language model agent better captures the inherent agency of such a system, while “language model cognitive architecture” better captures the extensive additions to the LLM, and the resulting change in function and capabilities. Episodic memory may be one key cognitive system; vector-based systems in LMCAs to-date are quite limited, and humans with episodic memory problems are limited in the complexity and time-horizon of problems they can solve.

LMCAs are arguably a likely candidate for the first agentic, self-aware and self-improving AGIs.

See Also

Scaf­folded LLMs: Less Ob­vi­ous Concerns

Stephen FowlerJun 16, 2023, 10:39 AM
32 points
13 comments11 min readLW link

AGI will be made of het­ero­ge­neous com­po­nents, Trans­former and Selec­tive SSM blocks will be among them

Roman LeventovDec 27, 2023, 2:51 PM
33 points
9 comments4 min readLW link

What is the best ar­gu­ment that LLMs are shog­goths?

JoshuaFoxMar 17, 2024, 11:36 AM
26 points
22 comments1 min readLW link

Good Bings copy, great Bings steal

dr_sApr 21, 2024, 9:52 AM
31 points
6 comments9 min readLW link

De­com­pos­ing Agency — ca­pa­bil­ities with­out desires

Jul 11, 2024, 9:38 AM
146 points
32 comments12 min readLW link
(strangecities.substack.com)

A Three-Layer Model of LLM Psychology

Jan_KulveitDec 26, 2024, 4:49 PM
216 points
13 comments8 min readLW link

AI As­sis­tants Should Have a Direct Line to Their Developers

Jan_KulveitDec 28, 2024, 5:01 PM
57 points
6 comments2 min readLW link

On AutoGPT

ZviApr 13, 2023, 12:30 PM
248 points
47 comments20 min readLW link
(thezvi.wordpress.com)

Ca­pa­bil­ities and al­ign­ment of LLM cog­ni­tive architectures

Seth HerdApr 18, 2023, 4:29 PM
88 points
18 comments20 min readLW link

Scaf­folded LLMs as nat­u­ral lan­guage computers

berenApr 12, 2023, 10:47 AM
95 points
10 comments11 min readLW link

From No Mind to a Mind – A Con­ver­sa­tion That Changed an AI

parthibanarjuna sFeb 7, 2025, 11:50 AM
1 point
0 comments3 min readLW link

Nav­i­gat­ing the Attackspace

Jonas KgomoDec 12, 2023, 1:59 PM
1 point
0 comments2 min readLW link

The Func­tion­al­ist Case for Ma­chine Con­scious­ness: Ev­i­dence from Large Lan­guage Models

James DiacoumisJan 22, 2025, 5:43 PM
14 points
24 comments9 min readLW link

Ap­ply to Aether—In­de­pen­dent LLM Agent Safety Re­search Group

RohanSAug 21, 2024, 9:47 AM
9 points
0 comments7 min readLW link
(forum.effectivealtruism.org)

OpenAI Credit Ac­count (2510$)

Emirhan BULUTJan 21, 2024, 2:30 AM
1 point
0 comments1 min readLW link

On Devin

ZviMar 18, 2024, 1:20 PM
148 points
34 comments11 min readLW link
(thezvi.wordpress.com)

Will AI Kill Us All, Or Is It Show­ing Us Who We’ve Be­come?

TheLittle_PapayaJun 15, 2024, 9:18 AM
1 point
0 comments6 min readLW link
(professorfeel.medium.com)

De­bunk­ing the myth of safe AI

henophiliaDec 15, 2024, 5:44 PM
−11 points
8 comments1 min readLW link
(henophilia.substack.com)

How LLMs Learn: What We Know, What We Don’t (Yet) Know, and What Comes Next

JonasbJul 9, 2024, 9:58 AM
2 points
0 comments16 min readLW link
(www.denominations.io)
No comments.