RSS

Modularity

TagLast edit: Feb 8, 2025, 12:32 AM by lesswrong-internal

Modularity is the extent to which a system can be divided into clusters. It is a very broad concept which can be applied across many different domains, for example:

In graph theory, modularity can be measured in terms of a graph’s structure. For instance, there is a common mathematical definition for graphs, which is based on the idea of modules as partitions of the nodes of a graph, with more edges within modules than would be expected by chance.

In evolutionary biology, modularity has been observed at many different levels, from protein structure to organ systems. There is currently no universally accepted explanation for why modularity seems to have been produced by evolution, and less so by genetic algorithms, although there are widely-held theories (most notably the idea of modularly varying goals, as proposed by Kashtan & Alon).

Modularity may be highly relevant for alignment research, because the more modular a system is, the greater the chances that we will be able to understand the cognition it is performing in terms of high-level abstractions.

LLM Mo­du­lar­ity: The Separa­bil­ity of Ca­pa­bil­ities in Large Lan­guage Models

NickyPMar 26, 2023, 9:57 PM
99 points
3 comments41 min readLW link

Iden­ti­fi­ca­tion of Nat­u­ral Modularity

Stephen FowlerJun 25, 2022, 3:05 PM
15 points
3 comments7 min readLW link

The­o­ries of Mo­du­lar­ity in the Biolog­i­cal Literature

Apr 4, 2022, 12:48 PM
51 points
13 comments7 min readLW link

What Is The True Name of Mo­du­lar­ity?

Jul 1, 2022, 2:55 PM
39 points
10 comments12 min readLW link

Evolu­tion of Modularity

johnswentworthNov 14, 2019, 6:49 AM
185 points
12 comments2 min readLW link1 review

Emer­gent mod­u­lar­ity and safety

Richard_NgoOct 21, 2021, 1:54 AM
31 points
15 comments3 min readLW link

Mo­du­lar­ity, sig­nal­ing, and be­lief in belief

Kaj_SotalaNov 13, 2011, 11:54 AM
29 points
14 comments5 min readLW link

Mo­du­lar­ity and Buzzy

Kaj_SotalaAug 4, 2011, 11:35 AM
34 points
27 comments9 min readLW link

Search­ing for Mo­du­lar­ity in Large Lan­guage Models

Sep 8, 2022, 2:25 AM
44 points
3 comments14 min readLW link

The econ­omy as an anal­ogy for ad­vanced AI systems

Nov 15, 2022, 11:16 AM
28 points
0 comments5 min readLW link

In­ter­nal In­ter­faces Are a High-Pri­or­ity In­ter­pretabil­ity Target

Thane RuthenisDec 29, 2022, 5:49 PM
26 points
6 comments7 min readLW link

Idea: Net­work mod­u­lar­ity and in­ter­pretabil­ity by sex­ual reproduction

qbolecFeb 12, 2023, 11:06 PM
3 points
3 comments1 min readLW link

EIS X: Con­tinual Learn­ing, Mo­du­lar­ity, Com­pres­sion, and Biolog­i­cal Brains

scasperFeb 21, 2023, 4:59 PM
14 points
4 comments3 min readLW link

Statis­tics for vague con­cepts and “Colors” of places

Q HomeAug 19, 2022, 10:33 AM
−1 points
2 comments8 min readLW link

Re­search Adenda: Model­ling Tra­jec­to­ries of Lan­guage Models

NickyPNov 13, 2023, 2:33 PM
28 points
0 comments12 min readLW link

Pro­ject In­tro: Selec­tion The­o­rems for Modularity

Apr 4, 2022, 12:59 PM
73 points
20 comments16 min readLW link

Ten ex­per­i­ments in mod­u­lar­ity, which we’d like you to run!

Jun 16, 2022, 9:17 AM
62 points
3 comments9 min readLW link

Selec­tion pro­cesses for subagents

Ryan KiddJun 30, 2022, 11:57 PM
36 points
2 comments9 min readLW link

Mo­du­lar­ity and as­sem­bly: AI safety via think­ing smaller

D WongFeb 20, 2025, 12:58 AM
2 points
0 comments11 min readLW link
(criticalreason.substack.com)

Basin broad­ness de­pends on the size and num­ber of or­thog­o­nal features

Aug 27, 2022, 5:29 PM
36 points
21 comments6 min readLW link
No comments.