Karthik Viswanathan

Karma: 19

I am a final-year PhD student at the University of Amsterdam in the Institute of Physics, working on interpretability in LLMs, with additional interests in applied topology and cosmology.
Personal website—https://karthikviswanathn.github.io/

Towards Understanding the Representation of Belief State Geometry in Transformers

Karthik ViswanathanApr 18, 2025, 12:39 PM

3 points

0 comments12 min readLW link

The REPHRASE Circuit: How Fine-Tuning Enhances LLMs to REPHRASE Text

Karthik ViswanathanApr 6, 2025, 3:02 PM

4 points

0 comments5 min readLW link

Workshop: Interpretability in LLMs using Geometric and Statistical Methods

Karthik ViswanathanFeb 22, 2025, 9:39 AM

17 points

0 comments8 min readLW link

Intrinsic Dimension of Prompts in LLMs

Karthik ViswanathanFeb 14, 2025, 7:02 PM

3 points

0 comments4 min readLW link

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer

Karthik Viswanathan

Towards Un­der­stand­ing the Rep­re­sen­ta­tion of Belief State Geom­e­try in Transformers

The REPHRASE Cir­cuit: How Fine-Tun­ing En­hances LLMs to REPHRASE Text

Work­shop: In­ter­pretabil­ity in LLMs us­ing Geo­met­ric and Statis­ti­cal Methods

In­trin­sic Di­men­sion of Prompts in LLMs

Towards Understanding the Representation of Belief State Geometry in Transformers

The REPHRASE Circuit: How Fine-Tuning Enhances LLMs to REPHRASE Text

Workshop: Interpretability in LLMs using Geometric and Statistical Methods

Intrinsic Dimension of Prompts in LLMs