Archimedes comments on Six (and a half) intuitions for KL divergence

[Archimedes]

This video breaks it down nicely along the lines of what you describe as the “common theme”.

https://​​www.youtube.com/​​watch?v=SxGYPqCgJWM