Kallistos

• KallistosMar 23, 2025, 3:50 AM

  1 point

  0

  in reply to: Sergii’s comment on: Any mis­takes in my un­der­stand­ing of Trans­form­ers?

  Many thanks!

• KallistosMar 21, 2025, 4:35 AM

  1 point

  0

  in reply to: mishka’s comment on: Any mis­takes in my un­der­stand­ing of Trans­form­ers?

  Oh, yes you’re right...hmmm. Unsure what to do about that, I’d love a neat graphical solution. Wasn’t quite sure how to represent repeating units without just duplicating subdiagrams!

• KallistosMar 21, 2025, 4:21 AM

  3 points

  0

  in reply to: mishka’s comment on: Any mis­takes in my un­der­stand­ing of Trans­form­ers?

  Many thanks! I have residuals going from before to after the MHA block, and from before to after MLP+FFNN. Should I have others in other places?

  edit: Those links are super!

[Question] Any mis­takes in my un­der­stand­ing of Trans­form­ers?