Sophie Y

• Sophie Y 30 May 2023 3:08 UTC

  1 point

  0

  on: How does GPT-3 spend its 175B pa­ram­e­ters?

  The architecture shown for “Not in GPT” seems to be wrong? GPT is decoder only. The part labeled as “Not in GPT” is decoder part.