Bartlomiej Lewandowski

[Question] SOLAR model pa­per questions

• Bartlomiej LewandowskiMar 29, 2023, 1:28 PM

  2 points

  1

  on: Why no ma­jor LLMs with mem­ory?

  I think there has been a lot of research in the past in this space. The first thing that popped into my mind was https://​​huggingface.co/​​docs/​​transformers/​​model_doc/​​rag

  Currently, there are some approaches using langchain to persist the history of a conversation into an embeddings database, and retrieve the relevant parts performing a similar query /​ task.

• Bartlomiej LewandowskiMar 14, 2023, 10:48 PM

  3 points

  1

  on: GPT can write Quines now (GPT-4)

  OpenAI has hired a lot of software engineers to code simple tasks, maybe these quines were a part of the fine tuning set?

• Bartlomiej LewandowskiDec 9, 2021, 4:54 AM

  2 points

  on: Deep­mind’s Go­pher—more pow­er­ful than GPT-3

  How is retro different from https://​​ai.facebook.com/​​blog/​​retrieval-augmented-generation-streamlining-the-creation-of-intelligent-natural-language-processing-models/​​ ?

• Bartlomiej LewandowskiJul 18, 2021, 11:19 AM

  1 point

  on: A closer look at chess scal­ings (into the past)

  Isn’t ELO a reference metric that changes with time? I would assume that 2800 ELO in the 90s is a different level to today’s 2800. Can we still make the same conclusions with that in mind?