I agree that language models like GPT-3 can be helpful in many of these ways—and the prompt you link to is great.
However, the OpenAI playground is a terrible “Tool for Thought” from a UX perspective.
Is there any great local (or web) app for exploring/learning with language models? (Or even just for GPT-3?) I’m thinking something that you add your API keys, and it has a pleasant interface for writing prompts, seeing results and storing all the outputs for your reference. Maybe integrating with more general tools for thought.
Some of the GPT-for-fiction-writing sites, e.g. WriteHolo, at least offer tools for saving and organizing the outputs. (Though WriteHolo uses GPT-J rather than GPT-3 and hasn’t been trained to respond to queries directly the way that GPT-3′s InstructGPT version has, so it may require more creative prompt engineering.)
I tried WriteHolo against an idea I had for a blog post and its recommendations were worse than useless. I think for non-fiction writing it’s probably a non-starter. It couldn’t even give me a concise summary of something readily available on Wikipedia (e.g. the availability heuristic), much less suggest creative connections that are at all coherent.
The default free model is GPT-J and pretty bad at doing anything nonfiction. The GPT-20B model on the 11.99 plan is a lot bigger & better for this purpose, but its intended purpose in that vein is generally expected to be “trying to drill out copy or do homework assignments”. Using OpenAI’s models would help fix that but I will literally never give OpenAI money for anything.
I think we might create a trial for the larger EleutherAI model at some point, but we stopped actively iterating on WriteHolo a while back and it’s currently just something we’re maintain for fun.
Tbh it’s quite a trip seeing others recommend it to people on LW.
Having seen anything good yet. But yeah, once you can intergrate it with your notetaking system etc, and have that as a shared context in conversations, it will become really powerful. Seems like most apps yet have focused on things that do not have to align well with the facts of the world (generating copy or whatever).
I agree that language models like GPT-3 can be helpful in many of these ways—and the prompt you link to is great.
However, the OpenAI playground is a terrible “Tool for Thought” from a UX perspective.
Is there any great local (or web) app for exploring/learning with language models? (Or even just for GPT-3?) I’m thinking something that you add your API keys, and it has a pleasant interface for writing prompts, seeing results and storing all the outputs for your reference. Maybe integrating with more general tools for thought.
This is what I’ve found so far that attempts to let you play with GPT-3 and other language models locally, none of which seem mature.
- https://github.com/pratos/gpt3-exp
- https://github.com/thesephist/calamity
- https://prompts.ai
Is there anything better out there that I’ve missed?
Some of the GPT-for-fiction-writing sites, e.g. WriteHolo, at least offer tools for saving and organizing the outputs. (Though WriteHolo uses GPT-J rather than GPT-3 and hasn’t been trained to respond to queries directly the way that GPT-3′s InstructGPT version has, so it may require more creative prompt engineering.)
I tried WriteHolo against an idea I had for a blog post and its recommendations were worse than useless. I think for non-fiction writing it’s probably a non-starter. It couldn’t even give me a concise summary of something readily available on Wikipedia (e.g. the availability heuristic), much less suggest creative connections that are at all coherent.
Disclaimer: I made WriteHolo w/ a friend
The default free model is GPT-J and pretty bad at doing anything nonfiction. The GPT-20B model on the 11.99 plan is a lot bigger & better for this purpose, but its intended purpose in that vein is generally expected to be “trying to drill out copy or do homework assignments”. Using OpenAI’s models would help fix that but I will literally never give OpenAI money for anything.
I think we might create a trial for the larger EleutherAI model at some point, but we stopped actively iterating on WriteHolo a while back and it’s currently just something we’re maintain for fun.
Tbh it’s quite a trip seeing others recommend it to people on LW.
It’s very cool, especially as a side project. If I’d known it was created by someone here I would have been more careful about the tone of my comment.
Lol you’re fine
Having seen anything good yet. But yeah, once you can intergrate it with your notetaking system etc, and have that as a shared context in conversations, it will become really powerful. Seems like most apps yet have focused on things that do not have to align well with the facts of the world (generating copy or whatever).