It would be a good idea to just look at what existing LLM writing services like Sudowrite or NovelAI do offer now. ChatGPT/Claude-3 may be the most convenient & powerful LLMs to use, but they are obviously not going to be the best for writing: their interfaces are simple and not the focus of their companies, and the RHLF/assistant-tuning devastates their creative writing ability.
I’d mention my Nenex. A good phrase here is “Photoshop for text”: https://interconnected.org/home/2024/05/31/camera
It would be a good idea to just look at what existing LLM writing services like Sudowrite or NovelAI do offer now. ChatGPT/Claude-3 may be the most convenient & powerful LLMs to use, but they are obviously not going to be the best for writing: their interfaces are simple and not the focus of their companies, and the RHLF/assistant-tuning devastates their creative writing ability.