Some of the problems you mentioned could be solved by creating a wrapper around the AI.
Technologically that feels like taking a step back—instead of throwing everything at the AI and magically getting an answer, it means designing a (very high-level) algorithm. But yeah, taking a step technologically is the usual response to dealing with limited resources.
For example, after each session, the algorithm could ask the AI to write a short summary. You could send the summary to the AI at the beginning of the new session, so it would kinda remember what happened recently, but also have enough short-term left for today.
Or in a separate chat, you could send the summaries of all previous sessions, and ask the AI to make some observations. Those would be then delivered to the main AI.
Timing could be solved by making the wrapper send a message automatically each 20 seconds, something like “M minutes and S seconds have passed since the last user input”. The AI would be instructed to respond with “WAIT” if it chooses to wait a little longer, and a text if it wants to say something.
Some of the problems you mentioned could be solved by creating a wrapper around the AI.
Technologically that feels like taking a step back—instead of throwing everything at the AI and magically getting an answer, it means designing a (very high-level) algorithm. But yeah, taking a step technologically is the usual response to dealing with limited resources.
For example, after each session, the algorithm could ask the AI to write a short summary. You could send the summary to the AI at the beginning of the new session, so it would kinda remember what happened recently, but also have enough short-term left for today.
Or in a separate chat, you could send the summaries of all previous sessions, and ask the AI to make some observations. Those would be then delivered to the main AI.
Timing could be solved by making the wrapper send a message automatically each 20 seconds, something like “M minutes and S seconds have passed since the last user input”. The AI would be instructed to respond with “WAIT” if it chooses to wait a little longer, and a text if it wants to say something.