Latency issues might make this too expensive in practice for chat-like systems, but I’m not sure. Also, chat-like systems might be a lower fraction of AI usage in the future in which case latency is less of an issue.
Latency issues might make this too expensive in practice for chat-like systems, but I’m not sure. Also, chat-like systems might be a lower fraction of AI usage in the future in which case latency is less of an issue.