You mentioned Mixture of Experts. That’s interesting. I’m not an expert in this area. I speculate that in an architecture similar to MoE, when one expert is working, the others are idle. In this way, we don’t need to run all the experts simultaneously, which indeed saves computation, but it doesn’t save memory. However, if an expert is shared among different tasks, when it’s not needed for one task, it can handle other tasks, so it can stay busy all the time.
The key point here is the independence of the experts, including what you mentioned, that each expert has an independent self-cognition. A possible bad scenario is that although there are many experts, they all passively follow the commands of a Leader AI. In this case, the AI team is essentially no different from a single superintelligence. Extra efforts are indeed needed to achieve this independence. Thank you for pointing this out!
I agree, it takes extra effort to make the AI behave like a team of experts.
Thank you :)
Good luck on sharing your ideas. If things aren’t working out, try changing strategies. Maybe instead of giving people a 100 page paper, tell them the idea you think is “the best,” and focus on that one idea. Add a little note at the end “by the way, if you want to see many other ideas from me, I have a 100 page paper here.”
Maybe even think of different ideas.
I cannot tell you which way is better, just keep trying different things. I don’t know what is right because I’m also having trouble sharing my ideas.
You mentioned Mixture of Experts. That’s interesting. I’m not an expert in this area. I speculate that in an architecture similar to MoE, when one expert is working, the others are idle. In this way, we don’t need to run all the experts simultaneously, which indeed saves computation, but it doesn’t save memory. However, if an expert is shared among different tasks, when it’s not needed for one task, it can handle other tasks, so it can stay busy all the time.
The key point here is the independence of the experts, including what you mentioned, that each expert has an independent self-cognition. A possible bad scenario is that although there are many experts, they all passively follow the commands of a Leader AI. In this case, the AI team is essentially no different from a single superintelligence. Extra efforts are indeed needed to achieve this independence. Thank you for pointing this out!
Happy holidays, too!
I agree, it takes extra effort to make the AI behave like a team of experts.
Thank you :)
Good luck on sharing your ideas. If things aren’t working out, try changing strategies. Maybe instead of giving people a 100 page paper, tell them the idea you think is “the best,” and focus on that one idea. Add a little note at the end “by the way, if you want to see many other ideas from me, I have a 100 page paper here.”
Maybe even think of different ideas.
I cannot tell you which way is better, just keep trying different things. I don’t know what is right because I’m also having trouble sharing my ideas.