One of the major, surprising consequences of this is that it’s likely to become infeasible to develop software in secret. If AI tools like this confer a large advantage, and the tools are exclusively cloud hosted, then maintaining the confidentiality of a code base will mean forgoing these tools, and if the impact of these tools is large enough, then forgoing them may not be feasible.
On the plus side, this will put malware developers at something of a disadvantage. It might increase the feasibility of preventing people from running dangerous AI experiments (which sure seem like they’re getting closer by the day). On the minus side, this creates an additional path to internet takeover, and increases centralization of power in general.
One of the major, surprising consequences of this is that it’s likely to become infeasible to develop software in secret.
Or maybe developers will find good ways of hacking value out of cloud hosted AI systems while keeping their actual code base secret. e.g. maybe you have a parallel code base that is developed in public, and a way of translating code-gen outputs there into something useful for your actual secret code base.
One of the major, surprising consequences of this is that it’s likely to become infeasible to develop software in secret. If AI tools like this confer a large advantage, and the tools are exclusively cloud hosted, then maintaining the confidentiality of a code base will mean forgoing these tools, and if the impact of these tools is large enough, then forgoing them may not be feasible.
On the plus side, this will put malware developers at something of a disadvantage. It might increase the feasibility of preventing people from running dangerous AI experiments (which sure seem like they’re getting closer by the day). On the minus side, this creates an additional path to internet takeover, and increases centralization of power in general.
surely private installations of the facility will be sold to trade-secret-protecting teams
I wonder how much closed-source software is hosted on non-public GH repos? GH Enterprise exists, and seems widely-used.
Or maybe developers will find good ways of hacking value out of cloud hosted AI systems while keeping their actual code base secret. e.g. maybe you have a parallel code base that is developed in public, and a way of translating code-gen outputs there into something useful for your actual secret code base.