A popular example that springs to mind is the results of an AI algorithm designed by a military research agency. From memory their task was to take a simplified simulation of naval warfare, with specifications for how much each aspect of ships, boats and weaponry cost and a budget. They were to use this to design the optimal fleet given their resources and the task was undertaken by military officers and a group which use an AI algorithm of some sort. The result was that the AI won easily but did so in a way that led the overseers to dismiss them as a failure because they optimised the problem specification as given, not the one ‘common sense’ led the humans to optimise.
Is this a reference to Eurisko winning the Traveller Trillion Credit Squadron tournament in 1981⁄82 ? If so I don’t think it was a military research agency.
(Sorry, didn’t see comment below) (Nitpick)
Is this a reference to Eurisko winning the Traveller Trillion Credit Squadron tournament in 1981⁄82 ? If so I don’t think it was a military research agency.