How could we do this? It seems to me that even if you were trying hard to avoid it, you’d have a very hard time not biasing your search in favour of examples that suited what you wanted to prove. Is there some external source of examples you could lean on that would unbias your survey, the way that people publish search terms in public databases when doing surveys of scientific consensus?
This is an issue with data collection on any interesting topic. It doesn’t prevent such efforts from being useful. You choose a criteria and collect data that way, others who think your criteria off complain and choose a subset of your data to see if that makes a difference, or go collect more data according to criteria they prefer.
How could we do this? It seems to me that even if you were trying hard to avoid it, you’d have a very hard time not biasing your search in favour of examples that suited what you wanted to prove. Is there some external source of examples you could lean on that would unbias your survey, the way that people publish search terms in public databases when doing surveys of scientific consensus?
This is an issue with data collection on any interesting topic. It doesn’t prevent such efforts from being useful. You choose a criteria and collect data that way, others who think your criteria off complain and choose a subset of your data to see if that makes a difference, or go collect more data according to criteria they prefer.
How would you start on a project like this? Serious, not rhetorical question.