Lack of publicly reporting null results was a subtle but huge problem in cognitive neuroscience. It took a while to figure out just how much effort was being wasted running studies that others had already tried and not reported because results were null.
Alignment doesn’t have the same journal gatekeeping system that filters out null results, but there’s probably a pretty strong tendency to report less on lack of progress than actual progress.
So post about it if you worked hard at something and got nowhere. This is valuable information when others choose their problems and approaches.
I do see people doing this; it would probably be valuable if we did it more.
Definitely.
Lack of publicly reporting null results was a subtle but huge problem in cognitive neuroscience. It took a while to figure out just how much effort was being wasted running studies that others had already tried and not reported because results were null.
Alignment doesn’t have the same journal gatekeeping system that filters out null results, but there’s probably a pretty strong tendency to report less on lack of progress than actual progress.
So post about it if you worked hard at something and got nowhere. This is valuable information when others choose their problems and approaches.
I do see people doing this; it would probably be valuable if we did it more.