I like this leetcode style aspect of the idea. Maybe if you identify the “Blind 75” of cognitive biases, that might be a good start. Or take practice problems from this course: https://callingbullshit.org/. Maybe if you identify which problems you want to train on, you can use an LLM to continuously rewrite them to prevent users from simply memorizing an answer and force them to think critically. There’s several ways to implement this sort of thing and I can easily imagine the high school version of myself falling down this rabbit hole.
Not to self promote too much, but I created a demo of a similarly inspired idea that I call newsbetting at https://www.rashomonnews.com. The idea was to use betting mechanisms to create skin in the game and help news consumers identify their own biases when reading the news. Maybe you can include this betting mechanism as a proxy for your confidence interval.
Regardless, I would very much like to see the outcome of this sort of project and I wish you the best!
I like this leetcode style aspect of the idea. Maybe if you identify the “Blind 75” of cognitive biases, that might be a good start. Or take practice problems from this course: https://callingbullshit.org/. Maybe if you identify which problems you want to train on, you can use an LLM to continuously rewrite them to prevent users from simply memorizing an answer and force them to think critically. There’s several ways to implement this sort of thing and I can easily imagine the high school version of myself falling down this rabbit hole.
Not to self promote too much, but I created a demo of a similarly inspired idea that I call newsbetting at https://www.rashomonnews.com. The idea was to use betting mechanisms to create skin in the game and help news consumers identify their own biases when reading the news. Maybe you can include this betting mechanism as a proxy for your confidence interval.
Regardless, I would very much like to see the outcome of this sort of project and I wish you the best!