When the Seagulls Cry by Ryukishi 07 is practically Online Algorithms: The Visual Novel, or even Infrabayesianism: The Visual Novel. I find it hard to recommend though, because while the concept is interesting and the mysteries good, the writing is overlong and the worldbuilding cringe. (Or maybe i just hate VNs as a medium).
Minor spoilers (explaining the story’s premise):
The main meta-story is a murder mystery game for two players: the “detective” and the “witch” who presents clues and insults the detective’s intelligence by presenting him elaborate “supernatural” non-explanations. (The last part is not in the rules, but it’s traditional.) The main plot point in that story is that as the witch player begins to lose, she starts cheating, retroactively changing the mystery solution, constrained only by the facts presented to the detective. Soon it becomes apparent that cheating is in fact expected, and the detective has to brute-force all solutions Absurdle-style.
Major spoilers (for ongoing rationalist drama): Grokking the ontology presented in Seagulls led me to understand how people may become Zizians.
See also Gwern’s more spoilerrific review.
I discovered John C Wright’s Golden Age trilogy thanks to one Eliezer Yudkowsky, who mentioned it multiple times in his notorious Sequences. By the end of the first book i was expecting something very much in the deception genre you’ve mentioned — a tragic psychological horror about an unreliable narrator being gaslit about the nature of reality. This is a genre i really enjoy, and i kind of hoped for a novel-length version of Scott Alexander’s The Last Temptation of Christ.
I did not get that, the trilogy goes in a wildly different direction. But saying whether for better or for worse — heck, even saying if it’s a good or bad book — would constitute massive SPOILERS for anyone who discovered this book through Yudkowsky. (If you know why he dropped it, it should be obvious).
I kept hate-reading it.