Ok, I will try to nudge him in the direction of analyzing risk mathematically. If he implements the strategy using python, do you think p-values are a good enough tool to analyze whether his proposed strategy is better than luck, or would I need a more complex framework? (If I understand correctly, the strategy he’s using doesn’t involve any parameters, so the risk of overfitting is low.)
That’s a complex question. A p-value is theoretically useful, but so easy to misuse in this context that I’d advise against it.
Quantitative finance is trickier than the physical sciences for a variety of reasons, such as regime change. If you’re interested in this subject, you may enjoy this thing I wrote about the subject. It doesn’t address your question directly, but it may provide some more general information to better understand the mathematical quirks of this field.
In addition, you may enjoy Skin in the Game by Nassim Taleb. (His other books are relevant to this topic too but Skin in the Game is the book to start with.)
Ok, I will try to nudge him in the direction of analyzing risk mathematically.
If he implements the strategy using python, do you think p-values are a good enough tool to analyze whether his proposed strategy is better than luck, or would I need a more complex framework? (If I understand correctly, the strategy he’s using doesn’t involve any parameters, so the risk of overfitting is low.)
That’s a complex question. A p-value is theoretically useful, but so easy to misuse in this context that I’d advise against it.
Quantitative finance is trickier than the physical sciences for a variety of reasons, such as regime change. If you’re interested in this subject, you may enjoy this thing I wrote about the subject. It doesn’t address your question directly, but it may provide some more general information to better understand the mathematical quirks of this field.
In addition, you may enjoy Skin in the Game by Nassim Taleb. (His other books are relevant to this topic too but Skin in the Game is the book to start with.)