I went back and forth on whether I should include that bit for exactly that reason. Knowing something is possible is half the battle and such. I ended up settling on a rough rule for whether I could include something:
It is trivial, or
it is already covered elsewhere, that coverage goes into more detail, and the audience of that coverage is vastly larger than my own post’s reach.
The more potentially dangerous an idea is, the stronger the requirements are.
Something like “single token prediction runs in constant time” falls into 1, while this fell in 2. There is technically nonzero added risk, but given the context and the lack of details, the risk seemed very small to the point of being okay to allude to as a discussion point.
I went back and forth on whether I should include that bit for exactly that reason. Knowing something is possible is half the battle and such. I ended up settling on a rough rule for whether I could include something:
It is trivial, or
it is already covered elsewhere, that coverage goes into more detail, and the audience of that coverage is vastly larger than my own post’s reach.
The more potentially dangerous an idea is, the stronger the requirements are.
Something like “single token prediction runs in constant time” falls into 1, while this fell in 2. There is technically nonzero added risk, but given the context and the lack of details, the risk seemed very small to the point of being okay to allude to as a discussion point.