Hey, we’ve been brainstorm ideas about better training strategies for base models and what types of experiments we can run at a small scale (e.g. training gpt-2 ) to get initial information. I think this idea is really promising and would love to chat about it.
Mike Vaiana
Karma: 310
Thanks for the interest! We are actively pursuing follow up work with AST inspired approaches to cooperation.