Transcript error fixed—the line that previously read
[Yudkowsky][17:40]
I expect it to go away before the end of days
but with there having been a big architectural innovation, not Stack More Layers
[Christiano][17:40]
if you name 5 possible architectural innovations I can call them small or large
should be
yeah
whereas I expect layer stacking + maybe changing loss (since logprob is too noisy) is sufficient
Transcript error fixed—the line that previously read
[Yudkowsky][17:40]
I expect it to go away before the end of days
but with there having been a big architectural innovation, not Stack More Layers
[Christiano][17:40]
I expect it to go away before the end of days
but with there having been a big architectural innovation, not Stack More Layers
[Yudkowsky][17:40]
if you name 5 possible architectural innovations I can call them small or large
should be
[Yudkowsky][17:40]
I expect it to go away before the end of days
but with there having been a big architectural innovation, not Stack More Layers
[Christiano][17:40]
yeah
whereas I expect layer stacking + maybe changing loss (since logprob is too noisy) is sufficient
[Yudkowsky][17:40]
if you name 5 possible architectural innovations I can call them small or large