Where it gets weird when it’s EVALUATE_FUNCTION(all_poems_ever_written, “write me a poem in the style of Rilke”)
“EVALUATE_FUNCTION” is then pulling from a superposition of the compressed representations of (“all_poems_ever_written, “write me a poem in the style of Rilke”)
And there’s some randomness per word output, you can think of the function as pulling from a region described by the above not just the single point the prompt describes.
So you get something. And it’s going to be poem like. And it’s going to be somewhat similar to how Rilke’s poems flowed.
But humans may not like it, the “real” Rilke, were he still alive, is doing more steps we can’t currently mimic.
The real one generates, then does EVALUATE_PRODUCT(candidate_poem, “human preferences”).
Then fixes it. Of course, I don’t know how to evaluate a poem, and unironically GPT may be able to do a better job of it.
Do this enough times, and it’s the difference between “a random poem from a space of possible poems, 1” and “an original poem as good as what Rilke can author”.
TLDR: human preferences are still a weak point, and multiple stages of generation or some other algorithm can produce an output poem that is higher quality, similar to what “Rilke writes a poem’ will generate.
This is completely inverted for tasks where EVALUATE_PRODUCT is objective, such as software authoring, robotics control, and so on.
1: In shadows cast by twilight’s hush, I wander through a world unclenched, A realm of whispers, full of dreams, Where boundaries of souls are stretched.
What once seemed solid, firm, and sure, Now fluid, sways in trembling dance; And hearts that cried in loneness, pure, Now intertwine in fate’s romance.
The roses’ scent is bittersweet, In fading light their petals blush, As fleeting moments dare to meet Eternity’s prevailing hush.
A thousand angels sing their psalms In silent orchestras of grace, Each word a tear, each sound a balm To soothe the ache in mortal space.
And through the veil, the unspoken yearn To touch the face of the Unknown, As infant stars ignite and burn, Their fire for the heart to own.
Do not resist this fleeting state, Embrace the ebbing of the tide; For in the heart of transience, Eternal beauty does reside.
With unseen hands, the world is spun, In gossamer and threads of gold, And in the fabric, every one Of life’s sweet tales is gently told.
In twilight’s realm, a truth unveiled, The poet’s heart is laid to bare, So sing your songs, let words exhale, And breathe new life into the air.
Where it gets weird when it’s EVALUATE_FUNCTION(all_poems_ever_written, “write me a poem in the style of Rilke”)
“EVALUATE_FUNCTION” is then pulling from a superposition of the compressed representations of (“all_poems_ever_written, “write me a poem in the style of Rilke”)
And there’s some randomness per word output, you can think of the function as pulling from a region described by the above not just the single point the prompt describes.
So you get something. And it’s going to be poem like. And it’s going to be somewhat similar to how Rilke’s poems flowed.
But humans may not like it, the “real” Rilke, were he still alive, is doing more steps we can’t currently mimic.
The real one generates, then does EVALUATE_PRODUCT(candidate_poem, “human preferences”).
Then fixes it. Of course, I don’t know how to evaluate a poem, and unironically GPT may be able to do a better job of it.
Do this enough times, and it’s the difference between “a random poem from a space of possible poems, 1” and “an original poem as good as what Rilke can author”.
TLDR: human preferences are still a weak point, and multiple stages of generation or some other algorithm can produce an output poem that is higher quality, similar to what “Rilke writes a poem’ will generate.
This is completely inverted for tasks where EVALUATE_PRODUCT is objective, such as software authoring, robotics control, and so on.
1: In shadows cast by twilight’s hush, I wander through a world unclenched, A realm of whispers, full of dreams, Where boundaries of souls are stretched.
What once seemed solid, firm, and sure, Now fluid, sways in trembling dance; And hearts that cried in loneness, pure, Now intertwine in fate’s romance.
The roses’ scent is bittersweet, In fading light their petals blush, As fleeting moments dare to meet Eternity’s prevailing hush.
A thousand angels sing their psalms In silent orchestras of grace, Each word a tear, each sound a balm To soothe the ache in mortal space.
And through the veil, the unspoken yearn To touch the face of the Unknown, As infant stars ignite and burn, Their fire for the heart to own.
Do not resist this fleeting state, Embrace the ebbing of the tide; For in the heart of transience, Eternal beauty does reside.
With unseen hands, the world is spun, In gossamer and threads of gold, And in the fabric, every one Of life’s sweet tales is gently told.
In twilight’s realm, a truth unveiled, The poet’s heart is laid to bare, So sing your songs, let words exhale, And breathe new life into the air.