How would a military which is increasingly run by AI factor into these scenarios? It seems most similar to organizational safety a la google building software with SWEs but the disanalogy might be that the AI is explicitly supposed to take over some part of the world and maybe it interpreted a command incorrectly. Or does this article only consider the AI taking over because it wanted to take over?
Steven
Karma: 31
Huh, did you experience any side effects?
I think discernment is not essential to entertainment. If people really want to learn what a slightly off piano sounds like and also pay for expert piano tuning, then that’s fine, but I don’t think people should be looked down upon for not having that level of discernment.
How would the agent represent non-coherent others? Like humans don’t have entirely coherent goals and in cases where the agent learns that it may satisfy one or another goal, how would it select which goal to choose? Take a human attempting to lose weight, with goals to eat to satisfaction and to not eat. Would the agent give the human food or withhold it?
One thing I find weird is that most of these objects of payment are correlated. The best paying jobs also have the best peers also have the most autonomy also have the most fun. Low paid jobs were mostly drudgery along all axes in my experience
Thanks for the summary. Why should this be true?
The fact that sympathy for hedonic utilitarianism is strongly correlated with intelligence is a somewhat worrying datapoint in favor of the plausibility of squiggle-maximizers.
Embracing positive sensory experience due to higher human levels of intelligence implies a linearity that I don’t think is true among other animals. Are chimps more hedonic utilitarian than ants than bacteria? Human intelligence is too narrow for this to be evidence of what something much smarter would do
Thank you for writing this. My girlfriend and I would like kids, but I generally try not to bring AI up around her. She got very anxious while listening to an 80k hours podcast on AI and it seemed generally bad for her. I don’t think any of my work will end up making an impact on AI, so I think basically the CS Lewis quote applies. Even if you know the game you’re playing is likely to end, there isn’t anything to do since there are no valid moves if the new game actually starts.
I did want to ask, how did you think about putting your children in school? Did you send them to a public school?
What does impossible mean in the context of clock neurons?
impossible in the first few moves.
What causes them to be unable to fire?
Q. What is generalization really for? What does it offer you?
Based on the vibe of the post, it seems like you’re trying to point at the concept of “being able to do many things”. I guess generalization isn’t ‘for’ anything, it’s a concept. For an agent, generalization is a method of being able to achieve an outcome based on limited past experience without needing to waste resources figuring out strategies it could have made if only it could generalize better. I can’t really tell based on what you said what I’m supposed to answer with “What does it offer you?”. Like, generalization offers me the ability to recognize bad chess moves in new scenarios that I haven’t seen, or it offers me the ability to take over the universe based on limited knowledge of physics. I don’t know where you’re trying to limit the word
I would add “finish it”. Many projects don’t actually get finished, you skip the last working set etc etc
I think this is in tension with the idea that green can be conservation of what he was talking about where spirituality is the idea of facing the other. That means that cutting down a redwood cuts away the other and the awe that you would feel in favor of your own power. Green isn’t a Buddhist view of the world, it’s the idea that there is a boundary between you and other and the other is worth regarding
I have to say that this is the first essay in a long time that I read in its entirety. I really like a defense of green, since I remember talking a while ago with friends about how green couldn’t possibly be a real personality type. Surely it was just a way to be black. I think that this was a good point, especially at the end of the appendix where all of our desires come from nature, so in a sense we can’t help but be green. I do think of green as being more about equilibrium in the current state of nature while the uglier parts of nature tend to be ignored. For example, death in a green mindset looks more like peacefully passing away in ones sleep while death in a black mindset looks like very slow decay. I think basically every color can be said to exist in nature, it’s more about ones reaction to that fact that determines the color.
Super good essay, I’m glad you wrote it!
Do you have an example of a HHH dataset available on the internet, or what a few examples of what those look like?
This made me think of Carmack’s integral of value over time vs maximal value. Oftentimes, we are LARPing because LARPing is a lot easier and faster than, as you say, debug until you know exactly what went wrong. When a program crashes, you’ll get a ton of logging information, but it’s often easier to just add retries and move on. If you’re working under deadlines, you know that, in some sense, the quicker fix where you’re bumping around in the dark will work and might be just as good as the slower fix of truly understanding the reason for a crash.
This is much less helpful for your own personal understanding, but often what you are delivering is a project, not an increase in understanding. When you want to stop LARPing, you have to go very slowly, and you don’t really have time to not LARP in most areas of life. This has the bad effect of making my own personal understanding of many subjects much more shallow than I would like, but it lets me deliver projects, which is net better for my company than deeply understanding software internals. In terms of things that I am trying to deeply learn, there are really only a few areas at a time that I can actually take a shot of understanding, and I have to be sure that I actually want to understand those areas.
I found this post helpful for clarifying the concept of LARPing, in the sense of technical subjects.
Hey everyone, air quality is looking pretty bad right now, it gives me a headache to be outside. We could go somewhere else, or hold off until it’s a bit colder so there are fewer fires, but I don’t want to go to a park today.
Sorry, I realized I’m out of town this Friday, so bumped it by a week
SSC Reno Meetup
It was great meeting everyone! I only got a few people’s emails, but I could hold more events like these so feel free to reach out at the contact address above if you want me to let you know when I do. Suggestions about how to make the event better would also be nice and very much appreciated
I meant EAST end, not west end
I think you’re pretty severely mistaken about bullshit jobs. You said
But there are many counter examples of this not being a real concept. See here for many of them: https://www.thediff.co/archive/bullshit-jobs-is-a-terrible-curiosity-killing-concept/