Tachikoma

• TachikomaMar 21, 2025, 12:36 AM

  6 points

  0

  in reply to: nielsrolf’s comment on: Why White-Box Redteam­ing Makes Me Feel Weird

  This can apply to humans as well. If you apologize for some terrible thing you did to another person long enough ago that they’ve put it out of their immediate memory, and then apologize at this later time, it can drag up those old memories and wounds. The act of apologizing can be selfish, and cause more harm than the apologizer would intend.

• TachikomaMar 9, 2025, 7:49 AM

  5 points

  2

  in reply to: Sam Marks’s comment on: So how well is Claude play­ing Poké­mon?

  Pokemon is a game literally made to be played and beaten by children. Six years old might be pushing the lower bound, but it didn’t become one of the largest gaming and entertainment franchises in the world by being too difficult to play for children, whom the game is designed for.

  Yes, kids get stuck and they do use extra resources like searching up info on game guides (old man moment, before the internet you had to find a friend who had the physical version and would let you borrow or look at it). But is the ability to search the internet the bottleneck that prevents Claude from getting past Mt. Moon in under 50 hours? That does not seem likely. In fact giving it access to the internet where it can get even more lost with potentially additional useless or irrelevant information could make the problem worse.

• TachikomaNov 20, 2023, 6:14 PM

  10 points

  6

  in reply to: orthonormal’s comment on: OpenAI: Facts from a Weekend

  The important question is, why now? Why with so little evidence to back-up what is such an extreme action?

• TachikomaNov 11, 2023, 8:10 PM

  7 points

  5

  on: It’s OK to be bi­ased to­wards humans

  I’m confused, what about AI art makes it such that humans cannot continue to create art? It seems like the bone to pick isn’t with AIs generating ‘art’ it’s that some artists have historically been able to make a living by creating commercial art, and AI’s being capable of generating commercial art threatens the livelihood of those human artists.

  There is nothing keeping you from continuing to select human generated art, or creating it yourself, even as AI generated art might be chosen by others.

  Just like you should be free to be biased towards human art, I think others should be free to either not be biased or even biased towards AI generated works.

• TachikomaNov 8, 2023, 8:49 PM

  1 point

  0

  on: Con­crete pos­i­tive vi­sions for a fu­ture with­out AGI

  The world population is set to decline over the course of this century. Fewer humans will mean fewer innovations as the world grows greyer, and a smaller workforce must spend more effort and energy taking care of a large elderly population. Additionally, climate change will eat into some other fraction of available resources to simply keep civilization chugging along that could have instead been used for growth. The reason AGI is so important is because it decouples intelligence from human population growth.

• TachikomaNov 3, 2023, 10:45 PM

  4 points

  3

  in reply to: lc’s comment on: The other side of the tidal wave

  How distressed would you be if the “good ending” were opt-in and existed somewhere far away from you? I’ve explored the future and have found one version that I think would satisfy your desire but I’m asking to get your perspective. Does it matter whether there are super-intelligent AIs but they leave our existing civilization alone and create a new one out on the fringes (the Artic, Antarctica or just out in space) and invite any humans to come along to join them without coercion? If you need more details, they’re available at the Opt-In Revolution, in narrative form.

• TachikomaSep 28, 2023, 6:16 PM

  4 points

  2

  on: The King and the Golem

  If they can build the golem once, surely they can build it again. I see no reason why not to order it to destroy itself—not even in an explicit manner but simply by putting it into situations where it faces a decision whether to sacrifice itself to save others, and then watching what decision it makes. And once you know how to build one, you can streamline the process to build many more to gather enough statistical confidence that the golem will, in a variety of situations in- and out-of-context, make decisions that prioritize the well-being of others over itself.

• TachikomaAug 21, 2023, 9:29 PM

  2 points

  1

  on: Steven Wolfram on AI Alignment

  Trying to ‘solve’ ethics by providing a list of features like was done with image recognition algorithms of yore is doomed to failure. Recognizing the right thing to do, just like recognizing a cat, requires learning from millions of different examples encoded in giant inscrutable neural networks.

The Opt-In Revolu­tion — My vi­sion of a pos­i­tive fu­ture with ASI (An ex­per­i­ment with LLM sto­ry­tel­ling)

• TachikomaMar 7, 2023, 3:15 AM

  7 points

  0

  on: Are we too con­fi­dent about un­al­igned AGI kil­ling off hu­man­ity?

  Early rationalist writing on the threats of unaligned AGI emerged out of thinking on GOFAI systems that were supposed to operate on rationalist or logical thought processes. Everything is explicitly coded and transparent. Based on this framework, if an AI system operates on pure logic, then you’d better ensure that you specify a goal that doesn’t leave any loopholes in it. In other words, AI would follow the laws exactly as they were written, not as they were intended by fuzzy human minds or the spirit animating them. Since the early alignment researchers could figure out how to logically specify human values and goals that would parse for a symbolic AI without leaving loopholes large enough to threaten humanity, they grew pessimistic about the whole prospect of alignment. This pessimism has infected the field and remains with us today, even with the rise of deep learning with deep neural networks.

  I will leave you with a quote from Eliezer Yudkowsky which I believe encapsulates this old view of how AI, and alignment, were supposed to work.

  Most of the time, the associational, similarity-based
  architecture of biological neural structures is a terrible
  inconvenience. Human evolution always works with neural
  structures—no other type of computational substrate is
  available—but some computational tasks are so ill-suited to the
  architecture that one must turn incredible hoops to encode them
  neurally. (This is why I tend to be instinctively suspicious of
  someone who says, ‘Let’s solve this problem with a neural net!’
  When the human mind comes up with a solution, it tends to phrase
  it as code, not a neural network. ‘If you really understood the
  problem,’ I think to myself, ‘you wouldn’t be using neural
  nets.’) - Contextualizing seed-AI proposals

• TachikomaFeb 19, 2023, 8:04 PM

  7 points

  5

  on: AGI in sight: our look at the game board

  Why have Self-Driving Vehicle companies made relatively little progress compared to expectations? It seems like autonomous driving in the real world might be nearly AGI-complete, and so it might be a good benchmark to measure AGI progress against. Is the deployment of SDCs being held up to a higher degree of safety than humans holding back progress in the field? Billions have been invested over the past decade across multiple companies with a clear model to operate on. Should we expect to see AGI before SDCs are widely available? I don’t think anyone in the field of autonomous vehicles think they will be widely deployed in difficult terrain or inclement weather conditions in five years.