Marius Adrian Nicoară

Satire: Sam Alt­man get’s grilled by the Fi­nan­cial Times for his kitchen and his cook­ing skills

• Marius Adrian NicoarăMay 13, 2025, 8:02 AM

  1 point

  0

  in reply to: Matrice Jacobine’s comment on: Ab­solute Zero: Re­in­forced Self-play Rea­son­ing with Zero Data

  I think editing should be possible. Not sure about deleting it entirely.

• Marius Adrian NicoarăMay 12, 2025, 6:42 PM

  3 points

  0

  on: Ab­solute Zero: Alpha Zero for LLM

  I think that from an AI Alignment perspective, giving AI so much control over its training seems to be very problematic. What we are mostly left with is to control the interface that AI has to physical reality i.e. sensors and actuators.

  For now, it seems to me that AI is mostly affecting the virtual world. I think the moment when AI can competently and more directly influence physical reality would be a tipping point, because then it can cause a lot more changes to the world.

  I would say that the ability to do continuous learning is required to adapt well to the complexity of physical reality. So a big improvement in continuous learning might be an important next goalpost to watch for.

• Marius Adrian NicoarăMay 12, 2025, 5:55 PM

  1 point

  0

  in reply to: Vladimir_Nesov’s comment on: Ab­solute Zero: Re­in­forced Self-play Rea­son­ing with Zero Data

  Yes, and there’s an interesting question in that post and and interesting answer in the comments there. Would be great to have everything in one place. @Matrice Jacobine and @alapmi, maybe you could try to come to some sort of an agreement?

An artis­tic illus­tra­tion of Scal­able Over­sight—“A world apart, nei­ther gods nor mor­tals”

• Marius Adrian NicoarăAug 26, 2024, 7:11 AM

  1 point

  0

  in reply to: Dagon’s comment on: Eth­i­cal De­cep­tion: Should AI Ever Lie?

  This seems like an introduction to the topic. enough to get the curiosity boiling.

Hyppotherapy

• Marius Adrian NicoarăAug 5, 2024, 7:29 PM

  1 point

  0

  on: AI Will Not Want to Self-Improve

  Looking at the convergent instrumental goals

  • self preservation

  • goal preservation

  • resource acquisition

  • self improvement

  I think some are more important than others.
  
  There is the argument that in order to predict the actions of a superintelligent agent you need to be as intelligent as it is. It would follow that an AI might not be able to predict if its goal will be preserved or not by self improvement.
  
  But I think it can have high confidence that self improvement will help with self preservation and resource acquisition. And those gains will be helpful with any new goal it might decide to have. So self improvement would not seem to be such a bad idea.

• Marius Adrian NicoarăJul 18, 2024, 3:17 PM

  1 point

  0

  in reply to: Martin Vlach’s comment on: Some de­sir­able prop­er­ties of au­to­mated wisdom

  >Are those your musings about agents questioning their assumptions and word-views?
  - Yes, these are my musings about agents questioning their assumptions and world-views.
  
  >And like, do you wish to improve your fallacies?
  - I want get better at avoiding fallacies. What I desire for myself I also desire for AI. As Marvin Minsky put it: “Will robots inherit the Earth? Yes, but they will be our children.”
  
  >higher threshold than ability, like inherent desire/​optimisation?
  What kind of stability? Any from https://​​en.wikipedia.org/​​wiki/​​Stable_algorithm? I’d focus more on sort of non-fatal influence. Should the property be more about the alg being careful/​​cautious?
  - I was thinking of stability in terms of avoiding infinite regress, as illustrated by Jonas noticing the endless sequence of metaphorical whale bellies.
  
  Philosopher Gabriel Liiceanu in his book “Despre limită” (English: Concerning limit—unfortunately, no English version seems to be available) argues that we fell lost when we loose our landmark-limit i.e. in the desert/​in the middle of the ocean on a cloudy night with no navigational tools. I would say that we can also get lost in our mental landscape and thus be unable to decide which goal to pursue.
  
  Consider the paperclip maximizing algorithm: once it has turned all available matter in the Universe into paperclips, what will it do? And if the algorithm can predict that it will reach this confusing state, does it decide to continue the paperclip optimization? As a Buddhist saying goes: “When you get what you desire, you become a different person. Consider becoming that version of yourself first and you might find that you no longer need the object of your desires.”.

• Marius Adrian NicoarăJul 13, 2024, 3:20 PM

  1 point

  0

  on: LessWrong/​ACX meetup Tran­sil­vanya tour—Sibiu

  Waited fo 20 minutes and no one showed up. Better luck next time, I guess.

Some de­sir­able prop­er­ties of au­to­mated wisdom

• Marius Adrian NicoarăJul 4, 2024, 2:03 PM

  1 point

  0

  on: LessWrong/​ACX meetup Tran­sil­vanya tour—Cluj Napoca

  Because no one has signed up, this event will not be held.

• Marius Adrian NicoarăJun 29, 2024, 2:45 PM

  1 point

  0

  on: LessWrong/​ACX meetup Tran­sil­vanya tour—Alba Iulia

  Nobody signed up, so the event will not take place.

LessWrong/​ACX meetup Tran­sil­vanya tour—Sibiu

LessWrong/​ACX meetup Tran­sil­vanya tour—Alba Iulia

LessWrong/​ACX meetup Tran­sil­vanya tour—Cluj Napoca

What and how much makes a differ­ence?

• Marius Adrian NicoarăMay 28, 2024, 6:42 PM

  1 point

  0

  on: The Best Tacit Knowl­edge Videos on Every Subject

  For the category Research/​Studying, I recommend the series “Understanding Medical Research: Your Facebook Friend is Wrong” by F. Perry Wilson. Bite-sized videos explaining how to approach medical research people.
  
  Last updated July 30 2020, so hopefully it reached many people during those confusing times and helped them strenghten their intellectual self defense. I wish I found out about it sooner, so that I could have recommended it earlier.

• Marius Adrian NicoarăMay 20, 2024, 6:10 AM

  1 point

  0

  in reply to: Marius Pop’s comment on: Cluj-Napoca, Ro­ma­nia – ACX Mee­tups Every­where 2022

  Hi,

  How did the event go?

  Any plans to organize a meetup this year?

  I’m planning to host a meetup in Sibiu this summer, because I haven’t seen an event scheduled here. Any advice? I’m also planning to host a meetup in Cluj-Napoca this year, if it’s not announced by someone else

  Kind regards, Marius Nicoară

• Marius Adrian NicoarăMay 19, 2024, 8:27 AM

  3 points

  0

  on: Open Thread Spring 2024

  Hello, I’m Marius, an embedded SW developer looking to pivot into AI and machine learning.
  

  I’ve read the Sequences and am reading ACX somewhat regularly.
  
  Looking forward to a fruitful discussions.
  
  Best wishes,
  Marius Nicoară