Alex_Altair

• Alex_Altair 30 Oct 2024 17:45 UTC

  7 points

  0

  in reply to: habryka’s comment on: Habryka’s Short­form Feed

  Positive feedback, I am happy to see the comment karma arrows pointing up and down instead of left and right. I have some degree of left-right confusion and was always click and unclicking my comments votes to figure out which was up and down.

  Also appreciate that the read time got put back into main posts.

  (Comment font stuff looks totally fine to me, both before and after this change.)

• Alex_Altair 28 Oct 2024 2:02 UTC

  2 points

  0

  in reply to: Dalcy’s comment on: Darcy’s Shortform

  [Some thoughts that are similar but different to my previous comment;]

  I suspect you can often just prove the behavioral selection theorem and structural selection theorem in separate, almost independent steps.

  1. Prove a behavioral theorem

  2. add in a structural assumption

  3. prove that behavioral result plus structural assumption implies structural result.

  Behavior essentially serves as an “interface”, and a given behavior can be implemented by any number of different structures. So it would make sense that you need to prove something about structure separately (and that you can prove it for multiple different types of structural assumption).

  Further claims: for any given structural class,

  • there will be a natural simplicity measure

  • simpler instances will be exponentially rare.

  A structural class is something like programs, or Markov chains, or structural causal models. The point of specifying structure is to in some way model how the system might actually be shaped in real life. So it seems to me that any of these will be specified with a finite string over a finite alphabet. This comes with the natural simplicity measure of the length of the specification string, and there are exponentially fewer short strings than long ones.^[1]

  So let’s say you want to prove that your thing X which has behavior B has specific structure S. Since structure S has a fixed description length, you almost automatically know that it’s exponentially less likely for X to be one of the infinitely many structures with description length longer than S. (Something similar holds for being within delta of S) The remaining issue is whether there are any other secret structures that are shorter than S (or of similar length) that X could be instead.

  1. ^

     Technically, you could have a subset of strings that didn’t grow exponentially. For example, you could, for some reason, decide to specify your Markov chains using only strings of zeros. That would grow linearly rather than exponentially. But this is clearly a less natural specification method.

• Alex_Altair 19 Oct 2024 0:45 UTC

  2 points

  0

  in reply to: Dalcy’s comment on: Darcy’s Shortform

  For some reason the “only if” always throws me off. It reminds me of the unless keyword in ruby, which is equivalent to if not, but somehow always made my brain segfault.

• Alex_Altair 19 Oct 2024 0:44 UTC

  4 points

  0

  in reply to: Alex_Altair’s comment on: Darcy’s Shortform

  It’s maybe also worth saying that any other description method is a subset of programs (or is incomputable and therefore not what real-world AI systems are). So if the theoretical issues in AIT bother you, you can probably make a similar argument using a programming language with no while loop, or I dunno, finite MDPs whose probability distributions are Gaussian with finite parameter descriptions.

• Alex_Altair 19 Oct 2024 0:39 UTC

  6 points

  0

  in reply to: Dalcy’s comment on: Darcy’s Shortform

  Yeah, I think structural selection theorems matter a lot, for reasons I discussed here.
  
  This is also one reason why I continue to be excited about Algorithmic Information Theory. Computable functions are behavioral, but programs (= algorithms) are structural! The fact that programs can be expressed in the homogeneous language of finite binary strings gives a clear way to select for structure; just limit the length of your program. We even know exactly how this mathematical parameter translates into real-world systems, because we can know exactly how many bits our ML models take up on the hard drives.
  
  And I think you can use algorithmic information distance to well-define just how close to agent-structured your policy is. First, define the specific program A that you mean to be maximally agent-structured (which I define as a utility-maximizing program). If your policy (as a program) can be described as “Program A, but different in ways X” then we have an upper bound for how close it is to agent-structured it is. X will be a program that tells you how to transform A into your policy, and that gives us a “distance” of at most the length of X in bits.
  
  For a given length, almost no programs act anything like A. So if your policy is only slightly bigger than A, and it acts like A, then it’s probably of the form “A, but slightly different”, which means it’s agent-structured. (Unfortunately this argument needs like 200 pages of clarification.)

• Alex_Altair 6 Oct 2024 0:01 UTC

  12 points

  4

  on: Seek­ing AI Align­ment Tu­tor/​Ad­vi­sor: $100–150/​hr

  FWIW I think this would be a lot less like “tutoring” and a lot more like “paying people to tell you their opinions”. Which is a fine thing to want to do, but I just want to make sure you don’t think there’s any kind of objective curriculum that comprises AI alignment.

• Alex_Altair 27 Sep 2024 22:46 UTC

  2 points

  0

  in reply to: Cole Wyeth’s comment on: Work with me on agent foun­da­tions: in­de­pen­dent fellowship

  Nice! Yeah I’d be happy to chat about that, and also happy to get referrals of any other researchers who might be interested in receiving this funding to work on it.

• Alex_Altair 24 Sep 2024 4:44 UTC

  11 points

  0

  on: Search 5000 books, speed up your re­search and per­sonal growth

  Note to readers; it is an obligatory warning on any post like this that you should not run random scripts downloaded from the internet without reading them to see what they do, because there are many harmful things they could be doing.

• Alex_Altair 21 Sep 2024 17:18 UTC

  3 points

  0

  in reply to: Nathan Helm-Burger’s comment on: Work with me on agent foun­da­tions: in­de­pen­dent fellowship

  <3!

Work with me on agent foun­da­tions: in­de­pen­dent fellowship

• Alex_Altair 28 Aug 2024 6:09 UTC

  5 points

  2

  on: Per­plex­ity wins my AI race

  FWIW I have used Perplexity twice since you mentioned it, it was somewhat helpful both times, but also, both times the citations had errors. By that I mean it would say something and then put a citation number next to it, but what it said was not in the cited document.

• Alex_Altair 28 Aug 2024 6:03 UTC

  4 points

  0

  on: My Apart­ment Art Com­mis­sion Process

  Aren’t they sick as hell???

  Can confirm, these are sick as hell

• Alex_Altair 22 Aug 2024 21:31 UTC

  5 points

  0

  in reply to: Hudjefa’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  I know that there’s something called the Lyapunov exponent. Could we “diminish the chaos” if we use logarithms, like with the Richter scale for earthquakes?

  This is a neat question. I think the answer is no, and here’s my attempt to describe why.

  The Lyapunov exponent measures the difference between the trajectories over time. If your system is the double pendulum, you need to be able to take two random states of the double pendulum and say how different they are. So it’s not like you’re measuring the speed, or the length, or something like that. And if you have this distance metric on the whole space of double-pendulum states, then you can’t “take the log” of all the distances at the same time (I think because that would break the triangle inequality).

• Alex_Altair 22 Aug 2024 21:16 UTC

  3 points

  0

  in reply to: Hudjefa’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  It possesses this subjective element (what we consider to be negligible differences) that seems to undermine its standing as a legitimate mathematical discipline.

  I think I see what you’re getting at here, but no, “chaotic” is a mathematical property that systems (of equations) either have or don’t have. The idea behind sensitive dependence on initial conditions is that any difference, no matter how small, will eventually lead to diverging trajectories. Since it will happen for arbitrarily small differences, it will definitely happen for whatever difference exists within our ability to make measurements. But the more precisely you measure, the longer it will take for the trajectories to diverge (which is what faul_sname is referring to).

• Alex_Altair 22 Aug 2024 21:01 UTC

  2 points

  0

  in reply to: Alexander Gietelink Oldenziel’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  The paper Gleick was referring to is this one, but it would be a lot of work to discern whether it was causal in getting telephone companies to do anything different. It sounds to me like the paper is saying that the particular telephone error data they were looking at could not be well-modeled as IID, nor could it be well-modeled as a standard Markov chain; instead, it was best modeled as a statistical fractal, which corresponds to a heavy-tailed distribution somehow.

• Alex_Altair 22 Aug 2024 20:26 UTC

  2 points

  0

  in reply to: philip_b’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  Definitely on the order of “tens of hours”, but it’d be hard to say more specifically. Also, almost all of that time (at least for me) went into learning stuff that didn’t go into this post. Partly that’s because the project is broader than this post, and partly because I have my own research priority of understanding systems theory pretty well.

• Alex_Altair 22 Aug 2024 20:23 UTC

  2 points

  2

  in reply to: Jay’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  For what it’s worth, I think you’re getting downvoted in part because what you write seems to indicate that you didn’t read the post.

• Alex_Altair 20 Aug 2024 20:04 UTC

  2 points

  0

  in reply to: Hastings’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  Huh, interesting! So the way I’m thinking about this is, your loss landscape determines the attractor/​repellor structure of your phase space (= network parameter space). For a (reasonable) optimization algorithm to have chaotic behavior on that landscape, it seems like the landscape would either have to have 1) a positive-measure flat region, on which the dynamics were ergodic, or 2) a strange attractor, which seems more plausible.

  I’m not sure how that relates to the above link; it mentions the parameters “diverging”, but it’s not clear to me how neural network weights can diverge; aren’t they bounded?

• Alex_Altair 20 Aug 2024 19:46 UTC

  2 points

  0

  in reply to: Hastings’s comment on: Quick look: ap­pli­ca­tions of chaos theory

  I’m curious about this part;

  even though the motion of the trebuchet with sling isn’t chaotic during the throw, it can be made chaotic by just varying the initial conditions, which rules out a simple closed form solution for non-chaotic initial conditions

  Do you know what theorems/​whatever this is from? It seems to me that if you know that “throws” constitute a subset of phase space that isn’t chaotic, then you should be able to have a closed-form solution for those trajectories.

• Alex_Altair 19 Aug 2024 14:00 UTC

  2 points

  0

  in reply to: habryka’s comment on: Alex_Al­tair’s Shortform

  It turns out I have the ESR version of firefox on this particular computer: Firefox 115.14.0esr (64-bit). Also tried it in incognito, and with all browser extensions turned off, and checked multiple posts that used sections.