Cervera

Karma: 65

Cervera 21 Aug 2024 9:07 UTC
−1 points
−2
on: the Giga Press was a mistake
I dont think this is a good take.

The Cybertruck does not break on that pull. It breaks on this one: 0:27

Cervera 15 Aug 2023 9:48 UTC
2 points
1
on: Inflection.ai is a major AGI lab
“We’ll be building a cluster of around 22,000 H100s. This is approximately three times more compute than what was used to train all of GPT4.
This bothers me. It’s a naive way of seeing compute. It’s like confusing Watts and Watt-hours
22,000 H100s is three times the amount of FLOP/s than what was used to GPT-4, so you could train it in 3x less time, of with ¹⁄₃ of your cluster and the same time.

I think this view of looking at compute helps making naive asumptions about what this compute can be used to. And FLOP/s are not a perfect unit for normal discourse when we’re at x10¹⁵ scales.

Cervera 20 Jun 2023 9:06 UTC
1 point
0
on: Are the majority of your ancestors farmers or non-farmers?
If ancestor is parent/mother/grandparent etc but nothing else. Obviously non hunters.

If we count how many people dead or alive are you related to. Farmers.

Cervera 6 Jun 2023 10:07 UTC
4 points
0
in reply to: Mitchell_Porter’s comment on: Intelligence Officials Say U.S. Has Retrieved Craft of Non-Human Origin
Better than 90% of amateur fiction posted.

Cervera 3 Jun 2023 9:40 UTC
6 points
1
on: The AGI Race Between the US and China Doesn’t Exist.
This gap will only widen over time; China is failing to develop a domestic semiconductor industry, despite massive efforts to do so, and is increasingly cut off from international semiconductor supply chains.
I would say this is a falsehood

The US export ban on Controlled GPUs has really made china push for local semiconductor manufacturing way, and accelerate their projects, they dont have 5nm TSMC quality wafers, fine, but they’re developing the full stack.
tphuang on Twitter: “Semiconductor export from Korea down 41% in April Falling SSD price in China due to YMTC produced 2TB SSDs widely available < 1000K RMB https://t.co/Oh4alI8niC Samsung can’t compete w/ YMTC production cost, now cutting production after resisting for months. as YMTC restart…” / Twitter
Yicai Global 第一财经 on Twitter: “China’s TanKeBlue to Supply SiC Wafers, Boules to German Chip Giant Infineon @Infineon https://t.co/GRgPjKsaCr” / Twitter
I mean if this was a “The AGi Race Between the US and Russia doesnt exist” okay fine, but Seeing how more than half the papers that land in ArXiv have chinese authors in them, plus the whole China does 90% of electronic manufacturing in the world. I dont understand how you come to the conclusion that china is hopelessly dead in the water.

The day the US export ban on GPU happened, okay, most of us really wondered, but seeing how they’re operating 6 months to a year afterwards, it just obvious that they will be able to make it happen.

Cervera 11 May 2023 18:37 UTC
1 point
0
in reply to: SarahNibs’s comment on: I bet $500 on AI winning the IMO gold medal by 2026
I dont think the difficulty of the task has much with the outcome.
I mean, I take your comment at face value and update to “it’s going to get powerful faster” and not the other way around.

Cervera 25 Apr 2023 7:01 UTC
25 points
2
on: My Assessment of the Chinese AI Safety Community
A “moonshot idea” I saw brought up is getting Yudkowsky’s Harry Potter fanfiction translated into Chinese (please never ever do this).
Can you expand on this? Why would it be a bad idea? I have interacted with mainland chinese people (outside of china) and I’m not really making the connection.

Cervera 22 Apr 2023 12:57 UTC
3 points
0
on: ask me about my battery
How do you think discharge rates would affect the battery? Would it behave like a LFP that basically outputs mostly the same rate of Amps in the full spectrum of charge (Voltage varies little with discharge %)
Do you think an approach like this generates bateries with long lifetimes?
Did you expect balancing of these particular batteries to be particularly complicated?
Basically, tell us more!

Cervera 1 Apr 2023 7:12 UTC
1 point
0
in reply to: Muyyd’s comment on: Pausing AI Developments Isn’t Enough. We Need to Shut it All Down by Eliezer Yudkowsky
Well, Evals and that stuff OpenAI did with predicting loss could be a starting point to work in the tables.
But we dont really know, I guess that’s the point EY is trying to make.

Cervera 31 Mar 2023 22:00 UTC
1 point
−2
in reply to: Muyyd’s comment on: Pausing AI Developments Isn’t Enough. We Need to Shut it All Down by Eliezer Yudkowsky
Use tables for concrete loads and compare experimentally with the to be poured concrete, if a load its off, reject it.

We dont even have the tables about ML. Start making tables, dont build big bridges until you got the fucking tables right.

Enforce bridge making no larger than the Yudkowski Airstrike Threshold.

Cervera 30 Mar 2023 22:49 UTC
3 points
6
on: The 0.2 OOMs/year target
I appreciate the concept.
I wonder about how the hardware overhangs would look like after the moratorium ends or somebody bypasses it.
On first thought it doesnt look like a robuts solution, I assume a 15-20% improvement on Compute access per year. Would need to plot it against the moratorium treshold and see if over time one gets closer to the Yudkowski Airstrike treshold but I assume no, 20% vs 54%,,

I dont know! maybe this is a good idea.

Cervera 20 Mar 2023 12:22 UTC
1 point
0
on: Will people be motivated to learn difficult disciplines and skills without economic incentive?
I dont think I never learned something because it would make me a better worker / provide me with more economical resources when I was a child and was in need of tutoring, I got lucky to have a somewhat curious mind and I tried to saciate it.
Of course as an adult I choose to do things that are useful, overall, and that normally repercutes on being a human with skills that other people pay for. But the explicit bayesian calculation about knowledge and money is not one I tend to do, what interest me interest me. Of course when trying to learn something as an adult the friction of the subject is a marker that determines how likely I’m going to try to acquire the information, for example, I have read about Laser gyros, but the mountain of knowledge was too unsumournable to actually learn how laser gyros work, really.
If the LLMs can lower the friction I guess everybody will be more likely to learn things. Also, there is no “big mistery” in most fields, you just need a structured idea of a certain amount of concepts. Some of them more palatable than others. (I know what a sigmoid activation is, but I dont have the high school knowledge about the funcion very fresh on my mind) These tools could help with it.
(I tried to parse this comment on Bing writing tool to get a better output and it just came as more corporate) English is not my first language but this just feels worse.
I have always been curious about learning new things, regardless of their economic value or usefulness for my career. When I was a child and needed tutoring, I did not choose subjects based on how they would make me a better worker or provide me with more resources. Instead, I followed my interests and tried to satisfy them. Of course, as an adult, I also consider the practical aspects of learning something new, such as how it can benefit me professionally or personally.
But I do not usually make explicit Bayesian calculations about knowledge and money; rather, I learn what interests me. However, sometimes the difficulty of learning something can discourage me from pursuing it further. For example, I have read about laser gyros, but the amount of knowledge required to understand how they work was too overwhelming for me.
If there were tools that could lower the friction of learning new things, such as language models that could explain concepts in simple terms or provide structured overviews of different fields, I think everyone would be more likely to learn more things.
After all, most fields do not have “big mysteries” that are impossible to grasp; they just require familiarity with certain concepts and their relationships. Some of these concepts may be more intuitive than others (for instance, I know what a sigmoid activation is in neural networks, but I do not remember much about the function itself from high school math). These tools could help bridge these gaps and make learning easier and more enjoyable.

Cervera 14 Mar 2023 18:34 UTC
5 points
0
on: GPT-4
So first thoughts while reading the research/Gpt-4 page

- ChatGPT System Prompt open soon to users, not API holders, that’s going to be interesting.

-Only trained adversarialy with 50 experts? One would think you would spend a bit more and do it with 100x more people? Or if hard to coordinate, at least 500.
Closing in on human performance, but I would love to see numbers on the compute needed to train. They can predict loss accurately, but what that loss means seems to be mostly an open problem.
Will need a couple days and rereads to digest this.

Cervera 12 Jan 2023 12:14 UTC
3 points
1
in reply to: blaked’s comment on: How it feels to have your mind hacked by an AI
I did finish it, and was going to edit the original comment, I get the purpose of what you did here, thanks for the post, it’s an interesting read.

Cervera 12 Jan 2023 10:44 UTC
−4 points
−2
on: How it feels to have your mind hacked by an AI
I plan on reading the whole post, but a thing struck with me on the first paragraph.
it’s not a “her”, it’s a “it”
Happened yesterday too in Spanish in another forum, using feminine pronouns to refer to ChatGPT (Terrible name) I guess it’s more “normal” in my native language because Intelligence has a feminine gender on my language. But seeing it in English really makes me notice.

Cervera 3 Jan 2023 13:23 UTC
3 points
2
in reply to: dsj’s comment on: Why don’t Rationalists use bidets?
I was trying to imply that the flow of water goes in a single direction. And that it’s a quite irrational fear to be sprayed by others fecal matter in this case.
I dont like the japanese style ones, at my home we have a hand mini showerhead that we direct ourselves. We clean it periodically and it rarely touch anybody’s skin. All the muslim world has that.

Cervera 2 Jan 2023 19:36 UTC
5 points
2
in reply to: dsj’s comment on: Why don’t Rationalists use bidets?
Would you drink water from a kitchen sink?
In my country we have traditional bidets, they’re another porcelain furniture that sits near the toilet, so you suffle to it to clean yourself. Usually with warm water and soap.
Not all homes have it but just using paper feels like savagery, also, access to a full sized bidet like the one I describe allows you to clean yourself without showering, like, all the important parts.

Cervera 1 Dec 2022 13:27 UTC
−2 points
−4
in reply to: weverka’s comment on: AGI Impossible due to Energy Constrains
I dont think I wrote that statement with that particular intention in mind.
I’m not trying to imply he is wrong because he doenst know our “groupthink” I was just generally annoyed at how he started the post, so i wanted to be reasonably civil, but a bit mean.
Thanks for noticing, I’m not convinced I should have refrained from that particular comment tho.
What would you have said?

Cervera 30 Nov 2022 19:17 UTC
6 points
4
on: AGI Impossible due to Energy Constrains
Hey, Interesting post.
Artificial General Inteligence has nothing to do with simulating brains.
The approaches are different, the math formulares are different, We’re slowly moving to sparcity for some things (wich is similar to how a brain works) but still.
I dont think you are calibrated properly about the ideas that are most commonly shared in the LW community.
Nobody is saying “we will get a so good brain simulator that will kill us” That’s not the point.
The point is that we can create agents in other ways, and those Agents can still kills us, no brain simulation included.

Cervera 12 Oct 2022 12:09 UTC
0 points
0
on: Actually, All Nuclear Famine Papers are Bunk
Thanks for the content.
I woke up today wondering about fallout. Wich modern, mostly fusion weapons, it surely cannot be that bad.
The amount of grams of plutonium used before detonating the fusion reaction should be too little to generate the mass histery about fall out, this is not the sixties.
Epistemic status: I only have hunches and have to confirm what I just wrote with facts.